The conservative personality said New Yorkers "had daggers in their eyes" when they saw him at an eatery.