I'm going to snip the quote tree, but it's much the same when you live in parts of New York state that aren't, well, New York City.
In fact, I just visited NYC for the first time a few months ago after a lifetime spent in New York state!
A few of mine who grew up in the same hometown (very rural part of the state) went to college out of state and constantly had to deal with people who assumed she was from NYC. When they learned her hometown had more cows than people and one stoplight in the entire municipality, they were dumbfounded.
One person actually tried to argue with her that she couldn't have grown up in New York, it must have been Pennsylvania or Ohio or something. 
Trying to explain that I live in a city in New York state that isn't New York City can get brain-hurty as well.
DF and I are from the SAME state, and he still doesn't understand that growing up in the San Fernando Valley in LA County is not the same as being from Inglewood (also in LA County).
We were watching the Notre Dame/USC game last night, and the announcer mentioned the game was being played at USC, which I noted.
DF - "Where is that, Inglewood?"
Me - "Yes."
DF - "Oh, that's where you're from."
Me -

"Uh, no-o-o, Inglewood is NOTHING like the San Fernando Valley and is not close by." (LA is horrendous for traffic so if you check out the distance, it might seem close by but, really, it could be a two-hour drive to get there from the Valley; in terms of communities, TOTALLY different).
I was very insulted and afraid he'd go around conveying to people that I come from Inglewood since he sometimes has the tendency to process information incorrectly and then tell that info to others.