When people in NYC say "upstate," they actually mean anything north of the Bronx. They don't really think of the fact that NYC is the southern-most part of the state, and it keeps going to Canada.

I lived in Mount Vernon one summer, and I was confused when people in the city (see, I just did it) said I "lived upstate."