This sounds disturbingly like the complaint that "crime should not happen in places where people like ME like to go". I doubt you intended that to be a racist or classist comment, but safety shouldn't be a luxury given only to people who can afford the nice parts of town.