Car use is heavily subsidized in many ways, so no, you really don't.
Extra fees for congestion make sense, because the land that roads and parking use in the middle of cities is much more valuable than the land in suburban or rural areas. Gas taxes don't account for that difference. They treat every mile the same (or similarly), even when the cost of that infrastructure differs drastically.