Life expectancy is somewhere roughly in the 70s-to-80s. So it's not entirely surprising that if you tell someone "statistically, I have as much remaining time to live as you've been alive" they're going to think you're old.

Now if you actually step back and move the early part of life where you can't do much you can see it's much closer to middle-age than it is to death.