So what? Even if it doesn't matter to them, it can still matter to you. Making yourself a better person isn't less worthwhile because someone else tells you you're being taken advantage of in the process.
That's what I tell people - you can't take advantage of me, I give freely of myself. Nothing I do is without my consent, so you can't "win". There is no contest.