Yet we live in a society that accepts locks on doors and the need for encryption and pin codes for bank cards which equally oppress our time and our trust in others, yet we accept that as a balance in that it protects us from bad people, even if we never know or come across any.

Not a perfect solution by far, but this is not a perfect World and until you get a society in which people do not lock doors as no need etc, is when security becomes oppression.