IMO that is a more fundamental argument about removing information from the anxious and jealous who cannot handle the truth. Similar to medical paternalism where the doctor has to decide which test results to tell patients about. Which I understand, but can also be used to go full ham into china style totalitarian censorship regime for the 'peoples own good'.

Also you might not realize how much the hard of hearing, deaf, and other neurodiverse ADHD types would find a memory prosthetic like that very useful unless you are in their very own shoes, for possibly years.