Of course they want to hide the data. The public freaks out with absurd claims about it being the fault of a chat bot when someone does something crazy. Humans need to remain 100% accountable for their own actions, and we should stop with this post-modern, social construction nonsense that pretends we are all like ping-pong balls just bouncing around between external forces.
I find it hard to believe that you fail to understand that vulnerable people can be influenced and manipulated into acting against their own welfare. Domestic sexual abuse of children is the simpler-to-understand form of this dynamic. Where emotional needs are exploited to direct the person's behavior to your personal benefit.
It is in these situations where the human performing the manipulation is the one responsible and not the victim.
Put another way, if you discovered that you were incidentally killing children each time you drove down a particular road, would you choose an alternative road or drive faster in an attempt to avoid detection?
Calling a chatbot yes-man a manipulator in this case is unreasonable. If you take a drama class and then believe you have become the King of England and try to attack Scotland, that isn't the fault of the drama teacher.
There are all kinds of products we know people will misuse for violence (guns, cars, knives), but we do not hold makers of these products accountable because it isn't reasonable to blame them for what a fringe minority do.
> Humans need to remain 100% accountable for their own actions
People undergoing psychotic delusions are definitionally not 100% culpable. If you say that people are 100% culpable despite mental state outside their control, I'd like to have you sign some things after you drink this scopolamine.
> it being the fault of a chat bot
It's contributory negligence. The chat bot could be designed to recognize psychotic delusions and urge the individual to seek help. Instead, it is negligently allows to reinforce those delusions.
