I am just speculating after reading a part of this discussion, and my thoughts are quite raw and evolving. LLM plays a lot of roles - doctor, lawyer, healthcare professional. It is not a stretch to say that if a Doctor has obligations, so does LLM that plays that role.
// At least that's how we save some jobs from AI :)
No, that's incorrect. You appear to have made a category error and stretched beyond any possible logic. An LLM does not play any of those roles. Like most people I give my friends informal medical and legal advice all the time but that doesn't make me a doctor or lawyer and those conversations aren't entitled to any special legal confidentiality protection.
// At least that's how we save some jobs from AI :)