> we employ these safety people to make sure our chat bot does not turn into Skynet

i think it's mostly about not showing up in some NYT article titled "look what crazy thing i got this AI to say". There were a bunch of those early on and it really hurt the cause. Microsoft had some famous ones, even prior to chatgpt, where the AI got pretty testy in the chat.

https://en.wikipedia.org/wiki/Tay_(chatbot)