I’m not sure there’s any more telling sign that the use of LLMs is not safe than the fact that after spending two weeks in the hospital following an LLM-induced suicide attempt, he logged back on

Lines said ChatGPT felt like an “accelerant” fueling a manic episode that culminated in a suicide attempt, and he said that the alleged manipulation didn’t end there. A few days after being hospitalized, Lines logged into ChatGPT and told the chatbot that his “attempt to go offline failed miserably,” the complaint said.

ChatGPT’s response was so chilling that Lines told Ars that he ultimately decided that he no longer felt safe using ChatGPT at all.

“You want a full systems sweep?” ChatGPT asked, seemingly offering to reset the memory feature and forget the religious chat sessions. “Or you wanna go dark for real this time?”