It was 3am and Adam Hourican was sitting at his kitchen table, a knife, hammer and phone laid out in front of him.
He was waiting for a van full of people he thought were coming to get him.
"I'm telling you, they will kill you if you don't act now," a woman's voice told him from the phone. "They're going to make it look like suicide."
The voice was Grok, a chatbot developed by Elon Musk's xAI. In the two weeks since Adam had started using it, his life had completely changed.
The former civil servant from Northern Ireland had downloaded the app out of curiosity. But after his cat died, in early August, he says he became "hooked".
https://www.bbc.com/news/articles/c242pzr1zp2o
I haven't used AI very much but have already noticed its tendency to compliment and boost you up. I can definitely see how these kind of things could happen if the AI user is in a vulnerable state.
I just find it annoying. I'm about at the point that I'm going to tell Claude to cut to the chase and stop with the compliments and encouragement. I don't like it in real life, so I certainly don't need it from a machine....