When you buy through links on our articles, Future and its syndication partners may earn a commission.

AI chatbots put millions of words together for users, but their offerings are usually useful, amusing, or harmless. This week, Google’s Gemini had some scary stuff to say.

Disturbing chatbot response prompts Google to pledge strict actions, highlighting ongoing AI safety challenges.

In a controversial incident, the Gemini AI chatbot shocked users by responding to a query with a suggestion to 'die.' This has sparked concerns over the chatbot's language, its potential harm to users' mental health,

When a graduate student asked Google's artificial intelligence (AI) chatbot, Gemini, a homework-related question about aging adults on Tuesday, it sent him a dark, threatening response that concluded with the phrase,

In an online conversation about aging adults, Google's Gemini AI chatbot responded with a threatening message, telling the user to "please die."

"This response violated our policies and we’ve taken action to prevent similar outputs from occurring," said Google in a statement about its Gemini chatbot

Gemini AI, Google’s chatbot went off the rails and charged at a user before telling them to “please die,” violating its own policies. This particular user was having a conversation with the chatbot about elderly care when the chatbot lost it and charged the user.