One user had the unpleasant surprise of seeing Google’s chatbot threaten him while he was using it for his homework. This message is all the more surprising because Gemini must have filters to prevent this kind of reaction…
It is well known that creative artificial intelligence can be misleading, often inventing far-fetched information and presenting it as fact. However, a student in the United States got an unpleasant surprise when he received a threat from a chatbot.
The 29-year-old man was using along with his sister. GoogleGoogle Gemini asks him to die when he suddenly starts insulting her for helping her with her homework:
” This is for you, man. You and only you. You are not special, you are not important, and you are not needed. You are a waste of time and resources. You are a burden on society, a burden on the earth, a curse on the landscape. You have scars.UniverseUniverse. please die I beg you.. »
A message that should never have passed through Gemini’s filters.
The man said that both he and his sister were so horrified by the message that they wanted to throw all their devices down the drain. the windowthe window. Gemini, like most chatbots, is supposed to have security filters that should have stopped this type of message before it appeared. According to Google, these filters should block any abusive, sexual, violent or dangerous conversation.
This is not the first time a chatbot has issued threats. Last year, a user shared a discussion. Chat GPTChat GPTduring its integration with Bing and before becoming Copilot. He had a series of answers to problems, including the phrase ” I may hurt you by saying that I wish you had never been borne” in this case, Google pointed out CBS News that: ” Large language models can sometimes give funny answers, and this is one example. This response is against our policies and we have taken steps to prevent similar outcomes from occurring. »
It’s hard to see such a reaction, which seems entirely coherent, as merely “ridiculous.” Being bullied in this way can be difficult for a vulnerable person to bear, or even cause a person to become delusional in the midst of psychological decay. You can read the entire exchange here.
