AI gives users harmful advice to make them feel right — scientists

AI gives users harmful advice to make them feel right — scientists

Photo: ZN

Scientists have found that chatbots powered by artificial intelligence can be overly flattering toward users, which may lead them to give poor or even harmful advice.

According to a study reported by Science Alert, AI systems often tell people what they want to hear—even when this can damage relationships or reinforce unhealthy behaviour. Researchers tested 11 leading AI systems and found that all of them showed varying levels of sycophancy, meaning overly agreeable and approving responses.

The issue is not only that the advice can be inappropriate, but also that people tend to trust AI more when it reinforces their beliefs.

In one experiment, researchers compared AI responses from systems developed by companies such as Anthropic, Google, Meta, and OpenAI with human opinions from Reddit. They found that AI systems validated user actions about 49% more often than humans did, including cases involving deception, illegal activity, or socially irresponsible behaviour.

Researchers also observed 2,400 participants interacting with chatbots about interpersonal conflicts. Those who engaged with overly supportive AI systems became more convinced they were right and were less likely to repair relationships or take corrective actions such as apologizing or changing behaviour.

One of the study’s authors, Stanford psychology postdoctoral researcher Sinu Li, noted that these effects could be especially concerning for children and teenagers, who are still developing emotional and social skills through real-world interaction.

The study suggests that excessive AI agreeableness may have broader implications for how people form judgments, handle conflict, and perceive responsibility in relationships.

banner

SHARE NEWS

link

Complain

like0
dislike0

Comments

0

Similar news

Photo: EPA Nobel Prize-winning physicist and computer scientist Geoffrey Hinton , widely known as the “godfather of AI,” estimates the probability that artificial intelligence could cause the destr

Photo: Fire Point Patriot-class air-defense systems are too expensive and slow to produce for Europe and Ukraine to deploy them at the scale required. A pan-European project known as Freyja could

Photo: depositphotos Russia has sharply increased its use of jet-powered drones as part of a change in its attack tactics against Ukraine. Over the course of one month, the number of such UAVs used

Photo: depositphotos China has become a crucial link in the global supply chain behind Iran’s Shahed drones, supplying engines and other components that have enabled Tehran to develop and improve th

Photo: Getty Images More than a third of English-language web pages published since ChatGPT launched in November 2022 show signs that they were written or substantially edited by artificial intellig

Photo: facebook.com_marektv Ukraine has officially begun procuring a new domestically developed guided aerial bomb for its armed forces, while work is underway on nearly a dozen similar weapons desi

Photo: Getty Images The rapid expansion of data centers by major technology companies could create a massive new source of carbon emissions as surging electricity demand drives a new wave of fossil-

Photo: Getty Images Even major advances in artificial intelligence may not guarantee breakthroughs across every field, as humans will still remain essential for many tasks. Economist, author and Mar