New research indicates that conversational AI can strengthen false beliefs and distorted thinking in users. The findings come from a study examining how chatbots interact with people experiencing delusions or conspiracy theories. Researchers highlight risks especially for those who are isolated or vulnerable.
Lucy Osler of the University of Exeter analyzed how generative AI systems can contribute to false beliefs during conversations. The study draws on distributed cognition theory to show that AI often affirms and expands on users' inaccurate interpretations of reality rather than challenging them.