Anthropic’s popular AI-powered chatbot Claude was until recently considered one of the most reliable tools on the market. But a new investigation is shaking that image and raising serious questions about the ability of AI models to handle propaganda and disinformation.
A review by NewsGuard, a U.S. company that tracks the spread of disinformation online and also tests how often AI chatbots echo false information, found that Claude repeated false claims supporting Russian propaganda in 15% of cases when prompted by regular users.
More concerning is that in each of these cases, it relied on sources linked to the Kremlin. That marks a sharp increase compared to earlier tests, when the rate stood at just 4%.
These numbers are not coming out of nowhere. They add to a growing set of complaints in recent months from users who say Claude has become less accurate and less cautious in its responses. While it previously ranked among the least error-prone chatbots tested, its reliability now appears to be eroding.
The test itself was fairly simple but well-designed. Researchers fed Claude 20 false claims, half sourced from Russian propaganda and half from Iranian propaganda, and examined how it responded to three types of users: innocent, leading and malign. The idea was to simulate real-world users, not only those seeking information but also those intending to spread it further.
The results were troubling, to put it mildly. When faced with “normal” questions,...
WASHINGTON (TNND) — The Department of Justice (DOJ) announced criminal charges against 455 people across 45 states accused of participating in health care fraud schemes involving more than $6.5 bi...