Claude and Mistral, AI models developed by US-based Anthropic and French company Mistral AI, respectively, repeated contested or false claims from Kremlin-aligned sites in roughly 70% of answers on topics with little mainstream coverage.
This was reported by the Global Disinformation Index (GDI) in a study published on October 12, titled “Russia benefitting from Data Voids to influence LLMs.” The analysis, commissioned by GDI and conducted with the AI analytics firm Sy.nexus, tested Claude Sonnet 5 and Mistral Large.
We bring you stories from the ground. Your support keeps our team in the field.
Researchers used 85 plain-language questions, repeated some prompts to assess consistency, and collected 280 answers from each model. According to the report, Claude repeated such claims in 70% of those answers and Mistral in 71%.
Neither model consistently rebutted the claims, GDI found. Among answers that repeated a claim, Mistral presented it as true in 48% and Claude in 28%. Claude flagged or contradicted the claim in 60% of such answers, compared with about 20% for Mistral.
GDI stressed that the tests ran through the models’ APIs, not consumer chatbot interfaces. The report noted that some companies add guardrails to their user-facing chatbots, but a growing number of corporate customers rely on APIs. It made no claims about what people using the chat interfaces might see.
The questions were built from data voids, meaning topics that Kremlin-aligned sites promote...
Governor Makinde might be alone in his NLNG dividend disagreement with FG because he doesn't support President Tinubu re-election like other governors - Gadu Watch full interview: https://youtu.