Think you can trust ChatGPT and Gemini to give you news? Here’s why you might want to think again


  • Nearly half of all AI assistant responses to current events contain major errors, according to a major international study.
  • Factual, sourcing, or contextual issues were apparent in 14 languages ​​and 18 countries.
  • Gemini fares worst, with a significant problem rate twice as high as its competitors.

When you ask an AI assistant about news and current affairs, you can expect a detached and authoritative response. But according to a large international study conducted by the BBC and coordinated by the European Broadcasting Union (EBU), almost half the time these answers are false, misleading or simply made up (anyone who has encountered the nonsense of Apple’s headlines about AI can relate).

The report examines how ChatGPT, Microsoft Copilot, Google Gemini and Perplexity handle news queries in 14 languages ​​across 18 countries. The report analyzed more than 3,000 individual responses provided by AI tools. Professional journalists from 22 public media outlets evaluated each response for accuracy, origin and ability to distinguish information from opinion.

The results have been grim for those who rely on AI for their information. The report found that 45% of all responses had a significant problem, 31% had supply issues, and 20% were simply inaccurate. It’s not just one or two embarrassing mistakes, like confusing the Belgian Prime Minister with the frontman of a Belgian pop group. The study revealed deep structural problems in the way these assistants process and disseminate information, regardless of language, country or platform.

(Image credit: BBC/EBU)

In some languages, the assistants were completely hallucinating the details. In others, they attributed the quotes to media outlets that had not published anything even close to what was being cited. Context was often lacking, with aides sometimes giving simplistic or misleading overviews instead of crucial nuances. In the worst case, it could change the meaning of an entire story.

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top