AI chatbots can’t be trusted, proves study, but Apple made a good choice

If there’s one piece of advice that bears repeating about AI chatbots it’s “Don’t use them to seek factual information – they absolutely cannot be trusted to be right.” A new study demonstrated the extent of the problem – but did show that Apple made a good choice in partnering with OpenAI’s ChatGPT for queries Siri can’t answer … There are two well-known problems with trying to use LLMs like ChatGPT, Gemini, and Grok as a substitute for web searches: They are very often wrong They are very often very confident about their incorrect information A study cited by the Columbia Journalism Review found that, even when you prompt a chatbot with an exact quote from a piece of journalism and ask for more details, most of them are wrong most of the time. The Tow Center for Digital Journalism carried out tests of eight AI chatbots which claim to carry out live web searches to get their facts: ChatGPT Perplexity Perplexity Pro DeepSeek Microsoft’s Copilot Grok-2 Grok-3 Gemini The s ... Read full article.