AI vs Google covers the broad productivity question of when search wins and when a chatbot wins for everyday tasks. This article narrows that question to one specific case that matters more than the others: a factual claim you plan to act on, repeat to someone else, or use to make a decision. For that case, the deciding factor is not speed or convenience - it is whether you end up with a source you can actually open and check.
The test that matters: can you click it
Plain chat - a chatbot with no live web-search mode turned on - generates its answer from patterns learned during training. It has no guaranteed connection to a checkable source at the moment you ask, even when it states a citation with total confidence. Search, and chat with search mode turned on, both return links you can open and judge yourself - which makes a citation checkable, not automatically genuine. A returned link can still be dead, or real but not the source of the claim it was attached to; what changes is that you can find that out in one click.
This is a real, measured gap, not a hypothetical one. A joint study by the BBC and the European Broadcasting Union - published as the News Integrity in AI Assistants Report - tested four major AI assistants - ChatGPT, Copilot, Gemini, and Perplexity - by having professional journalists across 22 public broadcasters in 18 countries evaluate more than 3,000 responses to news questions. It found 45% of AI answers had at least one significant issue, and sourcing was the single biggest cause: 31% of responses had serious sourcing problems, including missing, misleading, or incorrect attributions (BBC/EBU media centre summary, October 2025). That study tested assistants answering questions about published news content - exactly the kind of factual question this article is about.
A confident tone from a chatbot is not evidence that a fact is grounded in a real, current source. In the BBC/EBU study above, 31% of responses had serious sourcing problems - missing, misleading, or incorrect attributions - even when the assistants were answering questions about published news.
A simple decision rule
Ask one question before you ask anything else: will I act on this, repeat it to someone, or need to defend it later?
If no - casual curiosity, a low-stakes personal question, brainstorming - plain chat is fine. Getting it slightly wrong costs nothing.
If yes - a health question, a legal or financial detail, something you will tell a colleague or forward to a group chat, anything time-sensitive - require an openable citation. That means either:
- Search directly, and read the actual page yourself; or
- Chat with search/browsing mode turned on, then open the specific citations it returns rather than trusting its summary of them.
Plain chat without search mode should not be the last step for anything in the second category, regardless of how specific or confident the answer sounds.
Why “it sounded specific” is not the same test
A model asked a factual question will often produce a specific-sounding answer - a name, a date, a percentage - whether or not it actually has reliable grounding for that specific detail. This is the same mechanism covered in why AI sometimes gives confident wrong answers: the model is built to produce a plausible continuation, and plausible and correct frequently overlap but are not the same guarantee. Specificity is not a proxy for accuracy; a source you can open is.
Search mode is not automatically safe either
Turning on search or browsing mode closes the biggest gap - you now have clickable links you can check yourself - but it does not close all of them. An earlier BBC-only test that prompted assistants to use BBC News articles as sources where possible still found assistants summarizing, quoting, or framing those sources inaccurately at a meaningful rate (BBC, “Groundbreaking BBC research,” 2025). The later BBC/EBU international study found the same family of sourcing failures at scale. The fix is not skipping the check but doing a smaller version of it: open at least one of the cited links yourself and confirm the specific claim you care about actually appears the way the summary describes it. Checking an AI news summary against its primary source covers that step in detail.
When the right tool is neither
Some questions are not well served by search or a single chat answer at all. If the question requires reading many sources and synthesizing them into something structured - a comparison, a landscape overview, a briefing - Deep Research mode is the right tool, precisely because it produces a report with citations attached that you then audit, rather than a single unsourced paragraph. And if the claim in front of you is a viral post rather than a general question, tracing a viral claim is the more specific method - it starts from a claim someone else made rather than a question you are asking fresh.
A worked comparison
| Question | Plain chat okay? | What to do instead if not |
|---|---|---|
| ”Explain how compound interest works” | Yes - concept, not a specific current fact | - |
| ”What is the current EU AI Act deadline for X” | No | Search or chat-with-search, then open the regulation text |
| ”Summarize this article I’m pasting in” | Yes - source is what you gave it | - |
| ”What did [named study] actually find” | No | Search for the paper directly, read the abstract yourself |
| ”Brainstorm gift ideas for my dad” | Yes - no fact to get wrong | - |
| ”Is this claim in my group chat true” | No | Use the viral-claim source-trace method |
What “openable” does not guarantee
Even a clickable, real link can fail you in ways worth knowing about. A source can be genuine but outdated - accurate when written, wrong by the time you read it. It can be genuine but low-quality - a real page that is itself speculative, opinionated, or poorly sourced. And it can be genuine but irrelevant to the specific claim you are checking, even if it is topically related. Opening the link is the necessary first check, not the only one; skim for the publication date, the author or outlet’s track record, and whether the page actually addresses your specific question rather than something adjacent to it.
Common pitfalls
- Treating “the model has internet access on my phone” as automatic. Search mode is often a toggle you have to turn on explicitly, not a default. Check before you trust the answer.
- Trusting a citation without opening it. The BBC/EBU numbers above describe assistants that were specifically asked to cite sources and still got the sourcing wrong in nearly a third of cases.
- Using plain chat for anything you will repeat. If you would be embarrassed to be wrong in front of the person you are telling, that is the test for needing an openable source.
- Assuming search mode fixes accuracy, not just sourcing. It gives you a real link. You still have to read it.
Try it today
Before your next factual question - one you plan to act on or repeat - pause and ask whether you need an openable citation. If yes, either go straight to search or turn on your chat tool’s search mode, and open at least one link before you trust the answer. Use the search vs chat decision card to make the call quickly and consistently.
