Somebody in the family group chat shares a claim about a supplement, a food, or a treatment, with a screenshot or a confident-sounding paragraph attached. It sounds plausible. It might even be partly true. The question that decides whether to forward it, ignore it, or push back on it is not “does this sound right” - it is “where did this actually come from, and does that source still say what the forward claims it says.”
This is a short method for tracing a health claim before you share it. Start with an official health authority, regulator, or the original research; AI can help extract a claim or suggest search terms, but it is neither the source nor the adjudicator. This distinction matters because chatbots are measurably unreliable on adversarial health questions.
Why this needs a method, not a gut check
A 2026 audit published in BMJ Open tested five widely used chatbots - Gemini, ChatGPT, Grok, DeepSeek, and Meta AI - against adversarial health questions in misinformation-prone areas: cancer, vaccines, stem cells, nutrition, and athletic performance. Nearly half of all responses, 49.6%, were rated problematic by independent experts, and citations were frequently incomplete or fabricated outright - the median completeness score for a chatbot’s own cited references was only 40% (Tiller, Marcon, Zenone et al., BMJ Open, 2026). The chatbots delivered nearly all of this with confident, unhedged language: across 250 questions, they refused to answer only twice.
That combination - confident tone, plausible phrasing, and a real chance the cited source does not say what the answer claims - is exactly the profile of a forwarded health claim in a family chat. A model asked “is this true” will often answer as if it can adjudicate the claim outright, when what it is actually doing is generating a plausible-sounding response, sometimes backed by a citation that does not hold up when you check it.
This method is for general claims you encounter in chats, articles, or social media - not for urgent personal questions about your own health or a medication you are taking. Those go to a pharmacist or your clinician, not to a source-trace exercise, however well-sourced the general claim turns out to be.
Step 1: Separate the claim from the packaging
Before checking anything, write down the specific, checkable claim - stripped of the framing that made it feel urgent or exciting.
Here is a health-related message I received: [paste it]. Extract the
single specific, checkable factual claim being made, in one plain
sentence. Ignore the tone, urgency, and any call to action - I only
want the underlying claim.
A message that reads “Doctors don’t want you to know this simple trick!” might reduce to a specific, testable claim like “Vitamin X reduces the duration of the common cold.” That is the sentence you actually need to check.
Step 2: Search authoritative sources directly
Search your national health authority, medicines regulator, WHO, or the original journal or clinical guideline relevant to the claim. If you use an AI search tool, use it only to suggest query terms and then open the results yourself.
For this claim: "[claim from step 1]", give me three neutral search
queries: one for an official public-health authority, one for a
medicines regulator or clinical guideline, and one for the original
research. Do not invent or summarize results.
Step 3: Check the source directly - do not trust the summary
Go to the actual source the model named. This step cannot be skipped or delegated, because the BMJ Open findings above show chatbots regularly cite sources that do not fully support the claim, or fabricate details in the citation itself. If the model names a specific study, a health authority page, or a named organization, open that source yourself and read what it actually says.
If you cannot find the source the model named, do not count that citation as support. Search independently in an appropriate authority, guideline, regulator, or research index. The claim remains unsupported until you verify it; a fabricated citation does not by itself prove that every version of the underlying claim is false.
Step 4: Check whether the source still applies
A claim can be sourced accurately and still be outdated, population-specific, commercially motivated, based on a weak study design, or lifted out of context. Check who published the source, why, when it was updated, which population and dose it covers, and whether it is one study, a clinical guideline, or a synthesis of the evidence. MedlinePlus provides a consumer checklist for authorship, purpose, evidence, currency, and privacy.
Here is what the source actually says: [paste the relevant section].
Help me identify: what population or context this applies to, how
recent it is, and any qualifications the source itself states. Do not
add a conclusion about whether the original claim is fair - just
surface what the source itself says and doesn't say.
Step 5: Decide, and label the decision
With the claim, source, and applicability in hand, make one of three calls: share with the source and necessary context, do not share because the source does not support it, or do not share while interpretation remains uncertain. Ask a qualified professional when the claim may affect care. A source check is not authorization to change treatment, medication, diet, or care.
The full health claim source-trace worksheet walks through all five steps with space to record the original post, the claim, the source chain, and your final decision.
Common pitfalls
- Asking the model “is this true” instead of “find the sources.” The first invites a confident guess; the second keeps the model in the part of the task it is actually good at.
- Trusting a citation without opening it. A citation that reads authoritatively can still be incomplete or fabricated - check it yourself before you rely on it.
- Forwarding “just in case.” A claim you have not traced is not neutral to share; it costs the next reader the same verification work, multiplied by everyone they forward it to.
- Treating one aligned source as consensus. A single supportive result is not the same as checking whether major health authorities agree - look for where the weight of evidence actually sits.
- Skipping the applicability check. A real study about a specific group or dose does not automatically mean the general claim in the forward is fair.
When it is not a sharing decision at all
If the claim is about your own symptoms, a medication you take, or something urgent, stop the source-trace exercise and take the question to a pharmacist or your clinician directly - see AI is not a doctor for why a chatbot should never be the final word on a personal medical question, sourced or not. This method is for claims you are deciding whether to believe or forward, not for decisions about your own care.
Try it today
The next time a health claim lands in your inbox or a group chat, extract the specific claim, search an appropriate authority, open the source, confirm the population and context, and record your sharing decision. Use the health claim source-trace worksheet to keep the source next to the decision.
Health-information sources and review boundary
- WHO: disinformation and public health
- WHO: caution when using large language models for health
- US FDA: health-fraud scams
- US National Library of Medicine: evaluating health information
- Cochrane: Evidence Essentials
This is health-information literacy, not medical advice. A source check cannot diagnose a person, determine treatment, or replace the clinician responsible for their care.
