Thinking around AI · 08

Trust, then verify

Outcome

By the end, you'll be able to run a 3-step verification check on any factual answer Claude gives you.

Concept

Verifying isn't calling Claude a liar — it's a normal habit, the same one good researchers use on every source. The key move is lateral reading: instead of asking Claude "are you sure?" (it will usually just agree), you leave the chat and check the claim somewhere independent. Three steps: pull out the specific claim, search for it outside the conversation, and confirm the real source actually says what Claude said.

Weak approach vs. strong approach

The ask

You ask Claude whether the UN's 2023 climate report found that global temperatures are on track to rise 1.5°C by 2030, and Claude answers confidently, citing the IPCC Sixth Assessment Report (AR6) and a Nature Climate Change study from 2022. The sources sound authoritative, so you move on.

What comes back

You never find out that Claude got the date wrong — AR6 projects 1.5°C being crossed in the early 2030s, not by 2030 specifically — and the Nature Climate Change citation doesn't match any real 2022 study by the authors Claude named. Both errors are invisible because you stayed inside the chat. If you'd asked "are you sure?" Claude would have said yes.

Try it

Open claude.ai, and keep a second browser tab open for checking. Don't do your verifying inside the chat.

Step 1 — Get the claims

Ask Claude for three specific facts, with sources, about something you're studying right now.

Prompt

Give me 3 specific facts about [your current topic], and cite a source for each one.

Notice: You now have three checkable claims and three named sources.

Step 2 — Leave the chat

In your other tab, search for each claim and each source independently. Do not ask Claude whether it's sure — go around it, not through it.

Notice: Does the source actually exist? Does it actually say what Claude said it says?

Step 3 — Score each one

Label each of the three: confirmed (source exists and matches), distorted (source exists but says something different), or invented (the source or fact doesn't exist).

Notice: Count how many fall outside "confirmed." That number is why this habit matters.

What to look for: Lateral reading — checking outside the chat — catches the distortions and inventions that asking "are you sure?" never will.

Takeaway

Verification is a habit, not an accusation: leave the chat, find the source, and check that it says what you were told.

Your turn

You asked Claude for quick facts about honeybees. Here is its answer — decide what you would do with each claim, then check your verification. One of them is wrong.

Honeybees share the direction and distance of food with the hive through a movement called the waggle dance.

A strong colony can hold 50,000 to 60,000 bees at the height of summer.

The worker bees that gather nectar and tend the hive are male.

Honeybees can be trained to recognize individual human faces.

Over its whole life, a single worker bee makes only about a twelfth of a teaspoon of honey.

Classify every claim to check.

Practice

Practice with Claude

Try what this tutorial teaches. Conversations aren't saved.

Ask a question about working with AI, or paste a prompt to try — Claude will reply and point out where it could be sharper.


It's not a databaseMake it disagree with you