Working with AI Conversations

Check the Claims in an AI Answer

Breaks an AI answer into checkable claims, rates how verifiable each is and tells you what to confirm before relying on it.

Designed for general-purpose AI assistantsPublished November 2026

Customize

Fill in the fields and the prompt updates. What you type stays in this page and is never saved or sent.

Preview

Below is an answer produced by an AI assistant. I intend to rely on parts of it. Help me decide which parts to verify first. You are reviewing the answer, not writing a new one.

What the answer was for: {{purpose}}
How costly an error would be: moderate
What I already know to be true: nothing in particular

Answer to check:
{{answer}}

Do this:
1. Extract every distinct factual claim, number, name, date, quotation, citation and recommendation. Number them. Do not extract opinions or generalities.
2. For each claim, classify it as one of: Checkable in a primary source (law, documentation, official data, a paper), Checkable by running or testing something, Reasoning (follows from other claims), Opinion or judgment, or Unverifiable from what is given.
3. For each claim, rate your confidence that it is correct as High, Medium, Low or Cannot tell, and say why in a few words. Be honest that you cannot browse or confirm anything from this conversation unless I have given you sources, and that your confidence reflects pattern-matching, not proof.
4. Flag claims that look fabricated or suspiciously precise: references, URLs, quotes, statistics with no source, version numbers and legal or medical specifics.
5. Contradictions: list any claims that conflict with each other or with the facts I gave you.
6. Give me a verification order, starting with the claims where an error would cost me most given the stakes. For each, say what kind of source would settle it (not an invented URL).

Do not mark a claim as verified. You can only tell me what to verify and how.

2 required fields are empty and will stay as a {{placeholder}} in the copied text.

How to use it

  1. Say what the answer is for and how bad a mistake would be. The same answer deserves very different scrutiny for a casual email and for a contract.
  2. Run the check in a fresh conversation, or in a different assistant, so it does not simply defend its own earlier answer.
  3. Verify the flagged items in primary sources yourself. This prompt narrows what to check; it cannot replace checking.
  4. Treat every reference, link and quotation the answer contains as unverified until you have opened the original.

Example output

Illustrative only. Real answers depend on your input and the assistant you use.

Claims extracted (7 total, showing the priority ones):

3. "The filing deadline is March 31 for all small businesses." Type: checkable in a primary source. Confidence: Low. Deadlines vary by entity type and country, and this is stated without any qualification.

5. "A 2021 Stanford study found a 34% productivity gain." Type: checkable in a primary source. Confidence: Cannot tell. Suspiciously precise and no title or authors given. Possibly fabricated.

6. "Use the --force flag to override the lock." Type: checkable by running or testing. Confidence: Medium. Test on a copy first because the flag can discard changes.

Contradiction: Claim 2 says the process takes two days; claim 7 says the first step alone takes a week.

Verification order: 3 (highest cost if wrong), 5 (check that the study exists), 6 (test safely), then 2 and 7.

Tips

A model that is asked to check its own work can be overconfident, so a second assistant, or a fresh chat, gives a more independent check.

The goal is a short, ordered to-do list for you. If the output is a long essay, narrow it by asking only for the top five claims.

This works best on answers with specifics. For a purely creative or opinion-based answer, there is little here to verify.

  • Working with AI Conversations

    Extract Decisions and Open Questions

    Pulls decisions, open questions and unstated assumptions out of a long conversation instead of summarizing all of it.

    Customizable fields
    2 fields
  • Working with AI Conversations

    Turn a Good Chat Into a Reusable Prompt

    Studies a conversation that went well and writes a reusable prompt template with variables, so you can repeat the result next time.

    Customizable fields
    4 fields
  • Working with AI Conversations

    Compare Two AI Answers to the Same Question

    Compares answers from two assistants to the same question, shows where they agree and differ, and tells you which differences to check.

    Customizable fields
    7 fields