Hallucination

Definition
When an AI model confidently states something false. A key risk when deploying AI systems without verification.

Why it matters

A hallucination is when an AI model states something false with complete confidence: an API that does not exist, a function signature it invented, a fact it made up. Models are built to produce plausible-sounding output, and plausible is not the same as correct, so they will fill a gap with confident fiction rather than admit they do not know.

For a founder building with AI this is the failure mode to design around, because the model never signals which claims are solid and which are guessed. Say you're building a feature with Claude as your coding agent: it can call a library method that was never real, or claim a test passed when it never ran it. Or say you ask Perplexity to research a competitor and it produces a clean stat with a citation that, when you open it, says nothing of the sort.

The defence is never to trust output on its face, verify it against the real thing: check the actual API docs, run the code, read the row in Supabase yourself, drive the feature on the live surface. Good context cuts hallucination because the model has the real facts in front of it instead of guessing, which is exactly why feeding it the right files matters. Treat every confident claim from a model as a lead to verify, not a fact to bank.

Worked example

Suppose a six-person consultancy records its sales calls and uses an AI summary to update the CRM. One summary records that a prospect agreed to a three-month pilot at a price nobody discussed. The prospect had asked for a quote, not a commitment. The rep catches it only because the account manager reads the transcript. The team adds a step: Fireflies.ai produces the transcript and summary, and the rep checks any commitment, price or date against the recording before it goes into the deal record. The summaries stay useful for long calls, and the invented commitment never reaches a contract.

Tools in the example

Some links are affiliate links: we may earn a commission at no cost to you. It never decides a ranking. How we work with partners

Where it shows up

  • Writing copy that feels like conversation instead of marketing. How to sound like yourself.
    12 chapters