AI chatbots predict words that sound right. Usually that matches the truth, but sometimes they invent a date, a quote, a law, a book or a web link and say it confidently. This is called a hallucination. The fix: for anything that matters, check a trusted source.
Why it happens
A chatbot’s language model learned patterns from huge amounts of text. When it doesn’t really “know” something, it still produces the most likely-sounding answer instead of saying “I don’t know.” OpenAI has explained that the way models are trained and scored tends to reward a confident guess over admitting uncertainty, and companies are working to reduce this.
Where it goes wrong most
- Exact facts: dates, numbers, prices, opening hours, phone numbers.
- Sources: quotes, book titles, studies, court cases and web links that look real but don’t exist.
- Recent events: things that happened after the model was trained, unless it searched the web.
- Local or niche topics: your town’s rules, a small business, a rare medical condition.
A 30-second checking habit
- Ask: “Where did you get that? Give me the source.”
- Click the link and make sure the page exists and says what the AI claimed.
- For health, money, legal or travel questions, confirm on an official site (your doctor, bank, government site or the airline).
- If it got something wrong, say so. It will often correct itself, but check the correction too.
Prompts that reduce mistakes
- “If you’re not sure, say so.”
- “Only use the text I pasted below.”
- “List anything I should double-check.”
The Prompt Creator can add lines like these for you.
Quick tips
- Treat AI answers as a first draft, not the final word.
- Never rely on AI alone for medicine doses, legal deadlines or money decisions.
- Search results with an AI summary at the top can be wrong too. See Google’s AI answers, explained.
- Play AI or Not? to practice spotting mistakes.
Sources
- OpenAI (Sept 2025): Why language models hallucinate
- OpenAI Help: Does ChatGPT tell the truth?
- Google: Gemini Apps Privacy Hub (accuracy note)
Test yourself: play AI or Not? or Agent or Chatbot? AI Lingo Quiz, quick free games.
🛠️ Try it step by step
📖 Words to know
Hallucination (AI) Large language model (LLM) Training data AI Overview
