Mephistopheles
HomeDoes AI hallucinate?DeepSeek hallucinations
Model hallucination profile

Does DeepSeek hallucinate? What the data shows

Last updated: July 26, 2026

Yes. DeepSeek hallucinates, and notably its R1 reasoning model hallucinates far more than the V3 base model. Vectara measured DeepSeek-R1 at a 14.3% hallucination rate versus 3.9% for V3 in early 2025 — a case where stronger reasoning made faithfulness worse, not better.

Does DeepSeek hallucinate, and how often?

Yes, DeepSeek hallucinates, and it is the clearest public example of a counterintuitive pattern: adding reasoning increased its hallucination rate.

In Vectara's early-2025 analysis, DeepSeek-R1 (reasoning) hallucinated at 14.3% on grounded summarization while DeepSeek-V3 (base) hallucinated at just 3.9% — roughly a fourfold jump from turning on chain-of-thought (Vectara, 2025). Vectara's later leaderboard (May 2026) reports V3 at 6.1% and R1 at 11.3% on its harder dataset, preserving the same R1-worse-than-V3 gap (Vectara, 2026).

The reasoning trace itself is part of the problem. Reinforcement learning that sharpens chain-of-thought also rewards bolder, more confident generation, so R1 adds detail the source never contained.

Reasoning is not the same as grounding

A model that "thinks step by step" is not checking its steps against reality — it is generating more text, each token of which can drift. DeepSeek-R1 is the textbook case: more reasoning, more confident elaboration, more hallucination. Verify reasoning-model output at least as carefully as base-model output.

DeepSeek's signature failure: helpful over-elaboration in the reasoning trace

DeepSeek-R1's most characteristic failure is over-elaboration — adding plausible context or explanation that was never in the source, in an effort to be maximally helpful. Vectara attributed R1's high rate to a tendency to "overhelp," and found 71.7% of R1's hallucinations were "benign" plausible-sounding additions, versus 36.8% for V3 (Vectara, 2025). "Benign" here means it reads well, not that it is true.

Worked example. Give R1 a short passage that states a company was founded in Shenzhen, and ask it to summarise. R1 may return "founded in Shenzhen in 2011 by a team of former telecom engineers, initially focused on networking hardware" — a fluent, confident summary in which the year, the founders' background, and the product focus were never in your passage. The reasoning trace makes the fabrication feel earned.

How to fix DeepSeek hallucinations: manual and automated

The fix for DeepSeek, especially R1, is to constrain it to the source and to distrust the extra detail its reasoning adds.

Manual checks:

  • For summarization, instruct it to use only the supplied passage and to add nothing — then check that it obeyed.
  • Treat every specific it introduces (dates, names, backgrounds) that was not in your input as a candidate hallucination.
  • Prefer V3 over R1 when faithfulness matters more than reasoning depth.

Automated with Mephistopheles: paste any DeepSeek answer into /chat. Mephistopheles extracts each factual claim — including the ones R1's reasoning trace added — and grounds them against independent sources, returning a per-claim verdict and a hallucination-risk score. On our ~290-claim benchmark it catches ~88% of factual errors and passes ~98% of true statements clean. For sensitive content it can de-identify before external grounding.

Frequently asked questions

Why does DeepSeek-R1 hallucinate more than DeepSeek-V3?

Because R1's reinforcement-learned reasoning rewards bolder, more elaborate generation. Vectara measured R1 at 14.3% versus V3 at 3.9% in early 2025, attributing R1's rate to a tendency to "overhelp" — it adds context the source never contained. Stronger reasoning made faithfulness worse, not better.

Should I use DeepSeek V3 or R1 for factual work?

For faithfulness to a source, V3 has consistently hallucinated less than R1 in Vectara's testing. Use R1 where multi-step reasoning genuinely helps, but verify its output carefully — its reasoning trace tends to introduce confident, unsupported detail.

What is a benign hallucination?

A benign hallucination is a plausible-sounding addition that reads naturally but was not in the source. Vectara found 71.7% of DeepSeek-R1's hallucinations were benign in this sense. "Benign" describes how it sounds, not whether it is true — these still mislead readers who trust the output.

How do I verify a DeepSeek answer?

Paste it into Mephistopheles, which grounds each claim — including detail R1's reasoning added — against independent sources and returns a verdict with a hallucination-risk score, flagging unverifiable additions rather than guessing.

Verify what your AI just told you.

Paste any AI answer and Mephistopheles checks each claim against independent sources — no sign-up to try.

Verify an answer →