Aditya Venkatesh's Personal Website

What Are LLM Hallucinations?

When it comes to LLMs, “hallucinations” refer to instances where the model generates information that is inaccurate, irrelevant, or entirely fabricated. The term is metaphorical, borrowing from human experiences of perceiving things that aren’t real, to describe how an AI model can produce outputs that appear plausible and convincing but are fundamentally false or misleading. These hallucinations pose a significant challenge because they can undermine trust and limit the usefulness of LLMs in practical applications.

Types of LLM Hallucinations

Hallucinations in LLMs manifest in several distinct forms:

    Factual Inaccuracies: These occur when the model provides information that is simply wrong or misleading. Despite drawing from extensive training data, LLMs can mix facts incorrectly, invent dates, misattribute quotes, or otherwise present erroneous content as truth.

    Nonsensical Responses: Sometimes the output lacks logical coherence—sentences or paragraphs may be grammatically correct yet make no real sense, fail to connect ideas meaningfully, or veer into absurdity without clear reason.

    Contradictions: An LLM may produce conflicting statements either within a single response or between its response and the input prompt. This inconsistency can confuse users and reduce confidence in the model’s reasoning.

    Irrelevant or Off-Topic Content: The model might wander away from the subject at hand, introducing information or tangents that have little or no connection to the user’s query or the surrounding context. This distracts from the conversation’s purpose and reduces clarity.