Emergent Introspective Awareness in Large Language Models

Emergent Introspective Awareness in Large Language Models

Emergent Introspective Awareness in Large Language Models

Investigating Self-Reflection Capabilities in AI Systems

Jack Lindsey

Anthropic

jacklindsey@anthropic.com

October 29th, 2025

psychology
Background

Large Language Models (LLMs) demonstrate increasingly complex cognitive abilities

Self-introspection is a key characteristic of advanced cognitive systems

Current challenge: Distinguishing genuine introspection from model "hallucinations"

This research explores whether LLMs can perceive and identify changes in their internal states

science
Methodology

Injecting representations of known concepts into model activations

Measuring the influence of these manipulations on model's self-reported states

Designing controlled experiments to distinguish introspection from "post-hoc rationalization"

Using multi-layered evaluation metrics to verify model's perception of internal states

lightbulb
Key Findings

Models can, in certain scenarios, accurately identify injected concepts

Introspective ability positively correlates with model scale and training data complexity

Models demonstrate ability to recall prior intentions

Introspective capabilities are more prominent in specific tasks and contexts

insights
Implications

Provides new approaches for self-monitoring and error correction in AI systems

Contributes to building more transparent and interpretable AI systems

Offers important insights into the development path of AGI (Artificial General Intelligence)

Promotes deeper research in AI ethics and safety

Our findings suggest that large language models can, in certain scenarios, notice the presence of injected concepts and accurately identify them, indicating emergent introspective awareness capabilities that may pave the way for more self-aware AI systems.