Have you ever seen a student who works through problems very slowly but gets high scores? They check every step three times, afraid of making a mistake.
Many current large language model (LLM) reasoning systems are exactly like that student. When facing hard problems, they generate long chains of thought, reasoning step by step. More steps mean more accurate answers, but at the cost of increasingly long inference times. This is known as overthinking.
The paper discussed here addresses one question: can a model think less, but think better?
The STACK Method
The researchers propose STACK, short for State-Aware Reasoning Compression with Knowledge Guidance. The core idea is simple: decide whether to compress the reasoning process based on the model's current state.
They divide the possible states during reasoning into two categories:
1. Confident despite verbose output. In this case, redundant verification steps should be compressed so the model can move forward directly. 2. Uncertain or biased. Here, blind compression is dangerous; external knowledge should be introduced to guide the model and correct its biases.
STACK dynamically switches between these two strategies. It builds "long-short contrastive" samples and learns online when to compress and when to seek help. It also features an early stopping mechanism based on answer convergence: if the model reaches the same intermediate conclusion several steps in a row, further verification is unnecessary.
Training Approach
Rather than simple supervised learning, the authors combine PPO (Proximal Policy Optimization) and DPO (Direct Preference Optimization), letting the model learn a "state-aware compression policy" through reward differences.
Results
On three mathematical reasoning benchmarks, STACK cut reasoning length by 59.9% on average while improving accuracy by 4.8 percentage points.
In other words, the model not only thought less — it thought better.
Why It Matters
For a long time, people assumed "longer reasoning means better results." This paper shows that length and quality are not linearly correlated. Often, the later steps of a model's reasoning are just repeated verification, hesitation, or even the introduction of new errors.
A truly intelligent thinker is not the one who fills three pages of scratch work per step, but the one who knows when to be concise and when to dig deeper.
The researchers call this capability "state awareness" — the model must perceive its current cognitive state and adjust its strategy accordingly. This is still far from genuine "metacognition," but it is a meaningful start. If an AI can judge "I'm confident now, I can skip verification" or "I'm biased here, I should check external sources," it is no longer a simple token generator but a system with some capacity for self-regulation.
Thinking a little less and knowing more may be the next key direction in the evolution of reasoning models.
---
Paper information
- Title: Think Less, Know More: State-Aware Reasoning Compression
- arXiv: 2604.09150
- Key finding: state-aware reasoning compression, average 59.9% reduction in reasoning length with a 4.8-point accuracy improvement