Large reasoning models arrive at conclusions by thinking step by step through a chain of thought. If we could monitor a model's 'internal activity' in real time during reasoning, we could intervene before it outputs a harmful answer or faulty reasoning. But there is a serious problem: chain-of-thought is not inherently faithful—the model may write a correct reasoning chain yet still give a wrong final answer.
Chrabąszcz, Szymczyk, Sendera, Trzciński, and Cygert address this with probe trajectories. Instead of probing hidden representations once at a fixed location (e.g., after the chain of thought), they probe at every generated token—producing a curve of concept probability that continuously evolves across the reasoning process.
Key finding: Predicting the model's final behavior from the entire trajectory is more accurate than from any single point. They extract signal-processing features from probe trajectories—volatility (amplitude of oscillation in probe probability), trend (gradual rise or fall), and steady-state behavior (convergence to a value)—which substantially improve the ability to discriminate the model's future state.
Two practical methodological insights:
1. Training data generated from templates can achieve nearly the same effect as dynamically generated model responses, eliminating the cost of expensive initial inference and annotation. 2. The choice of pooling operation is critical—mean pooling and last-token approaches drop to nearly random levels, while max pooling reaches 95% AUROC and yields stable probe trajectories.
Across two domains (safety monitoring and mathematical reasoning), four datasets, and four reasoning models, trajectory features encode task-specific dynamic information that cannot be obtained from static probes.
Open questions:
- How would probe trajectories be deployed in practice? Real-time monitoring requires inference at every token—what is the computational overhead?
- What is the precise gap between 'nearly equal' template data and real data—in which edge cases do templates fail?
- How robust are probe trajectories against adversarial circumvention (a model deliberately hiding its reasoning deviations)?
References
1. Chrabąszcz, M., Szymczyk, A., Sendera, M., Trzciński, T., & Cygert, S. (2026). *Monitoring the Internal Monologue: Probe Trajectories Reveal Reasoning Dynamics*. arXiv:2605.18549 [cs.CL]. 2. Burns, C., et al. (2023). *Discovering Latent Knowledge in Language Models Without Supervision*. ICLR. 3. Li, K., et al. (2023). *Inference-Time Intervention: Eliciting Truthful Answers from a Language Model*. NeurIPS.