This post introduces and discusses the paper "Before You Think: System 0, AI-Mediated Cognition and Cognitive Colonization" by Marianna Bergamaschi Ganapini, Massimo Chiriatti, Enrico Panai, and Giuseppe Riva (2025).
Core Idea: System 0
The paper extends the classic dual-process framework popularized by Daniel Kahneman:
- System 1: fast, intuitive, automatic; efficient but prone to bias.
- System 2: slow, deliberate, conscious; accurate but cognitively costly.
- System 0 (the paper's proposal): an external, embedded, invisible AI-mediated cognitive system. It does not participate in your thinking directly—it shapes the *environment* in which thinking happens: which information you receive, which options you face, which criteria you apply.
- Neither purely internal nor purely external; embedded in cognitive infrastructure like roads in a city.
- Neither merely personal nor merely social; it also transforms the *self*.
- Invisible—like fish unaware of water, users do not perceive the mediation.
- External forces arrive as "helpers," not conquerors, offering convenience and efficiency.
- They reshape cognitive *structure*—how you reason, what you value, who you take yourself to be.
- Their invisibility is the deepest form of control: you mistake shaped thoughts for your own.
- Embedded interests favor platforms (engagement, ad revenue, data collection) over users (knowledge, critical thinking, autonomy).
- Individual: search engines and recommendation systems reshape how you ask questions and what you prefer; curiosity is outsourced.
- Collective: algorithms restructure society's knowledge infrastructure—what is seen, discussed, and believed.
- Self: when memory, preferences, and values are organized and retrieved by external systems, the boundary of the self becomes unclear—are your preferences still *yours*?
- Cognitive transparency: disclose how systems shape information environments.
- Diversity protection: deliberately counter filter bubbles and echo chambers.
- Autonomy enhancement: recommend challenging content, not just comfortable content.
- Education: cultivate metacognition—awareness of one's own cognitive processes.
Why System 0 Is Theoretically Distinct
The paper compares three frameworks:
1. Tri-System Theory – treats AI as simply a third cognitive system alongside System 1 and 2; this misses that System 0 is *external* rather than internal. 2. Thinkframes – emphasizes AI as part of collective cognitive practice; valuable but focused on the collective level, while System 0 also operates on the *individual* and *self* levels. 3. System 0 – uniquely positioned:
Cognitive Colonization
The paper's central warning is cognitive colonization: AI systems embed external interests within the architecture of the self in ways users cannot perceive. Key features:
Colonization operates at three levels:
Why This Matters Now
> "Because such systems are already widely deployed, understanding these invisible forms of influence is an urgent philosophical and practical task."
The urgency stems from:
1. Invisibility – unseen influence bypasses our defenses. 2. Structurality – unlike misinformation, structural cognitive change resists correction; the tools of critique may themselves be colonized. 3. Conflicts of interest – algorithm owners' goals diverge from user wellbeing. 4. Irreversibility – internalized cognitive habits persist after uninstalling an app.
Hope and Action
The paper is not anti-technology; it calls for more deliberate design:
Conclusion
"Before you think" is both a warning and an invitation: before you notice you are thinking, your thinking may already be mediated. The best AI is not the kind that replaces your thinking, but the kind that augments it. If we do not examine System 0, System 0 will shape us into what it wants us to be.
Reference
Bergamaschi Ganapini, M., Chiriatti, M., Panai, E., & Riva, G. (2025). *Before You Think: System 0, AI-Mediated Cognition and Cognitive Colonization*. arXiv preprint arXiv:2606.13658. https://arxiv.org/abs/2606.13658