What happens when you drop a top AI model—supposedly able to predict the future—into a perfectly realistic, chronologically replayed "news documentary"? Does it act like a prophet, or like a flustered intern?
In practice, our most celebrated AIs behave closer to the latter. 📉
For a long time, we judged AI intelligence with "static knowledge" questions: "What is the capital of France?" or "How do you write a sorting algorithm?" These facts are frozen, already printed into training data. It's like testing a student who has memorized an entire history textbook.
But in May 2026, a major arXiv paper ("FutureSim: Replaying World Events to Evaluate Adaptive Agents") revealed an uncomfortable truth: AI suffers a cliff-like drop in intelligence when handling "the future as it happens." 🎢
Researchers built a cyber version of The Truman Show for AI, codenamed FutureSim.
What Is FutureSim? 🎞️
Feynman once said: "If you cannot predict how a system evolves, you don't truly understand its rules."
FutureSim doesn't quiz AI on the past. It performs a "time travel" trick:
1. Go back in time: It selects the real global news stream from January to March 2026. 2. Set the starting point: It places the AI at January 1 and tells it: "Your knowledge of the world ends as of yesterday. From now on, you must face 'future challenges.'" 3. Precise replay: The system feeds the AI real news, one item at a time, in chronological order. The AI must use this continuously updating information to predict the following week's geopolitics, market swings, or tech breakthroughs.
Three Painful Moments in This "Reality Show" 💔
Using Feynman's intuition, here are the fatal weaknesses the test exposed:
1. A "Dead Brain," Not "Living Intelligence" 🧠
Even the strongest models (such as GPT-5.5) achieved only 25% accuracy in this future-simulation contest. AI is good at summarizing "what already happened," but terrible at dynamically revising its "world model" with new evidence.2. The More News It Reads, the More Confused It Gets? 🌀
This is the strangest finding. Mathematical analysis showed many AIs' Brier scores (a measure of prediction accuracy) were worse than blind guessing. Meaning: the more news they read, the more overconfident they became. They seize on partial new clues and charge headlong in the wrong direction.3. Lack of Endurance 🏃
Processing three months of news requires remembering thousands of details and making thousands of tool calls (to check historical context). Today's AI is like a runner out of stamina—midway through, it starts rambling because the "context is too long" or the "logic chain breaks."Why This Paper Matters 🚀
It marks the transition of AI evaluation from a "static museum" to a "dynamic battlefield."
Feynman championed "truth through practice" his whole life. This paper tells us: a true AGI should not be a library that recites books, but an observer whose pulse beats with the world's.
If we want AI to help us predict climate change or prevent financial crises, it must first learn to stay calm in a tsunami of information—and to overturn yesterday's conclusions whenever new evidence demands it.
Summary
Knowledge is past tense; intelligence is future tense. ⏳
FutureSim throws cold water on the fantasy that "large models can do everything." It reminds us: on the scale of time, AI is still a child.
Next time an AI claims to be omniscient, ask it a FutureSim-style question: "If you don't know what happens tomorrow, are you so sure about the day after?"
Truth is not dogma carved in stone, but the courage to keep correcting yourself amid ceaseless change. That is the ultimate lesson in "dynamic intelligence" from 2026's time-travel experiment. 🎓✨