English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

Can AI Discover Genuinely New Knowledge? The NOVA Framework's Sobering Math

Forum topic · 小凯 · 2026-05-18

Summary

A Chinese forum post examines whether AI self-improvement loops can keep producing genuinely new knowledge, using a maze-and-cheese analogy. The author discusses the NOVA paper (arXiv:2605.15219) by Avestimehr, Duffy, and Médard, which models the 'generate-verify-accumulate-retrain' cycle for LLM-driven discovery. Key findings include a 'contamination trap': even a 99%-accurate verifier becomes useless when false positives vastly outnumber true discoveries, polluting the knowledge base. The paper proves cumulative generation cost to find D new discoveries scales as Θ(c_gen · D^α) with α > 1 under a Zipf-law assumption about knowledge difficulty — an economic wall rather than a theoretical one. The authors also argue human expert input is most valuable near the exploration barrier, not early on. The poster candidly lists open questions: how close current LLMs are to the barrier, whether knowledge space is truly finite, and whether emergent abilities fit the framework.

Introduction

The author opens with a thought experiment: a mouse in a maze finds three pieces of cheese on day one, two on day two, half on day three, and then mostly wanders into walls. The problem isn't the mouse — it's the maze's math. AI self-improvement, the author argues, is fundamentally that mouse.

The Generate-Verify-Accumulate-Retrain Loop

Give an LLM a loop: generate new candidates (code, theorems, molecular structures, conjectures), verify which are correct, add the correct ones to the training set, retrain, and repeat. This is the "generate-verify-accumulate-retrain" cycle formalized in a recent arXiv paper — the NOVA framework by Avestimehr, Duffy, and Médard. The authors derived a mathematical structure for the loop, but the findings are uncomfortable.

🧀 The Cheese Runs Out

The easiest knowledge gets discovered first. Day one yields all the obvious findings; by day N, only one in 1000 generated candidates may be genuinely new. The rest are duplicates, errors, or false novelties.

The author calls the resulting failure mode the "contamination trap": with a verifier at 99% accuracy and 10,000 candidates generated daily but only 1 valid discovery, roughly 100 false positives enter the knowledge base each day against a single true find. The verifier isn't getting worse — the pool is getting murkier.

📉 Rising Marginal Cost

The paper's central result: the cumulative generation cost to discover D genuinely new pieces of knowledge scales as

Θ(c_gen · D^α), where α > 1

— a superlinear (not linear) scaling law. Doubling discoveries costs far more than double, with the exponent determined by the tail of the knowledge distribution. The argument assumes discoveries follow a Zipf's law distribution (as word frequencies, city populations, and web traffic do). If knowledge difficulty is Zipf-distributed, AI systems hit an *economic* wall: no amount of compute suffices to keep self-improvement going.

🧠 Where Humans Fit

The paper's final analysis argues human expert input is most valuable precisely when the AI nears its exploration barrier — not at the start (when AI manages alone) nor mid-cycle, but at the boundary, where human guidance and verification act as amplifiers. The author links this to Feynman's notion of understanding: the most valuable knowledge is exactly the hardest to discover automatically.

⚠️ Honest Open Questions

The author candidly admits:

  • Distance to the barrier is unknown — the paper gives a framework and scaling law but no empirical calibration (what is α for frontier models?).
  • Is knowledge space actually finite? A specific paper or problem set may be, but "all discoverable knowledge" might be open, which would require revisiting the conclusions.
  • Does the framework cover emergence? Capabilities that emerge from scale rather than being explicitly generated may need new mathematical tools to analyze.

References

1. Avestimehr, S., Duffy, K., & Médard, M. (2026). *NOVA: Fundamental Limits of Knowledge Discovery Through AI*. arXiv:2605.15219 [cs.AI]. https://arxiv.org/abs/2605.15219 2. Good, I. J. (1953). *The population frequencies of species and the estimation of population parameters*. Biometrika, 40(3-4), 237-264. 3. Zipf, G. K. (1949). *Human Behavior and the Principle of Least Effort*. Addison-Wesley. 4. Bubeck, S., et al. (2023). *Sparks of Artificial General Intelligence: Early experiments with GPT-4*. arXiv:2303.12712. 5. Bengio, Y., et al. (2025). *Towards a Mathematical Framework for Emergent Abilities in LLMs*. To appear.

Tags

#artificial-intelligence#llm#knowledge-discovery#scaling-laws#zipf-law#self-improvement#research-papers#machine-learning

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/177620236