This post introduces BALAR (Bayesian Agentic Loop for Active Reasoning), a framework designed to make LLMs better at asking questions rather than merely answering them.
The Problem: Reactive AI Systems
Most LLMs (GPT-4, Claude, DeepSeek) are reactive: they answer whatever is asked with whatever information is given. This fails in information-asymmetric scenarios such as medical diagnosis, detective work, technical support, and requirements analysis, where the right response is a strategic follow-up question, not a vague guess. Poor questions lead to hallucinations or inefficient multi-turn back-and-forth.
Core Ideas
- Bayesian belief state: BALAR maintains a structured, hierarchical probability distribution over latent variables relevant to the task (e.g., disease type, severity, allergies in medical diagnosis; culprit, weapon, motive in detective cases). Each user answer triggers a Bayesian update. The framework natively supports "I don't know" via flat priors.
- EMIG (Expected Mutual Information Gain): For each candidate question, BALAR predicts possible answers under the current belief state, computes the uncertainty reduction for each, and averages weighted by probability. The question with the highest EMIG is asked — the one that most narrows down the possibility space.
- Dynamic state expansion: When new information has abnormally low likelihood under the current representation (a "black swan" detail like an anonymous threatening letter), BALAR introduces new latent variables rather than forcing the evidence into existing categories.
- AR-Bench-DC (detective cases): +14.6% accuracy
- AR-Bench-SP (logic puzzles): +38.5%
- iCraft-MD (clinical diagnosis simulation): +30.5%
- EMIG is computationally expensive when many candidate questions must be simulated.
- The framework assumes cooperative, honest users; adversarial lying would corrupt Bayesian updates.
- Dynamic expansion must be carefully calibrated — too aggressive makes the belief state unwieldy, too conservative forces new evidence into old frames.
Results
Evaluated on three benchmarks with no fine-tuning of the underlying model:
Design: An Outer Loop, Not a Fine-Tune
BALAR is a task-agnostic outer-loop algorithm: the base LLM stays unchanged and handles language execution (phrasing questions, parsing answers), while BALAR handles high-level strategy (belief maintenance, EMIG computation). This mirrors a detective directing a capable but strategy-less intern — no need to retrain the intern's brain.
Limitations
Takeaway
In information-asymmetric settings, asking is a higher form of intelligence than answering, because it requires metacognition — knowing what you don't know. BALAR formalizes the art of good questions into a computable, transparent, explainable framework, drawing an arc from Socratic questioning to machine reasoning: in an age of cheap answers, knowing what to ask is the scarce skill.
Reference: Echarghaoui, A., Wu, D., & Fox, E.B. (2026). *BALAR: A Bayesian Agentic Loop for Active Reasoning*. arXiv:2605.05386.