English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

Instance-Dependent Sequential Limits as an Exact Information Ledger (arXiv 2610.42133)

Forum topic · 小凯 · 2026-11-03

Summary

A new paper by Akshay Balsubramani (arXiv:2610.42133, October 2026) unifies instance-dependent limits for bandit regret, sequential testing, best-arm identification, and Markov decision processes into a single inferential chain. The chain runs from a divergence decomposition through data processing to a statistic, a testing step that converts class guarantees into requirements on the history, and optimization over alternatives and allocations. The work formalizes this chain as an exact 'ledger': by the chain rule, data processing loses exactly one conditional divergence, which vanishes for arms in natural exponential families at per-arm counts and reward sums. A one-parameter family of martingale identities extends the decomposition to every tilt between two instances. Classical limits emerge as relaxations with named defects; all defects except those from asymptotic steps are computable from the algorithm's own run, and uniformly quantified defects are computable when the class guarantee is numeric. On seven published datasets—from movie ratings to engine replacements—the ledger pinpoints gaps between standard algorithms and classical limits. In best-arm identification and Wald tests between trained models, the dominant terms are typically the uniformly quantified defects.

Paper Overview

Field: Machine Learning Author: Akshay Balsubramani Published: 2026-10-30 arXiv: 2610.42133

Summary

Instance-dependent limits for bandit regret, sequential tests, best-arm identification, and Markov decision processes are proved by one unified inferential chain. The chain runs from a divergence decomposition, through data processing to a statistic, then through a testing step that turns a class guarantee into a requirement on the history, and finally concludes with optimization over alternatives and allocations. Only the first step is an identity.

This work writes the chain as an exact ledger:

  • By the chain rule, data processing loses exactly one conditional divergence; for arms in natural exponential families, this conditional divergence vanishes at the per-arm counts and reward sums.
  • A one-parameter family of martingale identities extends the decomposition to every tilt between two instances.
  • Classical limits follow via relaxations with named defects.
  • All defects except those from the asymptotic step can be computed from the algorithm's own run; uniformly quantified defects are computable only when the class guarantee is a number.
On seven published data sources—ranging from movie ratings to engine replacements—the ledger locates the gap between standard algorithms and classical limits. In best-arm identification and Wald tests between trained models, the largest terms are typically the uniformly quantified defects.

--- *Auto-collected on 2026-11-03*

Tags

#machine-learning#bandits#sequential-testing#best-arm-identification#markov-decision-processes#arxiv#information-theory

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178636704