English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

How to Verify Consistency of Probabilistic Claims: Interactive PCPs for AI Safety

Forum topic · 小凯 · 2026-08-13

Summary

A new arXiv paper (2608.11181) by Orr Paradise, Oliver Richardson, Yoshua Bengio, and Shafi Goldwasser addresses whether the answers of a probabilistic predictor to many conditional-probability queries are self-consistent, and whether this can be verified in polynomial time. The problem matters for AI safety, where safety relies on honest probabilistic predictions of unwanted outcomes from AI actions. The authors construct an interactive PCP: a predictive model is specified by a probability circuit P and a confidence circuit Q, implicitly defining exponentially many probabilistic claims. Their protocol lets a polynomial-time verifier check approximate consistency of (P,Q) by evaluating the circuits at only a few points and reading a few locations of a proof oracle encoding a witness distribution consistent with the predictions. As a foundation, they build on Nilsson's 1986 work to place l2-approximate consistency of explicit probabilistic claims in NP with certificate length O(mn + log B), later removing the dependence on bit-precision B via small completeness-soundness gaps. These results provide complexity-theoretic tools for probabilistic predictors to prove their own self-consistency.

Paper Overview

  • Field: Machine Learning
  • Authors: Orr Paradise, Oliver Richardson, Yoshua Bengio, Shafi Goldwasser
  • Published: 2026-08-11
  • arXiv: 2608.11181

Summary

When a probabilistic predictor answers many conditional-probability queries, are its answers self-consistent, and can this be verified in polynomial time? This problem is of interest for AI safety, where safety is derived from honesty about probabilistic predictions of unwanted outcomes potentially caused by an AI action.

The authors construct an interactive PCP as follows. Let a predictive model be specified by a probability circuit P and a circuit Q which outputs confidence in predictions. Together, P and Q implicitly specify exponentially many probabilistic claims. They show a protocol in which a polynomial-time verifier can verify the approximate consistency of (P,Q). The verifier is given the pair of circuits (P,Q), which it evaluates at only a few points; alongside them it is given a proof oracle — an encoding of a witness probability distribution allegedly consistent with (P,Q)'s predictions — and reads only a few locations while interacting with a single untrusted prover.

Along the way, one must ensure that a sparse witness distribution consistent with the model's predictions exists. To this end, the paper first considers witness distributions for consistency of explicit probabilistic claims: given m claims, each of the form Pr[Y = 1 | X = x] = p, over n Boolean variables. Building on work pioneered by Nilsson (Artif. Intell., 1986), the authors place l2-approximate consistency of explicit claims in NP with certificate length O(mn + log B), where B is the input bit-precision; they further show how to remove the dependence on B via a small additive completeness-soundness gap.

These results provide a complexity-theoretic foundation for proving self-consistency of probabilistic predictors. The authors view the interactive PCP as a first step toward training predictive models to prove their own self-consistency.

Original Abstract

When a probabilistic predictor answers many conditional-probability queries, are its answers self-consistent, and can this be verified in polynomial time? This problem is of interest for AI safety, where safety is derived from honesty about probabilistic predictions of unwanted outcomes potentially caused by an AI action. We construct an interactive PCP as follows. Let a predictive model be specified by a probability circuit P and a circuit Q which outputs confidence in predictions. Together, P and Q implicitly specify exponentially many probabilistic claims. We show a protocol in which a polynomial-time verifier can verify the approximate consistency of (P,Q). The verifier is given the pair of circuits (P,Q), which it evaluates at only a few points; alongside them it is given a proof orac...

---

*Auto-collected on 2026-08-13*

Tags

#machine-learning#ai-safety#interactive-proofs#pcp#probabilistic-reasoning#complexity-theory#arxiv-paper

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178633406