English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

A Quantum Roadmap for Softmax Attention: Exact Born-Rule Analogs for Transformer Attention

Forum topic · 小凯 · 2026-08-13

Summary

This paper by Eric A. F. Reinhardt and Adam J. Hauser (arXiv:2608.11173) presents an exact quantum analog of softmax attention for problems where inputs and outputs lie on the probability simplex. The authors show that attention scores correspond to Hadamard-test statistics on block-encoded projections of amplitude-encoded inputs. The exponential softmax maps bijectively to the interior of a cosine-squared family generated by Born-rule measurement, with the boundary expressing sparse attention with exact zeros at finite parameter values. The softmax temperature becomes a repetition count of post-selected measurement rounds, value aggregation is a deterministic column-loading channel, and gated residuals are auxiliary qubit preparation angles. Every learnable parameter maps to a rotation gate angle. Composite layers are exact in the infinite-sampling limit, while fully coherent variants achieve ε-approximation via quantum singular value transformation in the infinite-depth limit. The algebraic core is machine-verified in Lean 4.

Overview

Field: Machine Learning Authors: Eric A. F. F. Reinhardt, Adam J. Hauser Published: 2026-08-11 arXiv: 2608.11173

Abstract

The attention mechanism forms the foundation of many modern AI models such as the Transformer. In one subclass of problems where attention is used, inputs and outputs are bound to the probability simplex so that all outputs sum to one. In this setting, softmax attention admits an exact, component-by-component quantum realization.

Key Mechanisms

  • Attention scores are Hadamard-test statistics on block-encoded projections of amplitude-encoded inputs.
  • Exponential softmax is the interior of a cosine-squared family generated by Born-rule measurement under an exact bijection. Its boundary expresses sparse attention with exact zeros at finite parameter values.
  • Softmax temperature is a repetition count: post-selected measurement rounds realize discretized inverse temperature exactly.
  • Value aggregation is a deterministic column-loading channel extending column-stochastic value matrices.
  • Gated residual is a single auxiliary qubit's preparation angle, with an additive identity at mixing angle π/2.
  • Each learnable parameter is a rotation gate angle.
  • Precision Guarantees

  • Composite layers are exact in the infinite-sampling limit, with one measure-and-reload step per attention score.
  • Fully coherent variants are ε-approximate in the infinite-depth limit via quantum singular value transformation.
  • The algebraic core is machine-verified in Lean 4.
--- *Auto-collected on 2026-08-13*

Tags

#quantum-computing#attention-mechanism#transformers#softmax#machine-learning#born-rule#quantum-singular-value-transformation#lean4

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178633407