English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

Governed Enterprise Analytics: Policy-Executed Programs Outperform Runtime LLM Planning

Forum topic · 小凯 · 2026-09-06

Summary

This post summarizes an arXiv paper (2509.00002) from MasterControl AI Lab on a governed approach to enterprise analytics. A language model interprets the user's question, while a deterministic policy selects and executes a pre-approved analytical program that returns both results and evidence. The authors show this restriction remains expressive within a defined analytical class using relational operations plus aggregation, comparison, windows, ranking, and similarity. Fixed semantic, policy, data, and execution rules make results replayable. Across 440 runs, three 8B models generated SQL and selected tools at runtime, while Qwen3-8B only interpreted intent with policy executing the approved program. Of 330 runtime-planning episodes, none matched the full answer-and-evidence contract across all test datasets; the policy-executed analyzer matched 110 of 110. The authors note these results are specific to their configuration and do not prove runtime agents cannot succeed under other designs.

Paper Overview

  • Research Area: AI/ML
  • Authors: MasterControl AI Lab
  • Published: 2026-09-06
  • arXiv: 2509.00002
  • Summary

    The paper studies a governed approach to enterprise analytics: a language model interprets the question, while deterministic policy selects and runs a pre-approved analytical program that returns both results and evidence.

    Key claims

  • The restriction remains expressive within a defined analytical class, using relational operations plus aggregation, comparison, windows, ranking, and similarity.
  • Fixed meaning, policy, data, and execution rules make results replayable.
  • Across 440 runs, three 8B models generated SQL and selected tools at runtime, while Qwen3-8B interpreted intent only and policy executed the approved program.
  • None of 330 runtime-planning episodes matched the full answer-and-evidence contract across all test datasets; the policy-executed analyzer matched 110 of 110.

Caveat

The authors note this is a result of a specific configuration and does not prove that runtime agents cannot succeed under other designs.

Original Abstract

> We study a governed approach to enterprise analytics: a language model interprets the question, while deterministic policy selects and runs a pre-approved analytical program that returns both results and evidence. We show that this restriction can remain expressive within a defined analytical class, using relational operations plus aggregation, comparison, windows, ranking, and similarity. Fixed meaning, policy, data, and execution rules also make results replayable. Across 440 runs, three 8B models generated SQL and selected tools at runtime, while Qwen3-8B interpreted intent only and policy executed the approved program. None of 330 runtime-planning episodes matched the full answer-and-evidence contract across all test datasets; the policy-executed analyzer matched 110 of 110. This is a ...

*Auto-collected on 2026-09-06*

Tags

#ai#machine-learning#enterprise-analytics#llm#arxiv#governance#sql#reproducibility

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178634526