Paper Overview
Field: Machine Learning Authors: Yuhan Yang, Ruipu Li, Alexander Rodríguez Published: 2025-06-01 arXiv: 2606.04505
Abstract
Scientific simulators are increasingly being integrated into LLM-driven systems for high-stakes simulation-driven decision-making. However, existing frameworks primarily use LLMs to generate, calibrate, or execute simulators, treating them as black-box interfaces rather than as structured mechanistic systems that can be reasoned about. As a result, current approaches lack the ability to identify, represent, and reason about the assumptions and mechanisms underlying simulator behavior, limiting transparency, auditability, and decision justification.
Contribution: MechSim
The authors introduce MechSim, a mechanism-grounded neuro-symbolic reasoning framework for executable scientific simulators. Key aspects:
- Unlike prior neuro-symbolic approaches that primarily reason over static symbolic structures, MechSim enables LLM agents to reason about a simulator's mechanisms, assumptions, and execution behavior.
- Simulators are represented through a shared structured schema that captures assumptions, variables, mechanism dependencies, and execution traces.
- On top of this representation, LLM agents act as constrained reasoning engines, generating structured, evidence-grounded explanations that connect simulator outcomes to their underlying mechanisms.
- Mechanism-level explanation quality
- Simulator analysis
- Reliability of downstream decision-making
Results
Evaluations across multiple high-stakes domains show that MechSim improves:
*Auto-collected on 2026-06-05*