Paper Overview
Field: cs.AI Authors: Olena Bogdanov, Yeunji Jung, Chandra Dhir Published: 2026-05-21 arXiv: 2505.01254
Summary
Natural language to SQL (NL2SQL) conversion is an important problem for researchers and enterprises due to the ubiquitous importance of relational databases in broad-ranging practical problems. Despite the rapid advancements in the capabilities of LLMs, NL2SQL has not reached parity in accuracy with human expert SQL writers, hence needing additional improvements in NL2SQL algorithms.
This study presents AgentNLQ, a new multi-agent method for NL2SQL that achieves 78.1% semantic accuracy on the BIg Bench for LaRge-scale Database (BIRD) benchmark. The method leverages a semantically enriched representation of user-provided schema, adds user-provided business rules, and produces accurate SQL queries.
Key Contributions
1. Optimized multi-agent orchestrator: The authors designed an orchestrator in a multi-agent solution that uses LLMs to plan, orchestrate, reflect, and self-correct in order to generate accurate SQL queries.
2. Advanced schema enrichment: A method that creates context-aware metadata to improve generation accuracy.
3. Generalizability evaluation: The accuracy and generalizability of the method were demonstrated across different domains and datasets via evaluation on the BIRD-SQL benchmark.
Original Abstract
> Natural language to SQL (NL2SQL) conversion is an important problem for researchers and enterprises due to the ubiquitous importance of relational databases in broad-ranging practical problems. Despite the rapid advancements in the capabilities of LLMs, NL2SQL has not reached parity in accuracy with human expert SQL writers, hence needing additional improvements in NL2SQL algorithms. This study presents a new multi-agent method for NL2SQL that achieves 78.1% semantic accuracy on the BIg Bench for LaRge-scale Database (BIRD) benchmark. Our method leverages a semantically enriched representation of user-provided schema, adds user-provided business rules, and produces accurate SQL queries.
---
*Paper link: arXiv:2505.01254*