EUVIMEDEUVIMED entdecken
Crossref

LogicCat: A Chain-of-Thought Text-to-SQL Benchmark for Complex Reasoning

Liutao, Xutao Mao, Dixuan Zhang, Yifan Li, LiuHaixin, KongLulu, Jiaming Hou, Rui Li, YunLong Li, Aoze Zheng, Zhiqiang Zhang, Luo Zhewei und 3 weitere

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (36) · 29958-29966

DOI: 10.1609/aaai.v40i36.40243 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Liutao und 14 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Text-to-SQL is a critical task in natural language processing that aims to transform natural language questions into accurate and executable SQL queries. In real-world scenarios, these reasoning tasks are often accompanied by complex mathematical computations, domain knowledge, and hypothetical reasoning scenarios. However, existing large-scale Text-to-SQL datasets typically focus on business logic and task logic, neglecting critical factors such as vertical domain knowledge, complex mathematical reasoning, and hypothetical reasoning, which are essential for realistically reflecting the reasoning demands in practical applications and completing data querying and analysis. To bridge this gap, we introduce LogicCat, the first Text-to-SQL benchmark dataset specifically designed for complex reasoning and chain-of-thought parsing, encompassing physics, arithmetic, commonsense, and hypothetical reasoning scenarios. LogicCat comprises 4,038 English questions paired 12,114 detailed chain-of-thought reasoning steps, spanning 45 databases across diverse domains, significantly surpassing existing datasets in complexity. Experimental results demonstrate that LogicCat substantially increases the task difficulty for current state-of-the-art models to at most 33.20% execution accuracy, indicating that this task remains exceptionally challenging. The advancement of LogicCat represents a crucial step toward developing systems suitable for real-world enterprise data analysis and autonomous query generation.

Zitieren

APA

Liutao, Mao, X., Zhang, D., Li, Y., LiuHaixin, KongLulu, Hou, J., Li, R., Li, Y., Zheng, A., Zhang, Z., Zhewei, L., Zan, H., Zhang, K., & Peng, M. (2026). LogicCat: A Chain-of-Thought Text-to-SQL Benchmark for Complex Reasoning. Proceedings of the AAAI Conference on Artificial Intelligence, 40(36), 29958-29966. https://doi.org/10.1609/aaai.v40i36.40243

Vancouver

Liutao, Mao X, Zhang D, Li Y, LiuHaixin, KongLulu, et al. LogicCat: A Chain-of-Thought Text-to-SQL Benchmark for Complex Reasoning. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(36):29958-29966. doi:10.1609/aaai.v40i36.40243

BibTeX
@article{Liutao2026,
  author = {Liutao and Mao, Xutao and Zhang, Dixuan and Li, Yifan and LiuHaixin and KongLulu and Hou, Jiaming and Li, Rui and Li, YunLong and Zheng, Aoze and Zhang, Zhiqiang and Zhewei, Luo and Zan, Hongying and Zhang, Kunli and Peng, Min},
  title = {LogicCat: A Chain-of-Thought Text-to-SQL Benchmark for Complex Reasoning},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {36},
  pages = {29958--29966},
  doi = {10.1609/aaai.v40i36.40243}
}
Kostenlos starten →