SOTAVerified

Text-To-SQL

Text-to-SQL is a task in natural language processing (NLP) where the goal is to automatically generate SQL queries from natural language text. The task involves converting the text input into a structured representation and then using this representation to generate a semantically correct SQL query that can be executed on a database.

( Image credit: SyntaxSQLNet )

Papers

Showing 301350 of 424 papers

TitleStatusHype
Schema-Aware Multi-Task Learning for Complex Text-to-SQL0
SchemaGraphSQL: Efficient Schema Linking with Pathfinding Graph Algorithms for Text-to-SQL on Large-Scale Databases0
Controllable Data Augmentation for Context-Dependent Text-to-SQL0
SCoRe: Pre-Training for Context Representation in Conversational Semantic Parsing0
SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes0
Contrato360 2.0: A Document and Database-Driven Question-Answer System using Large Language Models and Agents0
SeaD: End-to-end Text-to-SQL Generation with Schema-aware Denoising0
CogniSQL-R1-Zero: Lightweight Reinforced Reasoning for Efficient SQL Generation0
A Benchmark to Understand the Role of Knowledge Graphs on Large Language Model's Accuracy for Question Answering on Enterprise SQL Databases0
Archer: A Human-Labeled Text-to-SQL Dataset with Arithmetic, Commonsense and Hypothetical Reasoning0
Self-supervised Text-to-SQL Learning with Header Alignment Training0
An Actor-Critic Approach to Boosting Text-to-SQL Large Language Model0
CoddLLM: Empowering Large Language Models for Data Analytics0
Cheaper, Better, Faster, Stronger: Robust Text-to-SQL without Chain-of-Thought or Fine-Tuning0
Semantic Evaluation for Text-to-SQL with Distilled Test Suite0
Semantic Parsing for Complex Data Retrieval: Targeting Query Plans vs. SQL for No-Code Access to Relational Databases0
UniSAr: A Unified Structure-Aware Autoregressive Language Model for Text-to-SQL0
CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQL0
Chase: A Large-Scale and Pragmatic Chinese Dataset for Cross-Database Context-Dependent Text-to-SQL0
Service-oriented Text-to-SQL Parsing0
SeSQL: Yet Another Large-scale Session-level Chinese Text-to-SQL Dataset0
UniSAr: A Unified Structure-Aware Autoregressive Language Model for Text-to-SQL0
SHARE: An SLM-based Hierarchical Action CorREction Assistant for Text-to-SQL0
Ambiguity Resolution in Text-to-Structured Data Mapping0
Solid-SQL: Enhanced Schema-linking based In-context Learning for Robust Text-to-SQL0
UNJOIN: Enhancing Multi-Table Text-to-SQL Generation via Schema Simplification0
Sparks of Tabular Reasoning via Text2SQL Reinforcement Learning0
CEGI: Measuring the trade-off between efficiency and carbon emissions for SLMs and VLMs0
CCoE: A Compact LLM with Collaboration of Experts0
Speak to your Parser: Interactive Text-to-SQL with Natural Language Feedback0
Speech-to-SQL Parsing: Error Correction with Multi-modal Representations0
Speech-to-SQL: Towards Speech-driven SQL Query Generation From Natural Language Question0
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows0
Calibrating LLMs for Text-to-SQL Parsing by Leveraging Sub-clause Frequencies0
SPSQL: Step-by-step Parsing Based Framework for Text-to-SQL Generation0
R^3: "This is My SQL, Are You With Me?" A Consensus-Based Multi-Agent System for Text-to-SQL Tasks0
SQLCritic: Correcting Text-to-SQL Generation via Clause-wise Critic0
SQLens: An End-to-End Framework for Error Detection and Correction in Text-to-SQL0
Bridging the Generalization Gap in Text-to-SQL Parsing with Schema Expansion0
SQLForge: Synthesizing Reliable and Diverse Data to Enhance Text-to-SQL Reasoning in LLMs0
Addressing Limitations of Encoder-Decoder Based Approach to Text-to-SQL0
SQLfuse: Enhancing Text-to-SQL Performance through Comprehensive LLM Synergy0
SQL-GEN: Bridging the Dialect Gap for Text-to-SQL Via Synthetic Data And Model Merging0
Unmasking Database Vulnerabilities: Zero-Knowledge Schema Inference Attacks in Text-to-SQL Systems0
Bridging the Gap: Transforming Natural Language Questions into SQL Queries via Abstract Query Pattern and Contextual Schema Markup0
Beyond Text-to-SQL for IoT Defense: A Comprehensive Framework for Querying and Classifying IoT Threats0
SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)0
SQLPrompt: In-Context Text-to-SQL with Minimal Labeled Data0
SQL-to-Schema Enhances Schema Linking in Text-to-SQL0
STAR: SQL Guided Pre-Training for Context-dependent Text-to-SQL Parsing0
Show:102550
← PrevPage 7 of 9Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Human PerformanceExecution Accurarcy (Human)92.96Unverified
2XiYan-SQLExecution Accuracy % (Test)75.63Unverified
3DSAIR + GPT-4oExecution Accuracy % (Test)74.12Unverified
4CHASE-SQL + GeminiExecution Accuracy % (Test)74.06Unverified
5ExSL + granite-34b-codeExecution Accuracy % (Test)73.17Unverified
6OpenSearch-SQL+ v2 + GPT-4oExecution Accuracy % (Test)72.28Unverified
7Distillery + GPT-4oExecution Accuracy % (Test)71.83Unverified
8Insights AIExecution Accuracy % (Test)70.26Unverified
9PURPLE + RED + GPT-4oExecution Accuracy % (Test)70.21Unverified
10MCTS-SQLExecution Accuracy % (Test)69.4Unverified
#ModelMetricClaimedVerifiedStatus
1XiYan-SQLExecution Accuracy (Test)89.65Unverified
2PET-SQLExecution Accuracy (Test)87.6Unverified
3datagpt-sql-7B + InvalidSQL-FeedbackExecution Accuracy (Dev)87.2Unverified
4DAIL-SQL + GPT-4 + Self-ConsistencyExecution Accuracy (Test)86.6Unverified
5DIN-SQL + GPT-4Execution Accuracy (Test)85.3Unverified
6datagpt-sql-7BExecution Accuracy (Dev)84.8Unverified
7MSc-SQLExecution Accuracy (Test)84.7Unverified
8MARLO + Claude 2.1Execution Accuracy (Test)84Unverified
9C3 + ChatGPT + Zero-ShotExecution Accuracy (Test)82.3Unverified
10code-davinci-002 175B (LEVER)Execution Accuracy (Dev)81.9Unverified
#ModelMetricClaimedVerifiedStatus
1Spider-Agent + o1-previewSuccess Rate17.03Unverified
2Spider-Agent + GPT-4oSuccess Rate10.13Unverified
3Spider-Agent + Claude-3.5-SonnectSuccess Rate9.02Unverified
4Spider-Agent + GPT-4Success Rate8.86Unverified
5Spider-Agent + Qwen2.5-72BSuccess Rate6.17Unverified
6Spider-Agent + DeepSeek-V2.5Success Rate5.22Unverified
7Spider-Agent + Gemini-Pro-1.5Success Rate2.53Unverified
8Spider-Agent + Llama-3.1-405BSuccess Rate2.21Unverified
#ModelMetricClaimedVerifiedStatus
1RASAT+PICARDinteraction match accuracy45.2Unverified
2RAT-SQL-TC + GAPinteraction match accuracy43.2Unverified
3HIE-SQL + GraPPainteraction match accuracy42.9Unverified
4RAT-SQL + SCoReinteraction match accuracy38.1Unverified
5EditSQL + BERTinteraction match accuracy25.3Unverified
6GAZP + BERTinteraction match accuracy23.5Unverified
7SyntaxSQL-coninteraction match accuracy5.2Unverified
#ModelMetricClaimedVerifiedStatus
1RAT-SQLExact Match (EM)26.77Unverified
2Edit-SQLExact Match (EM)11.73Unverified
#ModelMetricClaimedVerifiedStatus
1T5-LargePCM-F1 (dev)48.2Unverified
#ModelMetricClaimedVerifiedStatus
1XiYan-SQLExecution Accuracy69.86Unverified
#ModelMetricClaimedVerifiedStatus
1Orange-mini0-shot MRR74.17Unverified