SOTAVerified

Text-To-SQL

Text-to-SQL is a task in natural language processing (NLP) where the goal is to automatically generate SQL queries from natural language text. The task involves converting the text input into a structured representation and then using this representation to generate a semantically correct SQL query that can be executed on a database.

( Image credit: SyntaxSQLNet )

Papers

Showing 51100 of 424 papers

TitleStatusHype
Recent Advances in Text-to-SQL: A Survey of What We Have and What We ExpectCode1
Reward-SQL: Boosting Text-to-SQL via Stepwise Reasoning and Process-Supervised RewardsCode1
RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain DatabasesCode1
SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQLCode1
C3: Zero-shot Text-to-SQL with ChatGPTCode1
A Study of In-Context-Learning-Based Text-to-SQL ErrorsCode1
Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLsCode1
Can LLMs Effectively Leverage Graph Structural Information through Prompts, and Why?Code1
SEED: Enhancing Text-to-SQL Performance and Practical Usability Through Automatic Evidence GenerationCode1
Non-local Neural NetworksCode1
A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capabilityCode1
SPARQLing Database Queries from Intermediate Question DecompositionsCode1
Natural SQL: Making SQL Easier to Infer from Natural Language SpecificationsCode1
Optimizing Deeper Transformers on Small DatasetsCode1
Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case StudyCode1
DuoRAT: Towards Simpler Text-to-SQL ModelsCode1
Dynamic Hybrid Relation Network for Cross-Domain Context-Dependent Semantic ParsingCode1
mRAT-SQL+GAP:A Portuguese Text-to-SQL TransformerCode1
DrugEHRQA: A Question Answering Dataset on Structured and Unstructured Electronic Health Records For Medicine Related QueriesCode1
LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local RelationsCode1
MAGIC: Generating Self-Correction Guideline for In-Context Text-to-SQLCode1
BASE-SQL: A powerful open source Text-To-SQL baseline approachCode1
Dubo-SQL: Diverse Retrieval-Augmented Generation and Fine Tuning for Text-to-SQLCode1
EHR-SeqSQL : A Sequential Text-to-SQL Dataset For Interactively Exploring Electronic Health RecordsCode1
Leveraging Table Content for Zero-shot Text-to-SQL with Meta-LearningCode1
MAG-SQL: Multi-Agent Generative Approach with Soft Schema Linking and Iterative Sub-SQL Refinement for Text-to-SQLCode1
Interactive Text-to-SQL Generation via Editable Step-by-Step ExplanationsCode1
An Investigation Between Schema Linking and Text-to-SQL PerformanceCode1
Know What I don't Know: Handling Ambiguous and Unanswerable Questions for Text-to-SQLCode1
Improving Generalization in Language Model-Based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-Based TechniquesCode1
CRUSH4SQL: Collective Retrieval Using Schema Hallucination For Text2SQLCode1
In-Context Learning for Few-Shot Dialogue State TrackingCode1
A Pilot Study of Text-to-SQL Semantic Parsing for VietnameseCode1
LEVER: Learning to Verify Language-to-Code Generation with ExecutionCode1
Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-TrainingCode1
How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain SettingsCode1
An Imitation Game for Learning Semantic Parsers from User InteractionCode1
Hybrid Ranking Network for Text-to-SQLCode1
Measuring and Improving Compositional Generalization in Text-to-SQL via Component AlignmentCode1
ACT-SQL: In-Context Learning for Text-to-SQL with Automatically-Generated Chain-of-ThoughtCode1
DBCopilot: Natural Language Querying over Massive Databases via Schema RoutingCode1
MSc-SQL: Multi-Sample Critiquing Small Language Models For Text-To-SQL TranslationCode1
Augmenting Multi-Turn Text-to-SQL Datasets with Self-PlayCode1
Decomposition for Enhancing Attention: Improving LLM-based Text-to-SQL through Workflow ParadigmCode1
IGSQL: Database Schema Interaction Graph Based Neural Model for Context-Dependent Text-to-SQL GenerationCode1
Learning to Simulate Natural Language Feedback for Interactive Semantic ParsingCode1
FLEX: Expert-level False-Less EXecution Metric for Reliable Text-to-SQL BenchmarkCode1
ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL DialectsCode1
CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-EditionsCode1
GraPPa: Grammar-Augmented Pre-Training for Table Semantic ParsingCode1
Show:102550
← PrevPage 2 of 9Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Human PerformanceExecution Accurarcy (Human)92.96Unverified
2XiYan-SQLExecution Accuracy % (Test)75.63Unverified
3DSAIR + GPT-4oExecution Accuracy % (Test)74.12Unverified
4CHASE-SQL + GeminiExecution Accuracy % (Test)74.06Unverified
5ExSL + granite-34b-codeExecution Accuracy % (Test)73.17Unverified
6OpenSearch-SQL+ v2 + GPT-4oExecution Accuracy % (Test)72.28Unverified
7Distillery + GPT-4oExecution Accuracy % (Test)71.83Unverified
8Insights AIExecution Accuracy % (Test)70.26Unverified
9PURPLE + RED + GPT-4oExecution Accuracy % (Test)70.21Unverified
10MCTS-SQLExecution Accuracy % (Test)69.4Unverified
#ModelMetricClaimedVerifiedStatus
1XiYan-SQLExecution Accuracy (Test)89.65Unverified
2PET-SQLExecution Accuracy (Test)87.6Unverified
3datagpt-sql-7B + InvalidSQL-FeedbackExecution Accuracy (Dev)87.2Unverified
4DAIL-SQL + GPT-4 + Self-ConsistencyExecution Accuracy (Test)86.6Unverified
5DIN-SQL + GPT-4Execution Accuracy (Test)85.3Unverified
6datagpt-sql-7BExecution Accuracy (Dev)84.8Unverified
7MSc-SQLExecution Accuracy (Test)84.7Unverified
8MARLO + Claude 2.1Execution Accuracy (Test)84Unverified
9C3 + ChatGPT + Zero-ShotExecution Accuracy (Test)82.3Unverified
10code-davinci-002 175B (LEVER)Execution Accuracy (Dev)81.9Unverified
#ModelMetricClaimedVerifiedStatus
1Spider-Agent + o1-previewSuccess Rate17.03Unverified
2Spider-Agent + GPT-4oSuccess Rate10.13Unverified
3Spider-Agent + Claude-3.5-SonnectSuccess Rate9.02Unverified
4Spider-Agent + GPT-4Success Rate8.86Unverified
5Spider-Agent + Qwen2.5-72BSuccess Rate6.17Unverified
6Spider-Agent + DeepSeek-V2.5Success Rate5.22Unverified
7Spider-Agent + Gemini-Pro-1.5Success Rate2.53Unverified
8Spider-Agent + Llama-3.1-405BSuccess Rate2.21Unverified
#ModelMetricClaimedVerifiedStatus
1RASAT+PICARDinteraction match accuracy45.2Unverified
2RAT-SQL-TC + GAPinteraction match accuracy43.2Unverified
3HIE-SQL + GraPPainteraction match accuracy42.9Unverified
4RAT-SQL + SCoReinteraction match accuracy38.1Unverified
5EditSQL + BERTinteraction match accuracy25.3Unverified
6GAZP + BERTinteraction match accuracy23.5Unverified
7SyntaxSQL-coninteraction match accuracy5.2Unverified
#ModelMetricClaimedVerifiedStatus
1RAT-SQLExact Match (EM)26.77Unverified
2Edit-SQLExact Match (EM)11.73Unverified
#ModelMetricClaimedVerifiedStatus
1T5-LargePCM-F1 (dev)48.2Unverified
#ModelMetricClaimedVerifiedStatus
1XiYan-SQLExecution Accuracy69.86Unverified
#ModelMetricClaimedVerifiedStatus
1Orange-mini0-shot MRR74.17Unverified