SOTAVerified

Text-To-SQL

Text-to-SQL is a task in natural language processing (NLP) where the goal is to automatically generate SQL queries from natural language text. The task involves converting the text input into a structured representation and then using this representation to generate a semantically correct SQL query that can be executed on a database.

( Image credit: SyntaxSQLNet )

Papers

Showing 151200 of 424 papers

TitleStatusHype
Semi-Automatic Construction of Text-to-SQL Data for Domain TransferCode0
SParC: Cross-Domain Semantic Parsing in ContextCode0
Selective Demonstrations for Cross-domain Text-to-SQLCode0
Improving Text-to-SQL Evaluation MethodologyCode0
SelECT-SQL: Self-correcting ensemble Chain-of-Thought for Text-to-SQLCode0
DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQLCode0
AraSpider: Democratizing Arabic-to-SQLCode0
Semantic Decomposition of Question and SQL for Text-to-SQL ParsingCode0
Improving Demonstration Diversity by Human-Free Fusing for Text-to-SQLCode0
Robust Text-to-SQL Generation with Execution-Guided DecodingCode0
DAC: Decomposed Automation Correction for Text-to-SQLCode0
CSS: A Large-scale Cross-schema Chinese Text-to-SQL Medical DatasetCode0
Representing Schema Structure with Graph Neural Networks for Text-to-SQL ParsingCode0
CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to DatabasesCode0
Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL ParsingCode0
Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL ParsingCode0
ProbGate at EHRSQL 2024: Enhancing SQL Query Generation Accuracy through Probabilistic Threshold Filtering and Error HandlingCode0
Correcting Semantic Parses with Natural Language through Dynamic Schema EncodingCode0
Global Reasoning over Database Structures for Text-to-SQL ParsingCode0
OpenGrok: Enhancing SNS Data Processing with Distilled Knowledge and Mask-like MechanismsCode0
Automated Self-Refinement and Self-Correction for LLM-based Product Attribute Value ExtractionCode0
NL-EDIT: Correcting semantic parse errors through natural language interactionCode0
Federated Learning for Semantic Parsing: Task Formulation, Evaluation Setup, New AlgorithmsCode0
Pay More Attention to History: A Context Modelling Strategy for Conversational Text-to-SQLCode0
Content Enhanced BERT-based Text-to-SQL GenerationCode0
ColloQL: Robust Text-to-SQL Over Search QueriesCode0
Exploring Underexplored Limitations of Cross-Domain Text-to-SQL GeneralizationCode0
MAGNIFICo: Evaluating the In-Context Learning Ability of Large Language Models to Generalize to Novel InterpretationsCode0
Confidence Estimation for Error Detection in Text-to-SQL SystemsCode0
Benchmarking and Improving Text-to-SQL Generation under AmbiguityCode0
MURRE: Multi-Hop Table Retrieval with Removal for Open-Domain Text-to-SQLCode0
ColloQL: Robust Cross-Domain Text-to-SQL Over Search QueriesCode0
Explainable Multi-Modal Data Exploration in Natural Language via LLM AgentCode0
AnDB: Breaking Boundaries with an AI-Native Database for Universal Semantic AnalysisCode0
Text-to-SQL Generation for Question Answering on Electronic Medical RecordsCode0
Integrating question answering and text-to-SQL in PortugueseCode0
LLM-SQL-Solver: Can LLMs Determine SQL Equivalence?Code0
Evaluating the Data Model Robustness of Text-to-SQL Systems Based on Real User QueriesCode0
A Tale of Two Linkings: Dynamically Gating between Schema Linking and Structural Linking for Text-to-SQL ParsingCode0
JOLT-SQL: Joint Loss Tuning of Text-to-SQL with Confusion-aware Noisy Schema SamplingCode0
LogicCat: A Chain-of-Thought Text-to-SQL Benchmark for Multi-Domain Reasoning ChallengesCode0
Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question TypesCode0
ESM+: Modern Insights into Perspective on Text-to-SQL Evaluation in the Age of Large Language ModelsCode0
Non-Programmers Can Label Programs Indirectly via Active Examples: A Case Study with Text-to-SQLCode0
Leveraging Prior Experience: An Expandable Auxiliary Knowledge Base for Text-to-SQLCode0
Error Detection for Text-to-SQL Semantic ParsingCode0
BiomedSQL: Text-to-SQL for Scientific Reasoning on Biomedical Knowledge BasesCode0
Large Language Models are Good Multi-lingual Learners : When LLMs Meet Cross-lingual PromptsCode0
Enhancing Open-Domain Table Question Answering via Syntax- and Structure-aware Dense RetrievalCode0
Learn from Yesterday: A Semi-Supervised Continual Learning Method for Supervision-Limited Text-to-SQL Task StreamsCode0
Show:102550
← PrevPage 4 of 9Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Human PerformanceExecution Accurarcy (Human)92.96Unverified
2XiYan-SQLExecution Accuracy % (Test)75.63Unverified
3DSAIR + GPT-4oExecution Accuracy % (Test)74.12Unverified
4CHASE-SQL + GeminiExecution Accuracy % (Test)74.06Unverified
5ExSL + granite-34b-codeExecution Accuracy % (Test)73.17Unverified
6OpenSearch-SQL+ v2 + GPT-4oExecution Accuracy % (Test)72.28Unverified
7Distillery + GPT-4oExecution Accuracy % (Test)71.83Unverified
8Insights AIExecution Accuracy % (Test)70.26Unverified
9PURPLE + RED + GPT-4oExecution Accuracy % (Test)70.21Unverified
10MCTS-SQLExecution Accuracy % (Test)69.4Unverified
#ModelMetricClaimedVerifiedStatus
1XiYan-SQLExecution Accuracy (Test)89.65Unverified
2PET-SQLExecution Accuracy (Test)87.6Unverified
3datagpt-sql-7B + InvalidSQL-FeedbackExecution Accuracy (Dev)87.2Unverified
4DAIL-SQL + GPT-4 + Self-ConsistencyExecution Accuracy (Test)86.6Unverified
5DIN-SQL + GPT-4Execution Accuracy (Test)85.3Unverified
6datagpt-sql-7BExecution Accuracy (Dev)84.8Unverified
7MSc-SQLExecution Accuracy (Test)84.7Unverified
8MARLO + Claude 2.1Execution Accuracy (Test)84Unverified
9C3 + ChatGPT + Zero-ShotExecution Accuracy (Test)82.3Unverified
10code-davinci-002 175B (LEVER)Execution Accuracy (Dev)81.9Unverified
#ModelMetricClaimedVerifiedStatus
1Spider-Agent + o1-previewSuccess Rate17.03Unverified
2Spider-Agent + GPT-4oSuccess Rate10.13Unverified
3Spider-Agent + Claude-3.5-SonnectSuccess Rate9.02Unverified
4Spider-Agent + GPT-4Success Rate8.86Unverified
5Spider-Agent + Qwen2.5-72BSuccess Rate6.17Unverified
6Spider-Agent + DeepSeek-V2.5Success Rate5.22Unverified
7Spider-Agent + Gemini-Pro-1.5Success Rate2.53Unverified
8Spider-Agent + Llama-3.1-405BSuccess Rate2.21Unverified
#ModelMetricClaimedVerifiedStatus
1RASAT+PICARDinteraction match accuracy45.2Unverified
2RAT-SQL-TC + GAPinteraction match accuracy43.2Unverified
3HIE-SQL + GraPPainteraction match accuracy42.9Unverified
4RAT-SQL + SCoReinteraction match accuracy38.1Unverified
5EditSQL + BERTinteraction match accuracy25.3Unverified
6GAZP + BERTinteraction match accuracy23.5Unverified
7SyntaxSQL-coninteraction match accuracy5.2Unverified
#ModelMetricClaimedVerifiedStatus
1RAT-SQLExact Match (EM)26.77Unverified
2Edit-SQLExact Match (EM)11.73Unverified
#ModelMetricClaimedVerifiedStatus
1T5-LargePCM-F1 (dev)48.2Unverified
#ModelMetricClaimedVerifiedStatus
1XiYan-SQLExecution Accuracy69.86Unverified
#ModelMetricClaimedVerifiedStatus
1Orange-mini0-shot MRR74.17Unverified