Text-To-SQL

Text-to-SQL is a task in natural language processing (NLP) where the goal is to automatically generate SQL queries from natural language text. The task involves converting the text input into a structured representation and then using this representation to generate a semantically correct SQL query that can be executed on a database.

( Image credit: SyntaxSQLNet )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 351–375 of 424 papers

Title	Date	Tasks	Status	Hype
Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing	Mar 3, 2021	Data AugmentationQuestion Generation	—Unverified	0
An Investigation Between Schema Linking and Text-to-SQL Performance	Feb 3, 2021	Text to SQLText-To-SQL	CodeCode Available	1
GP: Context-free Grammar Pre-training for Text-to-SQL Parsers	Jan 25, 2021	DecoderSentence	—Unverified	0
Dynamic Hybrid Relation Network for Cross-Domain Context-Dependent Semantic Parsing	Jan 5, 2021	Dialogue State TrackingInductive Bias	CodeCode Available	1
SCoRe: Pre-Training for Context Representation in Conversational Semantic Parsing	Jan 1, 2021	Dialogue State TrackingLanguage Modeling	—Unverified	0
Optimizing Deeper Transformers on Small Datasets	Dec 30, 2020	Reading ComprehensionSemantic Parsing	CodeCode Available	1
Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing	Dec 23, 2020	DecoderDeep Attention	CodeCode Available	1
MT-Teql: Evaluating and Augmenting Consistency of Text-to-SQL Models with Metamorphic Testing	Dec 21, 2020	Text to SQLText-To-SQL	—Unverified	0
Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training	Dec 18, 2020	Language ModelingLanguage Modelling	CodeCode Available	1
Mention Extraction and Linking for SQL Query Generation	Dec 18, 2020	Sentenceslot-filling	—Unverified	0
Tracking Interaction States for Multi-Turn Text-to-SQL Semantic Parsing	Dec 9, 2020	Graph Neural NetworkSemantic Parsing	CodeCode Available	0
PG-GSQL: Pointer-Generator Network with Guide Decoding for Cross-Domain Context-Dependent Text-to-SQL Generation	Dec 1, 2020	DecoderText to SQL	CodeCode Available	0
SQL Generation via Machine Reading Comprehension	Dec 1, 2020	Machine Reading ComprehensionQuestion Answering	CodeCode Available	0
A Review of Cross-Domain Text-to-SQL Models	Dec 1, 2020	Text to SQLText-To-SQL	—Unverified	0
AirConcierge: Generating Task-Oriented Dialogue via Efficient Large-Scale Knowledge Retrieval	Nov 20, 2020	RetrievalTask-Oriented Dialogue Systems	CodeCode Available	0
IGSQL: Database Schema Interaction Graph Based Neural Model for Context-Dependent Text-to-SQL Generation	Nov 11, 2020	Text to SQLText-To-SQL	CodeCode Available	1
"What Do You Mean by That?" A Parser-Independent Interactive Approach for Enhancing Text-to-SQL	Nov 9, 2020	Text to SQLText-To-SQL	—Unverified	0
SeqGenSQL -- A Robust Sequence Generation Model for Structured Query Language	Nov 7, 2020	Text GenerationText to SQL	CodeCode Available	2
ColloQL: Robust Text-to-SQL Over Search Queries	Nov 1, 2020	Data AugmentationText to SQL	CodeCode Available	0
Service-oriented Text-to-SQL Parsing	Nov 1, 2020	Information RetrievalNatural Language Inference	—Unverified	0
``What Do You Mean by That?'' A Parser-Independent Interactive Approach for Enhancing Text-to-SQL	Nov 1, 2020	Text to SQLText-To-SQL	—Unverified	0
Re-examining the Role of Schema Linking in Text-to-SQL	Nov 1, 2020	Text to SQLText-To-SQL	—Unverified	0
DuSQL: A Large-Scale and Pragmatic Chinese Text-to-SQL Dataset	Nov 1, 2020	SQL ParsingText to SQL	—Unverified	0
Structure-Grounded Pretraining for Text-to-SQL	Oct 24, 2020	Text to SQLText-To-SQL	—Unverified	0
Did You Ask a Good Question? A Cross-Domain Question Intention Classification Benchmark for Text-to-SQL	Oct 23, 2020	Text to SQLText-To-SQL	CodeCode Available	1

Show:10 25 50

← PrevPage 15 of 17Next →

All datasets BIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)spider Spider 2.0 SParC KaggleDBQA SEDE SQL-Eval Text-To-SQL

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Human Performance	Execution Accurarcy (Human)	92.96	—	Unverified
2	XiYan-SQL	Execution Accuracy % (Test)	75.63	—	Unverified
3	DSAIR + GPT-4o	Execution Accuracy % (Test)	74.12	—	Unverified
4	CHASE-SQL + Gemini	Execution Accuracy % (Test)	74.06	—	Unverified
5	ExSL + granite-34b-code	Execution Accuracy % (Test)	73.17	—	Unverified
6	OpenSearch-SQL+ v2 + GPT-4o	Execution Accuracy % (Test)	72.28	—	Unverified
7	Distillery + GPT-4o	Execution Accuracy % (Test)	71.83	—	Unverified
8	Insights AI	Execution Accuracy % (Test)	70.26	—	Unverified
9	PURPLE + RED + GPT-4o	Execution Accuracy % (Test)	70.21	—	Unverified
10	MCTS-SQL	Execution Accuracy % (Test)	69.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	XiYan-SQL	Execution Accuracy (Test)	89.65	—	Unverified
2	PET-SQL	Execution Accuracy (Test)	87.6	—	Unverified
3	datagpt-sql-7B + InvalidSQL-Feedback	Execution Accuracy (Dev)	87.2	—	Unverified
4	DAIL-SQL + GPT-4 + Self-Consistency	Execution Accuracy (Test)	86.6	—	Unverified
5	DIN-SQL + GPT-4	Execution Accuracy (Test)	85.3	—	Unverified
6	datagpt-sql-7B	Execution Accuracy (Dev)	84.8	—	Unverified
7	MSc-SQL	Execution Accuracy (Test)	84.7	—	Unverified
8	MARLO + Claude 2.1	Execution Accuracy (Test)	84	—	Unverified
9	C3 + ChatGPT + Zero-Shot	Execution Accuracy (Test)	82.3	—	Unverified
10	code-davinci-002 175B (LEVER)	Execution Accuracy (Dev)	81.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Spider-Agent + o1-preview	Success Rate	17.03	—	Unverified
2	Spider-Agent + GPT-4o	Success Rate	10.13	—	Unverified
3	Spider-Agent + Claude-3.5-Sonnect	Success Rate	9.02	—	Unverified
4	Spider-Agent + GPT-4	Success Rate	8.86	—	Unverified
5	Spider-Agent + Qwen2.5-72B	Success Rate	6.17	—	Unverified
6	Spider-Agent + DeepSeek-V2.5	Success Rate	5.22	—	Unverified
7	Spider-Agent + Gemini-Pro-1.5	Success Rate	2.53	—	Unverified
8	Spider-Agent + Llama-3.1-405B	Success Rate	2.21	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RASAT+PICARD	interaction match accuracy	45.2	—	Unverified
2	RAT-SQL-TC + GAP	interaction match accuracy	43.2	—	Unverified
3	HIE-SQL + GraPPa	interaction match accuracy	42.9	—	Unverified
4	RAT-SQL + SCoRe	interaction match accuracy	38.1	—	Unverified
5	EditSQL + BERT	interaction match accuracy	25.3	—	Unverified
6	GAZP + BERT	interaction match accuracy	23.5	—	Unverified
7	SyntaxSQL-con	interaction match accuracy	5.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RAT-SQL	Exact Match (EM)	26.77	—	Unverified
2	Edit-SQL	Exact Match (EM)	11.73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	T5-Large	PCM-F1 (dev)	48.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	XiYan-SQL	Execution Accuracy	69.86	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Orange-mini	0-shot MRR	74.17	—	Unverified