Text-To-SQL
Text-to-SQL is a task in natural language processing (NLP) where the goal is to automatically generate SQL queries from natural language text. The task involves converting the text input into a structured representation and then using this representation to generate a semantically correct SQL query that can be executed on a database.
( Image credit: SyntaxSQLNet )
Papers
Showing 1–10 of 424 papers
All datasetsBIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQL Evaluation)spiderSpider 2.0SParCKaggleDBQASEDESQL-EvalText-To-SQL
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Spider-Agent + o1-preview | Success Rate | 17.03 | — | Unverified |
| 2 | Spider-Agent + GPT-4o | Success Rate | 10.13 | — | Unverified |
| 3 | Spider-Agent + Claude-3.5-Sonnect | Success Rate | 9.02 | — | Unverified |
| 4 | Spider-Agent + GPT-4 | Success Rate | 8.86 | — | Unverified |
| 5 | Spider-Agent + Qwen2.5-72B | Success Rate | 6.17 | — | Unverified |
| 6 | Spider-Agent + DeepSeek-V2.5 | Success Rate | 5.22 | — | Unverified |
| 7 | Spider-Agent + Gemini-Pro-1.5 | Success Rate | 2.53 | — | Unverified |
| 8 | Spider-Agent + Llama-3.1-405B | Success Rate | 2.21 | — | Unverified |