Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 26–50 of 1202 papers

Title	Date	Tasks	Status	Hype
Differentiable Tree Operations Promote Compositional Generalization	Jun 1, 2023	Semantic ParsingText Generation	CodeCode Available	1
Grammar Prompting for Domain-Specific Language Generation with Large Language Models	May 30, 2023	In-Context LearningSemantic Parsing	CodeCode Available	1
Improving Generalization in Language Model-Based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-Based Techniques	May 27, 2023	Domain GeneralizationLanguage Modeling	CodeCode Available	1
Generating Data for Symbolic Language with Large Language Models	May 23, 2023	Code GenerationSemantic Parsing	CodeCode Available	1
Fine-tuned LLMs Know More, Hallucinate Less with Few-Shot Sequence-to-Sequence Semantic Parsing over Wikidata	May 23, 2023	Knowledge Base Question AnsweringKnowledge Graphs	CodeCode Available	1
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages	May 19, 2023	In-Context LearningMultilingual NLP	CodeCode Available	1
Learning to Simulate Natural Language Feedback for Interactive Semantic Parsing	May 14, 2023	Semantic ParsingText to SQL	CodeCode Available	1
Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLs	May 4, 2023	Semantic ParsingSQL Parsing	CodeCode Available	1
Evaluating statistical language models as pragmatic reasoners	May 1, 2023	NegationSemantic Parsing	CodeCode Available	1
DPF: Learning Dense Prediction Fields with Weak Supervision	Mar 29, 2023	Intrinsic Image DecompositionPrediction	CodeCode Available	1
ReCOGS: How Incidental Details of a Logical Form Overshadow an Evaluation of Semantic Interpretation	Mar 24, 2023	FormSemantic Parsing	CodeCode Available	1
Open-source Frame Semantic Parsing	Mar 22, 2023	Semantic Parsing	CodeCode Available	1
Can ChatGPT Replace Traditional KBQA Models? An In-depth Analysis of the Question Answering Performance of the GPT LLM Family	Mar 14, 2023	Knowledge Base Question AnsweringLanguage Modeling	CodeCode Available	1
LEVER: Learning to Verify Language-to-Code Generation with Execution	Feb 16, 2023	Arithmetic ReasoningCode Generation	CodeCode Available	1
NL2CMD: An Updated Workflow for Natural Language to Bash Commands Translation	Feb 15, 2023	Code TranslationDiversity	CodeCode Available	1
Compositional Exemplars for In-context Learning	Feb 11, 2023	Code GenerationContrastive Learning	CodeCode Available	1
Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoning	Jan 31, 2023	HallucinationSemantic Parsing	CodeCode Available	1
Semantic Parsing for Conversational Question Answering over Knowledge Graphs	Jan 28, 2023	Conversational Question AnsweringKnowledge Graphs	CodeCode Available	1
OccluMix: Towards De-Occlusion Virtual Try-on by Semantically-Guided Mixup	Jan 3, 2023	Semantic ParsingVirtual Try-on	CodeCode Available	1
Diverse Demonstrations Improve In-context Compositional Generalization	Dec 13, 2022	In-Context LearningSemantic Parsing	CodeCode Available	1
CST5: Data Augmentation for Code-Switched Semantic Parsing	Nov 14, 2022	Data AugmentationSemantic Parsing	CodeCode Available	1
Calibrated Interpretation: Confidence Estimation in Semantic Parsing	Nov 14, 2022	Semantic Parsing	CodeCode Available	1
ReaRev: Adaptive Reasoning for Question Answering over Knowledge Graphs	Oct 24, 2022	Graph Question AnsweringKnowledge Graphs	CodeCode Available	1
ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples	Oct 22, 2022	Fact VerificationQuestion Answering	CodeCode Available	1
SpCQL: A Semantic Parsing Dataset for Converting Natural Language into Cypher	Oct 17, 2022	Natural Language QueriesSemantic Parsing	CodeCode Available	1

Show:10 25 50

← PrevPage 2 of 49Next →

All datasets WikiTableQuestions spider CFQ WebQuestionsSP WikiSQL ATIS Geo PTG (czech, MRP 2020)AMR (chinese, MRP 2020)AMR (english, MRP 2020)DRG (english, MRP 2020)DRG (german, MRP 2020)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ARTEMIS-DA	Accuracy (Test)	80.8	—	Unverified
2	SynTQA (Oracle)	Test Accuracy	77.5	—	Unverified
3	TabLaP	Accuracy (Test)	76.6	—	Unverified
4	SynTQA (GPT)	Accuracy (Test)	74.4	—	Unverified
5	Mix SC	Accuracy (Test)	73.6	—	Unverified
6	SynTQA (RF)	Accuracy (Test)	71.6	—	Unverified
7	CABINET	Accuracy (Test)	69.1	—	Unverified
8	NormTab+TabSQLify	Accuracy (Test)	68.63	—	Unverified
9	Chain-of-Table	Accuracy (Test)	67.31	—	Unverified
10	Tab-PoT	Accuracy (Test)	66.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RESDSQL-3B + NatSQL	Accuracy	84.1	—	Unverified
2	code-davinci-002 175B (LEVER)	Accuracy	81.9	—	Unverified
3	RASAT+PICARD	Accuracy	75.5	—	Unverified
4	Graphix-3B + PICARD	Accuracy	74	—	Unverified
5	T5-3B + PICARD	Accuracy	71.9	—	Unverified
6	SADGA + GAP	Accuracy	70.1	—	Unverified
7	RATSQL + GAP	Accuracy	69.7	—	Unverified
8	RATSQL + Grammar-Augmented Pre-Training	Accuracy	69.6	—	Unverified
9	RATSQL + BERT	Accuracy	65.6	—	Unverified
10	Exact Set Matching	Accuracy	19.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dynamic Least-to-Most Prompting	Exact Match	95	—	Unverified
2	LeAR	Exact Match	90.9	—	Unverified
3	T5-3B w/ Intermediate Representations	Exact Match	83.8	—	Unverified
4	Hierarchical Poset Decoding	Exact Match	69	—	Unverified
5	Universal Transformer	Exact Match	18.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReaRev	Accuracy	76.4	—	Unverified
2	NSM+h	Accuracy	74.3	—	Unverified
3	CBR-KBQA	Accuracy	70	—	Unverified
4	STAGG (Yih et al., 2016)	Accuracy	63.9	—	Unverified
5	T5-11B (Raffel et al., 2020)	Accuracy	56.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CABINET	Denotation accuracy (test)	89.5	—	Unverified
2	TAPEX-Large (weak supervision)	Denotation accuracy (test)	89.5	—	Unverified
3	ReasTAP-Large (weak supervision)	Denotation accuracy (test)	89.2	—	Unverified
4	NL2SQL-BERT	Accuracy	89	—	Unverified
5	TAPAS-Large (weak supervision)	Denotation accuracy (test)	83.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PhraseTransformer	Accuracy	90.4	—	Unverified
2	Tranx	Accuracy	86.2	—	Unverified
3	ASN (Rabinovich et al., 2017)	Accuracy	85.3	—	Unverified
4	ZH15 (Zhao and Huang, 2015)	Accuracy	84.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	coarse2fine	Accuracy	88.2	—	Unverified
2	PhraseTransformer	Accuracy	87.9	—	Unverified
3	Tranx	Accuracy	87.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN + RobeCzech	F1	92.36	—	Unverified
2	PERIN	F1	92.24	—	Unverified
3	HUJI-KU	F1	58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.52	—	Unverified
2	HUJI-KU	F1	45	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.23	—	Unverified
2	HUJI-KU	F1	52	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	94.16	—	Unverified
2	HUJI-KU	F1	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.83	—	Unverified
2	HUJI-KU	F1	62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	92.73	—	Unverified
2	HUJI-KU	F1	80	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.19	—	Unverified
2	HUJI-KU	F1	54	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAPEX-Large	Denotation Accuracy	74.5	—	Unverified
2	TAPAS-Large	Accuracy	67.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	76.4	—	Unverified
2	HUJI-KU	F1	73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	81.01	—	Unverified
2	HUJI-KU	F1	75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HSP	EM	66.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReasonBERTR	F1 Score	41.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MeMCE	Exact	40.3	—	Unverified