Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 151–175 of 1202 papers

Title	Date	Tasks	Status	Hype	Score
Learning to Synthesize Data for Semantic Parsing	Apr 12, 2021	Domain GeneralizationSemantic Parsing	CodeCode Available	1	5
Neural Machine Translation for Query Construction and Composition	Jun 27, 2018	Code GenerationKnowledge Base Question Answering	CodeCode Available	1	5
Optimizing Deeper Transformers on Small Datasets	Dec 30, 2020	Reading ComprehensionSemantic Parsing	CodeCode Available	1	5
Syntax-augmented Multilingual BERT for Cross-lingual Transfer	Jun 3, 2021	Cross-Lingual Transfernamed-entity-recognition	CodeCode Available	1	5
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering	Jul 8, 2022	Question AnsweringRetrieval	CodeCode Available	1	5
Break It Down: A Question Understanding Benchmark	Jan 31, 2020	Open-Domain Question AnsweringQuestion Answering	CodeCode Available	1	5
CST5: Data Augmentation for Code-Switched Semantic Parsing	Nov 14, 2022	Data AugmentationSemantic Parsing	CodeCode Available	1	5
Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing	Dec 23, 2020	DecoderDeep Attention	CodeCode Available	1	5
A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualization	Feb 4, 2019	DecoderSemantic Parsing	CodeCode Available	1	5
Handling Ontology Gaps in Semantic Parsing	Jun 27, 2024	HallucinationQuestion Answering	CodeCode Available	0	5
Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm	Jul 25, 2023	AttributeData Augmentation	CodeCode Available	0	5
Imitation Learning of Agenda-based Semantic Parsers	Jan 1, 2015	Imitation LearningQuestion Answering	CodeCode Available	0	5
AMUSE: Multilingual Semantic Parsing for Question Answering over Linked Data	Feb 26, 2018	FormKnowledge Base Question Answering	CodeCode Available	0	5
Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing	Jan 18, 2023	Domain GeneralizationInductive Bias	CodeCode Available	0	5
Greedy, Joint Syntactic-Semantic Parsing with Stack LSTMs	Jun 29, 2016	Semantic Parsing	CodeCode Available	0	5
Generic Axiomatization of Families of Noncrossing Graphs in Dependency Parsing	Jul 1, 2017	Dependency ParsingSemantic Parsing	CodeCode Available	0	5
A Transition-Based Directed Acyclic Graph Parser for UCCA	Apr 3, 2017	Semantic ParsingUCCA Parsing	CodeCode Available	0	5
Generic Axiomatization of Families of Noncrossing Graphs in Dependency Parsing	Jun 11, 2017	Dependency ParsingSemantic Parsing	CodeCode Available	0	5
A Tale of Two Linkings: Dynamically Gating between Schema Linking and Structural Linking for Text-to-SQL Parsing	Sep 30, 2020	Graph Neural NetworkSemantic Parsing	CodeCode Available	0	5
A Syntactic Neural Model for General-Purpose Code Generation	Apr 6, 2017	Code GenerationSemantic Parsing	CodeCode Available	0	5
Generative Face Completion	Apr 19, 2017	Facial InpaintingSemantic Parsing	CodeCode Available	0	5
Global Reasoning over Database Structures for Text-to-SQL Parsing	Aug 29, 2019	Graph Neural NetworkSemantic Parsing	CodeCode Available	0	5
Fully-Semantic Parsing and Generation: the BabelNet Meaning Representation	May 1, 2022	Natural Language UnderstandingSemantic Parsing	CodeCode Available	0	5
Function Assistant: A Tool for NL Querying of APIs	Jun 1, 2017	Natural Language QueriesSemantic Parsing	CodeCode Available	0	5
Cross-lingual AMR Aligner: Paying Attention to Cross-Attention	Jun 15, 2022	Abstract Meaning RepresentationSemantic Parsing	CodeCode Available	0	5

Show:10 25 50

← PrevPage 7 of 49Next →

All datasets WikiTableQuestions spider CFQ WebQuestionsSP WikiSQL ATIS Geo PTG (czech, MRP 2020)AMR (chinese, MRP 2020)AMR (english, MRP 2020)DRG (english, MRP 2020)DRG (german, MRP 2020)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ARTEMIS-DA	Accuracy (Test)	80.8	—	Unverified
2	SynTQA (Oracle)	Test Accuracy	77.5	—	Unverified
3	TabLaP	Accuracy (Test)	76.6	—	Unverified
4	SynTQA (GPT)	Accuracy (Test)	74.4	—	Unverified
5	Mix SC	Accuracy (Test)	73.6	—	Unverified
6	SynTQA (RF)	Accuracy (Test)	71.6	—	Unverified
7	CABINET	Accuracy (Test)	69.1	—	Unverified
8	NormTab+TabSQLify	Accuracy (Test)	68.63	—	Unverified
9	Chain-of-Table	Accuracy (Test)	67.31	—	Unverified
10	Tab-PoT	Accuracy (Test)	66.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RESDSQL-3B + NatSQL	Accuracy	84.1	—	Unverified
2	code-davinci-002 175B (LEVER)	Accuracy	81.9	—	Unverified
3	RASAT+PICARD	Accuracy	75.5	—	Unverified
4	Graphix-3B + PICARD	Accuracy	74	—	Unverified
5	T5-3B + PICARD	Accuracy	71.9	—	Unverified
6	SADGA + GAP	Accuracy	70.1	—	Unverified
7	RATSQL + GAP	Accuracy	69.7	—	Unverified
8	RATSQL + Grammar-Augmented Pre-Training	Accuracy	69.6	—	Unverified
9	RATSQL + BERT	Accuracy	65.6	—	Unverified
10	Exact Set Matching	Accuracy	19.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dynamic Least-to-Most Prompting	Exact Match	95	—	Unverified
2	LeAR	Exact Match	90.9	—	Unverified
3	T5-3B w/ Intermediate Representations	Exact Match	83.8	—	Unverified
4	Hierarchical Poset Decoding	Exact Match	69	—	Unverified
5	Universal Transformer	Exact Match	18.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReaRev	Accuracy	76.4	—	Unverified
2	NSM+h	Accuracy	74.3	—	Unverified
3	CBR-KBQA	Accuracy	70	—	Unverified
4	STAGG (Yih et al., 2016)	Accuracy	63.9	—	Unverified
5	T5-11B (Raffel et al., 2020)	Accuracy	56.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CABINET	Denotation accuracy (test)	89.5	—	Unverified
2	TAPEX-Large (weak supervision)	Denotation accuracy (test)	89.5	—	Unverified
3	ReasTAP-Large (weak supervision)	Denotation accuracy (test)	89.2	—	Unverified
4	NL2SQL-BERT	Accuracy	89	—	Unverified
5	TAPAS-Large (weak supervision)	Denotation accuracy (test)	83.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PhraseTransformer	Accuracy	90.4	—	Unverified
2	Tranx	Accuracy	86.2	—	Unverified
3	ASN (Rabinovich et al., 2017)	Accuracy	85.3	—	Unverified
4	ZH15 (Zhao and Huang, 2015)	Accuracy	84.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	coarse2fine	Accuracy	88.2	—	Unverified
2	PhraseTransformer	Accuracy	87.9	—	Unverified
3	Tranx	Accuracy	87.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN + RobeCzech	F1	92.36	—	Unverified
2	PERIN	F1	92.24	—	Unverified
3	HUJI-KU	F1	58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.52	—	Unverified
2	HUJI-KU	F1	45	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.23	—	Unverified
2	HUJI-KU	F1	52	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	94.16	—	Unverified
2	HUJI-KU	F1	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.83	—	Unverified
2	HUJI-KU	F1	62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	92.73	—	Unverified
2	HUJI-KU	F1	80	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.19	—	Unverified
2	HUJI-KU	F1	54	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAPEX-Large	Denotation Accuracy	74.5	—	Unverified
2	TAPAS-Large	Accuracy	67.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	76.4	—	Unverified
2	HUJI-KU	F1	73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	81.01	—	Unverified
2	HUJI-KU	F1	75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HSP	EM	66.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReasonBERTR	F1 Score	41.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MeMCE	Exact	40.3	—	Unverified