Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1026–1050 of 1202 papers

Title	Date	Tasks	Status
Discourse Representation Structure Parsing	Jul 1, 2018	PredictionQuestion Answering	CodeCode Available
Few-Shot Adaptation for Parsing Contextual Utterances with LLMs	Sep 18, 2023	In-Context LearningSemantic Parsing	CodeCode Available
Disambiguate First Parse Later: Generating Interpretations for Ambiguity Resolution in Semantic Parsing	Feb 25, 2025	Semantic ParsingText to SQL	CodeCode Available
Structural generalization is hard for sequence-to-sequence models	Oct 24, 2022	Semantic Parsing	CodeCode Available
Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive Evaluation	Mar 16, 2022	Data AugmentationDiversity	CodeCode Available
Digestion Algorithm in Hierarchical Symbolic Forests: A Fast Text Normalization Algorithm and Semantic Parsing Framework for Specific Scenarios and Lightweight Deployment	Dec 18, 2024	Lightweight DeploymentSemantic Parsing	CodeCode Available
On Evaluating Multilingual Compositional Generalization with Translated Datasets	Jun 20, 2023	Machine TranslationSemantic Parsing	CodeCode Available
Unobserved Local Structures Make Compositional Generalization Hard	Jan 15, 2022	Semantic Parsing	CodeCode Available
Interactive Instance-based Evaluation of Knowledge Base Question Answering	Nov 1, 2018	Entity LinkingKnowledge Base Question Answering	CodeCode Available
Federated Learning for Semantic Parsing: Task Formulation, Evaluation Setup, New Algorithms	May 26, 2023	Federated LearningSemantic Parsing	CodeCode Available
Transparent Semantic Parsing with Universal Dependencies Using Graph Transformations	Oct 1, 2022	Semantic Parsing	CodeCode Available
A Syntactic Neural Model for General-Purpose Code Generation	Apr 6, 2017	Code GenerationSemantic Parsing	CodeCode Available
Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning	Aug 21, 2018	Hierarchical Reinforcement Learningreinforcement-learning	CodeCode Available
Fast Intent Classification for Spoken Language Understanding	Dec 3, 2019	ClassificationDecision Making	CodeCode Available
Compositional generalization in semantic parsing with pretrained transformers	Sep 30, 2021	Out-of-Distribution GeneralizationSemantic Parsing	CodeCode Available
Compositional Generalization in Semantic Parsing: Pre-training vs. Specialized Architectures	Jul 17, 2020	Language ModelingLanguage Modelling	CodeCode Available
Semantic Parsing by Large Language Models for Intricate Updating Strategies of Zero-Shot Dialogue State Tracking	Oct 16, 2023	Dialogue State TrackingIn-Context Learning	CodeCode Available
A Split-and-Recombine Approach for Follow-up Query Analysis	Sep 19, 2019	Natural Language QueriesSemantic Parsing	CodeCode Available
Dialog-to-Action: Conversational Question Answering Over a Large-Scale Knowledge Base	Dec 1, 2018	Conversational Question AnsweringDecoder	CodeCode Available
Content Enhanced BERT-based Text-to-SQL Generation	Oct 16, 2019	Code GenerationSemantic Parsing	CodeCode Available
Ontology-Guided, Hybrid Prompt Learning for Generalization in Knowledge Graph Question Answering	Feb 6, 2025	Graph Question AnsweringKnowledge Graphs	CodeCode Available
Decoupling Structure and Lexicon for Zero-Shot Semantic Parsing	Apr 21, 2018	FormSemantic Parsing	CodeCode Available
SUBS: Subtree Substitution for Compositional Semantic Parsing	May 3, 2022	Data AugmentationSemantic Parsing	CodeCode Available
Dealing with Co-reference in Neural Semantic Parsing	Sep 1, 2017	AMR ParsingSemantic Parsing	CodeCode Available
Towards Autoformalization of Mathematics and Code Correctness: Experiments with Elementary Proofs	Jan 5, 2023	Mathematical ProofsSemantic Parsing	CodeCode Available

Show:10 25 50

← PrevPage 42 of 49Next →

All datasets WikiTableQuestions spider CFQ WebQuestionsSP WikiSQL ATIS Geo PTG (czech, MRP 2020)AMR (chinese, MRP 2020)AMR (english, MRP 2020)DRG (english, MRP 2020)DRG (german, MRP 2020)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ARTEMIS-DA	Accuracy (Test)	80.8	—	Unverified
2	SynTQA (Oracle)	Test Accuracy	77.5	—	Unverified
3	TabLaP	Accuracy (Test)	76.6	—	Unverified
4	SynTQA (GPT)	Accuracy (Test)	74.4	—	Unverified
5	Mix SC	Accuracy (Test)	73.6	—	Unverified
6	SynTQA (RF)	Accuracy (Test)	71.6	—	Unverified
7	CABINET	Accuracy (Test)	69.1	—	Unverified
8	NormTab+TabSQLify	Accuracy (Test)	68.63	—	Unverified
9	Chain-of-Table	Accuracy (Test)	67.31	—	Unverified
10	Tab-PoT	Accuracy (Test)	66.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RESDSQL-3B + NatSQL	Accuracy	84.1	—	Unverified
2	code-davinci-002 175B (LEVER)	Accuracy	81.9	—	Unverified
3	RASAT+PICARD	Accuracy	75.5	—	Unverified
4	Graphix-3B + PICARD	Accuracy	74	—	Unverified
5	T5-3B + PICARD	Accuracy	71.9	—	Unverified
6	SADGA + GAP	Accuracy	70.1	—	Unverified
7	RATSQL + GAP	Accuracy	69.7	—	Unverified
8	RATSQL + Grammar-Augmented Pre-Training	Accuracy	69.6	—	Unverified
9	RATSQL + BERT	Accuracy	65.6	—	Unverified
10	Exact Set Matching	Accuracy	19.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dynamic Least-to-Most Prompting	Exact Match	95	—	Unverified
2	LeAR	Exact Match	90.9	—	Unverified
3	T5-3B w/ Intermediate Representations	Exact Match	83.8	—	Unverified
4	Hierarchical Poset Decoding	Exact Match	69	—	Unverified
5	Universal Transformer	Exact Match	18.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReaRev	Accuracy	76.4	—	Unverified
2	NSM+h	Accuracy	74.3	—	Unverified
3	CBR-KBQA	Accuracy	70	—	Unverified
4	STAGG (Yih et al., 2016)	Accuracy	63.9	—	Unverified
5	T5-11B (Raffel et al., 2020)	Accuracy	56.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CABINET	Denotation accuracy (test)	89.5	—	Unverified
2	TAPEX-Large (weak supervision)	Denotation accuracy (test)	89.5	—	Unverified
3	ReasTAP-Large (weak supervision)	Denotation accuracy (test)	89.2	—	Unverified
4	NL2SQL-BERT	Accuracy	89	—	Unverified
5	TAPAS-Large (weak supervision)	Denotation accuracy (test)	83.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PhraseTransformer	Accuracy	90.4	—	Unverified
2	Tranx	Accuracy	86.2	—	Unverified
3	ASN (Rabinovich et al., 2017)	Accuracy	85.3	—	Unverified
4	ZH15 (Zhao and Huang, 2015)	Accuracy	84.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	coarse2fine	Accuracy	88.2	—	Unverified
2	PhraseTransformer	Accuracy	87.9	—	Unverified
3	Tranx	Accuracy	87.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN + RobeCzech	F1	92.36	—	Unverified
2	PERIN	F1	92.24	—	Unverified
3	HUJI-KU	F1	58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.52	—	Unverified
2	HUJI-KU	F1	45	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.23	—	Unverified
2	HUJI-KU	F1	52	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	94.16	—	Unverified
2	HUJI-KU	F1	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.83	—	Unverified
2	HUJI-KU	F1	62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	92.73	—	Unverified
2	HUJI-KU	F1	80	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.19	—	Unverified
2	HUJI-KU	F1	54	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAPEX-Large	Denotation Accuracy	74.5	—	Unverified
2	TAPAS-Large	Accuracy	67.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	76.4	—	Unverified
2	HUJI-KU	F1	73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	81.01	—	Unverified
2	HUJI-KU	F1	75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HSP	EM	66.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReasonBERTR	F1 Score	41.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MeMCE	Exact	40.3	—	Unverified