Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 151–175 of 1202 papers

Title	Date	Tasks	Status	Hype
An Investigation of LLMs' Inefficacy in Understanding Converse Relations	Oct 8, 2023	Knowledge Graph CompletionQuestion Answering	CodeCode Available	1
Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings	Feb 9, 2024	Machine TranslationQuantization	CodeCode Available	1
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning	May 10, 2021	Arithmetic ReasoningGeometry Problem Solving	CodeCode Available	1
KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge Base	Jul 8, 2020	AttributeDiagnostic	CodeCode Available	1
Language to Logical Form with Neural Attention	Jan 6, 2016	DecoderForm	CodeCode Available	1
Break It Down: A Question Understanding Benchmark	Jan 31, 2020	Open-Domain Question AnsweringQuestion Answering	CodeCode Available	1
Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training	Dec 18, 2020	Language ModelingLanguage Modelling	CodeCode Available	1
Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing	Dec 23, 2020	DecoderDeep Attention	CodeCode Available	1
A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualization	Feb 4, 2019	DecoderSemantic Parsing	CodeCode Available	1
A Unified Model for Soft Linguistic Reordering Constraints in Statistical Machine Translation	Jun 1, 2014	Machine TranslationSemantic Parsing	—Unverified	0
A Unified Framework for Structured Prediction: From Theory to Practice	Sep 1, 2017	AMR ParsingChunking	—Unverified	0
An Annotation Scheme for Quantifier Scope Disambiguation	May 1, 2012	Semantic ParsingSentence	—Unverified	0
A Unified Framework for Discourse Argument Identification via Shallow Semantic Parsing	Dec 1, 2012	ChunkingSemantic Parsing	—Unverified	0
Augmenting text for spoken language understanding with Large Language Models	Sep 17, 2023	Semantic ParsingSpoken Language Understanding	—Unverified	0
An Annotated Corpus for Machine Reading of Instructions in Wet Lab Protocols	May 1, 2018	BIG-bench Machine LearningReading Comprehension	—Unverified	0
Adapting Discriminative Reranking to Grounded Language Learning	Aug 1, 2013	Grounded language learningLanguage Acquisition	—Unverified	0
Augmenting FrameNet Via PPDB	Jun 1, 2014	Lexical AnalysisSemantic Parsing	—Unverified	0
A Type-coherent, Expressive Representation as an Initial Step to Language Understanding	Mar 22, 2019	Semantic Parsing	—Unverified	0
Analyse s\'emantique robuste par apprentissage antagoniste pour la g\'en\'eralisation de domaine (Robust Semantic Parsing with Adversarial Learning for Domain Generalization )	Jun 1, 2020	Domain GeneralizationSemantic Parsing	—Unverified	0
A Two-Stage Approach towards Generalization in Knowledge Base Question Answering	Jan 16, 2022	Knowledge Base Question AnsweringKnowledge Graphs	—Unverified	0
A Two-Stage Approach towards Generalization in Knowledge Base Question Answering	Nov 10, 2021	Knowledge Base Question AnsweringKnowledge Graphs	—Unverified	0
Adapting a FrameNet Semantic Parser for Spoken Language Understanding Using Adversarial Learning	Oct 7, 2019	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	—Unverified	0
Accurate polyglot semantic parsing with DAG grammars	Nov 1, 2020	Graph GenerationSemantic Parsing	—Unverified	0
Compositional Generalization in Dependency Parsing	Oct 13, 2021	Dependency ParsingSemantic Parsing	—Unverified	0
AT\&T: The Tag\&Parse Approach to Semantic Parsing of Robot Spatial Commands	Aug 1, 2014	Semantic ParsingTAG	—Unverified	0

Show:10 25 50

← PrevPage 7 of 49Next →

All datasets WikiTableQuestions spider CFQ WebQuestionsSP WikiSQL ATIS Geo PTG (czech, MRP 2020)AMR (chinese, MRP 2020)AMR (english, MRP 2020)DRG (english, MRP 2020)DRG (german, MRP 2020)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ARTEMIS-DA	Accuracy (Test)	80.8	—	Unverified
2	SynTQA (Oracle)	Test Accuracy	77.5	—	Unverified
3	TabLaP	Accuracy (Test)	76.6	—	Unverified
4	SynTQA (GPT)	Accuracy (Test)	74.4	—	Unverified
5	Mix SC	Accuracy (Test)	73.6	—	Unverified
6	SynTQA (RF)	Accuracy (Test)	71.6	—	Unverified
7	CABINET	Accuracy (Test)	69.1	—	Unverified
8	NormTab+TabSQLify	Accuracy (Test)	68.63	—	Unverified
9	Chain-of-Table	Accuracy (Test)	67.31	—	Unverified
10	Tab-PoT	Accuracy (Test)	66.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RESDSQL-3B + NatSQL	Accuracy	84.1	—	Unverified
2	code-davinci-002 175B (LEVER)	Accuracy	81.9	—	Unverified
3	RASAT+PICARD	Accuracy	75.5	—	Unverified
4	Graphix-3B + PICARD	Accuracy	74	—	Unverified
5	T5-3B + PICARD	Accuracy	71.9	—	Unverified
6	SADGA + GAP	Accuracy	70.1	—	Unverified
7	RATSQL + GAP	Accuracy	69.7	—	Unverified
8	RATSQL + Grammar-Augmented Pre-Training	Accuracy	69.6	—	Unverified
9	RATSQL + BERT	Accuracy	65.6	—	Unverified
10	Exact Set Matching	Accuracy	19.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dynamic Least-to-Most Prompting	Exact Match	95	—	Unverified
2	LeAR	Exact Match	90.9	—	Unverified
3	T5-3B w/ Intermediate Representations	Exact Match	83.8	—	Unverified
4	Hierarchical Poset Decoding	Exact Match	69	—	Unverified
5	Universal Transformer	Exact Match	18.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReaRev	Accuracy	76.4	—	Unverified
2	NSM+h	Accuracy	74.3	—	Unverified
3	CBR-KBQA	Accuracy	70	—	Unverified
4	STAGG (Yih et al., 2016)	Accuracy	63.9	—	Unverified
5	T5-11B (Raffel et al., 2020)	Accuracy	56.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CABINET	Denotation accuracy (test)	89.5	—	Unverified
2	TAPEX-Large (weak supervision)	Denotation accuracy (test)	89.5	—	Unverified
3	ReasTAP-Large (weak supervision)	Denotation accuracy (test)	89.2	—	Unverified
4	NL2SQL-BERT	Accuracy	89	—	Unverified
5	TAPAS-Large (weak supervision)	Denotation accuracy (test)	83.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PhraseTransformer	Accuracy	90.4	—	Unverified
2	Tranx	Accuracy	86.2	—	Unverified
3	ASN (Rabinovich et al., 2017)	Accuracy	85.3	—	Unverified
4	ZH15 (Zhao and Huang, 2015)	Accuracy	84.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	coarse2fine	Accuracy	88.2	—	Unverified
2	PhraseTransformer	Accuracy	87.9	—	Unverified
3	Tranx	Accuracy	87.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN + RobeCzech	F1	92.36	—	Unverified
2	PERIN	F1	92.24	—	Unverified
3	HUJI-KU	F1	58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.52	—	Unverified
2	HUJI-KU	F1	45	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.23	—	Unverified
2	HUJI-KU	F1	52	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	94.16	—	Unverified
2	HUJI-KU	F1	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.83	—	Unverified
2	HUJI-KU	F1	62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	92.73	—	Unverified
2	HUJI-KU	F1	80	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.19	—	Unverified
2	HUJI-KU	F1	54	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAPEX-Large	Denotation Accuracy	74.5	—	Unverified
2	TAPAS-Large	Accuracy	67.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	76.4	—	Unverified
2	HUJI-KU	F1	73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	81.01	—	Unverified
2	HUJI-KU	F1	75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HSP	EM	66.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReasonBERTR	F1 Score	41.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MeMCE	Exact	40.3	—	Unverified