Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 926–950 of 1202 papers

Title	Date	Tasks	Status
Philosophers are Mortal: Inferring the Truth of Unseen Facts	Aug 1, 2013	Common Sense ReasoningMachine Translation	—Unverified
Point-of-Interest Oriented Question Answering with Joint Inference of Semantic Matching and Distance Correlation	Dec 1, 2020	Question AnsweringRetrieval	—Unverified
Policy Shaping and Generalized Update Equations for Semantic Parsing from Denotations	Sep 5, 2018	Question AnsweringSemantic Parsing	—Unverified
Positional Attention-based Frame Identification with BERT: A Deep Learning Approach to Target Disambiguation and Semantic Frame Selection	Oct 31, 2019	Language ModelingLanguage Modelling	—Unverified
Practical Semantic Parsing for Spoken Language Understanding	Mar 11, 2019	Multi-Task LearningQuestion Answering	—Unverified
Predicate Matrix: extending SemLink through WordNet mappings	May 1, 2014	Natural Language InferenceQuestion Answering	—Unverified
Predicting Coreference in Abstract Meaning Representations	Dec 1, 2020	Abstract Meaning Representationcoreference-resolution	—Unverified
Predicting generalization performance with correctness discriminators	Nov 15, 2023	Semantic Parsing	—Unverified
Predicting Structures in NLP: Constrained Conditional Models and Integer Linear Programming in NLP	Jun 1, 2012	Dependency ParsingFeature Engineering	—Unverified
Predicting the Compositionality of Nominal Compounds: Giving Word Embeddings a Hard Time	Aug 1, 2016	LemmatizationMachine Translation	—Unverified
Priberam: A Turbo Semantic Parser with Second Order Features	Aug 1, 2014	Dependency ParsingSemantic Parsing	—Unverified
Probabilistic Dialogue Models with Prior Domain Knowledge	Jul 1, 2012	Dialogue ManagementSemantic Parsing	—Unverified
Probabilistic modeling of the syntax semantic interface using probabilistic context free grammars, Experiments with FrameNet (Mod\'elisation probabiliste de l'interface syntaxe s\'emantique \`a l'aide de grammaires hors contexte probabilistes Exp\'eriences avec FrameNet) [in French]	Jul 1, 2014	Semantic Parsing	—Unverified
Probabilistic Models for Learning a Semantic Parser Lexicon	Jun 1, 2016	Semantic Parsing	—Unverified
Probabilistic Type Theory for Incremental Dialogue Processing	Apr 1, 2014	Dialogue ManagementSemantic Parsing	—Unverified
How Proficient Are Large Language Models in Formal Languages? An In-Depth Insight for Knowledge Base Question Answering	Jan 11, 2024	In-Context LearningKnowledge Base Question Answering	—Unverified
Proceedings of the ACL 2014 Workshop on Semantic Parsing	Jun 1, 2014	Semantic Parsing	—Unverified
Proceedings of the IWCS Shared Task on Semantic Parsing	May 1, 2019	Semantic Parsing	—Unverified
Project Notes on building a conversational parser on top of a text parser: Towards a causal language tagger for spoken Chinese	Jan 1, 2017	Semantic Parsing	—Unverified
QAF: Frame Semantics-based Question Interpretation	Dec 1, 2016	Knowledge Base Question AnsweringQuestion Answering	—Unverified
QuaRel: A Dataset and Models for Answering Questions about Qualitative Relationships	Nov 20, 2018	FrictionSemantic Parsing	—Unverified
QUEST: A Natural Language Interface to Relational Databases	May 1, 2018	Relation ExtractionSemantic Parsing	—Unverified
Question Answering over Freebase with Multi-Column Convolutional Neural Networks	Jul 1, 2015	Multi-Task LearningQuestion Answering	—Unverified
Leveraging Abstract Meaning Representation for Knowledge Base Question Answering	Dec 3, 2020	Abstract Meaning RepresentationEntity Linking	—Unverified
Question Answering over Knowledge Base using Factual Memory Networks	Jun 1, 2016	Information RetrievalKnowledge Base Question Answering	—Unverified

Show:10 25 50

← PrevPage 38 of 49Next →

All datasets WikiTableQuestions spider CFQ WebQuestionsSP WikiSQL ATIS Geo PTG (czech, MRP 2020)AMR (chinese, MRP 2020)AMR (english, MRP 2020)DRG (english, MRP 2020)DRG (german, MRP 2020)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ARTEMIS-DA	Accuracy (Test)	80.8	—	Unverified
2	SynTQA (Oracle)	Test Accuracy	77.5	—	Unverified
3	TabLaP	Accuracy (Test)	76.6	—	Unverified
4	SynTQA (GPT)	Accuracy (Test)	74.4	—	Unverified
5	Mix SC	Accuracy (Test)	73.6	—	Unverified
6	SynTQA (RF)	Accuracy (Test)	71.6	—	Unverified
7	CABINET	Accuracy (Test)	69.1	—	Unverified
8	NormTab+TabSQLify	Accuracy (Test)	68.63	—	Unverified
9	Chain-of-Table	Accuracy (Test)	67.31	—	Unverified
10	Tab-PoT	Accuracy (Test)	66.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RESDSQL-3B + NatSQL	Accuracy	84.1	—	Unverified
2	code-davinci-002 175B (LEVER)	Accuracy	81.9	—	Unverified
3	RASAT+PICARD	Accuracy	75.5	—	Unverified
4	Graphix-3B + PICARD	Accuracy	74	—	Unverified
5	T5-3B + PICARD	Accuracy	71.9	—	Unverified
6	SADGA + GAP	Accuracy	70.1	—	Unverified
7	RATSQL + GAP	Accuracy	69.7	—	Unverified
8	RATSQL + Grammar-Augmented Pre-Training	Accuracy	69.6	—	Unverified
9	RATSQL + BERT	Accuracy	65.6	—	Unverified
10	Exact Set Matching	Accuracy	19.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dynamic Least-to-Most Prompting	Exact Match	95	—	Unverified
2	LeAR	Exact Match	90.9	—	Unverified
3	T5-3B w/ Intermediate Representations	Exact Match	83.8	—	Unverified
4	Hierarchical Poset Decoding	Exact Match	69	—	Unverified
5	Universal Transformer	Exact Match	18.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReaRev	Accuracy	76.4	—	Unverified
2	NSM+h	Accuracy	74.3	—	Unverified
3	CBR-KBQA	Accuracy	70	—	Unverified
4	STAGG (Yih et al., 2016)	Accuracy	63.9	—	Unverified
5	T5-11B (Raffel et al., 2020)	Accuracy	56.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CABINET	Denotation accuracy (test)	89.5	—	Unverified
2	TAPEX-Large (weak supervision)	Denotation accuracy (test)	89.5	—	Unverified
3	ReasTAP-Large (weak supervision)	Denotation accuracy (test)	89.2	—	Unverified
4	NL2SQL-BERT	Accuracy	89	—	Unverified
5	TAPAS-Large (weak supervision)	Denotation accuracy (test)	83.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PhraseTransformer	Accuracy	90.4	—	Unverified
2	Tranx	Accuracy	86.2	—	Unverified
3	ASN (Rabinovich et al., 2017)	Accuracy	85.3	—	Unverified
4	ZH15 (Zhao and Huang, 2015)	Accuracy	84.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	coarse2fine	Accuracy	88.2	—	Unverified
2	PhraseTransformer	Accuracy	87.9	—	Unverified
3	Tranx	Accuracy	87.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN + RobeCzech	F1	92.36	—	Unverified
2	PERIN	F1	92.24	—	Unverified
3	HUJI-KU	F1	58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.52	—	Unverified
2	HUJI-KU	F1	45	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.23	—	Unverified
2	HUJI-KU	F1	52	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	94.16	—	Unverified
2	HUJI-KU	F1	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.83	—	Unverified
2	HUJI-KU	F1	62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	92.73	—	Unverified
2	HUJI-KU	F1	80	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.19	—	Unverified
2	HUJI-KU	F1	54	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAPEX-Large	Denotation Accuracy	74.5	—	Unverified
2	TAPAS-Large	Accuracy	67.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	76.4	—	Unverified
2	HUJI-KU	F1	73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	81.01	—	Unverified
2	HUJI-KU	F1	75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HSP	EM	66.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReasonBERTR	F1 Score	41.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MeMCE	Exact	40.3	—	Unverified