Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 326–350 of 1202 papers

Title	Date	Tasks	Status
Unveiling the Black Box of PLMs with Semantic Anchors: Towards Interpretable Neural Semantic Parsing	Oct 4, 2022	DecoderHallucination	—Unverified
融合知识的多目标词联合框架语义分析模型(Knowledge-integrated Joint Model For Multi-target Frame Semantic Parsing)	Oct 1, 2022	Semantic Parsing	—Unverified
Parsing Natural Language into Propositional and First-Order Logic with Dual Reinforcement Learning	Oct 1, 2022	Natural Language Inferencereinforcement-learning	—Unverified
Transparent Semantic Parsing with Universal Dependencies Using Graph Transformations	Oct 1, 2022	Semantic Parsing	CodeCode Available
Data Synthesis and Iterative Refinement for Neural Semantic Parsing without Annotated Logical Forms	Oct 1, 2022	DenoisingLanguage Modeling	—Unverified
Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing	Oct 1, 2022	Code GenerationKnowledge Distillation	—Unverified
Generate-and-Retrieve: use your predictions to improve retrieval for semantic parsing	Sep 29, 2022	PredictionRetrieval	—Unverified
Compositional Semantic Parsing with Large Language Models	Sep 29, 2022	Semantic Parsing	—Unverified
Improving Text-to-SQL Semantic Parsing with Fine-grained Query Understanding	Sep 28, 2022	NERSemantic Parsing	—Unverified
Meta-Learning a Cross-lingual Manifold for Semantic Parsing	Sep 26, 2022	Cross-Lingual TransferMachine Translation	CodeCode Available
T5QL: Taming language models for SQL generation	Sep 21, 2022	Code GenerationRe-Ranking	—Unverified
CAE: Mechanism to Diminish the Class Imbalanced in SLU Slot Filling Task	Sep 21, 2022	intent-classificationIntent Classification	CodeCode Available
Knowledge Base Question Answering: A Semantic Parsing Perspective	Sep 12, 2022	AttributeKnowledge Base Question Answering	—Unverified
Reducing Model Churn: Stable Re-training of Conversational Agents	Sep 1, 2022	Semantic ParsingStructured Prediction	CodeCode Available
GRILLBot: An Assistant for Real-World Tasks with Neural Semantic Parsing and Graph-Based Representations	Aug 31, 2022	Semantic Parsing	—Unverified
A Survey on Table Question Answering: Recent Advances	Jul 12, 2022	Question AnsweringSemantic Parsing	—Unverified
Crake: Causal-Enhanced Table-Filler for Question Answering over Large Scale Knowledge Base	Jul 8, 2022	Question AnsweringRelation Extraction	CodeCode Available
Scene Graph Parsing via Abstract Meaning Representation in Pre-trained Language Models	Jul 1, 2022	Abstract Meaning RepresentationAMR Parsing	—Unverified
TurkishDelightNLP: A Neural Turkish NLP Toolkit	Jul 1, 2022	Dependency ParsingMorphological Tagging	CodeCode Available
Interactive Learning from Natural Language and Demonstrations using Signal Temporal Logic	Jul 1, 2022	Formal LogicQ-Learning	—Unverified
Logical Story Representations via FrameNet + Semantic Parsing	Jul 1, 2022	Formal LogicQuestion Answering	—Unverified
OPERA: Operation-Pivoted Discrete Reasoning over Text	Jul 1, 2022	Machine Reading ComprehensionReading Comprehension	CodeCode Available
STOP: A dataset for Spoken Task Oriented Semantic Parsing	Jun 29, 2022	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	—Unverified
A Double-Graph Based Framework for Frame Semantic Parsing	Jun 18, 2022	graph constructionSemantic Parsing	CodeCode Available
Cross-lingual AMR Aligner: Paying Attention to Cross-Attention	Jun 15, 2022	Abstract Meaning RepresentationSemantic Parsing	CodeCode Available

Show:10 25 50

← PrevPage 14 of 49Next →

All datasets WikiTableQuestions spider CFQ WebQuestionsSP WikiSQL ATIS Geo PTG (czech, MRP 2020)AMR (chinese, MRP 2020)AMR (english, MRP 2020)DRG (english, MRP 2020)DRG (german, MRP 2020)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ARTEMIS-DA	Accuracy (Test)	80.8	—	Unverified
2	SynTQA (Oracle)	Test Accuracy	77.5	—	Unverified
3	TabLaP	Accuracy (Test)	76.6	—	Unverified
4	SynTQA (GPT)	Accuracy (Test)	74.4	—	Unverified
5	Mix SC	Accuracy (Test)	73.6	—	Unverified
6	SynTQA (RF)	Accuracy (Test)	71.6	—	Unverified
7	CABINET	Accuracy (Test)	69.1	—	Unverified
8	NormTab+TabSQLify	Accuracy (Test)	68.63	—	Unverified
9	Chain-of-Table	Accuracy (Test)	67.31	—	Unverified
10	Tab-PoT	Accuracy (Test)	66.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RESDSQL-3B + NatSQL	Accuracy	84.1	—	Unverified
2	code-davinci-002 175B (LEVER)	Accuracy	81.9	—	Unverified
3	RASAT+PICARD	Accuracy	75.5	—	Unverified
4	Graphix-3B + PICARD	Accuracy	74	—	Unverified
5	T5-3B + PICARD	Accuracy	71.9	—	Unverified
6	SADGA + GAP	Accuracy	70.1	—	Unverified
7	RATSQL + GAP	Accuracy	69.7	—	Unverified
8	RATSQL + Grammar-Augmented Pre-Training	Accuracy	69.6	—	Unverified
9	RATSQL + BERT	Accuracy	65.6	—	Unverified
10	Exact Set Matching	Accuracy	19.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dynamic Least-to-Most Prompting	Exact Match	95	—	Unverified
2	LeAR	Exact Match	90.9	—	Unverified
3	T5-3B w/ Intermediate Representations	Exact Match	83.8	—	Unverified
4	Hierarchical Poset Decoding	Exact Match	69	—	Unverified
5	Universal Transformer	Exact Match	18.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReaRev	Accuracy	76.4	—	Unverified
2	NSM+h	Accuracy	74.3	—	Unverified
3	CBR-KBQA	Accuracy	70	—	Unverified
4	STAGG (Yih et al., 2016)	Accuracy	63.9	—	Unverified
5	T5-11B (Raffel et al., 2020)	Accuracy	56.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CABINET	Denotation accuracy (test)	89.5	—	Unverified
2	TAPEX-Large (weak supervision)	Denotation accuracy (test)	89.5	—	Unverified
3	ReasTAP-Large (weak supervision)	Denotation accuracy (test)	89.2	—	Unverified
4	NL2SQL-BERT	Accuracy	89	—	Unverified
5	TAPAS-Large (weak supervision)	Denotation accuracy (test)	83.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PhraseTransformer	Accuracy	90.4	—	Unverified
2	Tranx	Accuracy	86.2	—	Unverified
3	ASN (Rabinovich et al., 2017)	Accuracy	85.3	—	Unverified
4	ZH15 (Zhao and Huang, 2015)	Accuracy	84.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	coarse2fine	Accuracy	88.2	—	Unverified
2	PhraseTransformer	Accuracy	87.9	—	Unverified
3	Tranx	Accuracy	87.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN + RobeCzech	F1	92.36	—	Unverified
2	PERIN	F1	92.24	—	Unverified
3	HUJI-KU	F1	58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.52	—	Unverified
2	HUJI-KU	F1	45	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.23	—	Unverified
2	HUJI-KU	F1	52	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	94.16	—	Unverified
2	HUJI-KU	F1	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.83	—	Unverified
2	HUJI-KU	F1	62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	92.73	—	Unverified
2	HUJI-KU	F1	80	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.19	—	Unverified
2	HUJI-KU	F1	54	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAPEX-Large	Denotation Accuracy	74.5	—	Unverified
2	TAPAS-Large	Accuracy	67.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	76.4	—	Unverified
2	HUJI-KU	F1	73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	81.01	—	Unverified
2	HUJI-KU	F1	75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HSP	EM	66.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReasonBERTR	F1 Score	41.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MeMCE	Exact	40.3	—	Unverified