Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 901–925 of 1202 papers

Title	Date	Tasks	Status
Object-oriented Neural Programming (OONP) for Document Understanding	Sep 26, 2017	document understandingObject	—Unverified
On Codex Prompt Engineering for OCL Generation: An Empirical Study	Mar 28, 2023	Few-Shot LearningPrompt Engineering	—Unverified
One Semantic Parser to Parse Them All: Sequence to Sequence Multi-Task Learning on Semantic Parsing Datasets	Jun 8, 2021	AllMulti-Task Learning	—Unverified
On graph-based reentrancy-free semantic parsing	Feb 15, 2023	Semantic ParsingTAG	—Unverified
Online Semantic Parsing for Latency Reduction in Task-Oriented Dialogue	May 1, 2022	Machine TranslationSemantic Parsing	—Unverified
On maximum spanning DAG algorithms for semantic DAG parsing	Jun 1, 2014	Dependency ParsingSemantic Parsing	—Unverified
On Robustness of Neural Semantic Parsers	Feb 2, 2021	Data AugmentationSemantic Parsing	—Unverified
On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codex	Jan 30, 2023	Adversarial RobustnessLanguage Modeling	—Unverified
On the Compositional Generalization Gap of In-Context Learning	Nov 15, 2022	In-Context LearningSemantic Parsing	—Unverified
On The Ingredients of an Effective Zero-shot Semantic Parser	Oct 15, 2021	DiversitySemantic Parsing	—Unverified
On the Proper Treatment of Quantifiers in Probabilistic Logic Semantics	Apr 1, 2015	Fine-Grained Opinion AnalysisNatural Language Inference	—Unverified
Open-Domain Semantic Parsing with Boxer	May 1, 2015	Semantic ParsingWord Sense Disambiguation	—Unverified
OpenQA: Hybrid QA System Relying on Structured Knowledge Base as well as Non-structured Data	Dec 31, 2021	Answer SelectionMachine Reading Comprehension	—Unverified
OPERA:Operation-Pivoted Discrete Reasoning over Text	Apr 29, 2022	Machine Reading ComprehensionReading Comprehension	—Unverified
Parameterizing Context: Unleashing the Power of Parameter-Efficient Fine-Tuning and In-Context Tuning for Continual Table Semantic Parsing	Oct 7, 2023	Continual LearningData Augmentation	—Unverified
Paraphrase for Open Question Answering: New Dataset and Methods	Jun 1, 2016	Open-Ended Question AnsweringOpen Information Extraction	—Unverified
Paraphrase Generation from Latent-Variable PCFGs for Semantic Parsing	Jan 22, 2016	Open-Domain Question AnsweringParaphrase Generation	—Unverified
Paraphrasing Revisited with Neural Machine Translation	Apr 1, 2017	Machine TranslationQuestion Answering	—Unverified
PARF: Primitive-Aware Radiance Fusion for Indoor Scene Novel View Synthesis	Sep 29, 2023	Novel View SynthesisSemantic Parsing	—Unverified
Parsing Natural Language into Propositional and First-Order Logic with Dual Reinforcement Learning	Jan 16, 2022	reinforcement-learningReinforcement Learning (RL)	—Unverified
Parsing Natural Language into Propositional and First-Order Logic with Dual Reinforcement Learning	Oct 1, 2022	Natural Language Inferencereinforcement-learning	—Unverified
Parsing Software Requirements with an Ontology-based Semantic Role Labeler	Apr 1, 2015	Semantic ParsingSemantic Role Labeling	—Unverified
Pattern Learning for Relation Extraction with a Hierarchical Topic Model	Jul 1, 2012	Information RetrievalOpen Information Extraction	—Unverified
Bifold and Semantic Reasoning for Pedestrian Behavior Prediction	Dec 6, 2020	PredictionSemantic Parsing	—Unverified
Person image generation with semantic attention network for person re-identification	Aug 18, 2020	Image GenerationPerson Re-Identification	—Unverified

Show:10 25 50

← PrevPage 37 of 49Next →

All datasets WikiTableQuestions spider CFQ WebQuestionsSP WikiSQL ATIS Geo PTG (czech, MRP 2020)AMR (chinese, MRP 2020)AMR (english, MRP 2020)DRG (english, MRP 2020)DRG (german, MRP 2020)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ARTEMIS-DA	Accuracy (Test)	80.8	—	Unverified
2	SynTQA (Oracle)	Test Accuracy	77.5	—	Unverified
3	TabLaP	Accuracy (Test)	76.6	—	Unverified
4	SynTQA (GPT)	Accuracy (Test)	74.4	—	Unverified
5	Mix SC	Accuracy (Test)	73.6	—	Unverified
6	SynTQA (RF)	Accuracy (Test)	71.6	—	Unverified
7	CABINET	Accuracy (Test)	69.1	—	Unverified
8	NormTab+TabSQLify	Accuracy (Test)	68.63	—	Unverified
9	Chain-of-Table	Accuracy (Test)	67.31	—	Unverified
10	Tab-PoT	Accuracy (Test)	66.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RESDSQL-3B + NatSQL	Accuracy	84.1	—	Unverified
2	code-davinci-002 175B (LEVER)	Accuracy	81.9	—	Unverified
3	RASAT+PICARD	Accuracy	75.5	—	Unverified
4	Graphix-3B + PICARD	Accuracy	74	—	Unverified
5	T5-3B + PICARD	Accuracy	71.9	—	Unverified
6	SADGA + GAP	Accuracy	70.1	—	Unverified
7	RATSQL + GAP	Accuracy	69.7	—	Unverified
8	RATSQL + Grammar-Augmented Pre-Training	Accuracy	69.6	—	Unverified
9	RATSQL + BERT	Accuracy	65.6	—	Unverified
10	Exact Set Matching	Accuracy	19.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dynamic Least-to-Most Prompting	Exact Match	95	—	Unverified
2	LeAR	Exact Match	90.9	—	Unverified
3	T5-3B w/ Intermediate Representations	Exact Match	83.8	—	Unverified
4	Hierarchical Poset Decoding	Exact Match	69	—	Unverified
5	Universal Transformer	Exact Match	18.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReaRev	Accuracy	76.4	—	Unverified
2	NSM+h	Accuracy	74.3	—	Unverified
3	CBR-KBQA	Accuracy	70	—	Unverified
4	STAGG (Yih et al., 2016)	Accuracy	63.9	—	Unverified
5	T5-11B (Raffel et al., 2020)	Accuracy	56.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CABINET	Denotation accuracy (test)	89.5	—	Unverified
2	TAPEX-Large (weak supervision)	Denotation accuracy (test)	89.5	—	Unverified
3	ReasTAP-Large (weak supervision)	Denotation accuracy (test)	89.2	—	Unverified
4	NL2SQL-BERT	Accuracy	89	—	Unverified
5	TAPAS-Large (weak supervision)	Denotation accuracy (test)	83.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PhraseTransformer	Accuracy	90.4	—	Unverified
2	Tranx	Accuracy	86.2	—	Unverified
3	ASN (Rabinovich et al., 2017)	Accuracy	85.3	—	Unverified
4	ZH15 (Zhao and Huang, 2015)	Accuracy	84.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	coarse2fine	Accuracy	88.2	—	Unverified
2	PhraseTransformer	Accuracy	87.9	—	Unverified
3	Tranx	Accuracy	87.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN + RobeCzech	F1	92.36	—	Unverified
2	PERIN	F1	92.24	—	Unverified
3	HUJI-KU	F1	58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.52	—	Unverified
2	HUJI-KU	F1	45	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	80.23	—	Unverified
2	HUJI-KU	F1	52	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	94.16	—	Unverified
2	HUJI-KU	F1	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.83	—	Unverified
2	HUJI-KU	F1	62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	92.73	—	Unverified
2	HUJI-KU	F1	80	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	89.19	—	Unverified
2	HUJI-KU	F1	54	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAPEX-Large	Denotation Accuracy	74.5	—	Unverified
2	TAPAS-Large	Accuracy	67.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	76.4	—	Unverified
2	HUJI-KU	F1	73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PERIN	F1	81.01	—	Unverified
2	HUJI-KU	F1	75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HSP	EM	66.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReasonBERTR	F1 Score	41.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MeMCE	Exact	40.3	—	Unverified