SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 9511000 of 1202 papers

TitleStatusHype
Hyperedge Replacement and Nonprojective Dependency Structures0
IHS-RD-Belarus at SemEval-2016 Task 9: Transition-based Chinese Semantic Dependency Parsing with Online Reordering and Bootstrapping.0
Scalable Statistical Relational Learning for NLP0
Question Answering over Knowledge Base using Factual Memory Networks0
Deterministic natural language generation from meaning representations for machine translation0
Detecting novel metaphor using selectional preference information0
Cross-Lingual Question Answering Using Common Semantic Space0
Probabilistic Models for Learning a Semantic Parser Lexicon0
A Corpus and Semantic Parser for Multilingual Natural Language Querying of OpenStreetMap0
WHUNlp at SemEval-2016 Task DiMSUM: A Pilot Study in Detecting Minimal Semantic Units and their Meanings using Supervised Models0
UCL+Sheffield at SemEval-2016 Task 8: Imitation learning for AMR parsing with an alpha-bound0
Supertagging With LSTMs0
3D Semantic Parsing of Large-Scale Indoor Spaces0
The Meaning Factory at SemEval-2016 Task 8: Producing AMRs with Boxer0
Web Chat Conversations from Contact Centers: a Descriptive Study0
More than Word Cooccurrence: Exploring Support and Opposition in International Climate Negotiations with Semantic Parsing0
Towards Comparability of Linguistic Graph Banks for Semantic Parsing0
Enhancing The RATP-DECODA Corpus With Linguistic Annotations For Performing A Large Range Of NLP Tasks0
Construction of an English Dependency Corpus incorporating Compound Function Words0
Learning Executable Semantic Parsers for Natural Language Understanding0
Question Answering on Freebase via Relation Extraction and Textual EvidenceCode0
Paraphrase Generation from Latent-Variable PCFGs for Semantic Parsing0
Joint learning of ontology and semantic parser from text0
Learning to Make Inferences in a Semantic Parsing Task0
Transforming Dependency Structures to Logical Forms for Semantic ParsingCode0
Learning the Semantics of Manipulation Action0
Extracting Biomolecular Interactions Using Semantic Parsing of Biomedical TextCode0
Neural Enquirer: Learning to Query Tables with Natural Language0
Inducing Implicit Arguments from Comparable Texts: A Framework and Its Applications0
Improving Semantic Parsing with Enriched Synchronous Context-Free Grammar0
A Strong Lexical Matching Method for the Machine Comprehension Test0
Semantic Parsing via l_0-norm-based Alignment0
Joint A* CCG Parsing and Semantic Role Labelling0
Solving Geometry Problems: Combining Text and Diagram InterpretationCode0
Semantic Framework for Comparison Structures in Natural Language0
Any-language frame-semantic parsing0
Reversibility reconsidered: finite-state factors for efficient probabilistic sampling in parsing and generation0
Broad-coverage CCG Semantic Parsing with AMR0
ERSOM: A Structural Ontology Matching Approach Using Automatically Learned Entity Representation0
Automatically Solving Number Word Problems by Semantic Parsing and Reasoning0
A Supervised Semantic Parsing with Lexicon Extension and Syntactic Constraint0
Simple, Fast Semantic Parsing with a Tensor Kernel0
Scalable Semantic Parsing with Partial Ontologies0
NiuParser: A Chinese Syntactic and Semantic Parsing Toolkit0
Constrained Semantic Forests for Improved Discriminative Semantic Parsing0
Question Answering over Freebase with Multi-Column Convolutional Neural Networks0
End-to-end learning of semantic role labeling using recurrent neural networks0
Scalable Large-Margin Structured Learning: Theory and Algorithms0
Frame-Semantic Role Labeling with Heterogeneous Annotations0
Round trips with meaning stopovers0
Show:102550
← PrevPage 20 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified