SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 651–675 of 1202 papers

TitleStatusHype
T\"upa at SemEval-2019 Task1: (Almost) feature-free Semantic Parsing—0
Turku: Broad-Coverage Semantic Parsing with Rich Features—0
Turku: Semantic Dependency Parsing as a Sequence Classification—0
Type-Driven Incremental Semantic Parsing with Polymorphism—0
UC Davis at SemEval-2019 Task 1: DAG Semantic Parsing with Attention-based Decoder—0
UCL+Sheffield at SemEval-2016 Task 8: Imitation learning for AMR parsing with an alpha-bound—0
\'UFAL-Oslo at MRP 2019: Garage Sale Semantic Parsing—0
Un algorithme d’analyse sémantique fondée sur les graphes via le problème de l’arborescence généralisée couvrante (A graph-based semantic parsing algorithm via the generalized spanning arborescence problem)—0
Unanimous Prediction for 100\% Precision with Application to Learning Semantic Mappings—0
Uncertainty and Traffic-Aware Active Learning for Semantic Parsing—0
Unfreeze with Care: Space-Efficient Fine-Tuning of Semantic Parsing Models—0
Uni-Parser: Unified Semantic Parser for Question Answering on Knowledge Base and Database—0
Universal Discourse Representation Structure Parsing—0
Universal Semantic Annotator: the First Unified API for WSD, SRL and Semantic Parsing—0
UnixMan Corpus: A Resource for Language Learning in the Unix Domain—0
Unsupervised frame based Semantic Role Induction: application to French and English—0
Unsupervised Induction of Frame-Semantic Representations—0
Unsupervised Semantic Parsing of Video Collections—0
Update Frequently, Update Fast: Retraining Semantic Parsing Systems in a Fraction of Time—0
Using C5.0 and Exhaustive Search for Boosting Frame-Semantic Parsing Accuracy—0
Using language technology resources and tools to construct Swedish FrameNet—0
Using Positional Suffix Trees to Perform Agile Tree Kernel Calculation—0
Using Semantic Unification to Generate Regular Expressions from Natural Language—0
Using Shallow Semantic Parsing and Relation Extraction for Finding Contradiction in Text—0
Usnea: An Authorship Tool for Interactive Fiction using Retrieval Based Semantic Parsing—0
Show:102550
← PrevPage 27 of 49Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8—Unverified
2SynTQA (Oracle)Test Accuracy77.5—Unverified
3TabLaPAccuracy (Test)76.6—Unverified
4SynTQA (GPT)Accuracy (Test)74.4—Unverified
5Mix SCAccuracy (Test)73.6—Unverified
6SynTQA (RF)Accuracy (Test)71.6—Unverified
7CABINETAccuracy (Test)69.1—Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63—Unverified
9Chain-of-TableAccuracy (Test)67.31—Unverified
10Tab-PoTAccuracy (Test)66.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1—Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9—Unverified
3RASAT+PICARDAccuracy75.5—Unverified
4Graphix-3B + PICARDAccuracy74—Unverified
5T5-3B + PICARDAccuracy71.9—Unverified
6SADGA + GAPAccuracy70.1—Unverified
7RATSQL + GAPAccuracy69.7—Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6—Unverified
9RATSQL + BERTAccuracy65.6—Unverified
10Exact Set MatchingAccuracy19.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95—Unverified
2LeARExact Match90.9—Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8—Unverified
4Hierarchical Poset DecodingExact Match69—Unverified
5Universal TransformerExact Match18.9—Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4—Unverified
2NSM+hAccuracy74.3—Unverified
3CBR-KBQAAccuracy70—Unverified
4STAGG (Yih et al., 2016)Accuracy63.9—Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5—Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5—Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5—Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2—Unverified
4NL2SQL-BERTAccuracy89—Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6—Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4—Unverified
2TranxAccuracy86.2—Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3—Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2—Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2—Unverified
2PhraseTransformerAccuracy87.9—Unverified
3TranxAccuracy87.7—Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36—Unverified
2PERINF192.24—Unverified
3HUJI-KUF158—Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52—Unverified
2HUJI-KUF145—Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23—Unverified
2HUJI-KUF152—Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16—Unverified
2HUJI-KUF163—Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83—Unverified
2HUJI-KUF162—Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73—Unverified
2HUJI-KUF180—Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19—Unverified
2HUJI-KUF154—Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5—Unverified
2TAPAS-LargeAccuracy67.2—Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4—Unverified
2HUJI-KUF173—Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01—Unverified
2HUJI-KUF175—Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18—Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3—Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3—Unverified