SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 11511200 of 1202 papers

TitleStatusHype
Identifying Pathological Findings in German Radiology Reports Using a Syntacto-semantic Parsing Approach0
Improving machine translation by training against an automatic semantic frame based evaluation metric0
Vector Space Semantic Parsing: A Framework for Compositional Vector Space Models0
Models of Semantic Representation with Visual Attributes0
Adapting Discriminative Reranking to Grounded Language Learning0
Interpreting Situated Dialogue Utterances: an Update Model that Uses Speech, Gaze, and Gesture Information0
LOR-KBGEN, A Hybrid Approach To Generating from the KBGen Knowledge-Base0
Wordnet-Based Cross-Language Identification of Semantic Relations0
Leveraging Domain-Independent Information in Semantic Parsing0
The Effects of Lexical Resource Quality on Preference Violation Detection0
Modeling Syntactic and Semantic Structures in Hierarchical Phrase-based Translation0
Nonparametric Scene Parsing with Adaptive Feature Relevance and Semantic Context0
A Sentence Is Worth a Thousand Pixels0
SXUCFN-Core: STS Models Integrating FrameNet Parsing Information0
Semantic Parsing Freebase: Towards Open-domain Semantic Parsing0
Using Semantic Unification to Generate Regular Expressions from Natural Language0
Tidying up the Basement: A Tale of Large-Scale Parsing on National eInfrastructure0
Scope Disambiguation as a Tagging Task0
Dijkstra-WSA: A Graph-Based Approach to Word Sense Alignment0
Learning Dependency-Based Compositional SemanticsCode0
Weakly Supervised Learning of Semantic Parsers for Mapping Instructions to Actions0
Token and Type Constraints for Cross-Lingual Part-of-Speech Tagging0
Translating Questions to SQL Queries with Generative Parsers Discriminatively Reranked0
A Conditional Random Field-based Traditional Chinese Base Phrase Parser for SIGHAN Bake-off 2012 Evaluation0
Light Textual Inference for Semantic Parsing0
Semantic Parsing of Tamil Sentences0
Learning Compositional Semantics for Open Domain Semantic Parsing0
A Unified Framework for Discourse Argument Identification via Shallow Semantic Parsing0
Semantic Parsing with Bayesian Tree Transducers0
Pattern Learning for Relation Extraction with a Hierarchical Topic Model0
An Exact Dual Decomposition Algorithm for Shallow Semantic Parsing with Constraints0
ICT:A System Combination for Chinese Semantic Dependency Parsing0
Graph-based Semi-Supervised Learning Algorithms for NLP0
Unsupervised frame based Semantic Role Induction: application to French and English0
Verb Classification using Distributional Similarity in Syntactic and Semantic Structures0
Probabilistic Dialogue Models with Prior Domain Knowledge0
Weakly Supervised Training of Semantic Parsers0
Linking Named Entities to Any Database0
State-of-the-Art Kernels for Natural Language Processing0
Predicting Structures in NLP: Constrained Conditional Models and Integer Linear Programming in NLP0
Low-Dimensional Discriminative Reranking0
Knowledge Extraction and Joint Inference Using Tractable Markov Logic0
Graph-Based Lexicon Expansion with Sparsity-Inducing Penalties0
Learning to Interpret Natural Language Instructions0
Fully Automatic Semantic MT Evaluation0
Unsupervised Induction of Frame-Semantic Representations0
An Annotation Scheme for Quantifier Scope Disambiguation0
An implementation of a Latvian resource grammar in Grammatical Framework0
Lemmatising Serbian as Category Tagging with Bidirectional Sequence Classification0
Constructing Large Proposition Databases0
Show:102550
← PrevPage 24 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified