SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 10011050 of 1202 papers

TitleStatusHype
Question Answering over Freebase with Multi-Column Convolutional Neural Networks0
Graph parsing with s-graph grammars0
End-to-end learning of semantic role labeling using recurrent neural networks0
Environment-Driven Lexicon Induction for High-Level InstructionsCode0
Language to Code: Learning Semantic Parsers for If-This-Then-That Recipes0
Event Detection and Domain Adaptation with Convolutional Neural NetworksCode0
Scalable Semantic Parsing with Partial Ontologies0
Joint Case Argument Identification for Japanese Predicate Argument Structure Analysis0
Frame-Semantic Role Labeling with Heterogeneous Annotations0
Unsupervised Semantic Parsing of Video Collections0
Interpreting Questions with a Log-Linear Ranking Model in a Virtual Patient Dialogue System0
Identifying Various Kinds of Event Mentions in K-Parser Output0
Riga: from FrameNet to Semantic Frames with C6.0 Rules0
Turku: Semantic Dependency Parsing as a Sequence Classification0
Event Extraction as Frame-Semantic Parsing0
Lean Question Answering over Freebase from Scratch0
Book Reviews: Ontology-Based Interpretation of Natural Language by Philipp Cimiano, Christina Unger and John McCrae0
Using Positional Suffix Trees to Perform Agile Tree Kernel Calculation0
Open-Domain Semantic Parsing with Boxer0
Deep Learning and Continuous Representations for Natural Language Processing0
The Logic of AMR: Practical, Unified, Graph-Based Sentence Semantics for NLP0
Semantic parsing of speech using grammars learned with weak supervision0
Response-based Learning for Machine Translation of Open-domain Database Queries0
Because Syntax Does Matter: Improving Predicate-Argument Structures Parsing with Syntactic Features0
Grounded Semantic Parsing for Complex Knowledge Extraction0
On the Proper Treatment of Quantifiers in Probabilistic Logic Semantics0
Layers of Interpretation: On Grammar and Compositionality0
Parsing Software Requirements with an Ontology-based Semantic Role Labeler0
Semantic construction with graph grammars0
Rapid FrameNet annotation of spoken conversation transcripts0
Learning a Compositional Semantics for Freebase with an Open Predicate Vocabulary0
Domain Adaptation for Syntactic and Semantic Dependency Parsing Using Deep Belief Networks0
Efficient Inference and Structured Learning for Semantic Role Labeling0
Imitation Learning of Agenda-based Semantic ParsersCode0
Semantic Parsing of Ambiguous Input through Paraphrasing and Verification0
Supertagging: Introduction, learning, and application0
Robust Semantics for Semantic Parsing0
Type-Driven Incremental Semantic Parsing with Polymorphism0
Comparing Representations of Semantic Roles for String-To-Tree Decoding0
Morpho-syntactic Lexical Generalization for CCG Semantic Parsing0
Joint Relational Embeddings for Knowledge-based Question Answering0
Semantic Parsing with Relaxed Hybrid Trees0
Semantic Kernels for Semantic Parsing0
Semantic Parsing Using Content and Context: A Case Study from Requirements Elicitation0
Multi-Predicate Semantic Role Labeling0
Werdy: Recognition and Disambiguation of Verbs and Verb Phrases with Syntactic and Semantic Pruning0
Learning Compact Lexicons for CCG Semantic Parsing0
Multilingual Semantic Parsing : Parsing Multiple Languages into Semantic Representations0
Global Methods for Cross-lingual Semantic Role and Predicate Labelling0
Argument structure of adverbial derivatives in Russian0
Show:102550
← PrevPage 21 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified