SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 201250 of 1202 papers

TitleStatusHype
Knowledge Base Question Answering via Encoding of Complex Query GraphsCode0
Learning to Generalize Compositionally by Transferring Across Semantic Parsing TasksCode0
Compositional Semantic Parsing Across GraphbanksCode0
Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual TransferCode0
Improving Generalization in Semantic Parsing by Increasing Natural Language VariationCode0
Incorporating Graph Information in Transformer-based AMR ParsingCode0
Compositionality as Lexical SymmetryCode0
Compositional Task-Oriented Parsing as Abstractive Question AnsweringCode0
Compositional Generalization without Trees using Multiset Tagging and Latent PermutationsCode0
Joint Universal Syntactic and Semantic ParsingCode0
Compositional Generalization with Grounded Language ModelsCode0
A Split-and-Recombine Approach for Follow-up Query AnalysisCode0
Interactive Instance-based Evaluation of Knowledge Base Question AnsweringCode0
Compositional generalization in semantic parsing with pretrained transformersCode0
Learning Algebraic Recombination for Compositional GeneralizationCode0
Compositional Generalization in Semantic Parsing: Pre-training vs. Specialized ArchitecturesCode0
A Sketch-Based System for Semantic ParsingCode0
Content Differences in Syntactic and Semantic RepresentationsCode0
Imitation Learning of Agenda-based Semantic ParsersCode0
Content Enhanced BERT-based Text-to-SQL GenerationCode0
TAGPRIME: A Unified Framework for Relational Structure ExtractionCode0
Learning Neural Sequence-to-Sequence Models from Weak Feedback with Bipolar Ramp LossCode0
Compositional Generalization and Natural Language Variation: Can a Semantic Parsing Approach Handle Both?Code0
Compositional Generalisation with Structured Reordering and Fertility LayersCode0
Cross-lingual AMR Aligner: Paying Attention to Cross-AttentionCode0
Context Transformer with Stacked Pointer Networks for Conversational Question Answering over Knowledge GraphsCode0
Improving a Neural Semantic Parser by Counterfactual Learning from Human Bandit FeedbackCode0
Learning to Generalize from Sparse and Underspecified RewardsCode0
Neural Semantic Parsing by Character-based Translation: Experiments with Abstract Meaning RepresentationsCode0
Complex Question Decomposition for Semantic ParsingCode0
Greedy, Joint Syntactic-Semantic Parsing with Stack LSTMsCode0
Good-Enough Compositional Data AugmentationCode0
Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL ParsingCode0
A Grammar-Based Structural CNN Decoder for Code GenerationCode0
Conversational Semantic Parsing using Dynamic Context GraphsCode0
A Transition-Based Directed Acyclic Graph Parser for UCCACode0
Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic ParsingCode0
CORD: A Consolidated Receipt Dataset for Post-OCR ParsingCode0
Global Reasoning over Database Structures for Text-to-SQL ParsingCode0
Coarse-to-Fine Decoding for Neural Semantic ParsingCode0
Correcting Semantic Parses with Natural Language through Dynamic Schema EncodingCode0
Counterfactual Explanations for Natural Language InterfacesCode0
Counterfactual Learning from Human Proofreading Feedback for Semantic ParsingCode0
Memory-Based Semantic ParsingCode0
Meta-Learning a Cross-lingual Manifold for Semantic ParsingCode0
A Benchmark for Generalizable and Interpretable Temporal Question Answering over Knowledge BasesCode0
Generic Axiomatization of Families of Noncrossing Graphs in Dependency ParsingCode0
Crake: Causal-Enhanced Table-Filler for Question Answering over Large Scale Knowledge BaseCode0
Creation of a Balanced State-of-the-Art Multilayer Corpus for NLUCode0
Function Assistant: A Tool for NL Querying of APIsCode0
Show:102550
← PrevPage 5 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified