SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 851900 of 1202 papers

TitleStatusHype
Measuring and Reducing Model Update Regression in Structured Prediction for NLP0
Metagross: Meta Gated Recursive Controller Units for Sequence Modeling0
Meta-Learning for Domain Generalization in Semantic Parsing0
Modeling Global Semantics for Question Answering over Knowledge Bases0
Modeling Syntactic and Semantic Structures in Hierarchical Phrase-based Translation0
Modelling Events through Memory-based, Open-IE Patterns for Abstractive Summarization0
Modelling Natural Language, Programs, and their Intersection0
Models of Semantic Representation with Visual Attributes0
More than Word Cooccurrence: Exploring Support and Opposition in International Climate Negotiations with Semantic Parsing0
Morpho-syntactic Lexical Generalization for CCG Semantic Parsing0
MT/IE: Cross-lingual Open Information Extraction with Neural Sequence-to-Sequence Models0
MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmark0
Multi-hop Question Answering over Knowledge Graphs using Large Language Models0
Multi-level Alignment Pretraining for Multi-lingual Semantic Parsing0
Multilingual Abstract Meaning Representation for Celtic Languages0
Multilingual eXtended WordNet Knowledge Base: Semantic Parsing and Translation of Glosses0
Multilingual Information Extraction with PolyglotIE0
Multilingual Semantic Parsing : Parsing Multiple Languages into Semantic Representations0
Multilingual Supervision of Semantic Annotation0
Multimodal Logical Inference System for Visual-Textual Entailment0
Multi-Module System for Open Domain Chinese Question Answering over Knowledge Base0
Multiple Tasks Integration: Tagging, Syntactic and Semantic Parsing as a Single Task0
Multi-Predicate Semantic Role Labeling0
MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing0
Multi-Task Learning for Semantic Parsing with Cross-Domain Sketch0
Multi-VALUE: A Framework for Cross-Dialectal English NLP0
Natural Language Interface for Databases Using a Dual-Encoder Model0
Natural Language Interfaces for Tabular Data Querying and Visualization: A Survey0
Neural Architectures for Multilingual Semantic Parsing0
Neural Compositional Denotational Semantics for Question Answering0
Neural Enquirer: Learning to Query Tables in Natural Language0
Neural Enquirer: Learning to Query Tables with Natural Language0
Neural Machine Translation for Bilingually Scarce Scenarios: A Deep Multi-task Learning Approach0
Neural Models for Source Code Synthesis and Completion0
Neural Program Planner for Structured Predictions0
Neural Semantic Parsing0
Neural Semantic Parsing in Low-Resource Settings with Back-Translation and Meta-Learning0
Neural sentence generation from formal semantics0
Neural Shift-Reduce CCG Semantic Parsing0
Neural-Symbolic Inference for Robust Autoregressive Graph Parsing via Compositional Uncertainty Quantification0
Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision (Short Version)0
Neural-Symbolic Recursive Machine for Systematic Generalization0
NiuParser: A Chinese Syntactic and Semantic Parsing Toolkit0
NLP for Precision Medicine0
Noise Robust Named Entity Understanding for Voice Assistants0
Nonparametric Scene Parsing with Adaptive Feature Relevance and Semantic Context0
Normalizing Compositional Structures Across Graphbanks0
NoSta-D Named Entity Annotation for German: Guidelines and Dataset0
Not an Interlingua, But Close: Comparison of English AMRs to Chinese and Czech0
Novel positional encodings to enable tree-structured transformers0
Show:102550
← PrevPage 18 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified