SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 701750 of 1202 papers

TitleStatusHype
The Logic of AMR: Practical, Unified, Graph-Based Sentence Semantics for NLP0
The Meaning Factory at SemEval-2016 Task 8: Producing AMRs with Boxer0
The Meaning Factory at SemEval-2017 Task 9: Producing AMRs with Neural Semantic Parsing0
The Multilingual Paraphrase Database0
The Norwegian Dependency Treebank0
The Power of Prompt Tuning for Low-Resource Semantic Parsing0
The Power of Prompt Tuning for Low-Resource Semantic Parsing0
The Procedure of Lexico-Semantic Annotation of Sk Treebank0
The Role of CNL and AMR in Scalable Abstractive Summarization for Multilingual Media Monitoring0
The SUMMA Platform Prototype0
The Value of Semantic Parse Labeling for Knowledge Base Question Answering0
Thirty Musts for Meaning Banking0
Tidying up the Basement: A Tale of Large-Scale Parsing on National eInfrastructure0
Token and Type Constraints for Cross-Lingual Part-of-Speech Tagging0
Toward a Neural Semantic Parsing System for EHR Question Answering0
Toward Code Generation: A Survey and Lessons from Semantic Parsing0
Toward Data-Driven Tutorial Question Answering with Deep Learning Conversational Models0
Towards AMR-BR: A SemBank for Brazilian Portuguese Language0
Towards Broad-coverage Meaning Representation: The Case of Comparison Structures0
Towards Collaborative Neural-Symbolic Graph Semantic Parsing via Uncertainty0
Towards Collaborative Neural-Symbolic Graph Semantic Parsing via Uncertainty0
Towards Comparability of Linguistic Graph Banks for Semantic Parsing0
Towards Compositionally Generalizable Semantic Parsing in Large Language Models: A Survey0
Towards Knowledge-Intensive Text-to-SQL Semantic Parsing with Formulaic Knowledge0
Towards Problem Solving Agents that Communicate and Learn0
Towards README-EVAL : Interpreting README File Instructions0
Towards Surface Realization with CCGs Induced from Dependencies0
Towards Theme Detection in Personal Finance Questions0
Towards Transparent Interactive Semantic Parsing via Step-by-Step Correction0
Towards Universal Semantic Tagging0
Towards Zero-Shot Frame Semantic Parsing with Task Agnostic Ontologies and Simple Labels0
Training a Korean SRL System with Rich Morphological Features0
Training an adaptive dialogue policy for interactive learning of visually grounded word meanings0
Training Table Question Answering via SQL Query Decomposition0
Universal Decompositional Semantic Parsing0
Transferable Natural Language Interface to Structured Queries aided by Adversarial Generation0
Transfer Learning for Neural Semantic Parsing0
Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing0
Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing0
Transformer Semantic Parsing0
Transition-based Abstract Meaning Representation Parsing with Contextual Embeddings0
Transition-based DRS Parsing Using Stack-LSTMs0
Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Data0
Translating a Math Word Problem to a Expression Tree0
Translating Natural Language to SQL using Pointer-Generator Networks and How Decoding Order Matters0
Translating Questions to SQL Queries with Generative Parsers Discriminatively Reranked0
Translational Symmetry-Aware Facade Parsing for 3D Building Reconstruction0
TreePiece: Faster Semantic Parsing via Tree Tokenization0
T\"upa at SemEval-2019 Task1: (Almost) feature-free Semantic Parsing0
Turku: Broad-Coverage Semantic Parsing with Rich Features0
Show:102550
← PrevPage 15 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified