SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 501550 of 1202 papers

TitleStatusHype
Advancing Seq2seq with Joint Paraphrase Learning0
Accurate polyglot semantic parsing with DAG grammars0
\'UFAL at MRP 2020: Permutation-invariant Semantic Parsing in PERINCode1
LIMIT-BERT : Linguistics Informed Multi-Task BERTCode0
An Instance Level Approach for Shallow Semantic Parsing in Scientific Procedural Text0
Benchmarking Meaning Representations in Neural Semantic ParsingCode1
Compositional Generalization and Natural Language Variation: Can a Semantic Parsing Approach Handle Both?Code0
Conversational Semantic Parsing for Dialog State TrackingCode1
FLIN: A Flexible Natural Language Interface for Web Navigation0
Overcoming Conflicting Data when Updating a Neural Semantic ParserCode0
SmBoP: Semi-autoregressive Bottom-up Semantic ParsingCode1
Meta-Learning for Domain Generalization in Semantic Parsing0
Compositional Generalization via Semantic Tagging0
On the Potential of Lexico-logical Alignments for Semantic Parsing to SQL QueriesCode1
Open-Domain Frame Semantic Parsing Using TransformersCode1
Improving Company Valuations with Automated Knowledge Discovery, Extraction and Fusion0
Hierarchical Poset Decoding for Compositional Generalization in Language0
Update Frequently, Update Fast: Retraining Semantic Parsing Systems in a Fraction of Time0
Improving Compositional Generalization in Semantic ParsingCode1
HUJI-KU at MRP~2020: Two Transition-based Neural Parsers0
COGS: A Compositional Generalization Challenge Based on Semantic InterpretationCode1
Learning Adaptive Language Interfaces through Decomposition0
Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings0
AutoQA: From Databases To QA Semantic Parsers With Only Synthetic Training DataCode1
Word Level Language Identification in English Telugu Code Mixed Data0
Don't Parse, Insert: Multilingual Semantic Parsing with Insertion Based Decoding0
Adaptive Self-training for Few-shot Neural Sequence Labeling0
Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic Parsing0
A Pilot Study of Text-to-SQL Semantic Parsing for VietnameseCode1
A Tale of Two Linkings: Dynamically Gating between Schema Linking and Structural Linking for Text-to-SQL ParsingCode0
GraPPa: Grammar-Augmented Pre-Training for Table Semantic ParsingCode1
A Survey on Semantic Parsing from the perspective of Compositionality0
Conversational Semantic Parsing0
N-LTP: An Open-source Neural Language Technology Platform for ChineseCode3
Progressive Semantic-Aware Style Transformation for Blind Face RestorationCode1
Grounded Adaptation for Zero-shot Executable Semantic ParsingCode1
Leveraging Semantic Parsing for Relation Linking over Knowledge BasesCode1
Fast semantic parsing with well-typedness guarantees0
Span-based Semantic Parsing for Compositional GeneralizationCode1
MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmark0
Person image generation with semantic attention network for person re-identification0
Depressive, Drug Abusive, or Informative: Knowledge-aware Study of News Exposure during COVID-19 Outbreak0
Identity-Guided Human Semantic Parsing for Person Re-IdentificationCode1
A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challenges0
Compositional Generalization in Semantic Parsing: Pre-training vs. Specialized ArchitecturesCode0
KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge BaseCode1
DART: Open-Domain Structured Data Record to Text GenerationCode1
Semantic Evaluation for Text-to-SQL with Distilled Test Suite0
CraftAssist Instruction Parsing: Semantic Parsing for a Voxel-World Assistant0
Learning Web-based Procedures by Reasoning over Explanations and Demonstrations in Context0
Show:102550
← PrevPage 11 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified