SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 11011150 of 1202 papers

TitleStatusHype
Learning Joint Semantic Parsers from Disjoint DataCode0
Learning Language Games through InteractionCode0
Learning Neural Sequence-to-Sequence Models from Weak Feedback with Bipolar Ramp LossCode0
TAPAS: Weakly Supervised Table Parsing via Pre-trainingCode0
CAE: Mechanism to Diminish the Class Imbalanced in SLU Slot Filling TaskCode0
Learning Semantic Parsers from Denotations with Latent Structured Alignments and Abstract ProgramsCode0
Evaluating Large Language Models in Semantic Parsing for Conversational Question Answering over Knowledge GraphsCode0
Weakly Supervised Semantic Parsing by Learning from MistakesCode0
Butterfly Effects in Frame Semantic Parsing: impact of data processing on model rankingCode0
Learning from Explanations with Neural Execution TreeCode0
Bootstrapping a Crosslingual Semantic ParserCode0
Learning to Generalize Compositionally by Transferring Across Semantic Parsing TasksCode0
Learning to Generalize from Sparse and Underspecified RewardsCode0
Learning to Generate Programs for Table Fact Verification via Structure-Aware Semantic ParsingCode0
A Sketch-Based System for Semantic ParsingCode0
TAGPRIME: A Unified Framework for Relational Structure ExtractionCode0
Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge BaseCode0
Benchmarking Long-tail Generalization with Likelihood SplitsCode0
Semantic Parsing with Candidate Expressions for Knowledge Base Question AnsweringCode0
Evaluating Inter-Bilingual Semantic Parsing for Indian LanguagesCode0
Evaluating Induced CCG Parsers on Grounded Semantic ParsingCode0
Program Synthesis and Semantic Parsing with Learned Code IdiomsCode0
Cross-lingual CCG InductionCode0
Cross-lingual Back-Parsing: Utterance Synthesis from Meaning Representation for Zero-Resource Semantic ParsingCode0
Learning What is Essential in QuestionsCode0
Backpropagating through Structured Argmax using a SPIGOTCode0
Establishing Strong Baselines for the New Decade: Sequence Tagging, Syntactic and Semantic Parsing with BERTCode0
Leveraging Code to Improve In-context Learning for Semantic ParsingCode0
Cross-domain Semantic Parsing via ParaphrasingCode0
Semantic Parsing with Dual LearningCode0
Error Detection for Text-to-SQL Semantic ParsingCode0
Environment-Driven Lexicon Induction for High-Level InstructionsCode0
Towards Transparent Interactive Semantic Parsing via Step-by-Step CorrectionCode0
Enhancing SPARQL Generation by Triplet-order-sensitive Pre-trainingCode0
Enforcing Consistency in Weakly Supervised Semantic ParsingCode0
Creation of a Balanced State-of-the-Art Multilayer Corpus for NLUCode0
Content Differences in Syntactic and Semantic RepresentationCode0
Question Answering on Freebase via Relation Extraction and Textual EvidenceCode0
LIMIT-BERT : Linguistics Informed Multi-Task BERTCode0
ÚFAL MRPipe at MRP 2019: UDPipe Goes Semantic in the Meaning Representation Parsing Shared TaskCode0
\'UFAL MRPipe at MRP 2019: UDPipe Goes Semantic in the Meaning Representation Parsing Shared TaskCode0
A Tale of Two Linkings: Dynamically Gating between Schema Linking and Structural Linking for Text-to-SQL ParsingCode0
Semantic Role Labeling for Learner Chinese: the Importance of Syntactic Parsing and L2-L1 Parallel DataCode0
Accurate and Regret-aware Numerical Problem Solver for Tabular Question AnsweringCode0
Tracking Interaction States for Multi-Turn Text-to-SQL Semantic ParsingCode0
Weakly-supervised Semantic Parsing with Abstract ExamplesCode0
Semantic Structural Decomposition for Neural Machine TranslationCode0
Semantic Structural Evaluation for Text SimplificationCode0
Crake: Causal-Enhanced Table-Filler for Question Answering over Large Scale Knowledge BaseCode0
Counterfactual Learning from Human Proofreading Feedback for Semantic ParsingCode0
Show:102550
← PrevPage 23 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified