SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 251300 of 1202 papers

TitleStatusHype
GraphQ IR: Unifying the Semantic Parsing of Graph Query Languages with One Intermediate RepresentationCode1
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing0
LAGr: Label Aligned Graphs for Better Systematic Generalization in Semantic ParsingCode1
Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation0
Measuring Alignment Bias in Neural Seq2Seq Semantic ParsersCode0
SeqZero: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot ModelsCode0
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLCode1
Compositional Task-Oriented Parsing as Abstractive Question AnsweringCode0
SUBS: Subtree Substitution for Compositional Semantic ParsingCode0
Guided K-best Selection for Semantic Parsing Annotation0
Learning to Generate Programs for Table Fact Verification via Structure-Aware Semantic ParsingCode0
Online Semantic Parsing for Latency Reduction in Task-Oriented Dialogue0
S^2SQL: Injecting Syntax to Question-Schema Interaction Graph Encoder for Text-to-SQL Parsers0
Fully-Semantic Parsing and Generation: the BabelNet Meaning RepresentationCode0
KaFSP: Knowledge-Aware Fuzzy Semantic Parsing for Conversational Question Answering over a Large-Scale Knowledge BaseCode0
Towards Collaborative Neural-Symbolic Graph Semantic Parsing via Uncertainty0
OPERA:Operation-Pivoted Discrete Reasoning over Text0
Training Naturalized Semantic Parsers with Very Little DataCode0
Counterfactual Explanations for Natural Language InterfacesCode0
Modern Baselines for SPARQL Semantic ParsingCode1
Better Query Graph Selection for Knowledge Base Question Answering0
A Survey on Non-Autoregressive Generation for Neural Machine Translation and BeyondCode1
ArcaneQA: Dynamic Program Induction and Contextualized Encoding for Knowledge Base Question AnsweringCode1
Improving Top-K Decoding for Non-Autoregressive Semantic Parsing via Intent Conditioning0
Reducing Model Jitter: Stable Re-training of Semantic Parsers in Production Environments0
Modeling Label Correlations for Second-Order Semantic Dependency Parsing with Mean-Field InferenceCode0
ThingTalk: An Extensible, Executable Representation Language for Task-Oriented DialoguesCode2
Deep Portrait Delighting0
Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive EvaluationCode0
HIE-SQL: History Information Enhanced Network for Context-Dependent Text-to-SQL Semantic Parsing0
S^2SQL: Injecting Syntax to Question-Schema Interaction Graph Encoder for Text-to-SQL Parsers0
What Did You Say? Task-Oriented Dialog Datasets Are Not Conversational!?0
Unfreeze with Care: Space-Efficient Fine-Tuning of Semantic Parsing Models0
Evaluating Persian Tokenizers0
pNLP-Mixer: an Efficient all-MLP Architecture for LanguageCode1
Measuring and Reducing Model Update Regression in Structured Prediction for NLP0
Retrieve-and-Fill for Scenario-based Task-Oriented Semantic Parsing0
Compositionality as Lexical SymmetryCode0
SUBS: Subtree Substitution for Compositional Semantic Parsing0
SEQZERO: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models0
Parsing Natural Language into Propositional and First-Order Logic with Dual Reinforcement Learning0
Few-Shot Semantic Parsing with Language Models Trained On Code0
Logical Story Representations via FrameNet + Semantic Parsing0
A Two-Stage Approach towards Generalization in Knowledge Base Question Answering0
Learning to Transpile AMR into SPARQL0
Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing0
Efficient Zero-Shot Semantic Parsing with Paraphrasing from Pretrained Language Models0
Semantic Parsing for Planning Goals as Constrained Combinatorial Contextual Bandits0
Exploring Example Selection for Few-shot Text-to-SQL Semantic Parsing0
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language ModelsCode2
Show:102550
← PrevPage 6 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified