SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 351400 of 1202 papers

TitleStatusHype
Transition-based Abstract Meaning Representation Parsing with Contextual Embeddings0
Cross-TOP: Zero-Shot Cross-Schema Task-Oriented Parsing0
The Robotic Surgery Procedural FramebankCode0
Universal Semantic Annotator: the First Unified API for WSD, SRL and Semantic Parsing0
Un algorithme d’analyse sémantique fondée sur les graphes via le problème de l’arborescence généralisée couvrante (A graph-based semantic parsing algorithm via the generalized spanning arborescence problem)0
Multilingual Abstract Meaning Representation for Celtic Languages0
Makadi: A Large-Scale Human-Labeled Dataset for Hindi Semantic Parsing0
Transformer with Tree-order Encoding for Neural Program GenerationCode0
Semantic Parsing of Interpage Relations0
TAGPRIME: A Unified Framework for Relational Structure ExtractionCode0
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing0
When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding SystemsCode0
Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation0
Measuring Alignment Bias in Neural Seq2Seq Semantic ParsersCode0
SeqZero: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot ModelsCode0
Compositional Task-Oriented Parsing as Abstractive Question AnsweringCode0
SUBS: Subtree Substitution for Compositional Semantic ParsingCode0
Online Semantic Parsing for Latency Reduction in Task-Oriented Dialogue0
Guided K-best Selection for Semantic Parsing Annotation0
S^2SQL: Injecting Syntax to Question-Schema Interaction Graph Encoder for Text-to-SQL Parsers0
Towards Collaborative Neural-Symbolic Graph Semantic Parsing via Uncertainty0
Fully-Semantic Parsing and Generation: the BabelNet Meaning RepresentationCode0
Learning to Generate Programs for Table Fact Verification via Structure-Aware Semantic ParsingCode0
KaFSP: Knowledge-Aware Fuzzy Semantic Parsing for Conversational Question Answering over a Large-Scale Knowledge BaseCode0
Training Naturalized Semantic Parsers with Very Little DataCode0
OPERA:Operation-Pivoted Discrete Reasoning over Text0
Counterfactual Explanations for Natural Language InterfacesCode0
Better Query Graph Selection for Knowledge Base Question Answering0
Improving Top-K Decoding for Non-Autoregressive Semantic Parsing via Intent Conditioning0
Reducing Model Jitter: Stable Re-training of Semantic Parsers in Production Environments0
Modeling Label Correlations for Second-Order Semantic Dependency Parsing with Mean-Field InferenceCode0
Deep Portrait Delighting0
Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive EvaluationCode0
S^2SQL: Injecting Syntax to Question-Schema Interaction Graph Encoder for Text-to-SQL Parsers0
HIE-SQL: History Information Enhanced Network for Context-Dependent Text-to-SQL Semantic Parsing0
What Did You Say? Task-Oriented Dialog Datasets Are Not Conversational!?0
Unfreeze with Care: Space-Efficient Fine-Tuning of Semantic Parsing Models0
Evaluating Persian Tokenizers0
Measuring and Reducing Model Update Regression in Structured Prediction for NLP0
Retrieve-and-Fill for Scenario-based Task-Oriented Semantic Parsing0
Compositionality as Lexical SymmetryCode0
A Two-Stage Approach towards Generalization in Knowledge Base Question Answering0
Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing0
Few-Shot Semantic Parsing with Language Models Trained On Code0
Exploring Example Selection for Few-shot Text-to-SQL Semantic Parsing0
Semantic Parsing for Planning Goals as Constrained Combinatorial Contextual Bandits0
SEQZERO: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models0
Parsing Natural Language into Propositional and First-Order Logic with Dual Reinforcement Learning0
Efficient Zero-Shot Semantic Parsing with Paraphrasing from Pretrained Language Models0
SUBS: Subtree Substitution for Compositional Semantic Parsing0
Show:102550
← PrevPage 8 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified