SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 10011050 of 1202 papers

TitleStatusHype
Frustratingly Simple but Surprisingly Strong: Using Language-Independent Features for Zero-shot Cross-lingual Semantic ParsingCode0
Improving a Neural Semantic Parser by Counterfactual Learning from Human Bandit FeedbackCode0
Compositional Generalization with Grounded Language ModelsCode0
Diversity in Fashion Recommendation using Semantic ParsingCode0
From Language to Programs: Bridging Reinforcement Learning and Maximum Marginal LikelihoodCode0
From Characters to Time Intervals: New Paradigms for Evaluation and Neural Parsing of Time NormalizationsCode0
Frame- and Entity-Based Knowledge for Common-Sense Argumentative ReasoningCode0
Diverse In-Context Example Selection After Decomposing Programs and Aligned Utterances Improves Semantic ParsingCode0
NL-EDIT: Correcting semantic parse errors through natural language interactionCode0
Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional GeneralizationCode0
Universal Semantic ParsingCode0
NLP Workbench: Efficient and Extensible Integration of State-of-the-art Text Mining ToolsCode0
Disentangled Sequence to Sequence Learning for Compositional GeneralizationCode0
Semantic Captioning: Benchmark Dataset and Graph-Aware Few-Shot In-Context Learning for SQL2TextCode0
Discourse Representation Structure Parsing for ChineseCode0
A Benchmark for Generalizable and Interpretable Temporal Question Answering over Knowledge BasesCode0
Semantic Decomposition of Question and SQL for Text-to-SQL ParsingCode0
NormTab: Improving Symbolic Reasoning in LLMs Through Tabular Data NormalizationCode0
Tiny Neural Models for Seq2SeqCode0
AMUSE: Multilingual Semantic Parsing for Question Answering over Linked DataCode0
Novel positional encodings to enable tree-based transformersCode0
Incorporating Graph Information in Transformer-based AMR ParsingCode0
Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual TransferCode0
Strengthening Structural Inductive Biases by Pre-training to Perform Syntactic TransformationsCode0
Total Recall: a Customized Continual Learning Method for Neural Semantic ParsersCode0
Discourse Representation Structure ParsingCode0
Few-Shot Adaptation for Parsing Contextual Utterances with LLMsCode0
Disambiguate First Parse Later: Generating Interpretations for Ambiguity Resolution in Semantic ParsingCode0
Structural generalization is hard for sequence-to-sequence modelsCode0
Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive EvaluationCode0
Digestion Algorithm in Hierarchical Symbolic Forests: A Fast Text Normalization Algorithm and Semantic Parsing Framework for Specific Scenarios and Lightweight DeploymentCode0
On Evaluating Multilingual Compositional Generalization with Translated DatasetsCode0
Unobserved Local Structures Make Compositional Generalization HardCode0
Interactive Instance-based Evaluation of Knowledge Base Question AnsweringCode0
Federated Learning for Semantic Parsing: Task Formulation, Evaluation Setup, New AlgorithmsCode0
Transparent Semantic Parsing with Universal Dependencies Using Graph TransformationsCode0
A Syntactic Neural Model for General-Purpose Code GenerationCode0
Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement LearningCode0
Fast Intent Classification for Spoken Language UnderstandingCode0
Compositional generalization in semantic parsing with pretrained transformersCode0
Compositional Generalization in Semantic Parsing: Pre-training vs. Specialized ArchitecturesCode0
Semantic Parsing by Large Language Models for Intricate Updating Strategies of Zero-Shot Dialogue State TrackingCode0
A Split-and-Recombine Approach for Follow-up Query AnalysisCode0
Dialog-to-Action: Conversational Question Answering Over a Large-Scale Knowledge BaseCode0
Content Enhanced BERT-based Text-to-SQL GenerationCode0
Ontology-Guided, Hybrid Prompt Learning for Generalization in Knowledge Graph Question AnsweringCode0
Decoupling Structure and Lexicon for Zero-Shot Semantic ParsingCode0
SUBS: Subtree Substitution for Compositional Semantic ParsingCode0
Dealing with Co-reference in Neural Semantic ParsingCode0
Towards Autoformalization of Mathematics and Code Correctness: Experiments with Elementary ProofsCode0
Show:102550
← PrevPage 21 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified