SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 301350 of 1202 papers

TitleStatusHype
Effectiveness and Efficiency of Open Relation Extraction0
DRTS Parsing with Structure-Aware Encoding and Decoding0
Advancing Seq2seq with Joint Paraphrase Learning0
A Conditional Random Field-based Traditional Chinese Base Phrase Parser for SIGHAN Bake-off 2012 Evaluation0
Jointly Learning Semantic Parser and Natural Language Generator via Dual Information Maximization0
Abductive Matching in Question Answering0
Don't Parse, Insert: Multilingual Semantic Parsing with Insertion Based Decoding0
Cache Transition Systems for Graph Parsing0
ARTEMIS-DA: An Advanced Reasoning and Transformation Engine for Multi-Step Insight Synthesis in Data Analytics0
Answering Complicated Question Intents Expressed in Decomposed Question Sequences0
Exploring Graph-Algebraic CCG Combinators for Syntactic-Semantic AMR Parsing0
Exploring Neural Models for Parsing Natural Language into First-Order Logic0
Building compositional semantics and higher-order inference system for a wide-coverage Japanese CCG parser0
HPE:Answering Complex Questions over Text by Hybrid Question Parsing and Execution0
Exploiting Frame-Semantics and Frame-Semantic Parsing for Automatic Extraction of Typological Information from Descriptive Grammars of Natural Languages0
Broad-Coverage Semantic Parsing as Transduction0
Divide and Prompt: Chain of Thought Prompting for Text-to-SQL0
EventWiki: A Knowledge Base of Major Events0
Broad-coverage CCG Semantic Parsing with AMR0
Answer Extraction by Recursive Parse Tree Descent0
Explaining Large Language Model-Based Neural Semantic Parsers (Student Abstract)0
Exploring Example Selection for Few-shot Text-to-SQL Semantic Parsing0
Building a Neural Semantic Parser from a Domain Ontology0
Domain Adaptation for Low-Resource Neural Semantic Parsing0
Domain Adaptation for Semantic Parsing0
Domain Adaptation for Syntactic and Semantic Dependency Parsing Using Deep Belief Networks0
Domain Specific Automatic Question Generation from Text0
Don't Annotate, but Validate: a Data-to-Text Method for Capturing Event Data0
Exploring Unexplored Generalization Challenges for Cross-Database Semantic Parsing0
Don't Parse, Generate! A Sequence to Sequence Architecture for Task-Oriented Semantic Parsing0
Fast Forward Through Opportunistic Incremental Meaning Representation Construction0
Distilling Large Language Models into Tiny and Effective Students using pQRNN0
Draw Me a Flower: Processing and Grounding Abstraction in Natural Language0
Any-language frame-semantic parsing0
Disentangled Sequence to Sequence Learning for Compositional Generalization0
Breeding Fillmore’s Chickens and Hatching the Eggs: Recombining Frames and Roles in Frame-Semantic Parsing0
Annotation Schemes for Surface Construction Labeling0
Effective Search of Logical Forms for Weakly Supervised Knowledge-Based Question Answering0
Annotating and parsing to semantic frames: feedback from the French FrameNet project0
Efficient Logical Inference for Semantic Processing0
Efficient Prompting for LLM-based Generative Internet of Things0
Efficient techniques for parsing with tree automata0
A Double-Graph Based Framework for Frame Semantic Parsing0
El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsing0
Discourse Representation Parsing for Sentences and Documents0
Empirically-motivated Generalizations of CCG Semantic Parsing Learning Algorithms0
Disambiguating Verbs by Collocation: Corpus Lexicography meets Natural Language Processing0
End-to-End Cross-Domain Text-to-SQL Semantic Parsing with Auxiliary Task0
Bottom-Up Unranked Tree-to-Graph Transducers for Translation into Semantic Graphs0
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing0
Show:102550
← PrevPage 7 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified