SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 851900 of 1202 papers

TitleStatusHype
A Neural Model for Language Identification in Code-Switched Tweets0
A New Corpus and Imitation Learning Framework for Context-Dependent Semantic Parsing0
An Exact Dual Decomposition Algorithm for Shallow Semantic Parsing with Constraints0
An Extensible Framework for Verification of Numerical Claims0
An implementation of a Latvian resource grammar in Grammatical Framework0
An Improved Coarse-to-Fine Method for Solving Generation Tasks0
An In-Context Schema Understanding Method for Knowledge Base Question Answering0
An in-depth look at Euclidean disk embeddings for structure preserving parsing0
An Instance Level Approach for Shallow Semantic Parsing in Scientific Procedural Text0
A Hybrid Semantic Parsing Approach for Tabular Data Analysis0
Annotating and parsing to semantic frames: feedback from the French FrameNet project0
Annotation Schemes for Surface Construction Labeling0
Answer Extraction by Recursive Parse Tree Descent0
HPE:Answering Complex Questions over Text by Hybrid Question Parsing and Execution0
Answering Complicated Question Intents Expressed in Decomposed Question Sequences0
Any-language frame-semantic parsing0
Dspy-based Neural-Symbolic Pipeline to Enhance Spatial Reasoning in LLMs0
A Pointer Network Architecture for Context-Dependent Semantic Parsing0
A Probabilistic-Logic based Commonsense Representation Framework for Modelling Inferences with Multiple Antecedents and Varying Likelihoods0
Argument structure of adverbial derivatives in Russian0
A Robust Approach to Aligning Heterogeneous Lexical Resources0
Ar-Spider: Text-to-SQL in Arabic0
A Semantic Parsing Algorithm to Solve Linear Ordering Problems0
A Sentence Is Worth a Thousand Pixels0
AskYourDB: An end-to-end system for querying and visualizing relational databases using natural language0
Assessing Data Efficiency in Task-Oriented Semantic Parsing0
A Statistical Machine Translation Model with Forest-to-Tree Algorithm for Semantic Parsing0
A Step-wise Usage-based Method for Inducing Polysemy-aware Verb Classes0
A Strong Lexical Matching Method for the Machine Comprehension Test0
A Study of using Syntactic and Semantic Structures for Concept Segmentation and Labeling0
A Study on the Integration of Pipeline and E2E SLU systems for Spoken Semantic Parsing toward STOP Quality Challenge0
A Supervised Semantic Parsing with Lexicon Extension and Syntactic Constraint0
A survey of cross-lingual features for zero-shot cross-lingual semantic parsing0
A Survey of Syntactic-Semantic Parsing Based on Constituent and Dependency Structures0
A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutions0
A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challenges0
A Survey on Semantic Parsing0
A Survey on Semantic Parsing from the perspective of Compositionality0
A Survey on Table Question Answering: Recent Advances0
AT\&T: The Tag\&Parse Approach to Semantic Parsing of Robot Spatial Commands0
A Two-Stage Approach towards Generalization in Knowledge Base Question Answering0
A Two-Stage Approach towards Generalization in Knowledge Base Question Answering0
A Type-coherent, Expressive Representation as an Initial Step to Language Understanding0
Augmenting FrameNet Via PPDB0
Augmenting text for spoken language understanding with Large Language Models0
A Unified Framework for Discourse Argument Identification via Shallow Semantic Parsing0
A Unified Framework for Structured Prediction: From Theory to Practice0
A Unified Model for Soft Linguistic Reordering Constraints in Statistical Machine Translation0
Automatically Detecting the Position and Type of Psychiatric Evaluation Report Sections0
Automatically Solving Number Word Problems by Semantic Parsing and Reasoning0
Show:102550
← PrevPage 18 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified