SOTAVerified

Semantic Parsing

Semantic Parsing is the task of transducing natural language utterances into formal meaning representations. The target meaning representations can be defined according to a wide variety of formalisms. This include linguistically-motivated semantic representations that are designed to capture the meaning of any sentence such as λ-calculus or the abstract meaning representations. Alternatively, for more task-driven approaches to Semantic Parsing, it is common for meaning representations to represent executable programs such as SQL queries, robotic commands, smart phone instructions, and even general-purpose programming languages like Python and Java.

Source: Tranx: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation

Papers

Showing 10511100 of 1202 papers

TitleStatusHype
Global Methods for Cross-lingual Semantic Role and Predicate Labelling0
Priberam: A Turbo Semantic Parser with Second Order Features0
RoBox: CCG with Structured Perceptron for Supervised Semantic Parsing of Robotic Spatial Commands0
SemEval-2014 Task 6: Supervised Semantic Parsing of Robotic Spatial Commands0
ShrdLite: Semantic Parsing Using a Handmade Grammar0
CMU: Arc-Factored, Discriminative Semantic Dependency Parsing0
AT\&T: The Tag\&Parse Approach to Semantic Parsing of Robot Spatial Commands0
A Study of using Syntactic and Semantic Structures for Concept Segmentation and Labeling0
Argument structure of adverbial derivatives in Russian0
Turku: Broad-Coverage Semantic Parsing with Rich Features0
Alpage: Transition-based Semantic Graph Parsing with Syntactic Features0
Using language technology resources and tools to construct Swedish FrameNet0
UWM: Applying an Existing Trainable Semantic Parser to Parse Robotic Spatial Commands0
Cross-lingual Word Sense Disambiguation for Predicate Labelling of French0
Probabilistic modeling of the syntax semantic interface using probabilistic context free grammars, Experiments with FrameNet (Mod\'elisation probabiliste de l'interface syntaxe s\'emantique \`a l'aide de grammaires hors contexte probabilistes Exp\'eriences avec FrameNet) [in French]0
Deep Neural Network applied to Part-of-Speech Tagging (R\'eseau de neurones profond pour l'\'etiquetage morpho-syntaxique) [in French]0
Intermediary Semantic Representation through Proposition Structures0
Freebase QA: Information Extraction or Semantic Parsing?0
Augmenting FrameNet Via PPDB0
Efficient Logical Inference for Semantic Processing0
Response-based Learning for Grounded Machine Translation0
Statistical Models for Frame-Semantic Parsing0
Representing Caused Motion in Embodied Construction Grammar0
The Language of Actions: Recovering the Syntax and Semantics of Goal-Directed Human Activities0
A Unified Model for Soft Linguistic Reordering Constraints in Statistical Machine Translation0
Software Requirements: A new Domain for Semantic Parsers0
Context-dependent Semantic Parsing for Time Expressions0
On maximum spanning DAG algorithms for semantic DAG parsing0
Cooking with Semantics0
A Discriminative Graph-Based Parser for the Abstract Meaning Representation0
Knowledge-Based Question Answering as Machine Translation0
Learning a Lexicon for Broad-coverage Semantic Parsing0
Modelling Events through Memory-based, Open-IE Patterns for Abstractive Summarization0
Large-scale CCG Induction from the Groningen Meaning Bank0
Semantic Parsing via Paraphrasing0
A Step-wise Usage-based Method for Inducing Polysemy-aware Verb Classes0
Semantic Parsing using Distributional Semantics and Probabilistic Logic0
Information Extraction over Structured Data: Question Answering with Freebase0
Towards README-EVAL : Interpreting README File Instructions0
Towards Surface Realization with CCGs Induced from Dependencies0
A Comparison of the Events and Relations Across ACE, ERE, TAC-KBP, and FrameNet Annotation Standards0
Joint Syntactic and Semantic Parsing with Combinatory Categorial Grammar0
What are You Talking About? Text-to-Image Coreference0
A Robust Approach to Aligning Heterogeneous Lexical Resources0
Combining Formal and Distributional Models of Temporal and Intensional Semantics0
Semantic Parsing for Text to 3D Scene Generation0
Training a Korean SRL System with Rich Morphological Features0
Semantic Parsing for Single-Relation Question Answering0
Semantic Frame Identification with Distributed Word Representations0
From Treebank Parses to Episodic Logic and Commonsense Inference0
Show:102550
← PrevPage 22 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ARTEMIS-DAAccuracy (Test)80.8Unverified
2SynTQA (Oracle)Test Accuracy77.5Unverified
3TabLaPAccuracy (Test)76.6Unverified
4SynTQA (GPT)Accuracy (Test)74.4Unverified
5Mix SCAccuracy (Test)73.6Unverified
6SynTQA (RF)Accuracy (Test)71.6Unverified
7CABINETAccuracy (Test)69.1Unverified
8NormTab+TabSQLifyAccuracy (Test)68.63Unverified
9Chain-of-TableAccuracy (Test)67.31Unverified
10Tab-PoTAccuracy (Test)66.78Unverified
#ModelMetricClaimedVerifiedStatus
1RESDSQL-3B + NatSQLAccuracy84.1Unverified
2code-davinci-002 175B (LEVER)Accuracy81.9Unverified
3RASAT+PICARDAccuracy75.5Unverified
4Graphix-3B + PICARDAccuracy74Unverified
5T5-3B + PICARDAccuracy71.9Unverified
6SADGA + GAPAccuracy70.1Unverified
7RATSQL + GAPAccuracy69.7Unverified
8RATSQL + Grammar-Augmented Pre-TrainingAccuracy69.6Unverified
9RATSQL + BERTAccuracy65.6Unverified
10Exact Set MatchingAccuracy19.7Unverified
#ModelMetricClaimedVerifiedStatus
1Dynamic Least-to-Most PromptingExact Match95Unverified
2LeARExact Match90.9Unverified
3T5-3B w/ Intermediate RepresentationsExact Match83.8Unverified
4Hierarchical Poset DecodingExact Match69Unverified
5Universal TransformerExact Match18.9Unverified
#ModelMetricClaimedVerifiedStatus
1ReaRevAccuracy76.4Unverified
2NSM+hAccuracy74.3Unverified
3CBR-KBQAAccuracy70Unverified
4STAGG (Yih et al., 2016)Accuracy63.9Unverified
5T5-11B (Raffel et al., 2020)Accuracy56.5Unverified
#ModelMetricClaimedVerifiedStatus
1CABINETDenotation accuracy (test)89.5Unverified
2TAPEX-Large (weak supervision)Denotation accuracy (test)89.5Unverified
3ReasTAP-Large (weak supervision)Denotation accuracy (test)89.2Unverified
4NL2SQL-BERTAccuracy89Unverified
5TAPAS-Large (weak supervision)Denotation accuracy (test)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1PhraseTransformerAccuracy90.4Unverified
2TranxAccuracy86.2Unverified
3ASN (Rabinovich et al., 2017)Accuracy85.3Unverified
4ZH15 (Zhao and Huang, 2015)Accuracy84.2Unverified
#ModelMetricClaimedVerifiedStatus
1coarse2fineAccuracy88.2Unverified
2PhraseTransformerAccuracy87.9Unverified
3TranxAccuracy87.7Unverified
#ModelMetricClaimedVerifiedStatus
1PERIN + RobeCzechF192.36Unverified
2PERINF192.24Unverified
3HUJI-KUF158Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.52Unverified
2HUJI-KUF145Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF180.23Unverified
2HUJI-KUF152Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF194.16Unverified
2HUJI-KUF163Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.83Unverified
2HUJI-KUF162Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF192.73Unverified
2HUJI-KUF180Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF189.19Unverified
2HUJI-KUF154Unverified
#ModelMetricClaimedVerifiedStatus
1TAPEX-LargeDenotation Accuracy74.5Unverified
2TAPAS-LargeAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF176.4Unverified
2HUJI-KUF173Unverified
#ModelMetricClaimedVerifiedStatus
1PERINF181.01Unverified
2HUJI-KUF175Unverified
#ModelMetricClaimedVerifiedStatus
1HSPEM66.18Unverified
#ModelMetricClaimedVerifiedStatus
1ReasonBERTRF1 Score41.3Unverified
#ModelMetricClaimedVerifiedStatus
1MeMCEExact40.3Unverified