SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 10511100 of 1978 papers

TitleStatusHype
End-to-End Spoken Language Understanding: Performance analyses of a voice command task in a low resource setting0
Learning to translate by learning to communicateCode0
Forming Trees with Treeformers0
Chat-to-Design: AI Assisted Personalized Fashion Design0
Yes, No or IDK: The Challenge of Unanswerable Yes/No Questions0
Lightweight Transformers for Conversational AI0
A New Concept of Knowledge based Question Answering (KBQA) System for Multi-hop Reasoning0
m-Networks: Adapting the Triplet Networks for Acronym DisambiguationCode0
A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation0
RGL: A Simple yet Effective Relation Graph Augmented Prompt-based Tuning Approach for Few-Shot Learning0
On Curriculum Learning for Commonsense ReasoningCode0
NER4ID at SemEval-2022 Task 2: Named Entity Recognition for Idiomaticity DetectionCode0
AlexU-AL at SemEval-2022 Task 6: Detecting Sarcasm in Arabic Text Using Deep Learning TechniquesCode0
Efficient Learning of Multiple NLP Tasks via Collective Weight Factorization on BERT0
Efficient Semi-supervised Consistency Training for Natural Language Understanding0
Dyna-bAbI: unlocking bAbI’s potential with dynamic synthetic benchmarking0
Enhancing Self-Attention with Knowledge-Assisted Attention Maps0
ID10M: Idiom Identification in 10 LanguagesCode0
Strategies to Improve Few-shot Learning for Intent Classification and Slot-Filling0
Is neural language acquisition similar to natural? A chronological probing studyCode0
Compressing Pre-trained Transformers via Low-Bit NxM Sparsity for Natural Language Understanding0
Not Cheating on the Turing Test: Towards Grounded Language Learning in Artificial Intelligence0
ZoDIAC: Zoneout Dropout Injection Attention CalculationCode0
Meta Auxiliary Learning for Low-resource Spoken Language Understanding0
Unified BERT for Few-shot Natural Language Understanding0
Why Robust Natural Language Understanding is a Challenge0
Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems0
CHQ-Summ: A Dataset for Consumer Healthcare Question SummarizationCode0
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation0
Transformer based Urdu Handwritten Text Optical Character Reader0
BaSCo: An Annotated Basque-Spanish Code-Switching Corpus for Natural Language Understanding0
A Large Interlinked Knowledge Graph of the Italian Cultural Heritage0
Question Modifiers in Visual Question Answering0
Negation Detection in Dutch Spoken Human-Computer Conversations0
Dialogue Act and Slot Recognition in Italian Complex Dialogues0
Exploring Text Recombination for Automatic Narrative Level Detection0
Towards Building a Spoken Dialogue System for Argument Exploration0
The Robotic Surgery Procedural FramebankCode0
BasqueGLUE: A Natural Language Understanding Benchmark for BasqueCode0
SenticNet 7: A Commonsense-based Neurosymbolic AI Framework for Explainable Sentiment Analysis0
Strategy-level Entrainment of Dialogue System Users in a Creative Visual Reference Resolution Task0
Étiquetage ou génération de séquences pour la compréhension automatique du langage en contexte d’interaction? (Sequence tagging or sequence generation for Natural Language Understanding ?)0
DTW at Qur’an QA 2022: Utilising Transfer Learning with Transformers for Question Answering in a Low-resource DomainCode0
A Multi-level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inference0
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and GenerationCode0
IGLU 2022: Interactive Grounded Language Understanding in a Collaborative Environment at NeurIPS 2022Code0
NLU for Game-based Learning in Real: Initial Evaluations0
Automatic question generation based on sentence structure analysis using machine learning approach0
A Survey on Neural Open Information Extraction: Current Status and Future Directions0
When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding SystemsCode0
Show:102550
← PrevPage 22 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified