SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 326350 of 1978 papers

TitleStatusHype
CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language UnderstandingCode1
Incorporating BERT into Neural Machine TranslationCode1
DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented DialogueCode1
IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languagesCode1
HyperMixer: An MLP-based Low Cost Alternative to TransformersCode1
Anno-MI: A Dataset of Expert-Annotated Counselling DialoguesCode1
Causality-aware Concept Extraction based on Knowledge-guided PromptingCode1
Benchmarking Robustness of Machine Reading Comprehension ModelsCode1
MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-TuningCode1
Dual Inference for Improving Language Understanding and GenerationCode1
Cephalo: Multi-Modal Vision-Language Models for Bio-Inspired Materials Analysis and DesignCode1
MultiWOZ 2.3: A multi-domain task-oriented dialogue dataset enhanced with annotation corrections and co-reference annotationCode1
Natural Language Embedded Programs for Hybrid Language Symbolic ReasoningCode1
How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language UnderstandingCode1
NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented DialogueCode1
A Large-scale Comprehensive Abusiveness Detection Dataset with Multifaceted Labels from RedditCode1
DroidCall: A Dataset for LLM-powered Android Intent InvocationCode1
A Simple but Tough-to-Beat Data Augmentation Approach for Natural Language Understanding and GenerationCode1
Dual Learning for Semi-Supervised Natural Language UnderstandingCode1
DVMNet++: Rethinking Relative Pose Estimation for Unseen ObjectsCode1
Imagination-Augmented Natural Language UnderstandingCode1
ChatLog: Carefully Evaluating the Evolution of ChatGPT Across TimeCode1
ALBETO and DistilBETO: Lightweight Spanish Language ModelsCode1
Benchmarking Natural Language Understanding Services for building Conversational AgentsCode1
Conic10K: A Challenging Math Problem Understanding and Reasoning DatasetCode1
Show:102550
← PrevPage 14 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2BERT-large 340MAccuracy78.3Unverified
3UDSSM-II (ensemble)Accuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified