SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 376400 of 1978 papers

TitleStatusHype
Is BERT Blind? Exploring the Effect of Vision-and-Language Pretraining on Visual Language UnderstandingCode1
KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language ModelsCode1
Code Summarization with Structure-induced TransformerCode1
LLM4Jobs: Unsupervised occupation extraction and standardization leveraging Large Language ModelsCode1
SLiM: One-shot Quantization and Sparsity with Low-rank Approximation for LLM Weight CompressionCode1
Collaborative Multi-Agent Dialogue Model Training Via Reinforcement LearningCode1
A Surprisingly Robust Trick for Winograd Schema ChallengeCode1
Does It Make Sense? And Why? A Pilot Study for Sense Making and ExplanationCode1
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP TasksCode1
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge GraphsCode1
FlipDA: Effective and Robust Data Augmentation for Few-Shot LearningCode1
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language UnderstandingCode1
Neural RST-based Evaluation of Discourse CoherenceCode1
Structured Probabilistic CodingCode1
Comparison by Conversion: Reverse-Engineering UCCA from Syntax and Lexical SemanticsCode1
Stacked DeBERT: All Attention in Incomplete Data for Text ClassificationCode1
FOLIO: Natural Language Reasoning with First-Order LogicCode1
A Survey of RWKVCode1
An Information-theoretic Multi-task Representation Learning Framework for Natural Language UnderstandingCode0
Instance Regularization for Discriminative Language Model Pre-trainingCode0
BasqueGLUE: A Natural Language Understanding Benchmark for BasqueCode0
INSET: Sentence Infilling with INter-SEntential TransformerCode0
Integrating Task Specific Information into Pretrained Language Models for Low Resource Fine TuningCode0
BAM! Born-Again Multi-Task Networks for Natural Language UnderstandingCode0
Adversarial Robustness of Prompt-based Few-Shot Learning for Natural Language UnderstandingCode0
Show:102550
← PrevPage 16 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified