SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 10261050 of 1978 papers

TitleStatusHype
TexSmart: A System for Enhanced Natural Language Understanding0
TextGraphs-16 Natural Language Premise Selection Task: Zero-Shot Premise Selection with Prompting Generative Language Models0
Text Is Not All You Need: Multimodal Prompting Helps LLMs Understand Humor0
GeoHard: Towards Measuring Class-wise Hardness through Modelling Class Semantics0
Textual Entailment Recognition with Semantic Features from Empirical Text Representation0
Textual Inference and Meaning Representation in Human Robot Interaction0
The Dark Side of Human Feedback: Poisoning Large Language Models via User Inputs0
The Dark Side of the Language: Pre-trained Transformers in the DarkNet0
The Dark Side of the Language: Pre-trained Transformers in the DarkNet0
The Deep Learning Revolution and Its Implications for Computer Architecture and Chip Design0
The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding0
The Effect of Data Ordering in Image Classification0
The Impacts of Unanswerable Questions on the Robustness of Machine Reading Comprehension Models0
The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design0
The Limits of ChatGPT in Extracting Aspect-Category-Opinion-Sentiment Quadruples: A Comparative Analysis0
The Massively Multilingual Natural Language Understanding 2022 (MMNLU-22) Workshop and Competition0
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding0
The Negochat Corpus of Human-agent Negotiation Dialogues0
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures0
The Singleton Fallacy: Why Current Critiques of Language Models Miss the Point0
The state-of-the-art in web-scale semantic information processing for cloud computing0
The Twins Corpus of Museum Visitor Questions0
The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classification0
The Unstoppable Rise of Computational Linguistics in Deep Learning0
Things not Written in Text: Exploring Spatial Commonsense from Visual Signals0
Show:102550
← PrevPage 42 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified