SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 9761000 of 1978 papers

TitleStatusHype
Only One Relation Possible? Modeling the Ambiguity in Event Temporal Relation Extraction0
On the Calibration of Pre-trained Language Models using Mixup Guided by Area Under the Margin and Saliency0
On the cross-lingual transferability of multilingual prototypical models across NLU tasks0
On the Importance of Attention in Meta-Learning for Few-Shot Text Classification0
On the Limits of Learning to Actively Learn Semantic Representations0
On the N-gram Approximation of Pre-trained Language Models0
On the Role of Corpus Ordering in Language Modeling0
On the Winograd Schema: Situating Language Understanding in the Data-Information-Knowledge Continuum0
Ontology-based question answering over corporate structured data0
Ontology Population using LLMs0
OntoType: Ontology-Guided and Pre-Trained Language Model Assisted Fine-Grained Entity Typing0
Optimizing NLU Reranking Using Entity Resolution Signals in Multi-domain Dialog Systems0
ORB: An Open Reading Benchmark for Comprehensive Evaluation of Machine Reading Comprehension0
Out of Order: How Important Is The Sequential Order of Words in a Sentence in Natural Language Understanding Tasks?0
Overcoming Poor Word Embeddings with Word Definitions0
PAFFA: Premeditated Actions For Fast Agents0
Painter: Teaching Auto-regressive Language Models to Draw Sketches0
Pair-Level Supervised Contrastive Learning for Natural Language Inference0
PALM: Pre-training an Autoencoding\&Autoregressive Language Model for Context-conditioned Generation0
PanGu-Σ: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing0
PAPI: Exploiting Dynamic Parallelism in Large Language Model Decoding with a Processing-In-Memory-Enabled Computing System0
ParaNMT-50M: Pushing the Limits of Paraphrastic Sentence Embeddings with Millions of Machine Translations0
Paraphrase Generation for Semi-Supervised Learning in NLU0
Paraphrasing in Affirmative Terms Improves Negation Understanding0
ParaZh-22M: A Large-Scale Chinese Parabank via Machine Translation0
Show:102550
← PrevPage 40 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified