SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 276300 of 1978 papers

TitleStatusHype
How Certain is Your Transformer?Code1
Structure Inducing Pre-TrainingCode1
Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot FillingCode1
Empathetic BERT2BERT Conversational Model: Learning Arabic Language Generation with Little DataCode1
Syntax-BERT: Improving Pre-trained Transformers with Syntax TreesCode1
Chess as a Testbed for Language Model State TrackingCode1
Evolving Attention with Residual ConvolutionsCode1
Training Vision Transformers for Image RetrievalCode1
VisualMRC: Machine Reading Comprehension on Document ImagesCode1
LSOIE: A Large-Scale Dataset for Supervised Open Information ExtractionCode1
RomeBERT: Robust Training of Multi-Exit BERTCode1
TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored SearchCode1
BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in BanglaCode1
K-PLUG: KNOWLEDGE-INJECTED PRE-TRAINED LANGUAGE MODEL FOR NATURAL LANGUAGE UNDERSTANDING AND GENERATIONCode1
Robustness Testing of Language Understanding in Task-Oriented DialogCode1
UnNatural Language InferenceCode1
Code Summarization with Structure-induced TransformerCode1
MeDAL: Medical Abbreviation Disambiguation Dataset for Natural Language Understanding PretrainingCode1
CSKG: The CommonSense Knowledge GraphCode1
ParsiNLU: A Suite of Language Understanding Challenges for PersianCode1
Infusing Finetuning with Semantic DependenciesCode1
Braid: Weaving Symbolic and Neural Knowledge into Coherent Logical ExplanationsCode1
GLGE: A New General Language Generation Evaluation BenchmarkCode1
Fact-level Extractive Summarization with Hierarchical Graph Mask on BERTCode1
A Sequence-to-Sequence Approach to Dialogue State TrackingCode1
Show:102550
← PrevPage 12 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2BERT-large 340MAccuracy78.3Unverified
3UDSSM-II (ensemble)Accuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified