SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 251–275 of 1978 papers

TitleStatusHype
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization ApproachCode1
On Training Data Influence of GPT ModelsCode1
Optimal Subarchitecture Extraction For BERTCode1
On the Importance of Effectively Adapting Pretrained Language Models for Active LearningCode1
DroidCall: A Dataset for LLM-powered Android Intent InvocationCode1
Empowering News Recommendation with Pre-trained Language ModelsCode1
Braid: Weaving Symbolic and Neural Knowledge into Coherent Logical ExplanationsCode1
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and LanguageCode1
A Comprehensive Survey on Graph Neural NetworksCode1
Towards General Natural Language Understanding with Probabilistic WorldbuildingCode1
Bot or Human? Detecting ChatGPT Imposters with A Single QuestionCode1
CSKG: The CommonSense Knowledge GraphCode1
A Generative Model for Joint Natural Language Understanding and GenerationCode1
C-STS: Conditional Semantic Textual SimilarityCode1
Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language ModelsCode1
Ape210K: A Large-Scale and Template-Rich Dataset of Math Word ProblemsCode1
Break, Perturb, Build: Automatic Perturbation of Reasoning Paths Through Question DecompositionCode1
Cross-Lingual Semantic Role Labeling with High-Quality Translated Training CorpusCode1
CTRAN: CNN-Transformer-based Network for Natural Language UnderstandingCode1
ConFiguRe: Exploring Discourse-level Chinese Figures of SpeechCode1
Beyond Autoregression: Fast LLMs via Self-Distillation Through TimeCode1
Conic10K: A Challenging Math Problem Understanding and Reasoning DatasetCode1
A Persian Benchmark for Joint Intent Detection and Slot FillingCode1
CREAK: A Dataset for Commonsense Reasoning over Entity KnowledgeCode1
Compresso: Structured Pruning with Collaborative Prompting Learns Compact Large Language ModelsCode1
Show:102550
← PrevPage 11 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90—Unverified
2UDSSM-II (ensemble)Accuracy78.3—Unverified
3BERT-large 340MAccuracy78.3—Unverified
4UDSSM-I (ensemble)Accuracy76.7—Unverified
5DSSMAccuracy75—Unverified
6UDSSM-IIAccuracy75—Unverified
7BERT-base 110M + MASAccuracy68.3—Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7—Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60—Unverified
10Subword-level Transformer LMAccuracy58.3—Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5—Unverified
2BERT (none)Tags (Full) Acc82—Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81—Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3—Unverified
5RoBERTa + LinearFull F1 (Preps)78.2—Unverified
6GloVe (none)Tags (Full) Acc77.5—Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1—Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2—Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2—Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6—Unverified
2Legal-BERTCaseHOLD75.1—Unverified
3DeBERTaCaseHOLD72.1—Unverified
4LongformerCaseHOLD72—Unverified
5RoBERTaCaseHOLD71.7—Unverified
6BERTCaseHOLD70.7—Unverified
7BigBirdCaseHOLD70.4—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6—Unverified
2ConvBERT-DG + Pre + MultiAverage73.8—Unverified
3mslmAverage73.49—Unverified
4ConvBERT + Pre + MultiAverage68.22—Unverified
5BanLanGenAverage39.16—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89—Unverified
2mslmAverage85.83—Unverified
3ConvBERT-DG + Pre + MultiAverage85.34—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9—Unverified
2BERT-LARGEAverage82.1—Unverified