SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 301–350 of 1978 papers

TitleStatusHype
FewCLUE: A Chinese Few-shot Learning Evaluation BenchmarkCode1
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language UnderstandingCode1
DroidCall: A Dataset for LLM-powered Android Intent InvocationCode1
Distilling Large Vision-Language Model with Out-of-Distribution GeneralizabilityCode1
Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositionCode1
Call for Papers -- The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpusCode1
Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring SystemsCode1
GisPy: A Tool for Measuring Gist Inference Score in TextCode1
GLGE: A New General Language Generation Evaluation BenchmarkCode1
GLoRE: Evaluating Logical Reasoning of Large Language ModelsCode1
Dual Inference for Improving Language Understanding and GenerationCode1
Joint Prompt Optimization of Stacked LLMs using Variational InferenceCode1
A Toolkit for Generating Code Knowledge GraphsCode1
Graph Based Network with Contextualized Representations of Turns in DialogueCode1
How Certain is Your Transformer?Code1
DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented DialogueCode1
HyperMixer: An MLP-based Low Cost Alternative to TransformersCode1
A Comprehensive Analysis of Adapter EfficiencyCode1
Beyond Silent Letters: Amplifying LLMs in Emotion Recognition with Vocal NuancesCode1
Collaborative Multi-Agent Dialogue Model Training Via Reinforcement LearningCode1
IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languagesCode1
Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesCode1
BERT for Joint Intent Classification and Slot FillingCode1
InforMask: Unsupervised Informative Masking for Language Model PretrainingCode1
Intent Detection and Slot Filling for VietnameseCode1
Is BERT Blind? Exploring the Effect of Vision-and-Language Pretraining on Visual Language UnderstandingCode1
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model TuningCode1
DeLoRA: Decoupling Angles and Strength in Low-rank AdaptationCode1
Causal Distillation for Language ModelsCode1
KALA: Knowledge-Augmented Language Model AdaptationCode1
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge GraphsCode1
Causality-aware Concept Extraction based on Knowledge-guided PromptingCode1
Knowledge-enhanced Visual-Language Pre-training on Chest Radiology ImagesCode1
Knowledge Prompting in Pre-trained Language Model for Natural Language UnderstandingCode1
Dual Learning for Semi-Supervised Natural Language UnderstandingCode1
Cephalo: Multi-Modal Vision-Language Models for Bio-Inspired Materials Analysis and DesignCode1
Anno-MI: A Dataset of Expert-Annotated Counselling DialoguesCode1
Debiasing Methods in Natural Language Understanding Make Bias More AccessibleCode1
A Sequence-to-Sequence Approach to Dialogue State TrackingCode1
Large Language Models as Corporate LobbyistsCode1
A Large-scale Comprehensive Abusiveness Detection Dataset with Multifaceted Labels from RedditCode1
Benchmarking Robustness of Machine Reading Comprehension ModelsCode1
Benchmarking Natural Language Understanding Services for building Conversational AgentsCode1
Comparison by Conversion: Reverse-Engineering UCCA from Syntax and Lexical SemanticsCode1
C-STS: Conditional Semantic Textual SimilarityCode1
Leveraging Pre-trained Checkpoints for Sequence Generation TasksCode1
ChatLog: Carefully Evaluating the Evolution of ChatGPT Across TimeCode1
ALBETO and DistilBETO: Lightweight Spanish Language ModelsCode1
CTRAN: CNN-Transformer-based Network for Natural Language UnderstandingCode1
Belief Revision based Caption Re-ranker with Visual Semantic InformationCode1
Show:102550
← PrevPage 7 of 40Next →
All datasetsPDP60STREUSLELexGLUEDialoGLUE fewshotDialoGLUE fullGLUE

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90—Unverified
2UDSSM-II (ensemble)Accuracy78.3—Unverified
3BERT-large 340MAccuracy78.3—Unverified
4UDSSM-I (ensemble)Accuracy76.7—Unverified
5DSSMAccuracy75—Unverified
6UDSSM-IIAccuracy75—Unverified
7BERT-base 110M + MASAccuracy68.3—Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7—Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60—Unverified
10Subword-level Transformer LMAccuracy58.3—Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5—Unverified
2BERT (none)Tags (Full) Acc82—Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81—Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3—Unverified
5RoBERTa + LinearFull F1 (Preps)78.2—Unverified
6GloVe (none)Tags (Full) Acc77.5—Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1—Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2—Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2—Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6—Unverified
2Legal-BERTCaseHOLD75.1—Unverified
3DeBERTaCaseHOLD72.1—Unverified
4LongformerCaseHOLD72—Unverified
5RoBERTaCaseHOLD71.7—Unverified
6BERTCaseHOLD70.7—Unverified
7BigBirdCaseHOLD70.4—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6—Unverified
2ConvBERT-DG + Pre + MultiAverage73.8—Unverified
3mslmAverage73.49—Unverified
4ConvBERT + Pre + MultiAverage68.22—Unverified
5BanLanGenAverage39.16—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89—Unverified
2mslmAverage85.83—Unverified
3ConvBERT-DG + Pre + MultiAverage85.34—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9—Unverified
2BERT-LARGEAverage82.1—Unverified