SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 201250 of 1978 papers

TitleStatusHype
Joint Prompt Optimization of Stacked LLMs using Variational InferenceCode1
Debiasing Methods in Natural Language Understanding Make Bias More AccessibleCode1
Bridging Text and Vision: A Multi-View Text-Vision Registration Approach for Cross-Modal Place RecognitionCode1
How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language UnderstandingCode1
ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control CommunicationsCode1
Active Learning by Acquiring Contrastive ExamplesCode1
DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented DialogueCode1
A Top-Down Neural Architecture towards Text-Level Parsing of Discourse Rhetorical StructureCode1
Incorporating BERT into Parallel Sequence Decoding with AdaptersCode1
Increasing Model Capacity for Free: A Simple Strategy for Parameter Efficient Fine-tuningCode1
IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language UnderstandingCode1
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and LanguageCode1
Attention Is (not) All You Need for Commonsense ReasoningCode1
Analyzing Multi-Task Learning for Abstractive Text SummarizationCode1
Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositionCode1
IsoBN: Fine-Tuning BERT with Isotropic Batch NormalizationCode1
C-STS: Conditional Semantic Textual SimilarityCode1
Jack the Reader - A Machine Reading FrameworkCode1
KALA: Knowledge-Augmented Language Model AdaptationCode1
KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language ModelsCode1
KLUE: Korean Language Understanding EvaluationCode1
Knowledge-enhanced Visual-Language Pre-training on Chest Radiology ImagesCode1
CTRAN: CNN-Transformer-based Network for Natural Language UnderstandingCode1
LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional AdaptationCode1
CREAK: A Dataset for Commonsense Reasoning over Entity KnowledgeCode1
Automatic Disfluency Detection from Untranscribed SpeechCode1
Large Language Models are Temporal and Causal Reasoners for Video Question AnsweringCode1
Large Language Models as Corporate LobbyistsCode1
A Hybrid Architecture for Out of Domain Intent Detection and Intent DiscoveryCode1
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language ModelsCode1
Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language ModelsCode1
Convolution-enhanced Evolving Attention NetworksCode1
An Empirical Study of Tokenization Strategies for Various Korean NLP TasksCode1
ConvBERT: Improving BERT with Span-based Dynamic ConvolutionCode1
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and GenerationCode1
AutoTrans: Automating Transformer Design via Reinforced Architecture SearchCode1
Cross-Lingual Semantic Role Labeling with High-Quality Translated Training CorpusCode1
A Win-win Deal: Towards Sparse and Robust Pre-trained Language ModelsCode1
BERT for Joint Intent Classification and Slot FillingCode1
Baby's CoThought: Leveraging Large Language Models for Enhanced Reasoning in Compact ModelsCode1
ConFiguRe: Exploring Discourse-level Chinese Figures of SpeechCode1
Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM CompressionCode1
Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring SystemsCode1
ARBML: Democritizing Arabic Natural Language Processing ToolsCode1
Benchmarking Robustness of Machine Reading Comprehension ModelsCode1
Conic10K: A Challenging Math Problem Understanding and Reasoning DatasetCode1
CSKG: The CommonSense Knowledge GraphCode1
Distilling Large Vision-Language Model with Out-of-Distribution GeneralizabilityCode1
Collaborative Multi-Agent Dialogue Model Training Via Reinforcement LearningCode1
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge GraphsCode1
Show:102550
← PrevPage 5 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified