SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 301350 of 1978 papers

TitleStatusHype
FaVIQ: FAct Verification from Information-seeking QuestionsCode1
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP TasksCode1
Form-NLU: Dataset for the Form Natural Language UnderstandingCode1
CalBERT - Code-mixed Adaptive Language representations using BERTCode1
DeLoRA: Decoupling Angles and Strength in Low-rank AdaptationCode1
Call for Papers -- The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpusCode1
Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring SystemsCode1
Generating Training Data with Language Models: Towards Zero-Shot Language UnderstandingCode1
GisPy: A Tool for Measuring Gist Inference Score in TextCode1
GLADIS: A General and Large Acronym Disambiguation BenchmarkCode1
Active Learning by Acquiring Contrastive ExamplesCode1
Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM CompressionCode1
A Comprehensive Analysis of Adapter EfficiencyCode1
A Toolkit for Generating Code Knowledge GraphsCode1
BERT for Joint Intent Classification and Slot FillingCode1
CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language UnderstandingCode1
Joint Prompt Optimization of Stacked LLMs using Variational InferenceCode1
How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language UnderstandingCode1
Beyond Silent Letters: Amplifying LLMs in Emotion Recognition with Vocal NuancesCode1
Comparison by Conversion: Reverse-Engineering UCCA from Syntax and Lexical SemanticsCode1
Incorporating BERT into Neural Machine TranslationCode1
Incorporating BERT into Parallel Sequence Decoding with AdaptersCode1
Capabilities of GPT-4 on Medical Challenge ProblemsCode1
Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesCode1
Inducer-tuning: Connecting Prefix-tuning and Adapter-tuningCode1
InforMask: Unsupervised Informative Masking for Language Model PretrainingCode1
Dual Inference for Improving Language Understanding and GenerationCode1
IsoBN: Fine-Tuning BERT with Isotropic Batch NormalizationCode1
Anno-MI: A Dataset of Expert-Annotated Counselling DialoguesCode1
Jack the Reader - A Machine Reading FrameworkCode1
KALA: Knowledge-Augmented Language Model AdaptationCode1
Causality-aware Concept Extraction based on Knowledge-guided PromptingCode1
KLEJ: Comprehensive Benchmark for Polish Language UnderstandingCode1
KLUE: Korean Language Understanding EvaluationCode1
Debiasing Methods in Natural Language Understanding Make Bias More AccessibleCode1
Benchmarking Robustness of Machine Reading Comprehension ModelsCode1
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-CommerceCode1
LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional AdaptationCode1
Benchmarking Natural Language Understanding Services for building Conversational AgentsCode1
Large Language Model Inference Acceleration: A Comprehensive Hardware PerspectiveCode1
A Large-scale Comprehensive Abusiveness Detection Dataset with Multifaceted Labels from RedditCode1
Large Language Models are Temporal and Causal Reasoners for Video Question AnsweringCode1
A Simple but Tough-to-Beat Data Augmentation Approach for Natural Language Understanding and GenerationCode1
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language ModelsCode1
C-STS: Conditional Semantic Textual SimilarityCode1
Learning to Split for Automatic Bias DetectionCode1
ChatLog: Carefully Evaluating the Evolution of ChatGPT Across TimeCode1
ALBETO and DistilBETO: Lightweight Spanish Language ModelsCode1
CTRAN: CNN-Transformer-based Network for Natural Language UnderstandingCode1
Belief Revision based Caption Re-ranker with Visual Semantic InformationCode1
Show:102550
← PrevPage 7 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2BERT-large 340MAccuracy78.3Unverified
3UDSSM-II (ensemble)Accuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified