SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 1978 papers

TitleStatusHype
Vision Language Action Models in Robotic Manipulation: A Systematic ReviewCode2
State and Memory is All You Need for Robust and Reliable AI Agents—0
A Survey on Vision-Language-Action Models for Autonomous DrivingCode4
skLEP: A Slovak General Language Understanding BenchmarkCode0
SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Models—0
Semantic similarity estimation for domain specific data using BERT and other techniques—0
Towards Pervasive Distributed Agentic Generative AI -- A State of The Art—0
An Interdisciplinary Review of Commonsense Reasoning and Intent Detection—0
Motion-R1: Chain-of-Thought Reasoning and Reinforcement Learning for Human Motion Generation—0
Dialect Normalization using Large Language Models and Morphological RulesCode0
EdgeProfiler: A Fast Profiling Framework for Lightweight LLMs on Edge Using Analytical ModelCode0
Demonstrations of Integrity Attacks in Multi-Agent Systems—0
ChemGraph: An Agentic Framework for Computational Chemistry Workflows—0
ChemAU: Harness the Reasoning of LLMs in Chemical Research with Adaptive Uncertainty Estimation—0
Benchmarking Large Language Models for Cryptanalysis and Mismatched-Generalization—0
MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection—0
ICH-Qwen: A Large Language Model Towards Chinese Intangible Cultural Heritage—0
StreamLink: Large-Language-Model Driven Distributed Data Engineering System—0
Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM CompressionCode1
Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and OpportunitiesCode2
RefLoRA: Refactored Low-Rank Adaptation for Efficient Fine-Tuning of Large Models—0
Exploring the Vulnerability of the Content Moderation Guardrail in Large Language Models via Intent Manipulation—0
Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQLCode3
Unlocking Smarter Device Control: Foresighted Planning with a World Model-Driven Code Execution Approach—0
Logic-of-Thought: Empowering Large Language Models with Logic Programs for Solving Puzzles in Natural LanguageCode0
Large Language Model-Empowered Interactive Load Forecasting—0
SAE-SSV: Supervised Steering in Sparse Representation Spaces for Reliable Control of Language Models—0
Transfer of Structural Knowledge from Synthetic LanguagesCode0
Evolutionary Computation and Large Language Models: A Survey of Methods, Synergies, and Applications—0
Krikri: Advancing Open Large Language Models for Greek—0
Cross-Lingual Representation Alignment Through Contrastive Image-Caption TuningCode0
A Case Study of Cross-Lingual Zero-Shot Generalization for Classical Languages in LLMsCode0
ModernGBERT: German-only 1B Encoder Model Trained from Scratch—0
Cloud-Based AI Systems: Leveraging Large Language Models for Intelligent Fault Detection and Autonomous Self-Healing—0
Do LLMs Memorize Recommendation Datasets? A Preliminary Study on MovieLens-1MCode0
Human-like Cognitive Generalization for Large Models via Brain-in-the-loop Supervision—0
Hakim: Farsi Text Embedding Model—0
A Social Robot with Inner Speech for Dietary GuidanceCode0
TUMS: Enhancing Tool-use Abilities of LLMs with Multi-structure Handlers—0
Vision-Language-Action Models: Concepts, Progress, Applications and Challenges—0
A Comparative Analysis of Ethical and Safety Gaps in LLMs using Relative Danger Coefficient—0
An Empirical Study of Qwen3 QuantizationCode2
Structured Prompting and Feedback-Guided Reasoning with LLMs for Data Interpretation—0
TRAVELER: A Benchmark for Evaluating Temporal Reasoning across Vague, Implicit and Explicit References—0
Understanding LLM Scientific Reasoning through Promptings and Model's Explanation on the Answers—0
OET: Optimization-based prompt injection Evaluation ToolkitCode1
Hallucinations and Key Information Extraction in Medical Texts: A Comprehensive Assessment of Open-Source Large Language Models—0
Auto-SLURP: A Benchmark Dataset for Evaluating Multi-Agent Frameworks in Smart Personal AssistantCode0
Pushing the boundary on Natural Language Inference—0
A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigms—0
Show:102550
← PrevPage 1 of 40Next →
All datasetsPDP60STREUSLELexGLUEDialoGLUE fewshotDialoGLUE fullGLUE

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90—Unverified
2BERT-large 340MAccuracy78.3—Unverified
3UDSSM-II (ensemble)Accuracy78.3—Unverified
4UDSSM-I (ensemble)Accuracy76.7—Unverified
5DSSMAccuracy75—Unverified
6UDSSM-IIAccuracy75—Unverified
7BERT-base 110M + MASAccuracy68.3—Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7—Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60—Unverified
10Subword-level Transformer LMAccuracy58.3—Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5—Unverified
2BERT (none)Tags (Full) Acc82—Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81—Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3—Unverified
5RoBERTa + LinearFull F1 (Preps)78.2—Unverified
6GloVe (none)Tags (Full) Acc77.5—Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1—Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2—Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2—Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6—Unverified
2Legal-BERTCaseHOLD75.1—Unverified
3DeBERTaCaseHOLD72.1—Unverified
4LongformerCaseHOLD72—Unverified
5RoBERTaCaseHOLD71.7—Unverified
6BERTCaseHOLD70.7—Unverified
7BigBirdCaseHOLD70.4—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6—Unverified
2ConvBERT-DG + Pre + MultiAverage73.8—Unverified
3mslmAverage73.49—Unverified
4ConvBERT + Pre + MultiAverage68.22—Unverified
5BanLanGenAverage39.16—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89—Unverified
2mslmAverage85.83—Unverified
3ConvBERT-DG + Pre + MultiAverage85.34—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9—Unverified
2BERT-LARGEAverage82.1—Unverified