SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 401450 of 1978 papers

TitleStatusHype
Dialect Normalization using Large Language Models and Morphological RulesCode0
EdgeProfiler: A Fast Profiling Framework for Lightweight LLMs on Edge Using Analytical ModelCode0
Demonstrations of Integrity Attacks in Multi-Agent Systems0
ChemGraph: An Agentic Framework for Computational Chemistry Workflows0
ChemAU: Harness the Reasoning of LLMs in Chemical Research with Adaptive Uncertainty Estimation0
Benchmarking Large Language Models for Cryptanalysis and Mismatched-Generalization0
MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection0
ICH-Qwen: A Large Language Model Towards Chinese Intangible Cultural Heritage0
StreamLink: Large-Language-Model Driven Distributed Data Engineering System0
RefLoRA: Refactored Low-Rank Adaptation for Efficient Fine-Tuning of Large Models0
Exploring the Vulnerability of the Content Moderation Guardrail in Large Language Models via Intent Manipulation0
SAE-SSV: Supervised Steering in Sparse Representation Spaces for Reliable Control of Language Models0
Logic-of-Thought: Empowering Large Language Models with Logic Programs for Solving Puzzles in Natural LanguageCode0
Large Language Model-Empowered Interactive Load Forecasting0
Unlocking Smarter Device Control: Foresighted Planning with a World Model-Driven Code Execution Approach0
Evolutionary Computation and Large Language Models: A Survey of Methods, Synergies, and Applications0
Transfer of Structural Knowledge from Synthetic LanguagesCode0
Cross-Lingual Representation Alignment Through Contrastive Image-Caption TuningCode0
A Case Study of Cross-Lingual Zero-Shot Generalization for Classical Languages in LLMsCode0
ModernGBERT: German-only 1B Encoder Model Trained from Scratch0
Krikri: Advancing Open Large Language Models for Greek0
Cloud-Based AI Systems: Leveraging Large Language Models for Intelligent Fault Detection and Autonomous Self-Healing0
Do LLMs Memorize Recommendation Datasets? A Preliminary Study on MovieLens-1MCode0
Human-like Cognitive Generalization for Large Models via Brain-in-the-loop Supervision0
Hakim: Farsi Text Embedding Model0
TUMS: Enhancing Tool-use Abilities of LLMs with Multi-structure Handlers0
A Social Robot with Inner Speech for Dietary GuidanceCode0
Vision-Language-Action Models: Concepts, Progress, Applications and Challenges0
A Comparative Analysis of Ethical and Safety Gaps in LLMs using Relative Danger Coefficient0
Structured Prompting and Feedback-Guided Reasoning with LLMs for Data Interpretation0
TRAVELER: A Benchmark for Evaluating Temporal Reasoning across Vague, Implicit and Explicit References0
Understanding LLM Scientific Reasoning through Promptings and Model's Explanation on the Answers0
Hallucinations and Key Information Extraction in Medical Texts: A Comprehensive Assessment of Open-Source Large Language Models0
Auto-SLURP: A Benchmark Dataset for Evaluating Multi-Agent Frameworks in Smart Personal AssistantCode0
Pushing the boundary on Natural Language Inference0
A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigms0
TD-Suite: All Batteries Included Framework for Technical Debt ClassificationCode0
Kongzi: A Historical Large Language Model with Fact Enhancement0
Can you map it to English? The Role of Cross-Lingual Alignment in Multilingual Performance of LLMsCode0
Knowledge Graph-extended Retrieval Augmented Generation for Question Answering0
PathGPT: Leveraging Large Language Models for Personalized Route Generation0
Assessing how hyperparameters impact Large Language Models' sarcasm detection performance0
AROMA: Autonomous Rank-one Matrix AdaptationCode0
Catastrophic Forgetting in LLMs: A Comparative Analysis Across Language Tasks0
Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQL0
VectorFit : Adaptive Singular & Bias Vector Fine-Tuning of Pre-trained Foundation Models0
Language-specific Neurons Do Not Facilitate Cross-Lingual Transfer0
Natural Language Generation0
OmniGeo: Towards a Multimodal Large Language Models for Geospatial Artificial Intelligence0
A Review on Large Language Models for Visual Analytics0
Show:102550
← PrevPage 9 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified