SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 1978 papers

TitleStatusHype
DataComp-LM: In search of the next generation of training sets for language modelsCode7
Mixture-of-Agents Enhances Large Language Model CapabilitiesCode7
Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondCode6
Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGCode5
MedCare: Advancing Medical LLMs through Decoupling Clinical Alignment and Knowledge AggregationCode5
MING-MOE: Enhancing Medical Multi-Task Learning in Large Language Models with Sparse Mixture of Low-Rank Adapter ExpertsCode5
TaskWeaver: A Code-First Agent FrameworkCode5
How to Design Translation Prompts for ChatGPT: An Empirical StudyCode5
A Survey on Vision-Language-Action Models for Autonomous DrivingCode4
Decoder Tuning: Efficient Language Understanding as DecodingCode4
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice PerspectiveCode4
DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank AdaptationCode4
What Makes Good In-Context Examples for GPT-3?Code4
Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQLCode3
Large Language Model-Brained GUI Agents: A SurveyCode3
SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video SegmentationCode3
Tree Search for Language Model AgentsCode3
GameBench: Evaluating Strategic Reasoning Abilities of LLM AgentsCode3
MARIO: MAth Reasoning with code Interpreter Output -- A Reproducible PipelineCode3
Efficient Large Language Models: A SurveyCode3
GLM: General Language Model Pretraining with Autoregressive Blank InfillingCode3
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language UnderstandingCode3
Ludwig: a type-based declarative deep learning toolboxCode3
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingCode3
Attention Is All You NeedCode3
Vision Language Action Models in Robotic Manipulation: A Systematic ReviewCode2
Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and OpportunitiesCode2
An Empirical Study of Qwen3 QuantizationCode2
LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank AdaptationCode2
BEVDriver: Leveraging BEV Maps in LLMs for Robust Closed-Loop DrivingCode2
Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization AlignmentCode2
MCP-Solver: Integrating Language Models with Constraint Programming SystemsCode2
3DGraphLLM: Combining Semantic Graphs and Large Language Models for 3D Scene UnderstandingCode2
Large Language Model Safety: A Holistic SurveyCode2
Selective Aggregation for Low-Rank Adaptation in Federated LearningCode2
Balancing LoRA Performance and Efficiency with Simple Shard SharingCode2
Improving Text Embeddings for Smaller Language Models Using Contrastive Fine-tuningCode2
LoRA-Pro: Are Low-Rank Adapters Properly Optimized?Code2
MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math DataCode2
Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU TasksCode2
SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language ModelsCode2
Parameter-Efficient Fine-Tuning with Discrete Fourier TransformCode2
An empirical study of LLaMA3 quantization: from LLMs to MLLMsCode2
CleanAgent: Automating Data Standardization with LLM-based AgentsCode2
SciAssess: Benchmarking LLM Proficiency in Scientific Literature AnalysisCode2
The First Place Solution of WSDM Cup 2024: Leveraging Large Language Models for Conversational Multi-Doc QACode2
TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and GenerationCode2
Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and ActionCode2
Reflection-Tuning: Data Recycling Improves LLM Instruction-TuningCode2
LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language ModelsCode2
Show:102550
← PrevPage 1 of 40Next →
All datasetsPDP60STREUSLELexGLUEDialoGLUE fewshotDialoGLUE fullGLUE

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90—Unverified
2BERT-large 340MAccuracy78.3—Unverified
3UDSSM-II (ensemble)Accuracy78.3—Unverified
4UDSSM-I (ensemble)Accuracy76.7—Unverified
5DSSMAccuracy75—Unverified
6UDSSM-IIAccuracy75—Unverified
7BERT-base 110M + MASAccuracy68.3—Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7—Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60—Unverified
10Subword-level Transformer LMAccuracy58.3—Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5—Unverified
2BERT (none)Tags (Full) Acc82—Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81—Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3—Unverified
5RoBERTa + LinearFull F1 (Preps)78.2—Unverified
6GloVe (none)Tags (Full) Acc77.5—Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1—Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2—Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2—Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6—Unverified
2Legal-BERTCaseHOLD75.1—Unverified
3DeBERTaCaseHOLD72.1—Unverified
4LongformerCaseHOLD72—Unverified
5RoBERTaCaseHOLD71.7—Unverified
6BERTCaseHOLD70.7—Unverified
7BigBirdCaseHOLD70.4—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6—Unverified
2ConvBERT-DG + Pre + MultiAverage73.8—Unverified
3mslmAverage73.49—Unverified
4ConvBERT + Pre + MultiAverage68.22—Unverified
5BanLanGenAverage39.16—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89—Unverified
2mslmAverage85.83—Unverified
3ConvBERT-DG + Pre + MultiAverage85.34—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9—Unverified
2BERT-LARGEAverage82.1—Unverified