SOTAVerified

MMLU

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 340 papers

TitleStatusHype
Learning What Matters: Probabilistic Task Selection via Mutual Information for Model Finetuning—0
Step-wise Policy for Rare-tool Knowledge (SPaRK): Offline RL that Drives Diverse Tool Use in LLMsCode0
Lizard: An Efficient Linearization Framework for Large Language Models—0
Integrating External Tools with Large Language Models to Improve Accuracy—0
Growing Transformers: Modular Composition and Layer-wise Expansion on a Frozen SubstrateCode0
The Delta Learning Hypothesis: Preference Tuning on Weak Data can Yield Strong GainsCode1
Reinforcement Fine-Tuning Naturally Mitigates Forgetting in Continual Post-Training—0
any4: Learned 4-bit Numeric Representation for LLMsCode2
Emergent Semantics Beyond Token Embeddings: Transformer LMs with Frozen Visual Unicode RepresentationsCode0
Multi-lingual Functional Evaluation for Large Language Models—0
Enterprise Large Language Model Evaluation Benchmark—0
Biomed-Enriched: A Biomedical Dataset Enriched with LLMs for Pretraining and Extracting Rare and Hidden Content—0
Gazal-R1: Achieving State-of-the-Art Medical Reasoning with Parameter-Efficient Two-Stage Training—0
Surface Fairness, Deep Bias: A Comparative Study of Bias in Language Models—0
Slimming Down LLMs Without Losing Their Minds—0
MoE-GPS: Guidlines for Prediction Strategy for Dynamic Expert Duplication in MoE Load Balancing—0
From Threat to Tool: Leveraging Refusal-Aware Injection Attacks for Safety Alignment—0
Automatic Robustness Stress Testing of LLMs as Mathematical Problem Solvers—0
GEM: Empowering LLM for both Embedding Generation and Language Understanding—0
Do Language Models Mirror Human Confidence? Exploring Psychological Insights to Address Overconfidence in LLMsCode0
SiLVR: A Simple Language-based Video Reasoning FrameworkCode1
HELM: Hyperbolic Large Language Models via Mixture-of-Curvature ExpertsCode1
Simulating Training Data Leakage in Multiple-Choice Benchmarks for LLM EvaluationCode0
Model Unlearning via Sparse Autoencoder Subspace Guided Projections—0
Revisiting Uncertainty Estimation and Calibration of Large Language Models—0
Actor-Critic based Online Data Mixing For Language Model Pre-Training—0
DyePack: Provably Flagging Test Set Contamination in LLMs Using BackdoorsCode0
Large Language Models Often Know When They Are Being Evaluated—0
Reinforcing General Reasoning without VerifiersCode2
Capability-Based Scaling Laws for LLM Red-TeamingCode0
Interleaved Reasoning for Large Language Models via Reinforcement Learning—0
The Price of Format: Diversity Collapse in LLMsCode0
BnMMLU: Measuring Massive Multitask Language Understanding in BengaliCode0
Efficient Data Selection at Scale via Influence Distillation—0
LoTA-QAF: Lossless Ternary Adaptation for Quantization-Aware Fine-TuningCode0
B-score: Detecting biases in large language models using response history—0
INFERENCEDYNAMICS: Efficient Routing Across LLMs through Structured Capability and Knowledge Profiling—0
Training Step-Level Reasoning Verifiers with Formal Verification ToolsCode1
Cost-aware LLM-based Online Dataset Annotation—0
Dual Decomposition of Weights and Singular Value Low Rank Adaptation—0
Self-Reasoning Language Models: Unfold Hidden Reasoning Chains with Few Reasoning Catalyst—0
Context Reasoner: Incentivizing Reasoning Capability for Contextualized Privacy and Safety Compliance via Reinforcement Learning—0
Void in Language ModelsCode0
General-Reasoner: Advancing LLM Reasoning Across All DomainsCode3
Warm Up Before You Train: Unlocking General Reasoning in Resource-Constrained SettingsCode0
Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language ModelsCode1
HALO: Hierarchical Autonomous Logic-Oriented Orchestration for Multi-Agent LLM SystemsCode1
Tiny QA Benchmark++: Ultra-Lightweight, Synthetic Multilingual Dataset Generation & Smoke-Tests for Continuous LLM EvaluationCode1
Critique-Guided Distillation: Improving Supervised Fine-tuning via Better Distillation—0
MedCaseReasoning: Evaluating and learning diagnostic reasoning from clinical case reportsCode1
Show:102550
← PrevPage 1 of 7Next →
All datasetsSIOP 2020/2021MMLU-ProVCTK

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1go ahead, make my dataFinal_score61.72—Unverified
2#GreedyCowFinal_score61.63—Unverified
3Don't Ask Us yFinal_score61.4—Unverified
4Data_and_ConfusedFinal_score60.96—Unverified
5WafflesFinal_score60.91—Unverified
6raakaFinal_score60.91—Unverified
7Team ProcrustinationFinal_score60.64—Unverified
8Axiom Consulting PartnersFinal_score60.63—Unverified
9Lets_Be_FairFinal_score60.23—Unverified
10goonersFinal_score60.22—Unverified
#ModelMetricClaimedVerifiedStatus
1Orange-mini0-shot MRR99.19—Unverified
#ModelMetricClaimedVerifiedStatus
1HybridBeam+SI-SDRi13.3—Unverified