SOTAVerified

MMLU

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 340 papers

TitleStatusHype
ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All ToolsCode14
Qwen2 Technical ReportCode13
SCORE: Systematic COnsistency and Robustness Evaluation for Large Language ModelsCode11
LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-TuningCode9
Yi: Open Foundation Models by 01.AICode9
Efficient multi-prompt evaluation of LLMsCode7
DataComp-LM: In search of the next generation of training sets for language modelsCode7
Qwen2.5-Omni Technical ReportCode7
Revisiting MoE and Dense Speed-Accuracy Comparisons for LLM TrainingCode7
ART: Automatic multi-step reasoning and tool-use for large language modelsCode6
Training Compute-Optimal Large Language ModelsCode6
Make Your LLM Fully Utilize the ContextCode5
Baichuan 2: Open Large-scale Language ModelsCode4
BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical TextCode4
Galactica: A Large Language Model for ScienceCode4
Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up QuestionsCode4
YourBench: Easy Custom Evaluation Sets for EveryoneCode3
LayerSkip: Enabling Early Exit Inference and Self-Speculative DecodingCode3
Dynamic Cheatsheet: Test-Time Learning with Adaptive MemoryCode3
ChatMusician: Understanding and Generating Music Intrinsically with LLMCode3
HadaCore: Tensor Core Accelerated Hadamard Transform KernelCode3
General-Reasoner: Advancing LLM Reasoning Across All DomainsCode3
ReasonIR: Training Retrievers for Reasoning TasksCode3
Are We Done with MMLU?Code3
REPLUG: Retrieval-Augmented Black-Box Language ModelsCode3
Compact Language Models via Pruning and Knowledge DistillationCode3
DataDecide: How to Predict Best Pretraining Data with Small ExperimentsCode3
LoLCATs: On Low-Rank Linearizing of Large Language ModelsCode3
Scaling Instruction-Finetuned Language ModelsCode3
MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding BenchmarkCode3
What Matters in Transformers? Not All Attention is NeededCode2
Accurate LoRA-Finetuning Quantization of LLMs via Information RetentionCode2
A StrongREJECT for Empty JailbreaksCode2
Routoo: Learning to Route to Large Language Models EffectivelyCode2
AdvPrompter: Fast Adaptive Adversarial Prompting for LLMsCode2
SOTOPIA-π: Interactive Learning of Socially Intelligent Language AgentsCode2
tinyBenchmarks: evaluating LLMs with fewer examplesCode2
Rethinking Benchmark and Contamination for Language Models with Rephrased SamplesCode2
Reinforcing General Reasoning without VerifiersCode2
Right Question is Already Half the Answer: Fully Unsupervised LLM Reasoning IncentivizationCode2
MMLU-CF: A Contamination-free Multi-task Language Understanding BenchmarkCode2
any4: Learned 4-bit Numeric Representation for LLMsCode2
MedAgents: Large Language Models as Collaborators for Zero-shot Medical ReasoningCode2
Inheritune: Training Smaller Yet More Attentive Language ModelsCode2
EQ-Bench: An Emotional Intelligence Benchmark for Large Language ModelsCode2
Aurora:Activating Chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-TuningCode2
Atlas: Few-shot Learning with Retrieval Augmented Language ModelsCode2
Quamba2: A Robust and Scalable Post-training Quantization Framework for Selective State Space ModelsCode2
Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-InCode1
Efficient Online Data Mixing For Language Model Pre-TrainingCode1
Show:102550
← PrevPage 1 of 7Next →
All datasetsSIOP 2020/2021MMLU-ProVCTK

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1go ahead, make my dataFinal_score61.72—Unverified
2#GreedyCowFinal_score61.63—Unverified
3Don't Ask Us yFinal_score61.4—Unverified
4Data_and_ConfusedFinal_score60.96—Unverified
5WafflesFinal_score60.91—Unverified
6raakaFinal_score60.91—Unverified
7Team ProcrustinationFinal_score60.64—Unverified
8Axiom Consulting PartnersFinal_score60.63—Unverified
9Lets_Be_FairFinal_score60.23—Unverified
10goonersFinal_score60.22—Unverified
#ModelMetricClaimedVerifiedStatus
1Orange-mini0-shot MRR99.19—Unverified
#ModelMetricClaimedVerifiedStatus
1HybridBeam+SI-SDRi13.3—Unverified