SOTAVerified

MMLU

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 340 papers

TitleStatusHype
Monty Hall and Optimized Conformal Prediction to Improve Decision-Making with LLMs—0
More is Less: The Pitfalls of Multi-Model Synthetic Preference Data in DPO Safety Alignment—0
Multi-lingual Functional Evaluation for Large Language Models—0
Nanoscaling Floating-Point (NxFP): NanoMantissa, Adaptive Microexponents, and Code Recycling for Direct-Cast Compression of Large Language Models—0
Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset—0
Networks of Networks: Complexity Class Principles Applied to Compound AI Systems Design—0
None of the Above, Less of the Right: Parallel Patterns between Humans and LLMs on Multi-Choice Questions Answering—0
None of the Others: a General Technique to Distinguish Reasoning from Memorization in Multiple-Choice LLM Evaluation Benchmarks—0
NumeroLogic: Number Encoding for Enhanced LLMs' Numerical Reasoning—0
Obliviate: Efficient Unmemorization for Protecting Intellectual Property in Large Language Models—0
Octopus v4: Graph of language models—0
OctoTools: An Agentic Framework with Extensible Tools for Complex Reasoning—0
On the Reasoning Capacity of AI Models and How to Quantify It—0
OpenMedLM: Prompt engineering can out-perform fine-tuning in medical question-answering with open-source large language models—0
Optimised Grouped-Query Attention Mechanism for Transformers—0
Order Independence With Finetuning—0
ORI: O Routing Intelligence—0
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone—0
Pistis-RAG: Enhancing Retrieval-Augmented Generation with Human Feedback—0
PolyPrompt: Automating Knowledge Extraction from Multilingual Language Models with Dynamic Prompt Generation—0
Predicting Emergent Capabilities by Finetuning—0
BOTS-LM: Training Large Language Models for Setswana—0
Teuken-7B-Base & Teuken-7B-Instruct: Towards European LLMs—0
Project MPG: towards a generalized performance benchmark for LLM capabilities—0
Pruning Large Language Models via Accuracy Predictor—0
ConceptPsy:A Benchmark Suite with Conceptual Comprehensiveness in Psychology—0
Quantifying Variance in Evaluation Benchmarks—0
ALLaM: Large Language Models for Arabic and English—0
AgentInstruct: Toward Generative Teaching with Agentic Flows—0
Reactor Mk.1 performances: MMLU, HumanEval and BBH test results—0
Real-time Adapting Routing (RAR): Improving Efficiency Through Continuous Learning in Software Powered by Layered Foundation Models—0
Reasoning Beyond Bias: A Study on Counterfactual Prompting and Chain of Thought Reasoning—0
MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models—0
Reasoning Paths Optimization: Learning to Reason and Explore From Diverse Paths—0
Reasoning Robustness of LLMs to Adversarial Typographical Errors—0
Reinforcement Fine-Tuning Naturally Mitigates Forgetting in Continual Post-Training—0
Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models—0
MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMsCode0
Warm Up Before You Train: Unlocking General Reasoning in Resource-Constrained SettingsCode0
ChatBench: From Static Benchmarks to Human-AI EvaluationCode0
Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model EvaluationCode0
ARL2: Aligning Retrievers for Black-box Large Language Models via Self-guided Adaptive Relevance LabelingCode0
Earlier Tokens Contribute More: Learning Direct Preference Optimization From Temporal Decay PerspectiveCode0
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model LeaderboardsCode0
MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical ReasoningCode0
DFPE: A Diverse Fingerprint Ensemble for Enhancing LLM PerformanceCode0
BnMMLU: Measuring Massive Multitask Language Understanding in BengaliCode0
Review-Instruct: A Review-Driven Multi-Turn Conversations Generation Method for Large Language ModelsCode0
Noise Injection Reveals Hidden Capabilities of Sandbagging Language ModelsCode0
Rethinking Channel Dimensions to Isolate Outliers for Low-bit Weight Quantization of Large Language ModelsCode0
Show:102550
← PrevPage 6 of 7Next →
All datasetsSIOP 2020/2021MMLU-ProVCTK

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1go ahead, make my dataFinal_score61.72—Unverified
2#GreedyCowFinal_score61.63—Unverified
3Don't Ask Us yFinal_score61.4—Unverified
4Data_and_ConfusedFinal_score60.96—Unverified
5WafflesFinal_score60.91—Unverified
6raakaFinal_score60.91—Unverified
7Team ProcrustinationFinal_score60.64—Unverified
8Axiom Consulting PartnersFinal_score60.63—Unverified
9Lets_Be_FairFinal_score60.23—Unverified
10goonersFinal_score60.22—Unverified
#ModelMetricClaimedVerifiedStatus
1Orange-mini0-shot MRR99.19—Unverified
#ModelMetricClaimedVerifiedStatus
1HybridBeam+SI-SDRi13.3—Unverified