SOTAVerified

Mathematical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 805 papers

TitleStatusHype
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement LearningCode15
Qwen3 Technical ReportCode13
Qwen2.5 Technical ReportCode13
Absolute Zero: Reinforced Self-play Reasoning with Zero DataCode11
NeedleBench: Can LLMs Do Retrieval and Reasoning in Information-Dense Context?Code9
DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code IntelligenceCode9
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language ModelsCode9
s1: Simple test-time scalingCode9
EAGLE: Speculative Sampling Requires Rethinking Feature UncertaintyCode7
O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?Code7
Skywork-R1V3 Technical ReportCode7
Gorilla: Large Language Model Connected with Massive APIsCode6
Mistral 7BCode6
Training Compute-Optimal Large Language ModelsCode6
Sparks of Artificial General Intelligence: Early experiments with GPT-4Code6
Search-o1: Agentic Search-Enhanced Large Reasoning ModelsCode5
Kimi-VL Technical ReportCode5
Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8BCode5
DeepEyes: Incentivizing "Thinking with Images" via Reinforcement LearningCode5
R-KV: Redundancy-aware KV Cache Compression for Training-Free Reasoning Models AccelerationCode5
DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal DecompositionCode5
LIMO: Less is More for ReasoningCode5
Group-in-Group Policy Optimization for LLM Agent TrainingCode5
LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical ReasoningCode5
WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-InstructCode5
AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetCode4
MM-PRM: Enhancing Multimodal Mathematical Reasoning with Scalable Step-Level SupervisionCode4
Knowledge Fusion of Large Language ModelsCode4
ChatGPT for Robotics: Design Principles and Model AbilitiesCode4
OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction DataCode4
ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought TemplatesCode4
MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data EngineCode4
Galactica: A Large Language Model for ScienceCode4
SuperCorrect: Supervising and Correcting Language Models with Error-Driven InsightsCode4
LEAN-GitHub: Compiling GitHub LEAN repositories for a versatile LEAN proverCode4
How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data CompositionCode3
Self-Refine: Iterative Refinement with Self-FeedbackCode3
Reinforcement Learning for Reasoning in Large Language Models with One Training ExampleCode3
Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn'tCode3
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon GenerationCode3
General-Reasoner: Advancing LLM Reasoning Across All DomainsCode3
Reasoning with Language Model Prompting: A SurveyCode3
Self-rewarding correction for mathematical reasoningCode3
MuMath-Code: Combining Tool-Use Large Language Models with Multi-perspective Data Augmentation for Mathematical ReasoningCode3
PAL: Program-aided Language ModelsCode3
MM-Agent: LLM as Agents for Real-world Mathematical Modeling ProblemCode3
MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge GraphsCode3
MoRA: High-Rank Updating for Parameter-Efficient Fine-TuningCode3
MARIO: MAth Reasoning with code Interpreter Output -- A Reproducible PipelineCode3
DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing ReasoningCode3
Show:102550
← PrevPage 1 of 17Next →
All datasetsAIME24FrontierMathLila (IID)Lila (OOD)PGPS9KAMC23GeoQAMath500UniGeoUniGeo (PRV)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4—Unverified
2DeepSeek-r1Acc79.8—Unverified
3Openai-o1Acc74.4—Unverified
4Openai-o1-miniAcc70—Unverified
5Search-o1Acc56.7—Unverified
6s1-32BAcc56.7—Unverified
7Openai-o1-previewAcc44.6—Unverified
8Qwen2.5-72B-InstructAcc23.3—Unverified
9Claude3.5-SonnetAcc16—Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25—Unverified
2Gemini 1.5 Pro (002)Accuracy0.02—Unverified
3GPT-4oAccuracy0.01—Unverified
4o1-miniAccuracy0.01—Unverified
5o1-previewAccuracy0.01—Unverified
6Claude 3.5 SonnetAccuracy0.01—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48—Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39—Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45—Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27—Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8—Unverified
2PGPSNetCompletion accuracy62.7—Unverified
3GAPSCompletion accuracy61.2—Unverified
4Inter-GPSCompletion accuracy59.8—Unverified
5GeoformerCompletion accuracy35.6—Unverified
6NGSCompletion accuracy34.1—Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5—Unverified
2Math-MasterAcc82—Unverified
3Qwen2.5-Math-7B-instructAcc62.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2—Unverified
2GAPSAccuracy (%)67.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5—Unverified