SOTAVerified

Mathematical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 805 papers

TitleStatusHype
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon GenerationCode3
MARIO: MAth Reasoning with code Interpreter Output -- A Reproducible PipelineCode3
SkyMath: Technical ReportCode3
How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data CompositionCode3
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem SolvingCode3
Self-Refine: Iterative Refinement with Self-FeedbackCode3
Reasoning with Language Model Prompting: A SurveyCode3
PAL: Program-aided Language ModelsCode3
Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-ThoughtCode3
Training Verifiers to Solve Math Word ProblemsCode3
Confucius3-Math: A Lightweight High-Performance Reasoning LLM for Chinese K-12 Mathematics LearningCode2
CoRT: Code-integrated Reasoning within ThinkingCode2
Vision Matters: Simple Visual Perturbations Can Boost Multimodal Math ReasoningCode2
MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought ReasoningCode2
The Surprising Effectiveness of Negative Reinforcement in LLM ReasoningCode2
Reinforcing General Reasoning without VerifiersCode2
RL Tango: Reinforcing Generator and Verifier Together for Language ReasoningCode2
Optimizing Anytime Reasoning via Budget Relative Policy OptimizationCode2
DisCO: Reinforcing Large Reasoning Models with Discriminative Constrained OptimizationCode2
Agent RL Scaling Law: Agent RL with Spontaneous Code Execution for Mathematical Problem SolvingCode2
FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language ModelsCode2
Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative ReasoningCode2
LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank AdaptationCode2
Right Question is Already Half the Answer: Fully Unsupervised LLM Reasoning IncentivizationCode2
Efficient Reinforcement Finetuning via Adaptive Curriculum LearningCode2
MegaMath: Pushing the Limits of Open Math CorporaCode2
Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive TasksCode2
Can Atomic Step Decomposition Enhance the Self-structured Reasoning of Multimodal Large Models?Code2
RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMsCode2
Exploring the Limit of Outcome Reward for Learning Mathematical ReasoningCode2
ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference OptimizationCode2
Reusing Embeddings: Reproducible Reward Model Research in Large Language Model Alignment without GPUsCode2
Critique Fine-Tuning: Learning to Critique is More Effective than Learning to ImitateCode2
O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning PruningCode2
URSA: Understanding and Verifying Chain-of-thought Reasoning in Multimodal MathematicsCode2
B-STaR: Monitoring and Balancing Exploration and Exploitation in Self-Taught ReasonersCode2
Offline Reinforcement Learning for LLM Multi-Step ReasoningCode2
ProcessBench: Identifying Process Errors in Mathematical ReasoningCode2
TACO: Learning Multi-modal Action Models with Synthetic Chains-of-Thought-and-ActionCode2
Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-TuningCode2
Preference Optimization for Reasoning with Pseudo FeedbackCode2
Enhancing LLM Reasoning with Reward-guided Tree SearchCode2
AtomThink: A Slow Thinking Framework for Multimodal Mathematical ReasoningCode2
Unleashing Reasoning Capability of LLMs via Scalable Question Synthesis from ScratchCode2
MathCoder2: Better Math Reasoning from Continued Pretraining on Model-translated Mathematical CodeCode2
Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language ModelsCode2
LeanAgent: Lifelong Learning for Formal Theorem ProvingCode2
Gödel Agent: A Self-Referential Agent Framework for Recursive Self-ImprovementCode2
CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal ModelsCode2
Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning ProcessCode2
Show:102550
← PrevPage 2 of 17Next →
All datasetsAIME24FrontierMathLila (IID)Lila (OOD)PGPS9KAMC23GeoQAMath500UniGeoUniGeo (PRV)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4—Unverified
2DeepSeek-r1Acc79.8—Unverified
3Openai-o1Acc74.4—Unverified
4Openai-o1-miniAcc70—Unverified
5Search-o1Acc56.7—Unverified
6s1-32BAcc56.7—Unverified
7Openai-o1-previewAcc44.6—Unverified
8Qwen2.5-72B-InstructAcc23.3—Unverified
9Claude3.5-SonnetAcc16—Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25—Unverified
2Gemini 1.5 Pro (002)Accuracy0.02—Unverified
3GPT-4oAccuracy0.01—Unverified
4o1-miniAccuracy0.01—Unverified
5o1-previewAccuracy0.01—Unverified
6Claude 3.5 SonnetAccuracy0.01—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48—Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39—Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45—Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27—Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8—Unverified
2PGPSNetCompletion accuracy62.7—Unverified
3GAPSCompletion accuracy61.2—Unverified
4Inter-GPSCompletion accuracy59.8—Unverified
5GeoformerCompletion accuracy35.6—Unverified
6NGSCompletion accuracy34.1—Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5—Unverified
2Math-MasterAcc82—Unverified
3Qwen2.5-Math-7B-instructAcc62.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2—Unverified
2GAPSAccuracy (%)67.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5—Unverified