SOTAVerified

Mathematical Reasoning

Papers

Showing 51100 of 805 papers

TitleStatusHype
General-Reasoner: Advancing LLM Reasoning Across All DomainsCode3
Spurious Rewards: Rethinking Training Signals in RLVRCode3
MathArena: Evaluating LLMs on Uncontaminated Math CompetitionsCode3
Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMsCode3
Self-Refine: Iterative Refinement with Self-FeedbackCode3
AlphaMath Almost Zero: Process Supervision without ProcessCode3
Self-rewarding correction for mathematical reasoningCode3
Reinforcement Learning for Reasoning in Large Language Models with One Training ExampleCode3
Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn'tCode3
SkyMath: Technical ReportCode3
MuggleMath: Assessing the Impact of Query and Response Augmentation on Math ReasoningCode2
A Survey of Deep Learning for Mathematical ReasoningCode2
GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem SolversCode2
Preference Optimization for Reasoning with Pseudo FeedbackCode2
Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-TuningCode2
ProcessBench: Identifying Process Errors in Mathematical ReasoningCode2
Gödel Agent: A Self-Referential Agent Framework for Recursive Self-ImprovementCode2
MathPile: A Billion-Token-Scale Pretraining Corpus for MathCode2
Optimizing Anytime Reasoning via Budget Relative Policy OptimizationCode2
Agent RL Scaling Law: Agent RL with Spontaneous Code Execution for Mathematical Problem SolvingCode2
SOLO: A Single Transformer for Scalable Vision-Language ModelingCode2
Offline Reinforcement Learning for LLM Multi-Step ReasoningCode2
Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language ModelsCode2
O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning PruningCode2
Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation ModelsCode2
FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language ModelsCode2
Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning ProcessCode2
Reformatted AlignmentCode2
MetaMath: Bootstrap Your Own Mathematical Questions for Large Language ModelsCode2
Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive TasksCode2
MegaMath: Pushing the Limits of Open Math CorporaCode2
Measuring Mathematical Problem Solving With the MATH DatasetCode2
DRLE: Decentralized Reinforcement Learning at the Edge for Traffic Light Control in the IoVCode2
Efficient Reinforcement Finetuning via Adaptive Curriculum LearningCode2
Measuring Multimodal Mathematical Reasoning with MATH-Vision DatasetCode2
Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language ModelsCode2
DisCO: Reinforcing Large Reasoning Models with Discriminative Constrained OptimizationCode2
MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math DataCode2
Evaluating Mathematical Reasoning Beyond AccuracyCode2
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsCode2
Exploring the Compositional Deficiency of Large Language Models in Mathematical ReasoningCode2
MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningCode2
An Expression Tree Decoding Strategy for Mathematical Equation GenerationCode2
MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought ReasoningCode2
LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank AdaptationCode2
Benchmarking Benchmark Leakage in Large Language ModelsCode2
FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain ScenariosCode2
MAmmoTH: Building Math Generalist Models through Hybrid Instruction TuningCode2
Flow of Reasoning:Training LLMs for Divergent Problem Solving with Minimal ExamplesCode2
Can Atomic Step Decomposition Enhance the Self-structured Reasoning of Multimodal Large Models?Code2
Show:102550
← PrevPage 2 of 17Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4Unverified
2DeepSeek-r1Acc79.8Unverified
3Openai-o1Acc74.4Unverified
4Openai-o1-miniAcc70Unverified
5s1-32BAcc56.7Unverified
6Search-o1Acc56.7Unverified
7Openai-o1-previewAcc44.6Unverified
8Qwen2.5-72B-InstructAcc23.3Unverified
9Claude3.5-SonnetAcc16Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25Unverified
2Gemini 1.5 Pro (002)Accuracy0.02Unverified
3o1-previewAccuracy0.01Unverified
4GPT-4oAccuracy0.01Unverified
5Claude 3.5 SonnetAccuracy0.01Unverified
6o1-miniAccuracy0.01Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8Unverified
2PGPSNetCompletion accuracy62.7Unverified
3GAPSCompletion accuracy61.2Unverified
4Inter-GPSCompletion accuracy59.8Unverified
5GeoformerCompletion accuracy35.6Unverified
6NGSCompletion accuracy34.1Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5Unverified
2Math-MasterAcc82Unverified
3Qwen2.5-Math-7B-instructAcc62.5Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2Unverified
2GAPSAccuracy (%)67.8Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5Unverified