SOTAVerified

Mathematical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 401–450 of 805 papers

TitleStatusHype
ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection—0
Evaluating Grounded Reasoning by Code-Assisted Large Language Models for Mathematics—0
Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads—0
Evaluating Robustness of Reward Models for Mathematical Reasoning—0
Evaluating the Meta- and Object-Level Reasoning of Large Language Models for Question Answering—0
Evaluation of LLMs for mathematical problem solving—0
Evaluation of OpenAI o1: Opportunities and Challenges of AGI—0
Evolutionary Pre-Prompt Optimization for Mathematical Reasoning—0
Evolving LLMs' Self-Refinement Capability via Iterative Preference Optimization—0
Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domains—0
Expanding Search Space with Diverse Prompting Agents: An Efficient Sampling Approach for LLM Mathematical Reasoning—0
Expediting and Elevating Large Language Model Reasoning via Hidden Chain-of-Thought Decoding—0
Explain with Visual Keypoints Like a Real Mentor! A Benchmark for Multimodal Solution Explanation—0
Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data—0
Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions—0
Exploring the Mystery of Influential Data for Mathematical Reasoning—0
Exposing the Achilles' Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning—0
Federated Prompting and Chain-of-Thought Reasoning for Improving LLMs Answering—0
FG-PRM: Fine-grained Hallucination Detection and Mitigation in Language Model Mathematical Reasoning—0
FineMath: A Fine-Grained Mathematical Evaluation Benchmark for Chinese Large Language Models—0
Fine-Tuning and Prompt Optimization: Two Great Steps that Work Better Together—0
First-Step Advantage: Importance of Starting Right in Multi-Step Math Reasoning—0
Flow-DPO: Improving LLM Mathematical Reasoning through Online Multi-Agent Learning—0
Foreword: A Computable Universe, Understanding Computation and Exploring Nature As Computation—0
Formal Mathematical Reasoning: A New Frontier in AI—0
Fourier Circuits in Neural Networks and Transformers: A Case Study of Modular Arithmetic with Multiple Inputs—0
From Calculation to Adjudication: Examining LLM judges on Mathematical Reasoning Tasks—0
From Correctness to Comprehension: AI Agents for Personalized Error Diagnosis in Education—0
From Good to Great: Improving Math Reasoning with Tool-Augmented Interleaf Prompting—0
From Informal to Formal -- Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofs—0
FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI—0
Full-Step-DPO: Self-Supervised Preference Optimization with Step-wise Rewards for Mathematical Reasoning—0
GAPS: Geometry-Aware Problem Solver—0
GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning—0
GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoning—0
GFlowNet Fine-tuning for Diverse Correct Solutions in Mathematical Reasoning Tasks—0
GoRA: Gradient-driven Adaptive Low Rank Adaptation—0
GraphIC: A Graph-Based In-Context Example Retrieval Model for Multi-Step Reasoning—0
GraphMR: Graph Neural Network for Mathematical Reasoning—0
Guided by Gut: Efficient Test-Time Scaling with Reinforced Intrinsic Confidence—0
Guided Search Strategies in Non-Serializable Environments with Applications to Software Engineering Agents—0
Herald: A Natural Language Annotated Lean 4 Dataset—0
HM3: Hierarchical Multi-Objective Model Merging for Pretrained Models—0
HOFT: Householder Orthogonal Fine-tuning—0
How Difficulty-Aware Staged Reinforcement Learning Enhances LLMs' Reasoning Capabilities: A Preliminary Experimental Study—0
How Does Quantization Affect Multilingual LLMs?—0
How Numerical Precision Affects Mathematical Reasoning Capabilities of LLMs—0
HS-STAR: Hierarchical Sampling for Self-Taught Reasoners via Difficulty Estimation and Budget Reallocation—0
Improve Mathematical Reasoning in Language Models by Automated Process Supervision—0
Improving Mathematical Reasoning Capabilities of Small Language Models via Feedback-Driven Distillation—0
Show:102550
← PrevPage 9 of 17Next →
All datasetsAIME24FrontierMathLila (IID)Lila (OOD)PGPS9KAMC23GeoQAMath500UniGeoUniGeo (PRV)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4—Unverified
2DeepSeek-r1Acc79.8—Unverified
3Openai-o1Acc74.4—Unverified
4Openai-o1-miniAcc70—Unverified
5Search-o1Acc56.7—Unverified
6s1-32BAcc56.7—Unverified
7Openai-o1-previewAcc44.6—Unverified
8Qwen2.5-72B-InstructAcc23.3—Unverified
9Claude3.5-SonnetAcc16—Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25—Unverified
2Gemini 1.5 Pro (002)Accuracy0.02—Unverified
3GPT-4oAccuracy0.01—Unverified
4o1-miniAccuracy0.01—Unverified
5o1-previewAccuracy0.01—Unverified
6Claude 3.5 SonnetAccuracy0.01—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48—Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39—Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45—Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27—Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8—Unverified
2PGPSNetCompletion accuracy62.7—Unverified
3GAPSCompletion accuracy61.2—Unverified
4Inter-GPSCompletion accuracy59.8—Unverified
5GeoformerCompletion accuracy35.6—Unverified
6NGSCompletion accuracy34.1—Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5—Unverified
2Math-MasterAcc82—Unverified
3Qwen2.5-Math-7B-instructAcc62.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2—Unverified
2GAPSAccuracy (%)67.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5—Unverified