SOTAVerified

Mathematical Reasoning

Papers

Showing 401425 of 805 papers

TitleStatusHype
ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection0
Evaluating Grounded Reasoning by Code-Assisted Large Language Models for Mathematics0
Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads0
Evaluating Robustness of Reward Models for Mathematical Reasoning0
Evaluating the Meta- and Object-Level Reasoning of Large Language Models for Question Answering0
Evaluation of LLMs for mathematical problem solving0
Evaluation of OpenAI o1: Opportunities and Challenges of AGI0
Evolutionary Pre-Prompt Optimization for Mathematical Reasoning0
Evolving LLMs' Self-Refinement Capability via Iterative Preference Optimization0
Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domains0
Expanding Search Space with Diverse Prompting Agents: An Efficient Sampling Approach for LLM Mathematical Reasoning0
Expediting and Elevating Large Language Model Reasoning via Hidden Chain-of-Thought Decoding0
Explain with Visual Keypoints Like a Real Mentor! A Benchmark for Multimodal Solution Explanation0
Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data0
Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions0
Exploring the Mystery of Influential Data for Mathematical Reasoning0
Exposing the Achilles' Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning0
Federated Prompting and Chain-of-Thought Reasoning for Improving LLMs Answering0
FG-PRM: Fine-grained Hallucination Detection and Mitigation in Language Model Mathematical Reasoning0
FineMath: A Fine-Grained Mathematical Evaluation Benchmark for Chinese Large Language Models0
Fine-Tuning and Prompt Optimization: Two Great Steps that Work Better Together0
First-Step Advantage: Importance of Starting Right in Multi-Step Math Reasoning0
Flow-DPO: Improving LLM Mathematical Reasoning through Online Multi-Agent Learning0
Foreword: A Computable Universe, Understanding Computation and Exploring Nature As Computation0
Formal Mathematical Reasoning: A New Frontier in AI0
Show:102550
← PrevPage 17 of 33Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4Unverified
2DeepSeek-r1Acc79.8Unverified
3Openai-o1Acc74.4Unverified
4Openai-o1-miniAcc70Unverified
5Search-o1Acc56.7Unverified
6s1-32BAcc56.7Unverified
7Openai-o1-previewAcc44.6Unverified
8Qwen2.5-72B-InstructAcc23.3Unverified
9Claude3.5-SonnetAcc16Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25Unverified
2Gemini 1.5 Pro (002)Accuracy0.02Unverified
3GPT-4oAccuracy0.01Unverified
4o1-miniAccuracy0.01Unverified
5o1-previewAccuracy0.01Unverified
6Claude 3.5 SonnetAccuracy0.01Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8Unverified
2PGPSNetCompletion accuracy62.7Unverified
3GAPSCompletion accuracy61.2Unverified
4Inter-GPSCompletion accuracy59.8Unverified
5GeoformerCompletion accuracy35.6Unverified
6NGSCompletion accuracy34.1Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5Unverified
2Math-MasterAcc82Unverified
3Qwen2.5-Math-7B-instructAcc62.5Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2Unverified
2GAPSAccuracy (%)67.8Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5Unverified