SOTAVerified

Mathematical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 326–350 of 805 papers

TitleStatusHype
Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads—0
Can Language Models Rival Mathematics Students? Evaluating Mathematical Reasoning through Textual Manipulation and Human Experiments—0
LLMs can Find Mathematical Reasoning Mistakes by Pedagogical Chain-of-Thought—0
LLMs can implicitly learn from mistakes in-context—0
Evaluating Grounded Reasoning by Code-Assisted Large Language Models for Mathematics—0
A Comprehensive Evaluation of Large Language Models on Temporal Event Forecasting—0
ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection—0
Error Classification of Large Language Models on Math Word Problems: A Dynamically Adaptive Framework—0
Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answering—0
LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement—0
Assessing GPT4-V on Structured Reasoning Tasks—0
Building Math Agents with Multi-Turn Iterative Preference Learning—0
LLM Library Learning Fails: A LEGO-Prover Case Study—0
Entropy-Aware Branching for Improved Mathematical Reasoning—0
LLM Reasoning Engine: Specialized Training for Enhanced Mathematical Reasoning—0
LLMs can be easily Confused by Instructional Distractions—0
DavIR: Data Selection via Implicit Reward for Large Language Models—0
Ensembling Large Language Models with Process Reward-Guided Tree Search for Better Complex Reasoning—0
Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzles—0
Enhancing Reasoning through Process Supervision with Monte Carlo Tree Search—0
Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models—0
Enhancing Neural Mathematical Reasoning by Abductive Combination with Symbolic Library—0
Enhancing Mathematical Reasoning in LLMs with Background Operators—0
Are Large Language Models Robust in Understanding Code Against Semantics-Preserving Mutations?—0
Enhancing Mathematical Reasoning in LLMs by Stepwise Correction—0
Show:102550
← PrevPage 14 of 33Next →
All datasetsAIME24FrontierMathLila (IID)Lila (OOD)PGPS9KAMC23GeoQAMath500UniGeoUniGeo (PRV)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4—Unverified
2DeepSeek-r1Acc79.8—Unverified
3Openai-o1Acc74.4—Unverified
4Openai-o1-miniAcc70—Unverified
5s1-32BAcc56.7—Unverified
6Search-o1Acc56.7—Unverified
7Openai-o1-previewAcc44.6—Unverified
8Qwen2.5-72B-InstructAcc23.3—Unverified
9Claude3.5-SonnetAcc16—Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25—Unverified
2Gemini 1.5 Pro (002)Accuracy0.02—Unverified
3o1-previewAccuracy0.01—Unverified
4GPT-4oAccuracy0.01—Unverified
5Claude 3.5 SonnetAccuracy0.01—Unverified
6o1-miniAccuracy0.01—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48—Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39—Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45—Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27—Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8—Unverified
2PGPSNetCompletion accuracy62.7—Unverified
3GAPSCompletion accuracy61.2—Unverified
4Inter-GPSCompletion accuracy59.8—Unverified
5GeoformerCompletion accuracy35.6—Unverified
6NGSCompletion accuracy34.1—Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5—Unverified
2Math-MasterAcc82—Unverified
3Qwen2.5-Math-7B-instructAcc62.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2—Unverified
2GAPSAccuracy (%)67.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5—Unverified