SOTAVerified

Mathematical Reasoning

Papers

Showing 151200 of 805 papers

TitleStatusHype
LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual ContextsCode1
RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level MathematicsCode1
Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data ContaminationCode1
RePO: Replay-Enhanced Policy OptimizationCode1
LIMOPro: Reasoning Refinement for Efficient and Effective Test-time ScalingCode1
Assessing the Creativity of LLMs in Proposing Novel Solutions to Mathematical ProblemsCode1
PromptCoT: Synthesizing Olympiad-level Problems for Mathematical Reasoning in Large Language ModelsCode1
LIME: Learning Inductive Bias for Primitives of Mathematical ReasoningCode1
Lila: A Unified Benchmark for Mathematical ReasoningCode1
Proving Olympiad Inequalities by Synergizing LLMs and Symbolic ReasoningCode1
Let's Verify Math Questions Step by StepCode1
Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?Code1
Process-Driven Autoformalization in Lean 4Code1
Learning to Check: Unleashing Potentials for Self-Correction in Large Language ModelsCode1
Learning Multi-Step Reasoning by Solving Arithmetic TasksCode1
PACE: Marrying generalization in PArameter-efficient fine-tuning with Consistency rEgularizationCode1
Peano: Learning Formal Mathematical ReasoningCode1
Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and ObservationsCode1
Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and BeyondCode1
Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as AgentsCode1
Large Language Models for Multi-Robot Systems: A SurveyCode1
Benchmarking Multimodal Mathematical Reasoning with Explicit Visual DependencyCode1
Learning From Mistakes Makes LLM Better ReasonerCode1
A Reinforcement Learning Environment for Mathematical Reasoning via Program SynthesisCode1
Question Translation Training for Better Multilingual ReasoningCode1
Boosting MLLM Reasoning with Text-Debiased Hint-GRPOCode1
JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis ModelsCode1
Open Eyes, Then Reason: Fine-grained Visual Mathematical Understanding in MLLMsCode1
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic ReasoningCode1
Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical ReasoningCode1
KTAE: A Model-Free Algorithm to Key-Tokens Advantage Estimation in Mathematical ReasoningCode1
Implicit Reasoning in Transformers is Reasoning through ShortcutsCode1
A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement LearningCode1
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language ReasoningCode1
DRA-GRPO: Exploring Diversity-Aware Reward Adjustment for R1-Zero-Like Training of Large Language ModelsCode1
DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical ReasoningCode1
Echo Chamber: RL Post-training Amplifies Behaviors Learned in PretrainingCode1
A Probabilistic Inference Approach to Inference-Time Scaling of LLMs using Particle-Based Monte Carlo MethodsCode1
MUSTARD: Mastering Uniform Synthesis of Theorem and Proof DataCode1
H-STAR: LLM-driven Hybrid SQL-Text Adaptive Reasoning on TablesCode1
Natural Language Reasoning, A SurveyCode1
Modeling Complex Mathematical Reasoning via Large Language Model based MathAgentCode1
HARDMath: A Benchmark Dataset for Challenging Problems in Applied MathematicsCode1
IsarStep: a Benchmark for High-level Mathematical ReasoningCode1
Harnessing Negative Signals: Reinforcement Distillation from Teacher Data for LLM ReasoningCode1
GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language ModelsCode1
MultiMath: Bridging Visual and Mathematical Reasoning for Large Language ModelsCode1
Enhancing LLM Reasoning with Iterative DPO: A Comprehensive Empirical InvestigationCode1
Breaking the Data Barrier -- Building GUI Agents Through Task GeneralizationCode1
Diagram Formalization Enhanced Multi-Modal Geometry Problem SolverCode1
Show:102550
← PrevPage 4 of 17Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4Unverified
2DeepSeek-r1Acc79.8Unverified
3Openai-o1Acc74.4Unverified
4Openai-o1-miniAcc70Unverified
5s1-32BAcc56.7Unverified
6Search-o1Acc56.7Unverified
7Openai-o1-previewAcc44.6Unverified
8Qwen2.5-72B-InstructAcc23.3Unverified
9Claude3.5-SonnetAcc16Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25Unverified
2Gemini 1.5 Pro (002)Accuracy0.02Unverified
3o1-previewAccuracy0.01Unverified
4GPT-4oAccuracy0.01Unverified
5Claude 3.5 SonnetAccuracy0.01Unverified
6o1-miniAccuracy0.01Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8Unverified
2PGPSNetCompletion accuracy62.7Unverified
3GAPSCompletion accuracy61.2Unverified
4Inter-GPSCompletion accuracy59.8Unverified
5GeoformerCompletion accuracy35.6Unverified
6NGSCompletion accuracy34.1Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5Unverified
2Math-MasterAcc82Unverified
3Qwen2.5-Math-7B-instructAcc62.5Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2Unverified
2GAPSAccuracy (%)67.8Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5Unverified