SOTAVerified

Mathematical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 805 papers

TitleStatusHype
Turning large language models into cognitive modelsCode1
Evaluating Language Models for Mathematics through InteractionsCode1
Learning Multi-Step Reasoning by Solving Arithmetic TasksCode1
A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation AnalysisCode1
FedCBO: Reaching Group Consensus in Clustered Federated Learning through Consensus-based OptimizationCode1
Natural Language Reasoning, A SurveyCode1
MathPrompter: Mathematical Reasoning using Large Language ModelsCode1
A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from DiagramCode1
Tree-Based Representation and Generation of Natural and Mathematical LanguageCode1
Mathematical Capabilities of ChatGPTCode1
UniGeo: Unifying Geometry Logical Reasoning via Reformulating Mathematical ExpressionCode1
Peano: Learning Formal Mathematical ReasoningCode1
Lila: A Unified Benchmark for Mathematical ReasoningCode1
A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language ModelsCode1
Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical ReasoningCode1
CLEVR-Math: A Dataset for Compositional Language, Visual and Mathematical ReasoningCode1
A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human LevelCode1
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language ReasoningCode1
A Reinforcement Learning Environment for Mathematical Reasoning via Program SynthesisCode1
GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical ReasoningCode1
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic ReasoningCode1
LIME: Learning Inductive Bias for Primitives of Mathematical ReasoningCode1
IsarStep: a Benchmark for High-level Mathematical ReasoningCode1
VAR-MATH: Probing True Mathematical Reasoning in Large Language Models via Symbolic Multi-Instance Benchmarks—0
A Survey of Deep Learning for Geometry Problem SolvingCode0
KisMATH: Do LLMs Have Knowledge of Implicit Structures in Mathematical Reasoning?—0
Integrating External Tools with Large Language Models to Improve Accuracy—0
Agentic-R1: Distilled Dual-Strategy ReasoningCode0
CoRE: Enhancing Metacognition with Label-free Self-evaluation in LRMs—0
Large Language Models Don't Make Sense of Word Problems. A Scoping Review from a Mathematics Education Perspective—0
Layer Importance for Mathematical Reasoning is Forged in Pre-Training and Invariant after Post-Training—0
Test-time Scaling Techniques in Theoretical Physics -- A Comparison of Methods on the TPBench Dataset—0
Inside you are many wolves: Using cognitive models to interpret value trade-offs in LLMs—0
AdapThink: Adaptive Thinking Preferences for Reasoning Language Model—0
PhysUniBench: An Undergraduate-Level Physics Reasoning Benchmark for Multimodal Models—0
Towards Advanced Mathematical Reasoning for LLMs via First-Order Logic Theorem Proving—0
Massive Supervised Fine-tuning Experiments Reveal How Data, Layer, and Training Factors Shape LLM Alignment Quality—0
Revisiting Chain-of-Thought Prompting: Zero-shot Can Be Stronger than Few-shot—0
Investigating the interaction of linguistic and mathematical reasoning in language models using multilingual number puzzles—0
A Technical Study into Small Reasoning Language Models—0
LearnAlign: Reasoning Data Selection for Reinforcement Learning in Large Language Models Based on Improved Gradient Alignment—0
Eliciting Reasoning in Language Models with Cognitive Tools—0
Investigating the Potential of Large Language Model-Based Router Multi-Agent Architectures for Foundation Design Automation: A Task Classification and Expert Selection Study—0
NeuralNexus at BEA 2025 Shared Task: Retrieval-Augmented Prompting for Mistake Identification in AI TutorsCode0
PREMISE: Scalable and Strategic Prompt Optimization for Efficient Mathematical Reasoning in Large Models—0
Slimming Down LLMs Without Losing Their Minds—0
TeleMath: A Benchmark for Large Language Models in Telecom Mathematical Problem Solving—0
Beyond Gold Standards: Epistemic Ensemble of LLM Judges for Formal Mathematical Reasoning—0
Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation LearningCode0
Omni-DPO: A Dual-Perspective Paradigm for Dynamic Preference Learning of LLMsCode0
Show:102550
← PrevPage 6 of 17Next →
All datasetsAIME24FrontierMathLila (IID)Lila (OOD)PGPS9KAMC23GeoQAMath500UniGeoUniGeo (PRV)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4—Unverified
2DeepSeek-r1Acc79.8—Unverified
3Openai-o1Acc74.4—Unverified
4Openai-o1-miniAcc70—Unverified
5Search-o1Acc56.7—Unverified
6s1-32BAcc56.7—Unverified
7Openai-o1-previewAcc44.6—Unverified
8Qwen2.5-72B-InstructAcc23.3—Unverified
9Claude3.5-SonnetAcc16—Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25—Unverified
2Gemini 1.5 Pro (002)Accuracy0.02—Unverified
3GPT-4oAccuracy0.01—Unverified
4o1-miniAccuracy0.01—Unverified
5o1-previewAccuracy0.01—Unverified
6Claude 3.5 SonnetAccuracy0.01—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48—Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39—Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45—Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27—Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8—Unverified
2PGPSNetCompletion accuracy62.7—Unverified
3GAPSCompletion accuracy61.2—Unverified
4Inter-GPSCompletion accuracy59.8—Unverified
5GeoformerCompletion accuracy35.6—Unverified
6NGSCompletion accuracy34.1—Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5—Unverified
2Math-MasterAcc82—Unverified
3Qwen2.5-Math-7B-instructAcc62.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2—Unverified
2GAPSAccuracy (%)67.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5—Unverified