SOTAVerified

Mathematical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 601–650 of 805 papers

TitleStatusHype
Evaluating Robustness of Reward Models for Mathematical Reasoning—0
Scheherazade: Evaluating Chain-of-Thought Math Reasoning in LLMs with Chain-of-ProblemsCode0
INC-Math: Integrating Natural Language and Code for Enhanced Mathematical Reasoning in Large Language Models—0
Evaluation of OpenAI o1: Opportunities and Challenges of AGI—0
HM3: Hierarchical Multi-Objective Model Merging for Pretrained Models—0
Revisiting the Superficial Alignment Hypothesis—0
LLaMa-SciQ: An Educational Chatbot for Answering Science MCQ—0
ControlMath: Controllable Data Generation Promotes Math Generalist Models—0
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning—0
Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement—0
RoMath: A Mathematical Reasoning Benchmark in RomanianCode0
Causal Inference with Large Language Model: A Survey—0
Expediting and Elevating Large Language Model Reasoning via Hidden Chain-of-Thought Decoding—0
CPL: Critical Plan Step Learning Boosts LLM Generalization in Reasoning Tasks—0
MathGLM-Vision: Solving Mathematical Problems with Multi-Modal Large Language Model—0
Mathematical Formalized Problem Solving and Theorem Proving in Different Fields in Lean 4Code0
From Calculation to Adjudication: Examining LLM judges on Mathematical Reasoning Tasks—0
Building Math Agents with Multi-Turn Iterative Preference Learning—0
S^3c-Math: Spontaneous Step-level Self-correction Makes Large Language Models Better Mathematical Reasoners—0
Logic Contrastive Reasoning with Lightweight Large Language Model for Math Word Problems—0
SIaM: Self-Improving Code-Assisted Mathematical Reasoning of Large Language Models—0
AutoGeo: Automating Geometric Image Dataset Creation for Enhanced Geometry Understanding—0
Boosting Lossless Speculative Decoding via Feature Sampling and Partial Alignment Distillation—0
Tangram: Benchmark for Evaluating Geometric Element Recognition in Large Multimodal Models—0
Path-Consistency: Prefix Enhancement for Efficient Inference in LLM—0
Multi-tool Integration Application for Math Reasoning Using Large Language Model—0
Taming Generative Diffusion Prior for Universal Blind Image Restoration—0
SarcasmBench: Towards Evaluating Large Language Models on Sarcasm Understanding—0
Benchmarking Large Language Models for Math Reasoning TasksCode0
Concept Distillation from Strong to Weak Models via Hypotheses-to-Theories Prompting—0
MathScape: Evaluating MLLMs in multimodal Math Scenarios through a Hierarchical BenchmarkCode0
MAQA: Evaluating Uncertainty Quantification in LLMs Regarding Data UncertaintyCode0
MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problems—0
AI-Assisted Generation of Difficult Math QuestionsCode0
Optimizing Numerical Estimation and Operational Efficiency in the Legal Domain through Large Language Models—0
Reliable Reasoning Beyond Natural Language—0
A Comprehensive Evaluation of Large Language Models on Temporal Event Forecasting—0
Fine-Tuning and Prompt Optimization: Two Great Steps that Work Better Together—0
Key-Point-Driven Mathematical Reasoning Distillation of Large Language Model—0
Token-Supervised Value Models for Enhancing Mathematical Reasoning Capabilities of Large Language Models—0
Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist—0
Skywork-Math: Data Scaling Laws for Mathematical Reasoning in Large Language Models -- The Story Goes On—0
Progress or Regress? Self-Improvement Reversal in Post-training—0
Smart Vision-Language ReasonersCode0
How Does Quantization Affect Multilingual LLMs?—0
Integrate the Essence and Eliminate the Dross: Fine-Grained Self-Consistency for Free-Form Language GenerationCode0
FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language ModelsCode0
LiteSearch: Efficacious Tree Search for LLM—0
LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement—0
The Qiyas Benchmark: Measuring ChatGPT Mathematical and Language Understanding in Arabic—0
Show:102550
← PrevPage 13 of 17Next →
All datasetsAIME24FrontierMathLila (IID)Lila (OOD)PGPS9KAMC23GeoQAMath500UniGeoUniGeo (PRV)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4—Unverified
2DeepSeek-r1Acc79.8—Unverified
3Openai-o1Acc74.4—Unverified
4Openai-o1-miniAcc70—Unverified
5s1-32BAcc56.7—Unverified
6Search-o1Acc56.7—Unverified
7Openai-o1-previewAcc44.6—Unverified
8Qwen2.5-72B-InstructAcc23.3—Unverified
9Claude3.5-SonnetAcc16—Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25—Unverified
2Gemini 1.5 Pro (002)Accuracy0.02—Unverified
3o1-previewAccuracy0.01—Unverified
4GPT-4oAccuracy0.01—Unverified
5Claude 3.5 SonnetAccuracy0.01—Unverified
6o1-miniAccuracy0.01—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48—Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39—Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45—Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27—Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8—Unverified
2PGPSNetCompletion accuracy62.7—Unverified
3GAPSCompletion accuracy61.2—Unverified
4Inter-GPSCompletion accuracy59.8—Unverified
5GeoformerCompletion accuracy35.6—Unverified
6NGSCompletion accuracy34.1—Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5—Unverified
2Math-MasterAcc82—Unverified
3Qwen2.5-Math-7B-instructAcc62.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2—Unverified
2GAPSAccuracy (%)67.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5—Unverified