SOTAVerified

Mathematical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 301–350 of 805 papers

TitleStatusHype
Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions—0
Causal Inference with Large Language Model: A Survey—0
Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformers—0
AI4Math: A Native Spanish Benchmark for University-Level Mathematical Reasoning in Large Language Models—0
Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data—0
Can Theoretical Physics Research Benefit from Language Agents?—0
Assessing the Impact of Prompting Methods on ChatGPT's Mathematical Capabilities—0
Explain with Visual Keypoints Like a Real Mentor! A Benchmark for Multimodal Solution Explanation—0
Expediting and Elevating Large Language Model Reasoning via Hidden Chain-of-Thought Decoding—0
Can Pruning Improve Reasoning? Revisiting Long-CoT Compression with Capability in Mind for Better Reasoning—0
Expanding Search Space with Diverse Prompting Agents: An Efficient Sampling Approach for LLM Mathematical Reasoning—0
Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domains—0
Can LLMs understand Math? -- Exploring the Pitfalls in Mathematical Reasoning—0
Evolving LLMs' Self-Refinement Capability via Iterative Preference Optimization—0
Evolutionary Pre-Prompt Optimization for Mathematical Reasoning—0
Assessing the Emergent Symbolic Reasoning Abilities of Llama Large Language Models—0
Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts—0
Evaluation of OpenAI o1: Opportunities and Challenges of AGI—0
Evaluation of LLMs for mathematical problem solving—0
Can Large Language Models Invent Algorithms to Improve Themselves?—0
Evaluating the Meta- and Object-Level Reasoning of Large Language Models for Question Answering—0
Evaluating Robustness of Reward Models for Mathematical Reasoning—0
A Graph-Based Synthetic Data Pipeline for Scaling High-Quality Reasoning Instructions—0
Can Large Language Models Explain Themselves? A Study of LLM-Generated Self-Explanations—0
Assessing Robustness to Spurious Correlations in Post-Training Language Models—0
Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads—0
Can Language Models Rival Mathematics Students? Evaluating Mathematical Reasoning through Textual Manipulation and Human Experiments—0
DavIR: Data Selection via Implicit Reward for Large Language Models—0
Logic Contrastive Reasoning with Lightweight Large Language Model for Math Word Problems—0
Evaluating Grounded Reasoning by Code-Assisted Large Language Models for Mathematics—0
A Comprehensive Evaluation of Large Language Models on Temporal Event Forecasting—0
ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection—0
Error Classification of Large Language Models on Math Word Problems: A Dynamically Adaptive Framework—0
Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answering—0
LLMs can Find Mathematical Reasoning Mistakes by Pedagogical Chain-of-Thought—0
Assessing GPT4-V on Structured Reasoning Tasks—0
Building Math Agents with Multi-Turn Iterative Preference Learning—0
LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement—0
Entropy-Aware Branching for Improved Mathematical Reasoning—0
LLMs can be easily Confused by Instructional Distractions—0
LLMs can implicitly learn from mistakes in-context—0
Ensembling Large Language Models with Process Reward-Guided Tree Search for Better Complex Reasoning—0
Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzles—0
Enhancing Reasoning through Process Supervision with Monte Carlo Tree Search—0
AAPO: Enhance the Reasoning Capabilities of LLMs with Advantage Momentum—0
Enhancing Neural Mathematical Reasoning by Abductive Combination with Symbolic Library—0
Enhancing Mathematical Reasoning in LLMs with Background Operators—0
Are Large Language Models Robust in Understanding Code Against Semantics-Preserving Mutations?—0
Enhancing Mathematical Reasoning in LLMs by Stepwise Correction—0
Enhancing Mathematical Reasoning in Large Language Models with Self-Consistency-Based Hallucination Detection—0
Show:102550
← PrevPage 7 of 17Next →
All datasetsAIME24FrontierMathLila (IID)Lila (OOD)PGPS9KAMC23GeoQAMath500UniGeoUniGeo (PRV)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4—Unverified
2DeepSeek-r1Acc79.8—Unverified
3Openai-o1Acc74.4—Unverified
4Openai-o1-miniAcc70—Unverified
5s1-32BAcc56.7—Unverified
6Search-o1Acc56.7—Unverified
7Openai-o1-previewAcc44.6—Unverified
8Qwen2.5-72B-InstructAcc23.3—Unverified
9Claude3.5-SonnetAcc16—Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25—Unverified
2Gemini 1.5 Pro (002)Accuracy0.02—Unverified
3o1-previewAccuracy0.01—Unverified
4GPT-4oAccuracy0.01—Unverified
5Claude 3.5 SonnetAccuracy0.01—Unverified
6o1-miniAccuracy0.01—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48—Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39—Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45—Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27—Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8—Unverified
2PGPSNetCompletion accuracy62.7—Unverified
3GAPSCompletion accuracy61.2—Unverified
4Inter-GPSCompletion accuracy59.8—Unverified
5GeoformerCompletion accuracy35.6—Unverified
6NGSCompletion accuracy34.1—Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5—Unverified
2Math-MasterAcc82—Unverified
3Qwen2.5-Math-7B-instructAcc62.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2—Unverified
2GAPSAccuracy (%)67.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5—Unverified