SOTAVerified

Mathematical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 501–550 of 805 papers

TitleStatusHype
LoRA-Pro: Are Low-Rank Adapters Properly Optimized?Code2
Self-Training with Direct Preference Optimization Improves Chain-of-Thought ReasoningCode2
LEAN-GitHub: Compiling GitHub LEAN repositories for a versatile LEAN proverCode4
Toward Adaptive Reasoning in Large Language Models with Thought RollbackCode1
A Comprehensive Evaluation of Large Language Models on Temporal Event Forecasting—0
NeedleBench: Can LLMs Do Retrieval and Reasoning in Information-Dense Context?Code9
Reliable Reasoning Beyond Natural Language—0
Fine-Tuning and Prompt Optimization: Two Great Steps that Work Better Together—0
Key-Point-Driven Mathematical Reasoning Distillation of Large Language Model—0
OptiBench Meets ReSocratic: Measure and Improve LLMs for Optimization ModelingCode1
Token-Supervised Value Models for Enhancing Mathematical Reasoning Capabilities of Large Language Models—0
Skywork-Math: Data Scaling Laws for Mathematical Reasoning in Large Language Models -- The Story Goes On—0
MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data EngineCode4
Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist—0
SOLO: A Single Transformer for Scalable Vision-Language ModelingCode2
Progress or Regress? Self-Improvement Reversal in Post-training—0
LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual ContextsCode1
Smart Vision-Language ReasonersCode0
DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical ReasoningCode1
How Does Quantization Affect Multilingual LLMs?—0
TheoremLlama: Transforming General-Purpose LLMs into Lean4 ExpertsCode1
Integrate the Essence and Eliminate the Dross: Fine-Grained Self-Consistency for Free-Form Language GenerationCode0
FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language ModelsCode0
We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?Code2
Step-Controlled DPO: Leveraging Stepwise Error for Enhanced Mathematical ReasoningCode1
H-STAR: LLM-driven Hybrid SQL-Text Adaptive Reasoning on TablesCode1
LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement—0
LiteSearch: Efficacious Tree Search for LLM—0
The Qiyas Benchmark: Measuring ChatGPT Mathematical and Language Understanding in Arabic—0
Applying RLAIF for Code Generation with API-usage in Lightweight LLMs—0
Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMsCode3
MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math DataCode2
Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language ModelsCode2
Anomaly Detection of Tabular Data Using LLMs—0
Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts—0
Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads—0
LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language FeedbackCode1
Mathador-LM: A Dynamic Benchmark for Mathematical Reasoning on Large Language ModelsCode0
Learn Beyond The Answer: Training Language Models with Reflection for Mathematical ReasoningCode2
DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code IntelligenceCode9
CodeGemma: Open Code Models Based on Gemma—0
Step-level Value Preference Optimization for Mathematical ReasoningCode3
Exposing the Achilles' Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning—0
MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models—0
Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?Code1
ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models—0
Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8BCode5
Flow of Reasoning:Training LLMs for Divergent Problem Solving with Minimal ExamplesCode2
LLMs Are Not Intelligent Thinkers: Introducing Mathematical Topic Tree Benchmark for Comprehensive Evaluation of LLMsCode0
Robustness Assessment of Mathematical Reasoning in the Presence of Missing and Contradictory Conditions—0
Show:102550
← PrevPage 11 of 17Next →
All datasetsAIME24FrontierMathLila (IID)Lila (OOD)PGPS9KAMC23GeoQAMath500UniGeoUniGeo (PRV)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4—Unverified
2DeepSeek-r1Acc79.8—Unverified
3Openai-o1Acc74.4—Unverified
4Openai-o1-miniAcc70—Unverified
5s1-32BAcc56.7—Unverified
6Search-o1Acc56.7—Unverified
7Openai-o1-previewAcc44.6—Unverified
8Qwen2.5-72B-InstructAcc23.3—Unverified
9Claude3.5-SonnetAcc16—Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25—Unverified
2Gemini 1.5 Pro (002)Accuracy0.02—Unverified
3o1-previewAccuracy0.01—Unverified
4GPT-4oAccuracy0.01—Unverified
5Claude 3.5 SonnetAccuracy0.01—Unverified
6o1-miniAccuracy0.01—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48—Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39—Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45—Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27—Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8—Unverified
2PGPSNetCompletion accuracy62.7—Unverified
3GAPSCompletion accuracy61.2—Unverified
4Inter-GPSCompletion accuracy59.8—Unverified
5GeoformerCompletion accuracy35.6—Unverified
6NGSCompletion accuracy34.1—Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5—Unverified
2Math-MasterAcc82—Unverified
3Qwen2.5-Math-7B-instructAcc62.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2—Unverified
2GAPSAccuracy (%)67.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5—Unverified