SOTAVerified

Mathematical Reasoning

Papers

Showing 651700 of 805 papers

TitleStatusHype
MARIO: MAth Reasoning with code Interpreter Output -- A Reproducible PipelineCode3
SciInstruct: a Self-Reflective Instruction Annotated Dataset for Training Scientific Language ModelsCode2
Question Translation Training for Better Multilingual ReasoningCode1
CHAMP: A Competition-level Dataset for Fine-Grained Analyses of LLMs' Mathematical Reasoning Capabilities0
MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference OptimizationCode1
Olapa-MCoT: Enhancing the Chinese Mathematical Reasoning Capability of LLMs0
MathPile: A Billion-Token-Scale Pretraining Corpus for MathCode2
Knowledge Distillation of LLM for Automatic Scoring of Science Education Assessments0
Assessing the Impact of Prompting Methods on ChatGPT's Mathematical Capabilities0
GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoning0
From Good to Great: Improving Math Reasoning with Tool-Augmented Interleaf Prompting0
An In-depth Look at Gemini's Language AbilitiesCode1
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning0
Modeling Complex Mathematical Reasoning via Large Language Model based MathAgentCode1
TinyGSM: achieving >80% on GSM8k with small language models0
Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human AnnotationsCode1
Assessing GPT4-V on Structured Reasoning Tasks0
Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic ReasoningCode0
Universal Self-Consistency for Large Language Model Generation0
LANS: A Layout-Aware Neural Solver for Plane Geometry Problem0
AlignedCoT: Prompting Large Language Models via Native-Speaking DemonstrationsCode0
Orca 2: Teaching Small Language Models How to Reason0
OVM, Outcome-supervised Value Models for Planning in Mathematical ReasoningCode1
First-Step Advantage: Importance of Starting Right in Multi-Step Math Reasoning0
VerityMath: Advancing Mathematical Reasoning by Self-Verification Through Unit ConsistencyCode0
Let's Reinforce Step by Step0
ATHENA: Mathematical Reasoning with Thought ExpansionCode0
Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and ObservationsCode1
Learning From Mistakes Makes LLM Better ReasonerCode1
math-PVS: A Large Language Model Framework to Map Scientific Publications to PVS Theories0
SkyMath: Technical ReportCode3
MCC-KD: Multi-CoT Consistent Knowledge DistillationCode0
MAF: Multi-Aspect Feedback for Improving Reasoning in Large Language ModelsCode0
Can Large Language Models Explain Themselves? A Study of LLM-Generated Self-Explanations0
DavIR: Data Selection via Implicit Reward for Large Language Models0
TRIGO: Benchmarking Formal Mathematical Proof Reduction for Generative Language ModelsCode0
Let's reward step by step: Step-Level reward model as the Navigators for Reasoning0
An Expression Tree Decoding Strategy for Mathematical Equation GenerationCode2
KwaiYiiMath: Technical Report0
TRACE: A Comprehensive Benchmark for Continual Learning in Large Language ModelsCode1
Mistral 7BCode6
How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data CompositionCode3
MuggleMath: Assessing the Impact of Query and Response Augmentation on Math ReasoningCode2
LLM4DV: Using Large Language Models for Hardware Test Stimuli Generation0
Ada-Instruct: Adapting Instruction Generators for Complex ReasoningCode1
MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningCode2
Notes on a Path to AI Assistance in Mathematical Reasoning0
Novice Learner and Expert Tutor: Evaluating Math Reasoning Abilities of Large Language Models with Misconceptions0
SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-trainingCode1
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsCode2
Show:102550
← PrevPage 14 of 17Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4Unverified
2DeepSeek-r1Acc79.8Unverified
3Openai-o1Acc74.4Unverified
4Openai-o1-miniAcc70Unverified
5s1-32BAcc56.7Unverified
6Search-o1Acc56.7Unverified
7Openai-o1-previewAcc44.6Unverified
8Qwen2.5-72B-InstructAcc23.3Unverified
9Claude3.5-SonnetAcc16Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25Unverified
2Gemini 1.5 Pro (002)Accuracy0.02Unverified
3o1-previewAccuracy0.01Unverified
4GPT-4oAccuracy0.01Unverified
5Claude 3.5 SonnetAccuracy0.01Unverified
6o1-miniAccuracy0.01Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8Unverified
2PGPSNetCompletion accuracy62.7Unverified
3GAPSCompletion accuracy61.2Unverified
4Inter-GPSCompletion accuracy59.8Unverified
5GeoformerCompletion accuracy35.6Unverified
6NGSCompletion accuracy34.1Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5Unverified
2Math-MasterAcc82Unverified
3Qwen2.5-Math-7B-instructAcc62.5Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2Unverified
2GAPSAccuracy (%)67.8Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5Unverified