SOTAVerified

Mathematical Reasoning

Papers

Showing 626650 of 805 papers

TitleStatusHype
Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts0
Low-Rank Adaptation with Task-Relevant Feature Enhancement for Fine-tuning Language Models0
LPML: LLM-Prompting Markup Language for Mathematical Reasoning0
Lynx: Enabling Efficient MoE Inference through Dynamic Batch-Aware Expert Selection0
Machine learning and information theory concepts towards an AI Mathematician0
MAPS: A Multilingual Benchmark for Global Agent Performance and Security0
Markov Chain of Thought for Efficient Mathematical Reasoning0
Mars-PO: Multi-Agent Reasoning System Preference Optimization0
Massive Supervised Fine-tuning Experiments Reveal How Data, Layer, and Training Factors Shape LLM Alignment Quality0
MATATA: Weakly Supervised End-to-End MAthematical Tool-Augmented Reasoning for Tabular Applications0
MathDivide: Improved mathematical reasoning by large language models0
Assessment of Evolving Large Language Models in Upper Secondary Mathematics0
Mathematical Reasoning in Latent Space0
MathFimer: Enhancing Mathematical Reasoning by Expanding Reasoning Steps through Fill-in-the-Middle Task0
MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs0
MATHGLANCE: Multimodal Large Language Models Do Not Know Where to Look in Mathematical Diagrams0
MathGLM-Vision: Solving Mathematical Problems with Multi-Modal Large Language Model0
MathHay: An Automated Benchmark for Long-Context Mathematical Reasoning in LLMs0
MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations0
math-PVS: A Large Language Model Framework to Map Scientific Publications to PVS Theories0
MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?0
MCP-RADAR: A Multi-Dimensional Benchmark for Evaluating Tool Use Capabilities in Large Language Models0
MergeME: Model Merging Techniques for Homogeneous and Heterogeneous MoEs0
ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models0
INC-Math: Integrating Natural Language and Code for Enhanced Mathematical Reasoning in Large Language Models0
Show:102550
← PrevPage 26 of 33Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4Unverified
2DeepSeek-r1Acc79.8Unverified
3Openai-o1Acc74.4Unverified
4Openai-o1-miniAcc70Unverified
5s1-32BAcc56.7Unverified
6Search-o1Acc56.7Unverified
7Openai-o1-previewAcc44.6Unverified
8Qwen2.5-72B-InstructAcc23.3Unverified
9Claude3.5-SonnetAcc16Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25Unverified
2Gemini 1.5 Pro (002)Accuracy0.02Unverified
3o1-previewAccuracy0.01Unverified
4GPT-4oAccuracy0.01Unverified
5Claude 3.5 SonnetAccuracy0.01Unverified
6o1-miniAccuracy0.01Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8Unverified
2PGPSNetCompletion accuracy62.7Unverified
3GAPSCompletion accuracy61.2Unverified
4Inter-GPSCompletion accuracy59.8Unverified
5GeoformerCompletion accuracy35.6Unverified
6NGSCompletion accuracy34.1Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5Unverified
2Math-MasterAcc82Unverified
3Qwen2.5-Math-7B-instructAcc62.5Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2Unverified
2GAPSAccuracy (%)67.8Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5Unverified