SOTAVerified

Mathematical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 651–700 of 805 papers

TitleStatusHype
Towards Efficient and Effective Alignment of Large Language Models—0
SarcasmBench: Towards Evaluating Large Language Models on Sarcasm Understanding—0
Towards Self-Improvement of LLMs via MCTS: Leveraging Stepwise Knowledge with Curriculum Preference Learning—0
Towards Spoken Mathematical Reasoning: Benchmarking Speech-based Models over Multi-faceted Math Problems—0
Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning—0
Towards Tractable Mathematical Reasoning: Challenges, Strategies, and Opportunities for Solving Math Word Problems—0
Towards Understanding Multi-Round Large Language Model Reasoning: Approximability, Learnability and Generalizability—0
TPO: Aligning Large Language Models with Multi-branch & Multi-step Preference Trees—0
Training-Free Mitigation of Language Reasoning Degradation After Multimodal Instruction Tuning—0
Trajectory Bellman Residual Minimization: A Simple Value-Based Method for LLM Reasoning—0
Tropical Attention: Neural Algorithmic Reasoning for Combinatorial Algorithms—0
UGMathBench: A Diverse and Dynamic Benchmark for Undergraduate-Level Mathematical Reasoning with Large Language Models—0
Uncertainty-Aware Step-wise Verification with Generative Reward Models—0
Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap—0
Uni-LoRA: One Vector is All You Need—0
Universal Self-Consistency for Large Language Model Generation—0
Unlocking the Potential of Difficulty Prior in RL-based Multimodal Reasoning—0
Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approach—0
VAR-MATH: Probing True Mathematical Reasoning in Large Language Models via Symbolic Multi-Instance Benchmarks—0
VerifierQ: Enhancing LLM Test Time Compute with Q-Learning-based Verifiers—0
VideoMathQA: Benchmarking Mathematical Reasoning via Multimodal Understanding in Videos—0
VisAidMath: Benchmarking Visual-Aided Mathematical Reasoning—0
Weaker LLMs' Opinions Also Matter: Mixture of Opinions Enhances LLM's Mathematical Reasoning—0
WebChoreArena: Evaluating Web Browsing Agents on Realistic Tedious Web Tasks—0
What Are Step-Level Reward Models Rewarding? Counterintuitive Findings from MCTS-Boosted Mathematical Reasoning—0
Why are NLP Models Fumbling at Elementary Math? A Survey of Automatic Word Problem Solvers—0
Why are NLP Models Fumbling at Elementary Math? A Survey of Deep Learning based Word Problem Solvers—0
WirelessMathBench: A Mathematical Modeling Benchmark for LLMs in Wireless Communications—0
1bit-Merging: Dynamic Quantized Merging for Large Language Models—0
HARDMath2: A Benchmark for Applied Mathematics Built by Students as Part of a Graduate ClassCode0
Guided Stream of Search: Learning to Better Search with Language Models via Optimal Path GuidanceCode0
VerifiAgent: a Unified Verification Agent in Language Model ReasoningCode0
AI-Assisted Generation of Difficult Math QuestionsCode0
GThinker: Towards General Multimodal Reasoning via Cue-Guided RethinkingCode0
VerityMath: Advancing Mathematical Reasoning by Self-Verification Through Unit ConsistencyCode0
Give me a hint: Can LLMs take a hint to solve math problems?Code0
Gap-Filling Prompting Enhances Code-Assisted Mathematical ReasoningCode0
Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic ReasoningCode0
Accelerate Parallelizable Reasoning via Parallel Decoding within One SequenceCode0
FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language ModelsCode0
Explanation Selection Using Unlabeled Data for Chain-of-Thought PromptingCode0
Critical-Questions-of-Thought: Steering LLM reasoning with Argumentative QueryingCode0
Compositional Processing Emerges in Neural Networks Solving Math ProblemsCode0
SWI: Speaking with Intent in Large Language ModelsCode0
ComplexFormer: Disruptively Advancing Transformer Inference Ability via Head-Specific Complex Vector AttentionCode0
Process-based Self-Rewarding Language ModelsCode0
PSPO*: An Effective Process-supervised Policy Optimization for Reasoning AlignmentCode0
Agentic-R1: Distilled Dual-Strategy ReasoningCode0
Probability-Consistent Preference Optimization for Enhanced LLM ReasoningCode0
Reasoning over Uncertain Text by Generative Large Language ModelsCode0
Show:102550
← PrevPage 14 of 17Next →
All datasetsAIME24FrontierMathLila (IID)Lila (OOD)PGPS9KAMC23GeoQAMath500UniGeoUniGeo (PRV)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1XolverAcc94.4—Unverified
2DeepSeek-r1Acc79.8—Unverified
3Openai-o1Acc74.4—Unverified
4Openai-o1-miniAcc70—Unverified
5Search-o1Acc56.7—Unverified
6s1-32BAcc56.7—Unverified
7Openai-o1-previewAcc44.6—Unverified
8Qwen2.5-72B-InstructAcc23.3—Unverified
9Claude3.5-SonnetAcc16—Unverified
#ModelMetricClaimedVerifiedStatus
1o3Accuracy0.25—Unverified
2Gemini 1.5 Pro (002)Accuracy0.02—Unverified
3GPT-4oAccuracy0.01—Unverified
4o1-miniAccuracy0.01—Unverified
5o1-previewAccuracy0.01—Unverified
6Claude 3.5 SonnetAccuracy0.01—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.6—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.48—Unverified
3Neo-P (Fine-tuned, 2.7B)Accuracy0.39—Unverified
4GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
5Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.25—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Codex (Few-Shot, 175B)Accuracy0.59—Unverified
2Bhāskara-P (Fine-tuned, 2.7B)Accuracy0.45—Unverified
3GPT-3 (Few-Shot, 175B)Accuracy0.38—Unverified
4Bhāskara-A (Fine-tuned, 2.7B)Accuracy0.27—Unverified
5Neo-P (Fine-tuned, 2.7B)Accuracy0.24—Unverified
6Neo-A (Fine-tuned, 2.7B)Accuracy0.18—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDCompletion accuracy65.8—Unverified
2PGPSNetCompletion accuracy62.7—Unverified
3GAPSCompletion accuracy61.2—Unverified
4Inter-GPSCompletion accuracy59.8—Unverified
5GeoformerCompletion accuracy35.6—Unverified
6NGSCompletion accuracy34.1—Unverified
#ModelMetricClaimedVerifiedStatus
1QWQ-32B-previewAcc82.5—Unverified
2Math-MasterAcc82—Unverified
3Qwen2.5-Math-7B-instructAcc62.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)75.2—Unverified
2GAPSAccuracy (%)67.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Search-o1Acc86.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GOLDAccuracy (%)98.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GAPSAccuracy (%)97.5—Unverified