SOTAVerified

Arithmetic Reasoning

Papers

Showing 101150 of 175 papers

TitleStatusHype
Exploring Group and Symmetry Principles in Large Language Models0
Fact-Consistency Evaluation of Text-to-SQL Generation for Business Intelligence Using Exaone 3.50
Fine-Tuning and Prompt Optimization: Two Great Steps that Work Better Together0
FinLMM-R1: Enhancing Financial Reasoning in LMM through Scalable Data and Reward Design0
GaLore+: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection0
On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes0
Hint Marginalization for Improved Reasoning in Large Language Models0
Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insights0
Joint Flashback Adaptation for Forgetting-Resistant Instruction Tuning0
KwaiYiiMath: Technical Report0
Large Language Models are Null-Shot Learners0
Large Language Models Can Self-Correct with Key Condition Verification0
Large Language Models Can Self-Improve0
Learning-at-Criticality in Large Language Models for Quantum Field Theory and Beyond0
Model Card and Evaluations for Claude Models0
Neural-Symbolic Recursive Machine for Systematic Generalization0
NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks0
On Representational Dissociation of Language and Arithmetic in Large Language Models0
Making Large Language Models Better Reasoners with Step-Aware Verifier0
Orca 2: Teaching Small Language Models How to Reason0
Orca-Math: Unlocking the potential of SLMs in Grade School Math0
PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model0
Prompt Sketching for Large Language Models0
RCOT: Detecting and Rectifying Factual Inconsistency in Reasoning by Reversing Chain-of-Thought0
S^2FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity0
Self-Evaluation Guided Beam Search for Reasoning0
Hint of Thought prompting: an explainable and zero-shot approach to reasoning tasks with LLMs0
SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training0
Skin-in-the-Game: Decision Making via Multi-Stakeholder Alignment in LLMs0
Small Language Models are Equation Reasoners0
Solving math word problems with process- and outcome-based feedback0
SymBa: Symbolic Backward Chaining for Structured Natural Language Reasoning0
The ART of LLM Refinement: Ask, Refine, and Trust0
The Claude 3 Model Family: Opus, Sonnet, Haiku0
The Lottery LLM Hypothesis, Rethinking What Abilities Should LLM Compression Preserve?0
The Unreasonable Effectiveness of Eccentric Automatic Prompts0
Think Beyond Size: Adaptive Prompting for More Effective Reasoning0
Think-to-Talk or Talk-to-Think? When LLMs Come Up with an Answer in Multi-Step Arithmetic Reasoning0
ThoughtProbe: Classifier-Guided Thought Space Exploration Leveraging LLM Intrinsic Reasoning0
TinyGSM: achieving >80% on GSM8k with small language models0
Tokenization Constraints in LLMs: A Study of Symbolic and Arithmetic Reasoning Limits0
Towards Intrinsic Self-Correction Enhancement in Monte Carlo Tree Search Boosted Reasoning via Iterative Preference Learning0
Transcending Scaling Laws with 0.1% Extra Compute0
Unlocking Structured Thinking in Language Models with Cognitive Prompting0
VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL0
When do you need Chain-of-Thought Prompting for ChatGPT?0
Why Vision Language Models Struggle with Visual Arithmetic? Towards Enhanced Chart and Geometry Understanding0
Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMs0
0/1 Deep Neural Networks via Block Coordinate Descent0
Relating the Seemingly Unrelated: Principled Understanding of Generalization for Generative Models in Arithmetic Reasoning Tasks0
Show:102550
← PrevPage 3 of 4Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Claude 3.5 Sonnet (HPT)Accuracy97.72Unverified
2DUP prompt upon GPT-4Accuracy97.1Unverified
3Qwen2-Math-72B-Instruct (greedy)Accuracy96.7Unverified
4SFT-Mistral-7B (Metamath, OVM, Smart Ensemble)Accuracy96.4Unverified
5OpenMath2-Llama3.1-70B (majority@256)Accuracy96Unverified
6Jiutian-大模型Accuracy95.2Unverified
7DAMOMath-7B(MetaMath, OVM, BS, Ensemble)Accuracy95.1Unverified
8Claude 3 Opus (0-shot chain-of-thought)Accuracy95Unverified
9OpenMath2-Llama3.1-70BAccuracy94.9Unverified
10GPT-4 (Teaching-Inspired)Accuracy94.8Unverified
#ModelMetricClaimedVerifiedStatus
1Text-davinci-002 (175B)(zero-shot-cot)Accuracy78.7Unverified
2Text-davinci-002 (175B) (zero-shot)Accuracy17.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tree of Thoughts (b=5)Success0.74Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (Teaching-Inspired)Accuracy92.2Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (Teaching-Inspired)Accuracy89.2Unverified