SOTAVerified

Arithmetic Reasoning

Papers

Showing 1120 of 175 papers

TitleStatusHype
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning DatasetCode4
OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction DataCode4
LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language ModelsCode3
WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work TasksCode3
Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMsCode3
Reasoning with Language Model Prompting: A SurveyCode3
PAL: Program-aided Language ModelsCode3
Llemma: An Open Language Model For MathematicsCode3
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem SolvingCode3
MetaMath: Bootstrap Your Own Mathematical Questions for Large Language ModelsCode2
Show:102550
← PrevPage 2 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Claude 3.5 Sonnet (HPT)Accuracy97.72Unverified
2DUP prompt upon GPT-4Accuracy97.1Unverified
3Qwen2-Math-72B-Instruct (greedy)Accuracy96.7Unverified
4SFT-Mistral-7B (Metamath, OVM, Smart Ensemble)Accuracy96.4Unverified
5OpenMath2-Llama3.1-70B (majority@256)Accuracy96Unverified
6Jiutian-大模型Accuracy95.2Unverified
7DAMOMath-7B(MetaMath, OVM, BS, Ensemble)Accuracy95.1Unverified
8Claude 3 Opus (0-shot chain-of-thought)Accuracy95Unverified
9OpenMath2-Llama3.1-70BAccuracy94.9Unverified
10GPT-4 (Teaching-Inspired)Accuracy94.8Unverified
#ModelMetricClaimedVerifiedStatus
1Text-davinci-002 (175B)(zero-shot-cot)Accuracy78.7Unverified
2Text-davinci-002 (175B) (zero-shot)Accuracy17.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tree of Thoughts (b=5)Success0.74Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (Teaching-Inspired)Accuracy92.2Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (Teaching-Inspired)Accuracy89.2Unverified