SOTAVerified

Arithmetic Reasoning

Papers

Showing 61–70 of 175 papers

TitleStatusHype
Arithmetic Reasoning with LLM: Prolog Generation & Permutation—0
Large Language Models Can Self-Correct with Key Condition Verification—0
Skin-in-the-Game: Decision Making via Multi-Stakeholder Alignment in LLMs—0
Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment—0
Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Better Solvers for Math Word ProblemsCode1
Toward Self-Improvement of LLMs via Imagination, Searching, and CriticizingCode1
Bridging the Gap between Different Vocabularies for LLM EnsembleCode1
ReFT: Representation Finetuning for Language ModelsCode5
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM—0
The Claude 3 Model Family: Opus, Sonnet, Haiku—0
Show:102550
← PrevPage 7 of 18Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Claude 3.5 Sonnet (HPT)Accuracy97.72—Unverified
2DUP prompt upon GPT-4Accuracy97.1—Unverified
3Qwen2-Math-72B-Instruct (greedy)Accuracy96.7—Unverified
4SFT-Mistral-7B (Metamath, OVM, Smart Ensemble)Accuracy96.4—Unverified
5OpenMath2-Llama3.1-70B (majority@256)Accuracy96—Unverified
6Jiutian-大模型Accuracy95.2—Unverified
7DAMOMath-7B(MetaMath, OVM, BS, Ensemble)Accuracy95.1—Unverified
8Claude 3 Opus (0-shot chain-of-thought)Accuracy95—Unverified
9OpenMath2-Llama3.1-70BAccuracy94.9—Unverified
10GPT-4 (Teaching-Inspired)Accuracy94.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Text-davinci-002 (175B)(zero-shot-cot)Accuracy78.7—Unverified
2Text-davinci-002 (175B) (zero-shot)Accuracy17.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Tree of Thoughts (b=5)Success0.74—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (Teaching-Inspired)Accuracy92.2—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (Teaching-Inspired)Accuracy89.2—Unverified