Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 101–125 of 939 papers

Title	Date	Tasks	Status	Hype
Large Language Models Are Not Strong Abstract Reasoners	May 31, 2023	Common Sense ReasoningMemorization	CodeCode Available	1
PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning	May 31, 2023	Common Sense Reasoningcounterfactual	CodeCode Available	1
ImageNetVC: Zero- and Few-Shot Visual Commonsense Evaluation on 1000 ImageNet Categories	May 24, 2023	Common Sense Reasoning	CodeCode Available	1
ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games	May 24, 2023	Code GenerationCommon Sense Reasoning	CodeCode Available	1
Reasoning Implicit Sentiment with Chain-of-Thought Prompting	May 18, 2023	Common Sense ReasoningSentiment Analysis	CodeCode Available	1
AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation	May 16, 2023	Common Sense ReasoningDenoising	CodeCode Available	1
Boosting Theory-of-Mind Performance in Large Language Models via Prompting	Apr 22, 2023	Common Sense ReasoningIn-Context Learning	CodeCode Available	1
Guiding Pretraining in Reinforcement Learning with Large Language Models	Feb 13, 2023	Common Sense ReasoningLanguage Modeling	CodeCode Available	1
Exploring the Benefits of Training Expert Language Models over Instruction Tuning	Feb 7, 2023	Common Sense ReasoningCoreference Resolution	CodeCode Available	1
Large Language Models are Better Reasoners with Self-Verification	Dec 19, 2022	Arithmetic ReasoningCommon Sense Reasoning	CodeCode Available	1
Layout-aware Dreamer for Embodied Referring Expression Grounding	Nov 30, 2022	Common Sense ReasoningNavigate	CodeCode Available	1
Behavior Cloned Transformers are Neurosymbolic Reasoners	Oct 13, 2022	Common Sense Reasoning	CodeCode Available	1
Task Compass: Scaling Multi-task Pre-training with Task Prefix	Oct 12, 2022	Common Sense ReasoningData Augmentation	CodeCode Available	1
Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners	Oct 6, 2022	Common Sense ReasoningCoreference Resolution	CodeCode Available	1
Large Language Models are Pretty Good Zero-Shot Video Game Bug Detectors	Oct 5, 2022	Common Sense ReasoningLanguage Modelling	CodeCode Available	1
Leveraging Large (Visual) Language Models for Robot 3D Scene Understanding	Sep 12, 2022	Common Sense ReasoningScene Classification	CodeCode Available	1
TextWorldExpress: Simulating Text Games at One Million Steps Per Second	Aug 1, 2022	Common Sense Reasoningtext-based games	CodeCode Available	1
Rethinking Alignment in Video Super-Resolution Transformers	Jul 18, 2022	Common Sense ReasoningSuper-Resolution	CodeCode Available	1
Multi-label Classification with High-rank and High-order Label Correlations	Jul 9, 2022	Common Sense ReasoningMulti-Label Classification	CodeCode Available	1
Expressive Scene Graph Generation Using Commonsense Knowledge Infusion for Visual Understanding and Reasoning	May 31, 2022	Common Sense ReasoningGraph Generation	CodeCode Available	1
UL2: Unifying Language Learning Paradigms	May 10, 2022	Arithmetic ReasoningCommon Sense Reasoning	CodeCode Available	1
Learning to Detect Mobile Objects from LiDAR Scans Without Labels	Mar 29, 2022	Autonomous DrivingCommon Sense Reasoning	CodeCode Available	1
AbductionRules: Training Transformers to Explain Unexpected Inputs	Mar 23, 2022	Common Sense ReasoningLogical Reasoning	CodeCode Available	1
PACS: A Dataset for Physical Audiovisual CommonSense Reasoning	Mar 21, 2022	Common Sense ReasoningMultimodal Reasoning	CodeCode Available	1
SimAN: Exploring Self-Supervised Representation Learning of Scene Text via Similarity-Aware Normalization	Mar 20, 2022	Common Sense ReasoningContrastive Learning	CodeCode Available	1

Show:10 25 50

← PrevPage 5 of 38Next →

All datasets WinoGrande arc_challenge arc_easy ReCoRD CommonsenseQA PARus RuCoS RWSD BIG-bench (Causal Judgment)BIG-bench (Date Understanding)BIG-bench (Disambiguation QA)BIG-bench (Sports Understanding)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	96.1	—	Unverified
2	Unicorn 11B (fine-tuned)	Accuracy	91.3	—	Unverified
3	CompassMTL 567M with Tailor	Accuracy	90.5	—	Unverified
4	CompassMTL 567M	Accuracy	89.6	—	Unverified
5	UnifiedQA 11B (fine-tuned)	Accuracy	89.4	—	Unverified
6	Claude 3 Opus (5-shot)	Accuracy	88.5	—	Unverified
7	GPT-4 (5-shot)	Accuracy	87.5	—	Unverified
8	ExDeBERTa 567M	Accuracy	87	—	Unverified
9	LLaMA-2 13B + MixLoRA	Accuracy	86.3	—	Unverified
10	LLaMA3 8B+MoSLoRA	Accuracy	85.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4 (few-shot, k=25)	Accuracy	96.4	—	Unverified
2	PaLM 2 (few-shot, CoT, SC)	Accuracy	95.1	—	Unverified
3	Shivaay (4B, few-shot, k=8)	Accuracy	91.04	—	Unverified
4	StupidLLM	Accuracy	91.03	—	Unverified
5	Claude 2 (few-shot, k=5)	Accuracy	91	—	Unverified
6	Claude 1.3 (few-shot, k=5)	Accuracy	90	—	Unverified
7	PaLM 540B (Self Improvement, Self Consistency)	Accuracy	89.8	—	Unverified
8	PaLM 540B (Self Consistency)	Accuracy	88.7	—	Unverified
9	PaLM 540B (Self Improvement, CoT Prompting)	Accuracy	88.3	—	Unverified
10	PaLM 540B (Self Improvement, Standard-Prompting)	Accuracy	87.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	95.2	—	Unverified
2	LLaMA 3 8B+MoSLoRA (fine-tuned)	Accuracy	90.5	—	Unverified
3	PaLM 2-L (1-shot)	Accuracy	89.7	—	Unverified
4	PaLM 2-M (1-shot)	Accuracy	88	—	Unverified
5	LLaMA-3 8B + MixLoRA	Accuracy	86.5	—	Unverified
6	Camelidae-8×34B	Accuracy	86.2	—	Unverified
7	PaLM 2-S (1-shot)	Accuracy	85.6	—	Unverified
8	LLaMA 65B + CFG (0-shot)	Accuracy	84.2	—	Unverified
9	GAL 120B (0-shot)	Accuracy	83.8	—	Unverified
10	LLaMA-2 13B + MixLoRA	Accuracy	83.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Turing NLR v5 XXL 5.4B (fine-tuned)	EM	95.9	—	Unverified
2	ST-MoE-32B 269B (fine-tuned)	EM	95.1	—	Unverified
3	T5-11B	F1	94.1	—	Unverified
4	DeBERTa-1.5B	EM	94.1	—	Unverified
5	PaLM 540B (finetuned)	EM	94	—	Unverified
6	Vega v2 6B (fine-tuned)	EM	93.9	—	Unverified
7	PaLM 2-L (one-shot)	F1	93.8	—	Unverified
8	T5-XXL 11B (fine-tuned)	EM	93.4	—	Unverified
9	PaLM 2-M (one-shot)	F1	92.4	—	Unverified
10	PaLM 2-S (one-shot)	F1	92.1	—	Unverified