Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 501–525 of 939 papers

Title	Date	Tasks	Status	Hype
Contextualized Scene Imagination for Generative Commonsense Reasoning	Dec 12, 2021	Common Sense ReasoningDescriptive	CodeCode Available	0
Scaling Language Models: Methods, Analysis & Insights from Training Gopher	Dec 8, 2021	Abstract AlgebraAnachronisms	CodeCode Available	2
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention	Dec 6, 2021	Common Sense Reasoning	CodeCode Available	1
CO-STAR: Conceptualisation of Stereotypes for Analysis and Reasoning	Dec 1, 2021	Common Sense Reasoning	—Unverified	0
True or False: Does the Deep Learning Model Learn to Detect Rumors?	Dec 1, 2021	Common Sense Reasoning	—Unverified	0
A Bayesian-Symbolic Approach to Reasoning and Learning in Intuitive Physics	Dec 1, 2021	Bayesian InferenceBilevel Optimization	—Unverified	0
Common Sense Knowledge Learning for Open Vocabulary Neural Reasoning: A First View into Chronic Disease Literature	Nov 27, 2021	Common Sense Reasoning	—Unverified	0
Multimodal Sentiment Analysis with Common-sense Modulation	Nov 16, 2021	Common Sense ReasoningMultimodal Sentiment Analysis	—Unverified	0
AbductionRules: Training Transformers to Explain Unexpected Inputs	Nov 16, 2021	Common Sense ReasoningLogical Reasoning	—Unverified	0
Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manuals	Nov 16, 2021	Common Sense ReasoningOpen-Ended Question Answering	—Unverified	0
Deep Distilling: automated code generation using explainable deep learning	Nov 16, 2021	Code GenerationCommon Sense Reasoning	—Unverified	0
Free Will Belief as a consequence of Model-based Reinforcement Learning	Nov 14, 2021	Common Sense ReasoningDecision Making	—Unverified	0
Zero-Shot Information Extraction to Enhance a Knowledge Graph Describing Silk Textiles	Nov 1, 2021	Common Sense ReasoningKnowledge Graphs	CodeCode Available	0
Common Sense Bias in Semantic Role Labeling	Nov 1, 2021	Common Sense ReasoningSemantic Role Labeling	CodeCode Available	0
Think Before You Speak: Learning to Generate Implicit Knowledge for Response Generation by Self-Talk	Nov 1, 2021	Common Sense ReasoningResponse Generation	—Unverified	0
Wino-X: Multilingual Winograd Schemas for Commonsense Reasoning and Coreference Resolution	Nov 1, 2021	Common Sense Reasoningcoreference-resolution	CodeCode Available	0
“It doesn’t look good for a date”: Transforming Critiques into Preferences for Conversational Recommendation Systems	Nov 1, 2021	Common Sense ReasoningConversational Recommendation	CodeCode Available	0
AUTO-DISCERN: Autonomous Driving Using Common Sense Reasoning	Oct 17, 2021	Autonomous DrivingBIG-bench Machine Learning	—Unverified	0
Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation	Oct 16, 2021	Common Sense ReasoningExplainable Models	—Unverified	0
Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manuals	Oct 16, 2021	Common Sense ReasoningOpen-Ended Question Answering	—Unverified	0
Explore before Moving: A Feasible Path Estimation and Memory Recalling Framework for Embodied Navigation	Oct 16, 2021	Common Sense ReasoningEmbodied Question Answering	—Unverified	0
EventBERT: A Pre-Trained Model for Event Correlation Reasoning	Oct 13, 2021	Cloze TestCommon Sense Reasoning	—Unverified	0
Tabular Data Imputation: Choose KNN over Deep Learning	Sep 29, 2021	Common Sense ReasoningDeep Learning	—Unverified	0
Not-so fine-tuning: Measures of Common Sense for Language Models	Sep 29, 2021	Common Sense ReasoningGPU	—Unverified	0
Resolving label uncertainty with implicit generative models	Sep 29, 2021	Common Sense ReasoningSegmentation	—Unverified	0

Show:10 25 50

← PrevPage 21 of 38Next →

All datasets WinoGrande arc_challenge arc_easy ReCoRD CommonsenseQA PARus RuCoS RWSD BIG-bench (Causal Judgment)BIG-bench (Date Understanding)BIG-bench (Disambiguation QA)BIG-bench (Sports Understanding)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	96.1	—	Unverified
2	Unicorn 11B (fine-tuned)	Accuracy	91.3	—	Unverified
3	CompassMTL 567M with Tailor	Accuracy	90.5	—	Unverified
4	CompassMTL 567M	Accuracy	89.6	—	Unverified
5	UnifiedQA 11B (fine-tuned)	Accuracy	89.4	—	Unverified
6	Claude 3 Opus (5-shot)	Accuracy	88.5	—	Unverified
7	GPT-4 (5-shot)	Accuracy	87.5	—	Unverified
8	ExDeBERTa 567M	Accuracy	87	—	Unverified
9	LLaMA-2 13B + MixLoRA	Accuracy	86.3	—	Unverified
10	LLaMA3 8B+MoSLoRA	Accuracy	85.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4 (few-shot, k=25)	Accuracy	96.4	—	Unverified
2	PaLM 2 (few-shot, CoT, SC)	Accuracy	95.1	—	Unverified
3	Shivaay (4B, few-shot, k=8)	Accuracy	91.04	—	Unverified
4	StupidLLM	Accuracy	91.03	—	Unverified
5	Claude 2 (few-shot, k=5)	Accuracy	91	—	Unverified
6	Claude 1.3 (few-shot, k=5)	Accuracy	90	—	Unverified
7	PaLM 540B (Self Improvement, Self Consistency)	Accuracy	89.8	—	Unverified
8	PaLM 540B (Self Consistency)	Accuracy	88.7	—	Unverified
9	PaLM 540B (Self Improvement, CoT Prompting)	Accuracy	88.3	—	Unverified
10	PaLM 540B (Self Improvement, Standard-Prompting)	Accuracy	87.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	95.2	—	Unverified
2	LLaMA 3 8B+MoSLoRA (fine-tuned)	Accuracy	90.5	—	Unverified
3	PaLM 2-L (1-shot)	Accuracy	89.7	—	Unverified
4	PaLM 2-M (1-shot)	Accuracy	88	—	Unverified
5	LLaMA-3 8B + MixLoRA	Accuracy	86.5	—	Unverified
6	Camelidae-8×34B	Accuracy	86.2	—	Unverified
7	PaLM 2-S (1-shot)	Accuracy	85.6	—	Unverified
8	LLaMA 65B + CFG (0-shot)	Accuracy	84.2	—	Unverified
9	GAL 120B (0-shot)	Accuracy	83.8	—	Unverified
10	LLaMA-2 13B + MixLoRA	Accuracy	83.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Turing NLR v5 XXL 5.4B (fine-tuned)	EM	95.9	—	Unverified
2	ST-MoE-32B 269B (fine-tuned)	EM	95.1	—	Unverified
3	T5-11B	F1	94.1	—	Unverified
4	DeBERTa-1.5B	EM	94.1	—	Unverified
5	PaLM 540B (finetuned)	EM	94	—	Unverified
6	Vega v2 6B (fine-tuned)	EM	93.9	—	Unverified
7	PaLM 2-L (one-shot)	F1	93.8	—	Unverified
8	T5-XXL 11B (fine-tuned)	EM	93.4	—	Unverified
9	PaLM 2-M (one-shot)	F1	92.4	—	Unverified
10	PaLM 2-S (one-shot)	F1	92.1	—	Unverified