Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 151–200 of 939 papers

Title	Date	Tasks	Status	Hype
Guiding Pretraining in Reinforcement Learning with Large Language Models	Feb 13, 2023	Common Sense ReasoningLanguage Modeling	CodeCode Available	1
HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments	Jan 23, 2024	Common Sense ReasoningDecision Making	CodeCode Available	1
Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring Systems	Jul 14, 2020	Automated Essay ScoringCommon Sense Reasoning	CodeCode Available	1
ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games	May 24, 2023	Code GenerationCommon Sense Reasoning	CodeCode Available	1
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention	Dec 6, 2021	Common Sense Reasoning	CodeCode Available	1
Comprehensive Visual Question Answering on Point Clouds through Compositional Scene Manipulation	Dec 22, 2021	Common Sense ReasoningQuestion Answering	CodeCode Available	1
A Semantic Space is Worth 256 Language Descriptions: Make Stronger Segmentation Models with Descriptive Properties	Dec 21, 2023	Common Sense ReasoningDescriptive	CodeCode Available	1
Expressive Scene Graph Generation Using Commonsense Knowledge Infusion for Visual Understanding and Reasoning	May 31, 2022	Common Sense ReasoningGraph Generation	CodeCode Available	1
Exploring the Benefits of Training Expert Language Models over Instruction Tuning	Feb 7, 2023	Common Sense ReasoningCoreference Resolution	CodeCode Available	1
Conversational Word Embedding for Retrieval-Based Dialog System	Apr 28, 2020	Common Sense ReasoningMachine Translation	CodeCode Available	1
Generating similes effortlessly like a Pro: A Style Transfer Approach for Simile Generation	Sep 18, 2020	Common Sense ReasoningSentence	CodeCode Available	1
KETM:A Knowledge-Enhanced Text Matching method	Aug 11, 2023	Common Sense ReasoningQuestion Answering	CodeCode Available	1
Event2Mind for Russian: Understanding Emotions and Intents in Texts. Corpus and Model for Evaluation	Jun 17, 2020	Common Sense Reasoning	CodeCode Available	1
LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models	Oct 5, 2023	Common Sense ReasoningMultiple-choice	CodeCode Available	1
Language Models are Unsupervised Multitask Learners	Feb 14, 2019	Common Sense ReasoningCoreference Resolution	CodeCode Available	1
Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning	Jun 13, 2021	Common Sense ReasoningSentence	CodeCode Available	1
EventPlus: A Temporal Event Understanding Pipeline	Jan 13, 2021	Common Sense ReasoningEvent Extraction	CodeCode Available	1
Boosting Theory-of-Mind Performance in Large Language Models via Prompting	Apr 22, 2023	Common Sense ReasoningIn-Context Learning	CodeCode Available	1
Common Sense Enhanced Knowledge-based Recommendation with Large Language Model	Mar 27, 2024	Common Sense ReasoningKnowledge Graphs	CodeCode Available	1
Large Language Models as Evaluators for Recommendation Explanations	Jun 5, 2024	Common Sense ReasoningInstruction Following	CodeCode Available	1
Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge	Apr 6, 2021	Common Sense ReasoningWorld Knowledge	CodeCode Available	1
Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models	Jun 24, 2024	Common Sense ReasoningHallucination	CodeCode Available	1
Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEncoder	Jun 15, 2020	Common Sense ReasoningDecoder	CodeCode Available	1
Do Multilingual Language Models Think Better in English?	Aug 2, 2023	Common Sense ReasoningCross-Lingual Natural Language Inference	CodeCode Available	1
DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation	Jun 9, 2024	Common Sense ReasoningDenoising	CodeCode Available	1
DialogSum: A Real-Life Scenario Dialogue Summarization Dataset	May 14, 2021	Abstractive Dialogue SummarizationCommon Sense Reasoning	CodeCode Available	1
Mitigating the Alignment Tax of RLHF	Sep 12, 2023	Common Sense ReasoningContinual Learning	CodeCode Available	1
Exploring AIGC Video Quality: A Focus on Visual Harmony, Video-Text Consistency and Domain Distribution Gap	Apr 21, 2024	Common Sense Reasoning	CodeCode Available	1
KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoning	Sep 4, 2019	Common Sense ReasoningKnowledge Base Question Answering	CodeCode Available	1
Playing Codenames with Language Graphs and Word Embeddings	May 12, 2021	Board GamesCommon Sense Reasoning	CodeCode Available	1
An Improved Neural Baseline for Temporal Relation Extraction	Sep 1, 2019	Common Sense ReasoningNatural Language Understanding	—Unverified	0
Benchmarks for Automated Commonsense Reasoning: A Survey	Feb 9, 2023	Common Sense ReasoningSurvey	—Unverified	0
Belief Scene Graphs: Expanding Partial Scenes with Objects through Computation of Expectation	Feb 6, 2024	Common Sense ReasoningTask Planning	—Unverified	0
An Hymn of an even Deeper Sentiment Analysis	Jun 1, 2016	Common Sense ReasoningSemantic Role Labeling	—Unverified	0
LLM-Advisor: An LLM Benchmark for Cost-efficient Path Planning across Multiple Terrains	Mar 3, 2025	Common Sense ReasoningHallucination	—Unverified	0
Behind the Scenes of an Evolving Event Cloze Test	Apr 1, 2017	Cloze TestCommon Sense Reasoning	—Unverified	0
DEEPYANG at SemEval-2020 Task 4: Using the Hidden Layer State of BERT Model for Differentiating Common Sense	Dec 1, 2020	Common Sense ReasoningNatural Language Understanding	—Unverified	0
A Hierarchical Bayesian Model for Unsupervised Induction of Script Knowledge	Apr 1, 2014	Common Sense ReasoningQuestion Answering	—Unverified	0
Deep Unsupervised Hashing with Latent Semantic Components	Mar 17, 2022	Common Sense ReasoningImage Retrieval	—Unverified	0
DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models	Apr 4, 2024	Common Sense ReasoningComputational Efficiency	—Unverified	0
Design and Implementation of Linked Planning Domain Definition Language	Dec 17, 2019	Common Sense Reasoning	—Unverified	0
Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema	Apr 16, 2021	Artifact DetectionBias Detection	—Unverified	0
Baby Intuitions Benchmark (BIB): Discerning the goals, preferences, and actions of others	Feb 23, 2021	Common Sense Reasoning	—Unverified	0
An End-to-End Multi-task Learning Model for Fact Checking	Nov 1, 2018	Common Sense ReasoningEntity Linking	—Unverified	0
A vision-grounded dataset for predicting typical locations for verbs	May 1, 2018	Common Sense ReasoningImage Captioning	—Unverified	0
An Application of Pseudo-Log-Likelihoods to Natural Language Scoring	Jan 23, 2022	Common Sense ReasoningGPU	—Unverified	0
Abductive Reasoning as Self-Supervision for Common Sense Question Answering	Sep 6, 2019	Common Sense ReasoningDomain Adaptation	—Unverified	0
A Vision for Semantically Enriched Data Science	Mar 2, 2023	Common Sense ReasoningData Augmentation	—Unverified	0
A very preliminary analysis of DALL-E 2	Apr 25, 2022	Common Sense Reasoning	—Unverified	0
An Aposteriorical Clusterability Criterion for k-Means++ and Simplicity of Clustering	Apr 24, 2017	ClusteringCommon Sense Reasoning	—Unverified	0

Show:10 25 50

← PrevPage 4 of 19Next →

All datasets WinoGrande arc_challenge arc_easy ReCoRD CommonsenseQA PARus RuCoS RWSD BIG-bench (Causal Judgment)BIG-bench (Date Understanding)BIG-bench (Disambiguation QA)BIG-bench (Sports Understanding)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	96.1	—	Unverified
2	Unicorn 11B (fine-tuned)	Accuracy	91.3	—	Unverified
3	CompassMTL 567M with Tailor	Accuracy	90.5	—	Unverified
4	CompassMTL 567M	Accuracy	89.6	—	Unverified
5	UnifiedQA 11B (fine-tuned)	Accuracy	89.4	—	Unverified
6	Claude 3 Opus (5-shot)	Accuracy	88.5	—	Unverified
7	GPT-4 (5-shot)	Accuracy	87.5	—	Unverified
8	ExDeBERTa 567M	Accuracy	87	—	Unverified
9	LLaMA-2 13B + MixLoRA	Accuracy	86.3	—	Unverified
10	LLaMA3 8B+MoSLoRA	Accuracy	85.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4 (few-shot, k=25)	Accuracy	96.4	—	Unverified
2	PaLM 2 (few-shot, CoT, SC)	Accuracy	95.1	—	Unverified
3	Shivaay (4B, few-shot, k=8)	Accuracy	91.04	—	Unverified
4	StupidLLM	Accuracy	91.03	—	Unverified
5	Claude 2 (few-shot, k=5)	Accuracy	91	—	Unverified
6	Claude 1.3 (few-shot, k=5)	Accuracy	90	—	Unverified
7	PaLM 540B (Self Improvement, Self Consistency)	Accuracy	89.8	—	Unverified
8	PaLM 540B (Self Consistency)	Accuracy	88.7	—	Unverified
9	PaLM 540B (Self Improvement, CoT Prompting)	Accuracy	88.3	—	Unverified
10	PaLM 540B (Self Improvement, Standard-Prompting)	Accuracy	87.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	95.2	—	Unverified
2	LLaMA 3 8B+MoSLoRA (fine-tuned)	Accuracy	90.5	—	Unverified
3	PaLM 2-L (1-shot)	Accuracy	89.7	—	Unverified
4	PaLM 2-M (1-shot)	Accuracy	88	—	Unverified
5	LLaMA-3 8B + MixLoRA	Accuracy	86.5	—	Unverified
6	Camelidae-8×34B	Accuracy	86.2	—	Unverified
7	PaLM 2-S (1-shot)	Accuracy	85.6	—	Unverified
8	LLaMA 65B + CFG (0-shot)	Accuracy	84.2	—	Unverified
9	GAL 120B (0-shot)	Accuracy	83.8	—	Unverified
10	LLaMA-2 13B + MixLoRA	Accuracy	83.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Turing NLR v5 XXL 5.4B (fine-tuned)	EM	95.9	—	Unverified
2	ST-MoE-32B 269B (fine-tuned)	EM	95.1	—	Unverified
3	T5-11B	F1	94.1	—	Unverified
4	DeBERTa-1.5B	EM	94.1	—	Unverified
5	PaLM 540B (finetuned)	EM	94	—	Unverified
6	Vega v2 6B (fine-tuned)	EM	93.9	—	Unverified
7	PaLM 2-L (one-shot)	F1	93.8	—	Unverified
8	T5-XXL 11B (fine-tuned)	EM	93.4	—	Unverified
9	PaLM 2-M (one-shot)	F1	92.4	—	Unverified
10	PaLM 2-S (one-shot)	F1	92.1	—	Unverified