Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 476–500 of 939 papers

Title	Date	Tasks	Status	Hype
ST-MoE: Designing Stable and Transferable Sparse Expert Models	Feb 17, 2022	ARCCommon Sense Reasoning	CodeCode Available	3
Integration of knowledge and data in machine learning	Feb 15, 2022	BIG-bench Machine LearningCommon Sense Reasoning	—Unverified	0
Russian SuperGLUE 1.1: Revising the Lessons not Learned by Russian NLP models	Feb 15, 2022	Common Sense ReasoningReading Comprehension	—Unverified	0
Neural NID Rules	Feb 12, 2022	Common Sense ReasoningGraph Neural Network	—Unverified	0
NEWSKVQA: Knowledge-Aware News Video Question Answering	Feb 8, 2022	Common Sense ReasoningManagement	—Unverified	0
A Dataset for Interactive Vision-Language Navigation with Unknown Command Feasibility	Feb 4, 2022	Common Sense ReasoningQuestion Answering	CodeCode Available	1
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models	Jan 28, 2022	Common Sense ReasoningGSM8K	CodeCode Available	6
An Application of Pseudo-Log-Likelihoods to Natural Language Scoring	Jan 23, 2022	Common Sense ReasoningGPU	—Unverified	0
Evaluating Machine Common Sense via Cloze Testing	Jan 19, 2022	Common Sense ReasoningOpen-Ended Question Answering	—Unverified	0
COPA-SSE: Semi-structured Explanations for Commonsense Reasoning	Jan 18, 2022	Common Sense ReasoningKnowledge Graphs	CodeCode Available	0
Combining Fast and Slow Thinking for Human-like and Efficient Navigation in Constrained Environments	Jan 18, 2022	Common Sense ReasoningDecision Making	—Unverified	0
Unsupervised Common Sense Relation Extraction	Jan 16, 2022	Common Sense ReasoningRelation	—Unverified	0
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations	Jan 16, 2022	Common Sense ReasoningWorld Knowledge	—Unverified	0
CommonsenseQA 2.0: Exposing the Limits of AI through Gamification	Jan 14, 2022	Common Sense ReasoningNatural Language Understanding	—Unverified	0
Towards Automated Error Analysis: Learning to Characterize Errors	Jan 13, 2022	Common Sense ReasoningMeta-Learning	—Unverified	0
AI and the Sense of Self	Jan 7, 2022	Common Sense ReasoningDecision Making	—Unverified	0
Building Human-like Communicative Intelligence: A Grounded Perspective	Jan 2, 2022	Common Sense Reasoningimage-classification	—Unverified	0
Toward a New Science of Common Sense	Dec 23, 2021	Common Sense Reasoning	—Unverified	0
Reflash Dropout in Image Super-Resolution	Dec 22, 2021	Common Sense ReasoningImage Super-Resolution	CodeCode Available	1
Comprehensive Visual Question Answering on Point Clouds through Compositional Scene Manipulation	Dec 22, 2021	Common Sense ReasoningQuestion Answering	CodeCode Available	1
The Web Is Your Oyster -- Knowledge-Intensive NLP against a Very Large Web Corpus	Dec 18, 2021	Common Sense ReasoningRetrieval	CodeCode Available	1
Is "My Favorite New Movie" My Favorite Movie? Probing the Understanding of Recursive Noun Phrases	Dec 15, 2021	Common Sense ReasoningNatural Language Inference	CodeCode Available	0
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts	Dec 13, 2021	Common Sense ReasoningIn-Context Learning	—Unverified	0
Native Chinese Reader: A Dataset Towards Native-Level Chinese Machine Reading Comprehension	Dec 13, 2021	ArticlesCommon Sense Reasoning	—Unverified	0
Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection	Dec 13, 2021	Common Sense ReasoningKnowledge Graph Embeddings	—Unverified	0

Show:10 25 50

← PrevPage 20 of 38Next →

All datasets WinoGrande arc_challenge arc_easy ReCoRD CommonsenseQA PARus RuCoS RWSD BIG-bench (Causal Judgment)BIG-bench (Date Understanding)BIG-bench (Disambiguation QA)BIG-bench (Sports Understanding)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	96.1	—	Unverified
2	Unicorn 11B (fine-tuned)	Accuracy	91.3	—	Unverified
3	CompassMTL 567M with Tailor	Accuracy	90.5	—	Unverified
4	CompassMTL 567M	Accuracy	89.6	—	Unverified
5	UnifiedQA 11B (fine-tuned)	Accuracy	89.4	—	Unverified
6	Claude 3 Opus (5-shot)	Accuracy	88.5	—	Unverified
7	GPT-4 (5-shot)	Accuracy	87.5	—	Unverified
8	ExDeBERTa 567M	Accuracy	87	—	Unverified
9	LLaMA-2 13B + MixLoRA	Accuracy	86.3	—	Unverified
10	LLaMA3 8B+MoSLoRA	Accuracy	85.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4 (few-shot, k=25)	Accuracy	96.4	—	Unverified
2	PaLM 2 (few-shot, CoT, SC)	Accuracy	95.1	—	Unverified
3	Shivaay (4B, few-shot, k=8)	Accuracy	91.04	—	Unverified
4	StupidLLM	Accuracy	91.03	—	Unverified
5	Claude 2 (few-shot, k=5)	Accuracy	91	—	Unverified
6	Claude 1.3 (few-shot, k=5)	Accuracy	90	—	Unverified
7	PaLM 540B (Self Improvement, Self Consistency)	Accuracy	89.8	—	Unverified
8	PaLM 540B (Self Consistency)	Accuracy	88.7	—	Unverified
9	PaLM 540B (Self Improvement, CoT Prompting)	Accuracy	88.3	—	Unverified
10	PaLM 540B (Self Improvement, Standard-Prompting)	Accuracy	87.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	95.2	—	Unverified
2	LLaMA 3 8B+MoSLoRA (fine-tuned)	Accuracy	90.5	—	Unverified
3	PaLM 2-L (1-shot)	Accuracy	89.7	—	Unverified
4	PaLM 2-M (1-shot)	Accuracy	88	—	Unverified
5	LLaMA-3 8B + MixLoRA	Accuracy	86.5	—	Unverified
6	Camelidae-8×34B	Accuracy	86.2	—	Unverified
7	PaLM 2-S (1-shot)	Accuracy	85.6	—	Unverified
8	LLaMA 65B + CFG (0-shot)	Accuracy	84.2	—	Unverified
9	GAL 120B (0-shot)	Accuracy	83.8	—	Unverified
10	LLaMA-2 13B + MixLoRA	Accuracy	83.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Turing NLR v5 XXL 5.4B (fine-tuned)	EM	95.9	—	Unverified
2	ST-MoE-32B 269B (fine-tuned)	EM	95.1	—	Unverified
3	T5-11B	F1	94.1	—	Unverified
4	DeBERTa-1.5B	EM	94.1	—	Unverified
5	PaLM 540B (finetuned)	EM	94	—	Unverified
6	Vega v2 6B (fine-tuned)	EM	93.9	—	Unverified
7	PaLM 2-L (one-shot)	F1	93.8	—	Unverified
8	T5-XXL 11B (fine-tuned)	EM	93.4	—	Unverified
9	PaLM 2-M (one-shot)	F1	92.4	—	Unverified
10	PaLM 2-S (one-shot)	F1	92.1	—	Unverified