Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 451–500 of 939 papers

Title	Date	Tasks	Status	Hype
Towards the Detection of a Semantic Gap in the Chain of Commonsense Knowledge Triples	Jun 1, 2022	Common Sense ReasoningLanguage Modeling	—Unverified	0
Expressive Scene Graph Generation Using Commonsense Knowledge Infusion for Visual Understanding and Reasoning	May 31, 2022	Common Sense ReasoningGraph Generation	CodeCode Available	1
An Informational Space Based Semantic Analysis for Scientific Texts	May 31, 2022	Common Sense Reasoning	—Unverified	0
Leveraging QA Datasets to Improve Generative Data Augmentation	May 25, 2022	Common Sense ReasoningData Augmentation	CodeCode Available	0
Large Language Models are Zero-Shot Reasoners	May 24, 2022	Arithmetic ReasoningCommon Sense Reasoning	CodeCode Available	2
A Survey on Semantics in Automated Data Science	May 16, 2022	BIG-bench Machine LearningCommon Sense Reasoning	—Unverified	0
UL2: Unifying Language Learning Paradigms	May 10, 2022	Arithmetic ReasoningCommon Sense Reasoning	CodeCode Available	1
Irony Detection for Dutch: a Venture into the Implicit	May 1, 2022	Common Sense Reasoning	—Unverified	0
Trans-KBLSTM: An External Knowledge Enhanced Transformer BiLSTM Model for Tabular Reasoning	May 1, 2022	Common Sense ReasoningNatural Language Inference	—Unverified	0
Identifying relevant common sense information in knowledge graphs	May 1, 2022	Common Sense ReasoningKnowledge Graphs	CodeCode Available	0
Detecting COVID-19 Conspiracy Theories with Transformers and TF-IDF	May 1, 2022	Common Sense ReasoningFake News Detection	—Unverified	0
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations	Apr 27, 2022	Common Sense ReasoningWorld Knowledge	—Unverified	0
A very preliminary analysis of DALL-E 2	Apr 25, 2022	Common Sense Reasoning	—Unverified	0
PaLM: Scaling Language Modeling with Pathways	Apr 5, 2022	Auto DebuggingCode Generation	CodeCode Available	2
Training Compute-Optimal Large Language Models	Mar 29, 2022	AnachronismsAnalogical Similarity	CodeCode Available	6
Learning to Detect Mobile Objects from LiDAR Scans Without Labels	Mar 29, 2022	Autonomous DrivingCommon Sense Reasoning	CodeCode Available	1
STaR: Bootstrapping Reasoning With Reasoning	Mar 28, 2022	Common Sense ReasoningLanguage Modeling	CodeCode Available	2
AbductionRules: Training Transformers to Explain Unexpected Inputs	Mar 23, 2022	Common Sense ReasoningLogical Reasoning	CodeCode Available	1
PACS: A Dataset for Physical Audiovisual CommonSense Reasoning	Mar 21, 2022	Common Sense ReasoningMultimodal Reasoning	CodeCode Available	1
SimAN: Exploring Self-Supervised Representation Learning of Scene Text via Similarity-Aware Normalization	Mar 20, 2022	Common Sense ReasoningContrastive Learning	CodeCode Available	1
Deep Unsupervised Hashing with Latent Semantic Components	Mar 17, 2022	Common Sense ReasoningImage Retrieval	—Unverified	0
K-VQG: Knowledge-aware Visual Question Generation for Common-sense Acquisition	Mar 15, 2022	Common Sense ReasoningQuestion Generation	—Unverified	0
Efficient Language Modeling with Sparse all-MLP	Mar 14, 2022	AllCommon Sense Reasoning	—Unverified	0
Resolving label uncertainty with implicit posterior models	Feb 28, 2022	Common Sense ReasoningSegmentation	CodeCode Available	1
Embarrassingly Simple Performance Prediction for Abductive Natural Language Inference	Feb 21, 2022	Common Sense ReasoningModel Selection	CodeCode Available	0
ST-MoE: Designing Stable and Transferable Sparse Expert Models	Feb 17, 2022	ARCCommon Sense Reasoning	CodeCode Available	3
Integration of knowledge and data in machine learning	Feb 15, 2022	BIG-bench Machine LearningCommon Sense Reasoning	—Unverified	0
Russian SuperGLUE 1.1: Revising the Lessons not Learned by Russian NLP models	Feb 15, 2022	Common Sense ReasoningReading Comprehension	—Unverified	0
Neural NID Rules	Feb 12, 2022	Common Sense ReasoningGraph Neural Network	—Unverified	0
NEWSKVQA: Knowledge-Aware News Video Question Answering	Feb 8, 2022	Common Sense ReasoningManagement	—Unverified	0
A Dataset for Interactive Vision-Language Navigation with Unknown Command Feasibility	Feb 4, 2022	Common Sense ReasoningQuestion Answering	CodeCode Available	1
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models	Jan 28, 2022	Common Sense ReasoningGSM8K	CodeCode Available	6
An Application of Pseudo-Log-Likelihoods to Natural Language Scoring	Jan 23, 2022	Common Sense ReasoningGPU	—Unverified	0
Evaluating Machine Common Sense via Cloze Testing	Jan 19, 2022	Common Sense ReasoningOpen-Ended Question Answering	—Unverified	0
COPA-SSE: Semi-structured Explanations for Commonsense Reasoning	Jan 18, 2022	Common Sense ReasoningKnowledge Graphs	CodeCode Available	0
Combining Fast and Slow Thinking for Human-like and Efficient Navigation in Constrained Environments	Jan 18, 2022	Common Sense ReasoningDecision Making	—Unverified	0
Unsupervised Common Sense Relation Extraction	Jan 16, 2022	Common Sense ReasoningRelation	—Unverified	0
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations	Jan 16, 2022	Common Sense ReasoningWorld Knowledge	—Unverified	0
CommonsenseQA 2.0: Exposing the Limits of AI through Gamification	Jan 14, 2022	Common Sense ReasoningNatural Language Understanding	—Unverified	0
Towards Automated Error Analysis: Learning to Characterize Errors	Jan 13, 2022	Common Sense ReasoningMeta-Learning	—Unverified	0
AI and the Sense of Self	Jan 7, 2022	Common Sense ReasoningDecision Making	—Unverified	0
Building Human-like Communicative Intelligence: A Grounded Perspective	Jan 2, 2022	Common Sense Reasoningimage-classification	—Unverified	0
Toward a New Science of Common Sense	Dec 23, 2021	Common Sense Reasoning	—Unverified	0
Reflash Dropout in Image Super-Resolution	Dec 22, 2021	Common Sense ReasoningImage Super-Resolution	CodeCode Available	1
Comprehensive Visual Question Answering on Point Clouds through Compositional Scene Manipulation	Dec 22, 2021	Common Sense ReasoningQuestion Answering	CodeCode Available	1
The Web Is Your Oyster -- Knowledge-Intensive NLP against a Very Large Web Corpus	Dec 18, 2021	Common Sense ReasoningRetrieval	CodeCode Available	1
Is "My Favorite New Movie" My Favorite Movie? Probing the Understanding of Recursive Noun Phrases	Dec 15, 2021	Common Sense ReasoningNatural Language Inference	CodeCode Available	0
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts	Dec 13, 2021	Common Sense ReasoningIn-Context Learning	—Unverified	0
Native Chinese Reader: A Dataset Towards Native-Level Chinese Machine Reading Comprehension	Dec 13, 2021	ArticlesCommon Sense Reasoning	—Unverified	0
Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection	Dec 13, 2021	Common Sense ReasoningKnowledge Graph Embeddings	—Unverified	0

Show:10 25 50

← PrevPage 10 of 19Next →

All datasets WinoGrande arc_challenge arc_easy ReCoRD CommonsenseQA PARus RuCoS RWSD BIG-bench (Causal Judgment)BIG-bench (Date Understanding)BIG-bench (Disambiguation QA)BIG-bench (Sports Understanding)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	96.1	—	Unverified
2	Unicorn 11B (fine-tuned)	Accuracy	91.3	—	Unverified
3	CompassMTL 567M with Tailor	Accuracy	90.5	—	Unverified
4	CompassMTL 567M	Accuracy	89.6	—	Unverified
5	UnifiedQA 11B (fine-tuned)	Accuracy	89.4	—	Unverified
6	Claude 3 Opus (5-shot)	Accuracy	88.5	—	Unverified
7	GPT-4 (5-shot)	Accuracy	87.5	—	Unverified
8	ExDeBERTa 567M	Accuracy	87	—	Unverified
9	LLaMA-2 13B + MixLoRA	Accuracy	86.3	—	Unverified
10	LLaMA3 8B+MoSLoRA	Accuracy	85.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4 (few-shot, k=25)	Accuracy	96.4	—	Unverified
2	PaLM 2 (few-shot, CoT, SC)	Accuracy	95.1	—	Unverified
3	Shivaay (4B, few-shot, k=8)	Accuracy	91.04	—	Unverified
4	StupidLLM	Accuracy	91.03	—	Unverified
5	Claude 2 (few-shot, k=5)	Accuracy	91	—	Unverified
6	Claude 1.3 (few-shot, k=5)	Accuracy	90	—	Unverified
7	PaLM 540B (Self Improvement, Self Consistency)	Accuracy	89.8	—	Unverified
8	PaLM 540B (Self Consistency)	Accuracy	88.7	—	Unverified
9	PaLM 540B (Self Improvement, CoT Prompting)	Accuracy	88.3	—	Unverified
10	PaLM 540B (Self Improvement, Standard-Prompting)	Accuracy	87.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	95.2	—	Unverified
2	LLaMA 3 8B+MoSLoRA (fine-tuned)	Accuracy	90.5	—	Unverified
3	PaLM 2-L (1-shot)	Accuracy	89.7	—	Unverified
4	PaLM 2-M (1-shot)	Accuracy	88	—	Unverified
5	LLaMA-3 8B + MixLoRA	Accuracy	86.5	—	Unverified
6	Camelidae-8×34B	Accuracy	86.2	—	Unverified
7	PaLM 2-S (1-shot)	Accuracy	85.6	—	Unverified
8	LLaMA 65B + CFG (0-shot)	Accuracy	84.2	—	Unverified
9	GAL 120B (0-shot)	Accuracy	83.8	—	Unverified
10	LLaMA-2 13B + MixLoRA	Accuracy	83.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Turing NLR v5 XXL 5.4B (fine-tuned)	EM	95.9	—	Unverified
2	ST-MoE-32B 269B (fine-tuned)	EM	95.1	—	Unverified
3	T5-11B	F1	94.1	—	Unverified
4	DeBERTa-1.5B	EM	94.1	—	Unverified
5	PaLM 540B (finetuned)	EM	94	—	Unverified
6	Vega v2 6B (fine-tuned)	EM	93.9	—	Unverified
7	PaLM 2-L (one-shot)	F1	93.8	—	Unverified
8	T5-XXL 11B (fine-tuned)	EM	93.4	—	Unverified
9	PaLM 2-M (one-shot)	F1	92.4	—	Unverified
10	PaLM 2-S (one-shot)	F1	92.1	—	Unverified