Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 576–600 of 939 papers

Title	Date	Tasks	Status	Hype
Muppet: Massive Multi-task Representations with Pre-Finetuning	Jan 26, 2021	Abstractive Text SummarizationCommon Sense Reasoning	CodeCode Available	0
TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviors	Jan 17, 2021	Common Sense ReasoningData Augmentation	—Unverified	0
EventPlus: A Temporal Event Understanding Pipeline	Jan 13, 2021	Common Sense ReasoningEvent Extraction	CodeCode Available	1
A design of human-like robust AI machines in object identification	Jan 7, 2021	Causal InferenceCommon Sense Reasoning	—Unverified	0
Extraction of Common-Sense Relations from Procedural Task Instructions using BERT	Jan 1, 2021	Common Sense Reasoning	—Unverified	0
Grounding Consistency: Distilling Spatial Common Sense for Precise Visual Relationship Detection	Jan 1, 2021	Common Sense ReasoningGraph Generation	CodeCode Available	1
Detecting Persuasive Atypicality by Modeling Contextual Compatibility	Jan 1, 2021	Common Sense Reasoning	CodeCode Available	0
Pre-training Text-to-Text Transformers to Write and Reason with Concepts	Jan 1, 2021	Common Sense ReasoningLanguage Modelling	—Unverified	0
A Bayesian-Symbolic Approach to Learning and Reasoning for Intuitive Physics	Jan 1, 2021	Bayesian InferenceCommon Sense Reasoning	—Unverified	0
Median DC for Sign Recovery: Privacy can be Achieved by Deterministic Algorithms	Jan 1, 2021	Common Sense ReasoningPrivacy Preserving	—Unverified	0
Conflict-driven Inductive Logic Programming	Dec 31, 2020	Common Sense ReasoningInductive logic programming	—Unverified	0
Design Knowledge Representation with Technology Semantic Network	Dec 31, 2020	Common Sense Reasoning	—Unverified	0
Seeing is Knowing! Fact-based Visual Question Answering using Knowledge Graph Embeddings	Dec 31, 2020	Common Sense ReasoningKnowledge Graph Embeddings	—Unverified	0
My Teacher Thinks The World Is Flat! Interpreting Automatic Essay Scoring Mechanism	Dec 27, 2020	Common Sense ReasoningNatural Language Understanding	CodeCode Available	0
Knowledge Graphs Evolution and Preservation -- A Technical Report from ISWS 2019	Dec 22, 2020	Common Sense ReasoningKnowledge Graphs	—Unverified	0
Exploring and Analyzing Machine Commonsense Benchmarks	Dec 21, 2020	Common Sense ReasoningQuestion Answering	—Unverified	0
Lexically-constrained Text Generation through Commonsense Knowledge Extraction and Injection	Dec 19, 2020	Common Sense ReasoningConditional Text Generation	—Unverified	0
Can Transformers Reason About Effects of Actions?	Dec 17, 2020	Common Sense ReasoningQuestion Answering	—Unverified	0
Computational principles of intelligence: learning and reasoning with neural networks	Dec 17, 2020	Common Sense Reasoning	—Unverified	0
Deliberative and Conceptual Inference in Service Robots	Dec 13, 2020	Common Sense ReasoningDecision Making	CodeCode Available	0
Fusing Context Into Knowledge Graph for Commonsense Question Answering	Dec 9, 2020	Common Sense ReasoningKnowledge Graphs	CodeCode Available	1
Playing Text-Based Games with Common Sense	Dec 4, 2020	Common Sense ReasoningDeep Reinforcement Learning	—Unverified	0
How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering	Dec 2, 2020	Common Sense ReasoningQuestion Answering	CodeCode Available	1
Seeing the World through Text: Evaluating Image Descriptions for Commonsense Reasoning in Machine Reading Comprehension	Dec 1, 2020	Common Sense ReasoningMachine Reading Comprehension	—Unverified	0
HR@JUST Team at SemEval-2020 Task 4: The Impact of RoBERTa Transformer for Evaluation Common Sense Understanding	Dec 1, 2020	Common Sense Reasoning	—Unverified	0

Show:10 25 50

← PrevPage 24 of 38Next →

All datasets WinoGrande arc_challenge arc_easy ReCoRD CommonsenseQA PARus RuCoS RWSD BIG-bench (Causal Judgment)BIG-bench (Date Understanding)BIG-bench (Disambiguation QA)BIG-bench (Sports Understanding)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	96.1	—	Unverified
2	Unicorn 11B (fine-tuned)	Accuracy	91.3	—	Unverified
3	CompassMTL 567M with Tailor	Accuracy	90.5	—	Unverified
4	CompassMTL 567M	Accuracy	89.6	—	Unverified
5	UnifiedQA 11B (fine-tuned)	Accuracy	89.4	—	Unverified
6	Claude 3 Opus (5-shot)	Accuracy	88.5	—	Unverified
7	GPT-4 (5-shot)	Accuracy	87.5	—	Unverified
8	ExDeBERTa 567M	Accuracy	87	—	Unverified
9	LLaMA-2 13B + MixLoRA	Accuracy	86.3	—	Unverified
10	LLaMA3 8B+MoSLoRA	Accuracy	85.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4 (few-shot, k=25)	Accuracy	96.4	—	Unverified
2	PaLM 2 (few-shot, CoT, SC)	Accuracy	95.1	—	Unverified
3	Shivaay (4B, few-shot, k=8)	Accuracy	91.04	—	Unverified
4	StupidLLM	Accuracy	91.03	—	Unverified
5	Claude 2 (few-shot, k=5)	Accuracy	91	—	Unverified
6	Claude 1.3 (few-shot, k=5)	Accuracy	90	—	Unverified
7	PaLM 540B (Self Improvement, Self Consistency)	Accuracy	89.8	—	Unverified
8	PaLM 540B (Self Consistency)	Accuracy	88.7	—	Unverified
9	PaLM 540B (Self Improvement, CoT Prompting)	Accuracy	88.3	—	Unverified
10	PaLM 540B (Self Improvement, Standard-Prompting)	Accuracy	87.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	95.2	—	Unverified
2	LLaMA 3 8B+MoSLoRA (fine-tuned)	Accuracy	90.5	—	Unverified
3	PaLM 2-L (1-shot)	Accuracy	89.7	—	Unverified
4	PaLM 2-M (1-shot)	Accuracy	88	—	Unverified
5	LLaMA-3 8B + MixLoRA	Accuracy	86.5	—	Unverified
6	Camelidae-8×34B	Accuracy	86.2	—	Unverified
7	PaLM 2-S (1-shot)	Accuracy	85.6	—	Unverified
8	LLaMA 65B + CFG (0-shot)	Accuracy	84.2	—	Unverified
9	GAL 120B (0-shot)	Accuracy	83.8	—	Unverified
10	LLaMA-2 13B + MixLoRA	Accuracy	83.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Turing NLR v5 XXL 5.4B (fine-tuned)	EM	95.9	—	Unverified
2	ST-MoE-32B 269B (fine-tuned)	EM	95.1	—	Unverified
3	T5-11B	F1	94.1	—	Unverified
4	DeBERTa-1.5B	EM	94.1	—	Unverified
5	PaLM 540B (finetuned)	EM	94	—	Unverified
6	Vega v2 6B (fine-tuned)	EM	93.9	—	Unverified
7	PaLM 2-L (one-shot)	F1	93.8	—	Unverified
8	T5-XXL 11B (fine-tuned)	EM	93.4	—	Unverified
9	PaLM 2-M (one-shot)	F1	92.4	—	Unverified
10	PaLM 2-S (one-shot)	F1	92.1	—	Unverified