Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 276–300 of 939 papers

Title	Date	Tasks	Status	Hype
SAGE: Smart home Agent with Grounded Execution	Nov 1, 2023	Common Sense ReasoningGeneral Knowledge	—Unverified	0
ROME: Evaluating Pre-trained Vision-Language Models on Reasoning beyond Visual Common Sense	Oct 30, 2023	Common Sense ReasoningLanguage Modeling	CodeCode Available	0
DCQA: Document-Level Chart Question Answering towards Complex Reasoning and Common-Sense Understanding	Oct 29, 2023	Answer GenerationChart Question Answering	CodeCode Available	0
LLM-FP4: 4-Bit Floating-Point Quantized Transformers	Oct 25, 2023	Common Sense ReasoningQuantization	CodeCode Available	2
Exploring Large Language Models as a Source of Common-Sense Knowledge for Robots	Oct 19, 2023	Common Sense Reasoning	CodeCode Available	0
GestureGPT: Toward Zero-Shot Free-Form Hand Gesture Understanding with Large Language Model Agents	Oct 19, 2023	Common Sense ReasoningForm	CodeCode Available	0
Penetrative AI: Making LLMs Comprehend the Physical World	Oct 14, 2023	Common Sense ReasoningWorld Knowledge	—Unverified	0
Co-NavGPT: Multi-Robot Cooperative Visual Semantic Navigation Using Vision Language Models	Oct 11, 2023	Common Sense ReasoningEfficient Exploration	—Unverified	0
Heuristic Vision Pre-Training with Self-Supervised and Supervised Multi-Task Learning	Oct 11, 2023	Common Sense ReasoningContrastive Learning	—Unverified	0
NEWTON: Are Large Language Models Capable of Physical Reasoning?	Oct 10, 2023	AttributeCommon Sense Reasoning	—Unverified	0
Mistral 7B	Oct 10, 2023	answerability predictionArithmetic Reasoning	CodeCode Available	6
LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models	Oct 5, 2023	Common Sense ReasoningMultiple-choice	CodeCode Available	1
AdaRefiner: Refining Decisions of Language Models with Adaptive Feedback	Sep 29, 2023	Common Sense ReasoningDecision Making	CodeCode Available	1
Telling Stories for Common Sense Zero-Shot Action Recognition	Sep 29, 2023	Action RecognitionArticles	CodeCode Available	0
DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models	Sep 28, 2023	10-shot image generation1 Image, 2*2 Stitchi	CodeCode Available	2
Self-Refined Large Language Model as Automated Reward Function Designer for Deep Reinforcement Learning in Robotics	Sep 13, 2023	Common Sense ReasoningDeep Reinforcement Learning	CodeCode Available	0
TrafficGPT: Viewing, Processing and Interacting with Traffic Foundation Models	Sep 13, 2023	Common Sense ReasoningDecision Making	CodeCode Available	1
Learning to Predict Concept Ordering for Common Sense Generation	Sep 12, 2023	Common Sense ReasoningSentence	CodeCode Available	0
Mitigating the Alignment Tax of RLHF	Sep 12, 2023	Common Sense ReasoningContinual Learning	CodeCode Available	1
SAGE: Structured Attribute Value Generation for Billion-Scale Product Catalogs	Sep 12, 2023	AttributeCommon Sense Reasoning	—Unverified	0
Textbooks Are All You Need II: phi-1.5 technical report	Sep 11, 2023	AllCode Generation	—Unverified	0
What Is Near?: Room Locality Learning for Enhanced Robot Vision-Language-Navigation in Indoor Living Environments	Sep 10, 2023	Common Sense ReasoningDecision Making	—Unverified	0
SayNav: Grounding Large Language Models for Dynamic Planning to Navigation in New Environments	Sep 8, 2023	Common Sense ReasoningNavigate	CodeCode Available	1
Interpretable Visual Question Answering via Reasoning Supervision	Sep 7, 2023	Common Sense ReasoningQuestion Answering	—Unverified	0
Multilingual Text Representation	Sep 2, 2023	Common Sense ReasoningNatural Language Understanding	—Unverified	0

Show:10 25 50

← PrevPage 12 of 38Next →

All datasets WinoGrande arc_challenge arc_easy ReCoRD CommonsenseQA PARus RuCoS RWSD BIG-bench (Causal Judgment)BIG-bench (Date Understanding)BIG-bench (Disambiguation QA)BIG-bench (Sports Understanding)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	96.1	—	Unverified
2	Unicorn 11B (fine-tuned)	Accuracy	91.3	—	Unverified
3	CompassMTL 567M with Tailor	Accuracy	90.5	—	Unverified
4	CompassMTL 567M	Accuracy	89.6	—	Unverified
5	UnifiedQA 11B (fine-tuned)	Accuracy	89.4	—	Unverified
6	Claude 3 Opus (5-shot)	Accuracy	88.5	—	Unverified
7	GPT-4 (5-shot)	Accuracy	87.5	—	Unverified
8	ExDeBERTa 567M	Accuracy	87	—	Unverified
9	LLaMA-2 13B + MixLoRA	Accuracy	86.3	—	Unverified
10	LLaMA3 8B+MoSLoRA	Accuracy	85.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4 (few-shot, k=25)	Accuracy	96.4	—	Unverified
2	PaLM 2 (few-shot, CoT, SC)	Accuracy	95.1	—	Unverified
3	Shivaay (4B, few-shot, k=8)	Accuracy	91.04	—	Unverified
4	StupidLLM	Accuracy	91.03	—	Unverified
5	Claude 2 (few-shot, k=5)	Accuracy	91	—	Unverified
6	Claude 1.3 (few-shot, k=5)	Accuracy	90	—	Unverified
7	PaLM 540B (Self Improvement, Self Consistency)	Accuracy	89.8	—	Unverified
8	PaLM 540B (Self Consistency)	Accuracy	88.7	—	Unverified
9	PaLM 540B (Self Improvement, CoT Prompting)	Accuracy	88.3	—	Unverified
10	PaLM 540B (Self Improvement, Standard-Prompting)	Accuracy	87.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ST-MoE-32B 269B (fine-tuned)	Accuracy	95.2	—	Unverified
2	LLaMA 3 8B+MoSLoRA (fine-tuned)	Accuracy	90.5	—	Unverified
3	PaLM 2-L (1-shot)	Accuracy	89.7	—	Unverified
4	PaLM 2-M (1-shot)	Accuracy	88	—	Unverified
5	LLaMA-3 8B + MixLoRA	Accuracy	86.5	—	Unverified
6	Camelidae-8×34B	Accuracy	86.2	—	Unverified
7	PaLM 2-S (1-shot)	Accuracy	85.6	—	Unverified
8	LLaMA 65B + CFG (0-shot)	Accuracy	84.2	—	Unverified
9	GAL 120B (0-shot)	Accuracy	83.8	—	Unverified
10	LLaMA-2 13B + MixLoRA	Accuracy	83.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Turing NLR v5 XXL 5.4B (fine-tuned)	EM	95.9	—	Unverified
2	ST-MoE-32B 269B (fine-tuned)	EM	95.1	—	Unverified
3	T5-11B	F1	94.1	—	Unverified
4	DeBERTa-1.5B	EM	94.1	—	Unverified
5	PaLM 540B (finetuned)	EM	94	—	Unverified
6	Vega v2 6B (fine-tuned)	EM	93.9	—	Unverified
7	PaLM 2-L (one-shot)	F1	93.8	—	Unverified
8	T5-XXL 11B (fine-tuned)	EM	93.4	—	Unverified
9	PaLM 2-M (one-shot)	F1	92.4	—	Unverified
10	PaLM 2-S (one-shot)	F1	92.1	—	Unverified