SOTAVerified

Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Showing 551600 of 939 papers

TitleStatusHype
AI and the Sense of Self0
Building Human-like Communicative Intelligence: A Grounded Perspective0
Toward a New Science of Common Sense0
Is "My Favorite New Movie" My Favorite Movie? Probing the Understanding of Recursive Noun PhrasesCode0
Native Chinese Reader: A Dataset Towards Native-Level Chinese Machine Reading Comprehension0
Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection0
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts0
Contextualized Scene Imagination for Generative Commonsense ReasoningCode0
True or False: Does the Deep Learning Model Learn to Detect Rumors?0
A Bayesian-Symbolic Approach to Reasoning and Learning in Intuitive Physics0
CO-STAR: Conceptualisation of Stereotypes for Analysis and Reasoning0
Common Sense Knowledge Learning for Open Vocabulary Neural Reasoning: A First View into Chronic Disease Literature0
Deep Distilling: automated code generation using explainable deep learning0
AbductionRules: Training Transformers to Explain Unexpected Inputs0
Multimodal Sentiment Analysis with Common-sense Modulation0
Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manuals0
Free Will Belief as a consequence of Model-based Reinforcement Learning0
“It doesn’t look good for a date”: Transforming Critiques into Preferences for Conversational Recommendation SystemsCode0
Common Sense Bias in Semantic Role LabelingCode0
Think Before You Speak: Learning to Generate Implicit Knowledge for Response Generation by Self-Talk0
Zero-Shot Information Extraction to Enhance a Knowledge Graph Describing Silk TextilesCode0
Wino-X: Multilingual Winograd Schemas for Commonsense Reasoning and Coreference ResolutionCode0
AUTO-DISCERN: Autonomous Driving Using Common Sense Reasoning0
Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation0
Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manuals0
Explore before Moving: A Feasible Path Estimation and Memory Recalling Framework for Embodied Navigation0
EventBERT: A Pre-Trained Model for Event Correlation Reasoning0
Tabular Data Imputation: Choose KNN over Deep Learning0
Modeling and Control of bittide Synchronization0
Not-so fine-tuning: Measures of Common Sense for Language Models0
Resolving label uncertainty with implicit generative models0
Conversational Multi-Hop Reasoning with Neural Commonsense Knowledge and Symbolic Logic Rules0
The Neural Metric Factorization for Computational Drug Repositioning0
"It doesn't look good for a date": Transforming Critiques into Preferences for Conversational Recommendation SystemsCode0
Story Generation with Commonsense Knowledge Graphs and Axioms0
Does Knowledge Help General NLU? An Empirical Study0
DialogSum Challenge: Summarizing Real-Life Scenario Dialogues0
Modeling Semantics and Pragmatics of Spatial Prepositions via Hierarchical Common-Sense Primitives0
Comprehension Based Question Answering using Bloom’s Taxonomy0
Explanations for CommonsenseQA: New Dataset and Models0
ADEPT: An Adjective-Dependent Plausibility Task0
TGEA: An Error-Annotated Dataset and Benchmark Tasks for TextGeneration from Pretrained Language Models0
From Common Sense Reasoning to Neural Network Models through Multiple Preferences: an overview0
A Systematic Survey of Text Worlds as Embodied Natural Language Environments0
Scientia Potentia Est -- On the Role of Knowledge in Computational Argumentation0
Multi-Task Learning and Adapted Knowledge Models for Emotion-Cause Extraction0
Comprehension Based Question Answering using Bloom's Taxonomy0
Predicting Numerals in Natural Language Text Using a Language Model Considering the Quantitative Aspects of Numerals0
Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks0
Scalar Adjective Identification and Multilingual Ranking0
Show:102550
← PrevPage 12 of 19Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy96.1Unverified
2Unicorn 11B (fine-tuned)Accuracy91.3Unverified
3CompassMTL 567M with TailorAccuracy90.5Unverified
4CompassMTL 567MAccuracy89.6Unverified
5UnifiedQA 11B (fine-tuned)Accuracy89.4Unverified
6Claude 3 Opus (5-shot)Accuracy88.5Unverified
7GPT-4 (5-shot)Accuracy87.5Unverified
8ExDeBERTa 567MAccuracy87Unverified
9LLaMA-2 13B + MixLoRAAccuracy86.3Unverified
10LLaMA3 8B+MoSLoRAAccuracy85.8Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (few-shot, k=25)Accuracy96.4Unverified
2PaLM 2 (few-shot, CoT, SC)Accuracy95.1Unverified
3Shivaay (4B, few-shot, k=8)Accuracy91.04Unverified
4StupidLLMAccuracy91.03Unverified
5Claude 2 (few-shot, k=5)Accuracy91Unverified
6Claude 1.3 (few-shot, k=5)Accuracy90Unverified
7PaLM 540B (Self Improvement, Self Consistency)Accuracy89.8Unverified
8PaLM 540B (Self Consistency)Accuracy88.7Unverified
9PaLM 540B (Self Improvement, CoT Prompting)Accuracy88.3Unverified
10PaLM 540B (Self Improvement, Standard-Prompting)Accuracy87.2Unverified
#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy95.2Unverified
2LLaMA 3 8B+MoSLoRA (fine-tuned)Accuracy90.5Unverified
3PaLM 2-L (1-shot)Accuracy89.7Unverified
4PaLM 2-M (1-shot)Accuracy88Unverified
5LLaMA-3 8B + MixLoRAAccuracy86.5Unverified
6Camelidae-8×34BAccuracy86.2Unverified
7PaLM 2-S (1-shot)Accuracy85.6Unverified
8LLaMA 65B + CFG (0-shot)Accuracy84.2Unverified
9GAL 120B (0-shot)Accuracy83.8Unverified
10LLaMA-2 13B + MixLoRAAccuracy83.5Unverified
#ModelMetricClaimedVerifiedStatus
1Turing NLR v5 XXL 5.4B (fine-tuned)EM95.9Unverified
2ST-MoE-32B 269B (fine-tuned)EM95.1Unverified
3T5-11BF194.1Unverified
4DeBERTa-1.5BEM94.1Unverified
5PaLM 540B (finetuned)EM94Unverified
6Vega v2 6B (fine-tuned)EM93.9Unverified
7PaLM 2-L (one-shot)F193.8Unverified
8T5-XXL 11B (fine-tuned)EM93.4Unverified
9PaLM 2-M (one-shot)F192.4Unverified
10PaLM 2-S (one-shot)F192.1Unverified