SOTAVerified

Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Showing 301350 of 939 papers

TitleStatusHype
Affective Common Sense Knowledge Acquisition for Sentiment Analysis0
"Tidy Up the Table": Grounding Common-sense Objective for Tabletop Object Rearrangement0
Comprehension Based Question Answering using Bloom's Taxonomy0
A Bayesian-Symbolic Approach to Reasoning and Learning in Intuitive Physics0
Comparing Apples to Oranges: A Dataset & Analysis of LLM Humour Understanding from Traditional Puns to Topical Jokes0
A Discourse-Annotated Corpus of Conjoined VPs0
A Bayesian-Symbolic Approach to Learning and Reasoning for Intuitive Physics0
CommonsenseQA 2.0: Exposing the Limits of AI through Gamification0
A Study on Neuro-Symbolic Artificial Intelligence: Healthcare Perspectives0
Commonsense Ontology Micropatterns0
A Strong Lexical Matching Method for the Machine Comprehension Test0
Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Models0
How Pre-trained Word Representations Capture Commonsense Physical Comparisons0
How to Understand Named Entities: Using Common Sense for News Captioning0
Common Sense Knowledge, Ontology and Text Mining for Implicit Requirements0
A Statistical View on Synthetic Aperture Imaging for Occlusion Removal0
Align-GRAG: Reasoning-Guided Dual Alignment for Graph Retrieval-Augmented Generation0
Commonsense Knowledge in Wikidata0
FusionSense: Bridging Common Sense, Vision, and Touch for Robust Sparse-View Reconstruction0
Commonsense Knowledge from Scene Graphs for Textual Environments0
Assisting human experts in the interpretation of their visual process: A case study on assessing copper surface adhesive potency0
Common Sense Is All You Need0
FRIDA to the Rescue! Analyzing Synthetic Data Effectiveness in Object-Based Common Sense Reasoning for Disaster Response0
Assessment of cognitive characteristics in intelligent systems and predictive ability0
Common-Sense Bias Modeling for Classification Tasks0
Fractional trends and cycles in macroeconomic time series0
Aspect Extraction from Product Reviews Using Category Hierarchy Information0
A design of human-like robust AI machines in object identification0
Hierarchical Relational Inference0
FoundaBench: Evaluating Chinese Fundamental Knowledge Capabilities of Large Language Models0
Forecasting Social Navigation in Crowded Complex Scenes0
Commonsense about Human Senses: Labeled Data Collection Processes0
FirePlace: Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placement0
Ask Me What You Need: Product Retrieval using Knowledge from GPT-30
Heuristic Vision Pre-Training with Self-Supervised and Supervised Multi-Task Learning0
COMMA-DEER: COmmon-sense Aware Multimodal Multitask Approach for Detection of Emotion and Emotional Reasoning in Conversations0
Framework for Certification of AI-Based Systems0
Free Will Belief as a consequence of Model-based Reinforcement Learning0
ADEPT: An Adjective-Dependent Plausibility Task0
From Blind Solvers to Logical Thinkers: Benchmarking LLMs' Logical Integrity on Faulty Mathematical Problems0
From Common Sense Reasoning to Neural Network Models through Multiple Preferences: an overview0
Functional-level Uncertainty Quantification for Calibrated Fine-tuning on LLMs0
Fine-grained evaluation of Quality Estimation for Machine translation based on a linguistically motivated Test Suite0
HEIE: MLLM-Based Hierarchical Explainable AIGC Image Implausibility Evaluator0
FVQA 2.0: Introducing Adversarial Samples into Fact-based Visual Question Answering0
FVQA: Fact-based Visual Question Answering0
HGSGNLP at IEST 2018: An Ensemble of Machine Learning and Deep Neural Architectures for Implicit Emotion Classification in Tweets0
Common Sense Knowledge Learning for Open Vocabulary Neural Reasoning: A First View into Chronic Disease Literature0
FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answering0
Features of Verb Complements in Co-composition: A case study of Chinese baking verb using Weibo corpus0
Show:102550
← PrevPage 7 of 19Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy96.1Unverified
2Unicorn 11B (fine-tuned)Accuracy91.3Unverified
3CompassMTL 567M with TailorAccuracy90.5Unverified
4CompassMTL 567MAccuracy89.6Unverified
5UnifiedQA 11B (fine-tuned)Accuracy89.4Unverified
6Claude 3 Opus (5-shot)Accuracy88.5Unverified
7GPT-4 (5-shot)Accuracy87.5Unverified
8ExDeBERTa 567MAccuracy87Unverified
9LLaMA-2 13B + MixLoRAAccuracy86.3Unverified
10LLaMA3 8B+MoSLoRAAccuracy85.8Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (few-shot, k=25)Accuracy96.4Unverified
2PaLM 2 (few-shot, CoT, SC)Accuracy95.1Unverified
3Shivaay (4B, few-shot, k=8)Accuracy91.04Unverified
4StupidLLMAccuracy91.03Unverified
5Claude 2 (few-shot, k=5)Accuracy91Unverified
6Claude 1.3 (few-shot, k=5)Accuracy90Unverified
7PaLM 540B (Self Improvement, Self Consistency)Accuracy89.8Unverified
8PaLM 540B (Self Consistency)Accuracy88.7Unverified
9PaLM 540B (Self Improvement, CoT Prompting)Accuracy88.3Unverified
10PaLM 540B (Self Improvement, Standard-Prompting)Accuracy87.2Unverified
#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy95.2Unverified
2LLaMA 3 8B+MoSLoRA (fine-tuned)Accuracy90.5Unverified
3PaLM 2-L (1-shot)Accuracy89.7Unverified
4PaLM 2-M (1-shot)Accuracy88Unverified
5LLaMA-3 8B + MixLoRAAccuracy86.5Unverified
6Camelidae-8×34BAccuracy86.2Unverified
7PaLM 2-S (1-shot)Accuracy85.6Unverified
8LLaMA 65B + CFG (0-shot)Accuracy84.2Unverified
9GAL 120B (0-shot)Accuracy83.8Unverified
10LLaMA-2 13B + MixLoRAAccuracy83.5Unverified
#ModelMetricClaimedVerifiedStatus
1Turing NLR v5 XXL 5.4B (fine-tuned)EM95.9Unverified
2ST-MoE-32B 269B (fine-tuned)EM95.1Unverified
3T5-11BF194.1Unverified
4DeBERTa-1.5BEM94.1Unverified
5PaLM 540B (finetuned)EM94Unverified
6Vega v2 6B (fine-tuned)EM93.9Unverified
7PaLM 2-L (one-shot)F193.8Unverified
8T5-XXL 11B (fine-tuned)EM93.4Unverified
9PaLM 2-M (one-shot)F192.4Unverified
10PaLM 2-S (one-shot)F192.1Unverified