SOTAVerified

Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Showing 401450 of 939 papers

TitleStatusHype
HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model0
Humans in Humans Out: On GPT Converging Toward Common Sense in both Success and Failure0
ContextGPT: Infusing LLMs Knowledge into Neuro-Symbolic Activity Recognition Models0
A Tool for Extracting Conversational Implicatures0
IIT (BHU): System Description for LSDSem'17 Shared Task0
A mathematical theory of super-resolution and two-point resolution0
Affordance Extraction and Inference based on Semantic Role Labeling0
Human-Object Interaction from Human-Level Instructions0
Context-based Natural Language Processing for GIS-based Vague Region Visualization0
HR@JUST Team at SemEval-2020 Task 4: The Impact of RoBERTa Transformer for Evaluation Common Sense Understanding0
Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection0
Enhancing Cross-Modal Contextual Congruence for Crowdfunding Success using Knowledge-infused Learning0
How to Understand Named Entities: Using Common Sense for News Captioning0
Content selection as semantic-based ontology exploration0
ATLAS: Learning to Optimally Memorize the Context at Test Time0
"Tidy Up the Table": Grounding Common-sense Objective for Tabletop Object Rearrangement0
How Pre-trained Word Representations Capture Commonsense Physical Comparisons0
Improving Tool Retrieval by Leveraging Large Language Models for Query Generation0
Bridging Visual Perception with Contextual Semantics for Understanding Robot Manipulation Tasks0
How Factuality Determines Sentiment Inferences0
Constructing a Dictionary Describing Feature Changes of Arguments in Event Sentences0
Inducing Neural Models of Script Knowledge0
A Theory of Human-Like Few-Shot Learning0
Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insights0
Constrained Text Generation with Global Guidance -- Case Study on CommonGen0
Hierarchical Relational Inference0
Informed Haar-like Features Improve Pedestrian Detection0
InstructionBench: An Instructional Video Understanding Benchmark0
Integrating a Heterogeneous Graph with Entity-aware Self-attention using Relative Position Labels for Reading Comprehension Model0
Integration of knowledge and data in machine learning0
Consolidating Commonsense Knowledge0
Interactive and Expressive Code-Augmented Planning with Large Language Models0
A Systematic Survey of Text Worlds as Embodied Natural Language Environments0
Interactive Learning of Spatial Knowledge for Text to 3D Scene Generation0
HGSGNLP at IEST 2018: An Ensemble of Machine Learning and Deep Neural Architectures for Implicit Emotion Classification in Tweets0
Conflict-driven Inductive Logic Programming0
Interpretable Visual Question Answering via Reasoning Supervision0
Intrinsically Motivated Learning of Causal World Models0
Investigating Data Contamination in Modern Benchmarks for Large Language Models0
Investigating the Application of Common-Sense Knowledge-Base for Identifying Term Obfuscation in Adversarial Communication0
iPerceive: Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering0
IPPON: Common Sense Guided Informative Path Planning for Object Goal Navigation0
Heuristic Vision Pre-Training with Self-Supervised and Supervised Multi-Task Learning0
Irony Detection for Dutch: a Venture into the Implicit0
HEIE: MLLM-Based Hierarchical Explainable AIGC Image Implausibility Evaluator0
Concept Induction using LLMs: a user experiment for assessment0
A Systematic Survey of Text Worlds as Embodied Natural Language Environments0
Is the Elephant Flying? Resolving Ambiguities in Text-to-Image Generative Models0
A Machine Consciousness architecture based on Deep Learning and Gaussian Processes0
Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective0
Show:102550
← PrevPage 9 of 19Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy96.1Unverified
2Unicorn 11B (fine-tuned)Accuracy91.3Unverified
3CompassMTL 567M with TailorAccuracy90.5Unverified
4CompassMTL 567MAccuracy89.6Unverified
5UnifiedQA 11B (fine-tuned)Accuracy89.4Unverified
6Claude 3 Opus (5-shot)Accuracy88.5Unverified
7GPT-4 (5-shot)Accuracy87.5Unverified
8ExDeBERTa 567MAccuracy87Unverified
9LLaMA-2 13B + MixLoRAAccuracy86.3Unverified
10LLaMA3 8B+MoSLoRAAccuracy85.8Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (few-shot, k=25)Accuracy96.4Unverified
2PaLM 2 (few-shot, CoT, SC)Accuracy95.1Unverified
3Shivaay (4B, few-shot, k=8)Accuracy91.04Unverified
4StupidLLMAccuracy91.03Unverified
5Claude 2 (few-shot, k=5)Accuracy91Unverified
6Claude 1.3 (few-shot, k=5)Accuracy90Unverified
7PaLM 540B (Self Improvement, Self Consistency)Accuracy89.8Unverified
8PaLM 540B (Self Consistency)Accuracy88.7Unverified
9PaLM 540B (Self Improvement, CoT Prompting)Accuracy88.3Unverified
10PaLM 540B (Self Improvement, Standard-Prompting)Accuracy87.2Unverified
#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy95.2Unverified
2LLaMA 3 8B+MoSLoRA (fine-tuned)Accuracy90.5Unverified
3PaLM 2-L (1-shot)Accuracy89.7Unverified
4PaLM 2-M (1-shot)Accuracy88Unverified
5LLaMA-3 8B + MixLoRAAccuracy86.5Unverified
6Camelidae-8×34BAccuracy86.2Unverified
7PaLM 2-S (1-shot)Accuracy85.6Unverified
8LLaMA 65B + CFG (0-shot)Accuracy84.2Unverified
9GAL 120B (0-shot)Accuracy83.8Unverified
10LLaMA-2 13B + MixLoRAAccuracy83.5Unverified
#ModelMetricClaimedVerifiedStatus
1Turing NLR v5 XXL 5.4B (fine-tuned)EM95.9Unverified
2ST-MoE-32B 269B (fine-tuned)EM95.1Unverified
3T5-11BF194.1Unverified
4DeBERTa-1.5BEM94.1Unverified
5PaLM 540B (finetuned)EM94Unverified
6Vega v2 6B (fine-tuned)EM93.9Unverified
7PaLM 2-L (one-shot)F193.8Unverified
8T5-XXL 11B (fine-tuned)EM93.4Unverified
9PaLM 2-M (one-shot)F192.4Unverified
10PaLM 2-S (one-shot)F192.1Unverified