SOTAVerified

Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Showing 401450 of 939 papers

TitleStatusHype
A Tool for Extracting Conversational Implicatures0
HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model0
A Large Scale Database of Strongly-related Events in Japanese0
Identifying Restaurant Features via Sentiment Analysis on Yelp Reviews0
IIT (BHU): System Description for LSDSem'17 Shared Task0
Can We Trust Embodied Agents? Exploring Backdoor Attacks against Embodied LLM-based Decision-Making Systems0
A Rule-Based Approach to Aspect Extraction from Product Reviews0
KoGuN: Accelerating Deep Reinforcement Learning via Integrating Human Suboptimal Knowledge0
K-XLNet: A General Method for Combining Explicit Knowledge with Language Model Pretraining0
Implicit Sentiment Analysis Based on Chain of Thought Prompting0
Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection0
Enhancing Cross-Modal Contextual Congruence for Crowdfunding Success using Knowledge-infused Learning0
Improving Implicit Semantic Role Labeling by Predicting Semantic Frame Arguments0
Audit-LLM: Multi-Agent Collaboration for Log-based Insider Threat Detection0
Explore before Moving: A Feasible Path Estimation and Memory Recalling Framework for Embodied Navigation0
Exploiting Proximity-Aware Tasks for Embodied Social Navigation0
Improving Text-to-Pictograph Translation Through Word Sense Disambiguation0
Improving Tool Retrieval by Leveraging Large Language Models for Query Generation0
CLaSP: Learning Concepts for Time-Series Signals from Natural Language Supervision0
Augmenting Autotelic Agents with Large Language Models0
Incremental Fine-grained Information Status Classification Using Attention-based LSTMs0
Inducing Neural Models of Script Knowledge0
Exploiting Pseudo Image Captions for Multimodal Summarization0
Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insights0
CO-STAR: Conceptualisation of Stereotypes for Analysis and Reasoning0
A Unified Model for Video Understanding and Knowledge Embedding with Heterogeneous Knowledge Graph Dataset0
Informed Haar-like Features Improve Pedestrian Detection0
InstructionBench: An Instructional Video Understanding Benchmark0
Integrating a Heterogeneous Graph with Entity-aware Self-attention using Relative Position Labels for Reading Comprehension Model0
Integration of knowledge and data in machine learning0
Interaction-aware Decision Making with Adaptive Strategies under Merging Scenarios0
Interactive and Expressive Code-Augmented Planning with Large Language Models0
Interactive health insight miner: an adaptive, semantic-based approach0
Interactive Learning of Spatial Knowledge for Text to 3D Scene Generation0
Artificial General Intelligence (AGI)-Native Wireless Systems: A Journey Beyond 6G0
CSReader at SemEval-2018 Task 11: Multiple Choice Question Answering as Textual Entailment0
Interpretable Visual Question Answering via Reasoning Supervision0
Intrinsically Motivated Learning of Causal World Models0
Investigating Data Contamination in Modern Benchmarks for Large Language Models0
Investigating the Application of Common-Sense Knowledge-Base for Identifying Term Obfuscation in Adversarial Communication0
iPerceive: Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering0
IPPON: Common Sense Guided Informative Path Planning for Object Goal Navigation0
DaVinci at SemEval-2024 Task 9: Few-shot prompting GPT-3.5 for Unconventional Reasoning0
Irony Detection for Dutch: a Venture into the Implicit0
KnowRA: Knowledge Retrieval Augmented Method for Document-level Relation Extraction with Comprehensive Reasoning Abilities0
Automatic Identification of Age-Appropriate Ratings of Song Lyrics0
Explanations for CommonsenseQA: New Dataset and Models0
Is the Elephant Flying? Resolving Ambiguities in Text-to-Image Generative Models0
A Review on Objective-Driven Artificial Intelligence0
A Danish FrameNet Lexicon and an Annotated Corpus Used for Training and Evaluating a Semantic Frame Classifier0
Show:102550
← PrevPage 9 of 19Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy96.1Unverified
2Unicorn 11B (fine-tuned)Accuracy91.3Unverified
3CompassMTL 567M with TailorAccuracy90.5Unverified
4CompassMTL 567MAccuracy89.6Unverified
5UnifiedQA 11B (fine-tuned)Accuracy89.4Unverified
6Claude 3 Opus (5-shot)Accuracy88.5Unverified
7GPT-4 (5-shot)Accuracy87.5Unverified
8ExDeBERTa 567MAccuracy87Unverified
9LLaMA-2 13B + MixLoRAAccuracy86.3Unverified
10LLaMA3 8B+MoSLoRAAccuracy85.8Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (few-shot, k=25)Accuracy96.4Unverified
2PaLM 2 (few-shot, CoT, SC)Accuracy95.1Unverified
3Shivaay (4B, few-shot, k=8)Accuracy91.04Unverified
4StupidLLMAccuracy91.03Unverified
5Claude 2 (few-shot, k=5)Accuracy91Unverified
6Claude 1.3 (few-shot, k=5)Accuracy90Unverified
7PaLM 540B (Self Improvement, Self Consistency)Accuracy89.8Unverified
8PaLM 540B (Self Consistency)Accuracy88.7Unverified
9PaLM 540B (Self Improvement, CoT Prompting)Accuracy88.3Unverified
10PaLM 540B (Self Improvement, Standard-Prompting)Accuracy87.2Unverified
#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy95.2Unverified
2LLaMA 3 8B+MoSLoRA (fine-tuned)Accuracy90.5Unverified
3PaLM 2-L (1-shot)Accuracy89.7Unverified
4PaLM 2-M (1-shot)Accuracy88Unverified
5LLaMA-3 8B + MixLoRAAccuracy86.5Unverified
6Camelidae-8×34BAccuracy86.2Unverified
7PaLM 2-S (1-shot)Accuracy85.6Unverified
8LLaMA 65B + CFG (0-shot)Accuracy84.2Unverified
9GAL 120B (0-shot)Accuracy83.8Unverified
10LLaMA-2 13B + MixLoRAAccuracy83.5Unverified
#ModelMetricClaimedVerifiedStatus
1Turing NLR v5 XXL 5.4B (fine-tuned)EM95.9Unverified
2ST-MoE-32B 269B (fine-tuned)EM95.1Unverified
3T5-11BF194.1Unverified
4DeBERTa-1.5BEM94.1Unverified
5PaLM 540B (finetuned)EM94Unverified
6Vega v2 6B (fine-tuned)EM93.9Unverified
7PaLM 2-L (one-shot)F193.8Unverified
8T5-XXL 11B (fine-tuned)EM93.4Unverified
9PaLM 2-M (one-shot)F192.4Unverified
10PaLM 2-S (one-shot)F192.1Unverified