SOTAVerified

Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Showing 251–300 of 939 papers

TitleStatusHype
A framework for mining lifestyle profiles through multi-dimensional and high-order mobility feature clustering—0
From Blind Solvers to Logical Thinkers: Benchmarking LLMs' Logical Integrity on Faulty Mathematical Problems—0
From Common Sense Reasoning to Neural Network Models through Multiple Preferences: an overview—0
Distributional semantics for ontology verification—0
FVQA 2.0: Introducing Adversarial Samples into Fact-based Visual Question Answering—0
Audit-LLM: Multi-Agent Collaboration for Log-based Insider Threat Detection—0
Cooperating with Machines—0
Ambiguss, a game for building a Sense Annotated Corpus for French—0
Conversational Multi-Hop Reasoning with Neural Commonsense Knowledge and Symbolic Logic Rules—0
Stereotype Detection in LLMs: A Multiclass, Explainable, and Benchmark-Driven Approach—0
AbductionRules: Training Transformers to Explain Unexpected Inputs—0
Conversational AI : Open Domain Question Answering and Commonsense Reasoning—0
Converging Measures and an Emergent Model: A Meta-Analysis of Human-Automation Trust Questionnaires—0
Attentioned Convolutional LSTM InpaintingNetwork for Anomaly Detection in Videos—0
A Tool for Extracting Conversational Implicatures—0
ContextGPT: Infusing LLMs Knowledge into Neuro-Symbolic Activity Recognition Models—0
A mathematical theory of super-resolution and two-point resolution—0
Affordance Extraction and Inference based on Semantic Role Labeling—0
Framework for Certification of AI-Based Systems—0
Context-based Natural Language Processing for GIS-based Vague Region Visualization—0
Content selection as semantic-based ontology exploration—0
ATLAS: Learning to Optimally Memorize the Context at Test Time—0
Bridging Visual Perception with Contextual Semantics for Understanding Robot Manipulation Tasks—0
Constructing a Dictionary Describing Feature Changes of Arguments in Event Sentences—0
A Theory of Human-Like Few-Shot Learning—0
A Machine Consciousness architecture based on Deep Learning and Gaussian Processes—0
Constrained Text Generation with Global Guidance -- Case Study on CommonGen—0
Consolidating Commonsense Knowledge—0
A Systematic Survey of Text Worlds as Embodied Natural Language Environments—0
Conflict-driven Inductive Logic Programming—0
Concept Induction using LLMs: a user experiment for assessment—0
A Systematic Survey of Text Worlds as Embodied Natural Language Environments—0
Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective—0
Free Will Belief as a consequence of Model-based Reinforcement Learning—0
FVQA: Fact-based Visual Question Answering—0
ConceptAgent: LLM-Driven Precondition Grounding and Tree Search for Robust Task Planning and Execution—0
A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions—0
Co-NavGPT: Multi-Robot Cooperative Visual Semantic Navigation Using Vision Language Models—0
Computing Sentiment Scores of Verb Phrases for Vietnamese—0
A Survey on Semantics in Automated Data Science—0
A Logic-based Approach for Recognizing Textual Entailment Supported by Ontological Background Knowledge—0
Computational principles of intelligence: learning and reasoning with neural networks—0
Computational Argumentation: A Journey Beyond Semantics, Logic, Opinions, and Easy Tasks—0
A Logical Model for Supporting Social Commonsense Knowledge Acquisition—0
Comprehensive Annotation of Various Types of Temporal Information on the Time Axis—0
Comprehension Based Question Answering using Bloom’s Taxonomy—0
A survey of Identification and mitigation of Machine Learning algorithmic biases in Image Analysis—0
Affective Common Sense Knowledge Acquisition for Sentiment Analysis—0
FirePlace: Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placement—0
Comprehension Based Question Answering using Bloom's Taxonomy—0
Show:102550
← PrevPage 6 of 19Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy96.1—Unverified
2Unicorn 11B (fine-tuned)Accuracy91.3—Unverified
3CompassMTL 567M with TailorAccuracy90.5—Unverified
4CompassMTL 567MAccuracy89.6—Unverified
5UnifiedQA 11B (fine-tuned)Accuracy89.4—Unverified
6Claude 3 Opus (5-shot)Accuracy88.5—Unverified
7GPT-4 (5-shot)Accuracy87.5—Unverified
8ExDeBERTa 567MAccuracy87—Unverified
9LLaMA-2 13B + MixLoRAAccuracy86.3—Unverified
10LLaMA3 8B+MoSLoRAAccuracy85.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (few-shot, k=25)Accuracy96.4—Unverified
2PaLM 2 (few-shot, CoT, SC)Accuracy95.1—Unverified
3Shivaay (4B, few-shot, k=8)Accuracy91.04—Unverified
4StupidLLMAccuracy91.03—Unverified
5Claude 2 (few-shot, k=5)Accuracy91—Unverified
6Claude 1.3 (few-shot, k=5)Accuracy90—Unverified
7PaLM 540B (Self Improvement, Self Consistency)Accuracy89.8—Unverified
8PaLM 540B (Self Consistency)Accuracy88.7—Unverified
9PaLM 540B (Self Improvement, CoT Prompting)Accuracy88.3—Unverified
10PaLM 540B (Self Improvement, Standard-Prompting)Accuracy87.2—Unverified
#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy95.2—Unverified
2LLaMA 3 8B+MoSLoRA (fine-tuned)Accuracy90.5—Unverified
3PaLM 2-L (1-shot)Accuracy89.7—Unverified
4PaLM 2-M (1-shot)Accuracy88—Unverified
5LLaMA-3 8B + MixLoRAAccuracy86.5—Unverified
6Camelidae-8×34BAccuracy86.2—Unverified
7PaLM 2-S (1-shot)Accuracy85.6—Unverified
8LLaMA 65B + CFG (0-shot)Accuracy84.2—Unverified
9GAL 120B (0-shot)Accuracy83.8—Unverified
10LLaMA-2 13B + MixLoRAAccuracy83.5—Unverified
#ModelMetricClaimedVerifiedStatus
1Turing NLR v5 XXL 5.4B (fine-tuned)EM95.9—Unverified
2ST-MoE-32B 269B (fine-tuned)EM95.1—Unverified
3T5-11BF194.1—Unverified
4DeBERTa-1.5BEM94.1—Unverified
5PaLM 540B (finetuned)EM94—Unverified
6Vega v2 6B (fine-tuned)EM93.9—Unverified
7PaLM 2-L (one-shot)F193.8—Unverified
8T5-XXL 11B (fine-tuned)EM93.4—Unverified
9PaLM 2-M (one-shot)F192.4—Unverified
10PaLM 2-S (one-shot)F192.1—Unverified