SOTAVerified

Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Showing 851900 of 939 papers

TitleStatusHype
Generative AI-in-the-loop: Integrating LLMs and GPTs into the Next Generation Networks0
Geo-distinctive Visual Element Matching for Location Estimation of Images0
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts0
GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping0
GLRD: Global-Local Collaborative Reason and Debate with PSL for 3D Open-Vocabulary Detection0
GO FIGURE: A Meta Evaluation of Factuality in Summarization0
Good Automatic Authentication Question Generation0
GPT-4V Takes the Wheel: Promises and Challenges for Pedestrian Behavior Prediction0
GrapeQA: GRaph Augmentation and Pruning to Enhance Question-Answering0
Grounding Language Plans in Demonstrations Through Counterfactual Perturbations0
Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Art0
Handling Multiword Expressions in Causality Estimation0
HEIE: MLLM-Based Hierarchical Explainable AIGC Image Implausibility Evaluator0
Heuristic Vision Pre-Training with Self-Supervised and Supervised Multi-Task Learning0
HGSGNLP at IEST 2018: An Ensemble of Machine Learning and Deep Neural Architectures for Implicit Emotion Classification in Tweets0
Hierarchical Relational Inference0
How Factuality Determines Sentiment Inferences0
How Pre-trained Word Representations Capture Commonsense Physical Comparisons0
"Tidy Up the Table": Grounding Common-sense Objective for Tabletop Object Rearrangement0
How to Understand Named Entities: Using Common Sense for News Captioning0
HR@JUST Team at SemEval-2020 Task 4: The Impact of RoBERTa Transformer for Evaluation Common Sense Understanding0
Human-Object Interaction from Human-Level Instructions0
Humans in Humans Out: On GPT Converging Toward Common Sense in both Success and Failure0
HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model0
Identifying Restaurant Features via Sentiment Analysis on Yelp Reviews0
IIT (BHU): System Description for LSDSem'17 Shared Task0
Implicit Sentiment Analysis Based on Chain of Thought Prompting0
Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection0
Enhancing Cross-Modal Contextual Congruence for Crowdfunding Success using Knowledge-infused Learning0
Improving Implicit Semantic Role Labeling by Predicting Semantic Frame Arguments0
Improving Preference Extraction In LLMs By Identifying Latent Knowledge Through Classifying Probes0
Improving Text-to-Pictograph Translation Through Word Sense Disambiguation0
Improving Tool Retrieval by Leveraging Large Language Models for Query Generation0
Incremental Fine-grained Information Status Classification Using Attention-based LSTMs0
Inducing Neural Models of Script Knowledge0
Inductive Learning of Answer Set Programs from Noisy Examples0
Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insights0
Informed Haar-like Features Improve Pedestrian Detection0
InstructionBench: An Instructional Video Understanding Benchmark0
Integrating a Heterogeneous Graph with Entity-aware Self-attention using Relative Position Labels for Reading Comprehension Model0
Integration of knowledge and data in machine learning0
Interaction-aware Decision Making with Adaptive Strategies under Merging Scenarios0
Interactive and Expressive Code-Augmented Planning with Large Language Models0
Interactive health insight miner: an adaptive, semantic-based approach0
Interactive Learning of Spatial Knowledge for Text to 3D Scene Generation0
Interpretable Visual Question Answering via Reasoning Supervision0
Intrinsically Motivated Learning of Causal World Models0
Investigating Data Contamination in Modern Benchmarks for Large Language Models0
Investigating the Application of Common-Sense Knowledge-Base for Identifying Term Obfuscation in Adversarial Communication0
iPerceive: Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering0
Show:102550
← PrevPage 18 of 19Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy96.1Unverified
2Unicorn 11B (fine-tuned)Accuracy91.3Unverified
3CompassMTL 567M with TailorAccuracy90.5Unverified
4CompassMTL 567MAccuracy89.6Unverified
5UnifiedQA 11B (fine-tuned)Accuracy89.4Unverified
6Claude 3 Opus (5-shot)Accuracy88.5Unverified
7GPT-4 (5-shot)Accuracy87.5Unverified
8ExDeBERTa 567MAccuracy87Unverified
9LLaMA-2 13B + MixLoRAAccuracy86.3Unverified
10LLaMA3 8B+MoSLoRAAccuracy85.8Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (few-shot, k=25)Accuracy96.4Unverified
2PaLM 2 (few-shot, CoT, SC)Accuracy95.1Unverified
3Shivaay (4B, few-shot, k=8)Accuracy91.04Unverified
4StupidLLMAccuracy91.03Unverified
5Claude 2 (few-shot, k=5)Accuracy91Unverified
6Claude 1.3 (few-shot, k=5)Accuracy90Unverified
7PaLM 540B (Self Improvement, Self Consistency)Accuracy89.8Unverified
8PaLM 540B (Self Consistency)Accuracy88.7Unverified
9PaLM 540B (Self Improvement, CoT Prompting)Accuracy88.3Unverified
10PaLM 540B (Self Improvement, Standard-Prompting)Accuracy87.2Unverified
#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy95.2Unverified
2LLaMA 3 8B+MoSLoRA (fine-tuned)Accuracy90.5Unverified
3PaLM 2-L (1-shot)Accuracy89.7Unverified
4PaLM 2-M (1-shot)Accuracy88Unverified
5LLaMA-3 8B + MixLoRAAccuracy86.5Unverified
6Camelidae-8×34BAccuracy86.2Unverified
7PaLM 2-S (1-shot)Accuracy85.6Unverified
8LLaMA 65B + CFG (0-shot)Accuracy84.2Unverified
9GAL 120B (0-shot)Accuracy83.8Unverified
10LLaMA-2 13B + MixLoRAAccuracy83.5Unverified
#ModelMetricClaimedVerifiedStatus
1Turing NLR v5 XXL 5.4B (fine-tuned)EM95.9Unverified
2ST-MoE-32B 269B (fine-tuned)EM95.1Unverified
3T5-11BF194.1Unverified
4DeBERTa-1.5BEM94.1Unverified
5PaLM 540B (finetuned)EM94Unverified
6Vega v2 6B (fine-tuned)EM93.9Unverified
7PaLM 2-L (one-shot)F193.8Unverified
8T5-XXL 11B (fine-tuned)EM93.4Unverified
9PaLM 2-M (one-shot)F192.4Unverified
10PaLM 2-S (one-shot)F192.1Unverified