SOTAVerified

Common Sense Reasoning

Common sense reasoning tasks are intended to require the model to go beyond pattern recognition. Instead, the model should use "common sense" or world knowledge to make inferences.

Papers

Showing 301350 of 939 papers

TitleStatusHype
Declarative Reasoning on Explanations Using Constraint Logic ProgrammingCode0
PointLLM: Empowering Large Language Models to Understand Point CloudsCode2
Towards One-Shot Learning for Text Classification using Inductive Logic ProgrammingCode0
OmniQuant: Omnidirectionally Calibrated Quantization for Large Language ModelsCode2
CHORUS: Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images0
A Review on Objective-Driven Artificial Intelligence0
Multimodal Analysis Of Google Bard And GPT-Vision: Experiments In Visual Reasoning0
Token-Scaled Logit Distillation for Ternary Weight Generative Language ModelsCode1
KETM:A Knowledge-Enhanced Text Matching methodCode1
LLaMA-E: Empowering E-commerce Authoring with Object-Interleaved Instruction Following0
Bootstrapping Developmental AIs: From Simple Competences to Intelligent Human-Compatible AIs0
Vocab-Expander: A System for Creating Domain-Specific Vocabularies Based on Word Embeddings0
dPASP: A Comprehensive Differentiable Probabilistic Answer Set Programming Environment For Neurosymbolic Learning and Reasoning0
Do Multilingual Language Models Think Better in English?Code1
When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities0
An Overview Of Temporal Commonsense Reasoning and Acquisition0
"Tidy Up the Table": Grounding Common-sense Objective for Tabletop Object Rearrangement0
Integrating a Heterogeneous Graph with Entity-aware Self-attention using Relative Position Labels for Reading Comprehension Model0
Drive Like a Human: Rethinking Autonomous Driving with Large Language ModelsCode2
Retrieval Augmented Generation using Engineering Design KnowledgeCode0
Model Card and Evaluations for Claude Models0
Piecing Together Clues: A Benchmark for Evaluating the Detective Skills of Large Language Models0
Some Preliminary Steps Towards Metaverse Logic0
GPT4RoI: Instruction Tuning Large Language Model on Region-of-InterestCode2
Garbage in, garbage out: Zero-shot detection of crime using Large Language ModelsCode0
Stay on topic with Classifier-Free Guidance0
REFLECT: Summarizing Robot Experiences for Failure Explanation and CorrectionCode1
Kernel Choice Matters for Boundary Inference Using Local Polynomial Density: With Application to Manipulation Testing0
Knowledge-Driven Robot Program Synthesis from Human VR DemonstrationsCode0
Multi-CLIP: Contrastive Vision-Language Pre-training for Question Answering tasks in 3D Scenes0
Being Right for Whose Right Reasons?Code0
AWQ: Activation-aware Weight Quantization for LLM Compression and AccelerationCode6
Large Language Models Are Not Strong Abstract ReasonersCode1
What does the Failure to Reason with "Respectively" in Zero/Few-Shot Settings Tell Us about Language Models?0
PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) PlanningCode1
Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and MemoryCode2
MEMEX: Detecting Explanatory Evidence for Memes via Knowledge-Enriched ContextualizationCode0
ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text GamesCode1
Editing Common Sense in TransformersCode0
ImageNetVC: Zero- and Few-Shot Visual Commonsense Evaluation on 1000 ImageNet CategoriesCode1
LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language ModelsCode2
The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-TuningCode2
Augmenting Autotelic Agents with Large Language Models0
PlugMed: Improving Specificity in Patient-Centered Medical Dialogue Generation using In-Context Learning0
Reasoning Implicit Sentiment with Chain-of-Thought PromptingCode1
PaLM 2 Technical ReportCode0
AR-Diffusion: Auto-Regressive Diffusion Model for Text GenerationCode1
Translating SUMO-K to Higher-Order Set Theory0
Leveraging Large Language Models in Conversational Recommender Systems0
Exploiting Pseudo Image Captions for Multimodal Summarization0
Show:102550
← PrevPage 7 of 19Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy96.1Unverified
2Unicorn 11B (fine-tuned)Accuracy91.3Unverified
3CompassMTL 567M with TailorAccuracy90.5Unverified
4CompassMTL 567MAccuracy89.6Unverified
5UnifiedQA 11B (fine-tuned)Accuracy89.4Unverified
6Claude 3 Opus (5-shot)Accuracy88.5Unverified
7GPT-4 (5-shot)Accuracy87.5Unverified
8ExDeBERTa 567MAccuracy87Unverified
9LLaMA-2 13B + MixLoRAAccuracy86.3Unverified
10LLaMA3 8B+MoSLoRAAccuracy85.8Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4 (few-shot, k=25)Accuracy96.4Unverified
2PaLM 2 (few-shot, CoT, SC)Accuracy95.1Unverified
3Shivaay (4B, few-shot, k=8)Accuracy91.04Unverified
4StupidLLMAccuracy91.03Unverified
5Claude 2 (few-shot, k=5)Accuracy91Unverified
6Claude 1.3 (few-shot, k=5)Accuracy90Unverified
7PaLM 540B (Self Improvement, Self Consistency)Accuracy89.8Unverified
8PaLM 540B (Self Consistency)Accuracy88.7Unverified
9PaLM 540B (Self Improvement, CoT Prompting)Accuracy88.3Unverified
10PaLM 540B (Self Improvement, Standard-Prompting)Accuracy87.2Unverified
#ModelMetricClaimedVerifiedStatus
1ST-MoE-32B 269B (fine-tuned)Accuracy95.2Unverified
2LLaMA 3 8B+MoSLoRA (fine-tuned)Accuracy90.5Unverified
3PaLM 2-L (1-shot)Accuracy89.7Unverified
4PaLM 2-M (1-shot)Accuracy88Unverified
5LLaMA-3 8B + MixLoRAAccuracy86.5Unverified
6Camelidae-8×34BAccuracy86.2Unverified
7PaLM 2-S (1-shot)Accuracy85.6Unverified
8LLaMA 65B + CFG (0-shot)Accuracy84.2Unverified
9GAL 120B (0-shot)Accuracy83.8Unverified
10LLaMA-2 13B + MixLoRAAccuracy83.5Unverified
#ModelMetricClaimedVerifiedStatus
1Turing NLR v5 XXL 5.4B (fine-tuned)EM95.9Unverified
2ST-MoE-32B 269B (fine-tuned)EM95.1Unverified
3T5-11BF194.1Unverified
4DeBERTa-1.5BEM94.1Unverified
5PaLM 540B (finetuned)EM94Unverified
6Vega v2 6B (fine-tuned)EM93.9Unverified
7PaLM 2-L (one-shot)F193.8Unverified
8T5-XXL 11B (fine-tuned)EM93.4Unverified
9PaLM 2-M (one-shot)F192.4Unverified
10PaLM 2-S (one-shot)F192.1Unverified