SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 399 papers

TitleStatusHype
Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programming—0
Learning from Natural Language Explanations for Generalizable Entity Matching—0
RAD: A Comprehensive Dataset for Benchmarking the Robustness of Image Anomaly DetectionCode1
DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented GenerationCode1
F-LMM: Grounding Frozen Large Multimodal ModelsCode2
Generative Explore-Exploit: Training-free Optimization of Generative Recommender Systems using LLM Optimizers—0
HYDRA: Model Factorization Framework for Black-Box LLM PersonalizationCode1
ContextFlow++: Generalist-Specialist Flow-based Generative Models with Mixed-Variable Context EncodingCode0
Slow and Steady Wins the Race: Maintaining Plasticity with Hare and Tortoise NetworksCode1
CRoFT: Robust Fine-Tuning with Concurrent Optimization for OOD Generalization and Open-Set OOD DetectionCode1
SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge—0
Health Index Estimation Through Integration of General Knowledge with Unsupervised LearningCode1
MoST: Multi-modality Scene Tokenization for Motion Prediction—0
Towards Generalizable Agents in Text-Based Educational Environments: A Study of Integrating RL with LLMs—0
Enhancing Action Recognition from Low-Quality Skeleton Data via Part-Level Knowledge Distillation—0
Evaluating Consistency and Reasoning Capabilities of Large Language Models—0
Learning Electromagnetic Metamaterial Physics With ChatGPT—0
When Life gives you LLMs, make LLM-ADE: Large Language Models with Adaptive Data Engineering—0
Pretraining and Updates of Domain-Specific LLM: A Case Study in the Japanese Business Domain—0
Knowledge graphs for empirical concept retrievalCode0
Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful KnowledgeCode0
BEAR: A Unified Framework for Evaluating Relational Knowledge in Causal and Masked Language ModelsCode1
Benchmarking Large Language Models for Persian: A Preliminary Study Focusing on ChatGPTCode1
Prompt Learning via Meta-RegularizationCode1
Juru: Legal Brazilian Large Language Model from Reputable Sources—0
Are LLMs Good Cryptic Crossword Solvers?—0
CoIN: A Benchmark of Continual Instruction tuNing for Multimodel Large Language ModelCode2
DiPrompT: Disentangled Prompt Tuning for Multiple Latent Domain Generalization in Federated Learning—0
See Through Their Minds: Learning Transferable Neural Representation from Cross-Subject fMRICode1
Deep Prompt Multi-task Network for Abuse Language Detection—0
MedSafetyBench: Evaluating and Improving the Medical Safety of Large Language ModelsCode1
K-Link: Knowledge-Link Graph from LLMs for Enhanced Representation Learning in Multivariate Time-Series Data—0
Pruning neural network models for gene regulatory dynamics using data and domain knowledgeCode0
Beyond Specialization: Assessing the Capabilities of MLLMs in Age and Gender EstimationCode3
Can LLM Generate Culturally Relevant Commonsense QA Data? Case Study in Indonesian and SundaneseCode1
Bootstrapping Cognitive Agents with a Large Language Model—0
OMGEval: An Open Multilingual Generative Evaluation Benchmark for Large Language ModelsCode1
Inductive Graph Alignment Prompt: Bridging the Gap between Graph Pre-training and Inductive Fine-tuning From Spectral Perspective—0
CyberMetric: A Benchmark Dataset based on Retrieval-Augmented Generation for Evaluating LLMs in Cybersecurity KnowledgeCode2
Pre-training and Diagnosing Knowledge Base Completion ModelsCode1
GALA: Generating Animatable Layered Assets from a Single Scan—0
INCPrompt: Task-Aware incremental Prompting for Rehearsal-Free Class-incremental Learning—0
The Unreasonable Effectiveness of Easy Training Data for Hard TasksCode1
Generic Knowledge Boosted Pre-training For Remote Sensing ImagesCode1
Imagine Before Go: Self-Supervised Generative Map for Object Goal NavigationCode2
KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling—0
MMA: Multi-Modal Adapter for Vision-Language ModelsCode2
GeoGalactica: A Scientific Large Language Model in GeoscienceCode1
Time Travelling Pixels: Bitemporal Features Integration with Foundation Model for Remote Sensing Image Change DetectionCode1
VIEScore: Towards Explainable Metrics for Conditional Image Synthesis EvaluationCode1
Show:102550
← PrevPage 4 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3—Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8—Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2—Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1—Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9—Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3—Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8—Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81—Unverified