SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Showing 176200 of 399 papers

TitleStatusHype
Are LLMs Good Cryptic Crossword Solvers?0
CoIN: A Benchmark of Continual Instruction tuNing for Multimodel Large Language ModelCode2
DiPrompT: Disentangled Prompt Tuning for Multiple Latent Domain Generalization in Federated Learning0
See Through Their Minds: Learning Transferable Neural Representation from Cross-Subject fMRICode1
Deep Prompt Multi-task Network for Abuse Language Detection0
MedSafetyBench: Evaluating and Improving the Medical Safety of Large Language ModelsCode1
K-Link: Knowledge-Link Graph from LLMs for Enhanced Representation Learning in Multivariate Time-Series Data0
Pruning neural network models for gene regulatory dynamics using data and domain knowledgeCode0
Beyond Specialization: Assessing the Capabilities of MLLMs in Age and Gender EstimationCode3
Can LLM Generate Culturally Relevant Commonsense QA Data? Case Study in Indonesian and SundaneseCode1
Bootstrapping Cognitive Agents with a Large Language Model0
OMGEval: An Open Multilingual Generative Evaluation Benchmark for Large Language ModelsCode1
Inductive Graph Alignment Prompt: Bridging the Gap between Graph Pre-training and Inductive Fine-tuning From Spectral Perspective0
CyberMetric: A Benchmark Dataset based on Retrieval-Augmented Generation for Evaluating LLMs in Cybersecurity KnowledgeCode2
Pre-training and Diagnosing Knowledge Base Completion ModelsCode1
GALA: Generating Animatable Layered Assets from a Single Scan0
INCPrompt: Task-Aware incremental Prompting for Rehearsal-Free Class-incremental Learning0
The Unreasonable Effectiveness of Easy Training Data for Hard TasksCode1
Generic Knowledge Boosted Pre-training For Remote Sensing ImagesCode1
Imagine Before Go: Self-Supervised Generative Map for Object Goal NavigationCode2
KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling0
MMA: Multi-Modal Adapter for Vision-Language ModelsCode2
GeoGalactica: A Scientific Large Language Model in GeoscienceCode1
Time Travelling Pixels: Bitemporal Features Integration with Foundation Model for Remote Sensing Image Change DetectionCode1
VIEScore: Towards Explainable Metrics for Conditional Image Synthesis EvaluationCode1
Show:102550
← PrevPage 8 of 16Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81Unverified