SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Showing 291300 of 399 papers

TitleStatusHype
Biomedical Large Languages Models Seem not to be Superior to Generalist Models on Unseen Medical Data0
BinBert: Binary Code Understanding with a Fine-tunable and Execution-aware Transformer0
Pretraining and Updates of Domain-Specific LLM: A Case Study in the Japanese Business Domain0
Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination0
Proceedings of the ISCA/ITG Workshop on Diversity in Large Speech and Language Models0
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning0
PMoE: Progressive Mixture of Experts with Asymmetric Transformer for Continual Learning0
Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programming0
Prompting Encoder Models for Zero-Shot Classification: A Cross-Domain Study in Italian0
BAPO: Base-Anchored Preference Optimization for Overcoming Forgetting in Large Language Models Personalization0
Show:102550
← PrevPage 30 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81Unverified