SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Showing 76100 of 399 papers

TitleStatusHype
A Comprehensive Evaluation of GPT-4V on Knowledge-Intensive Visual Question AnsweringCode1
HAE-RAE Bench: Evaluation of Korean Knowledge in Language ModelsCode1
Overcoming Generic Knowledge Loss with Selective Parameter UpdateCode1
DR-Tune: Improving Fine-tuning of Pretrained Visual Models by Distribution Regularization with Semantic CalibrationCode1
PMET: Precise Model Editing in a TransformerCode1
Knowledge Prompt-tuning for Sequential RecommendationCode1
Towards Task Sampler Learning for Meta-LearningCode1
GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language ModelCode1
Bert4XMR: Cross-Market Recommendation with Bidirectional Encoder Representations from TransformerCode1
MIANet: Aggregating Unbiased Instance and General Information for Few-Shot Semantic SegmentationCode1
Better Question-Answering Models on a BudgetCode1
EPVT: Environment-aware Prompt Vision Transformer for Domain Generalization in Skin Lesion RecognitionCode1
Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report GenerationCode1
Few-Shot Class-Incremental Learning via Class-Aware Bilateral DistillationCode1
PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model AdaptationCode1
Dual Modality Prompt Tuning for Vision-Language Pre-Trained ModelCode1
Learning with Recoverable ForgettingCode1
CC-Riddle: A Question Answering Dataset of Chinese Character RiddlesCode1
Prompt-aligned Gradient for Prompt TuningCode1
Relphormer: Relational Graph Transformer for Knowledge Graph RepresentationsCode1
Seed-Guided Topic Discovery with Out-of-Vocabulary SeedsCode1
Knowledge Graph Contrastive Learning for RecommendationCode1
KALA: Knowledge-Augmented Language Model AdaptationCode1
BEAMetrics: A Benchmark for Language Generation Evaluation EvaluationCode1
Generative Pre-Training from MoleculesCode1
Show:102550
← PrevPage 4 of 16Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81Unverified