SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Showing 51100 of 399 papers

TitleStatusHype
MIANet: Aggregating Unbiased Instance and General Information for Few-Shot Semantic SegmentationCode1
DA-Ada: Learning Domain-Aware Adapter for Domain Adaptive Object DetectionCode1
A New Learning Paradigm for Foundation Model-based Remote Sensing Change DetectionCode1
RAG with Differential PrivacyCode1
A Dual-Space Framework for General Knowledge Distillation of Large Language ModelsCode1
SAFE: Slow and Fast Parameter-Efficient Tuning for Continual Learning with Pre-Trained ModelsCode1
BEAMetrics: A Benchmark for Language Generation Evaluation EvaluationCode1
PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model AdaptationCode1
CRoFT: Robust Fine-Tuning with Concurrent Optimization for OOD Generalization and Open-Set OOD DetectionCode1
See Through Their Minds: Learning Transferable Neural Representation from Cross-Subject fMRICode1
Can LLM Generate Culturally Relevant Commonsense QA Data? Case Study in Indonesian and SundaneseCode1
Show, Attend and Distill:Knowledge Distillation via Attention-based Feature MatchingCode1
Aligning Medical Images with General Knowledge from Large Language ModelsCode1
Learning with Recoverable ForgettingCode1
Knowledge Prompt-tuning for Sequential RecommendationCode1
Automated Phrase Mining from Massive Text CorporaCode1
KGPT: Knowledge-Grounded Pre-Training for Data-to-Text GenerationCode1
Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to DoCode1
Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMsCode1
A Comprehensive Evaluation of GPT-4V on Knowledge-Intensive Visual Question AnsweringCode1
HYDRA: Model Factorization Framework for Black-Box LLM PersonalizationCode1
HAE-RAE Bench: Evaluation of Korean Knowledge in Language ModelsCode1
Go From the General to the Particular: Multi-Domain Translation with Domain Transformation NetworksCode1
Health Index Estimation Through Integration of General Knowledge with Unsupervised LearningCode1
GeoGalactica: A Scientific Large Language Model in GeoscienceCode1
A General Knowledge Injection Framework for ICD CodingCode1
GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language ModelCode1
How Well Do LLMs Handle Cantonese? Benchmarking Cantonese Capabilities of Large Language ModelsCode1
HELM: Hyperbolic Large Language Models via Mixture-of-Curvature ExpertsCode1
Importance-based Neuron Allocation for Multilingual Neural Machine TranslationCode1
Knowledge Graph Contrastive Learning for RecommendationCode1
Few-Shot Class-Incremental Learning via Class-Aware Bilateral DistillationCode1
FuseChat-3.0: Preference Optimization Meets Heterogeneous Model FusionCode1
Towards Task Sampler Learning for Meta-LearningCode1
Generative Pre-Training from MoleculesCode1
CurriculumLoc: Enhancing Cross-Domain Geolocalization through Multi-Stage RefinementCode1
Dual Modality Prompt Tuning for Vision-Language Pre-Trained ModelCode1
CityBench: Evaluating the Capabilities of Large Language Models for Urban TasksCode1
BEAR: A Unified Framework for Evaluating Relational Knowledge in Causal and Masked Language ModelsCode1
DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented GenerationCode1
CC-Riddle: A Question Answering Dataset of Chinese Character RiddlesCode1
Decoupling General and Personalized Knowledge in Federated Learning via Additive and Low-Rank DecompositionCode1
Benchmarking Large Language Models for Persian: A Preliminary Study Focusing on ChatGPTCode1
DIAGen: Diverse Image Augmentation with Generative ModelsCode1
Bert4XMR: Cross-Market Recommendation with Bidirectional Encoder Representations from TransformerCode1
Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report GenerationCode1
Better Question-Answering Models on a BudgetCode1
ElecBench: a Power Dispatch Evaluation Benchmark for Large Language ModelsCode1
EPVT: Environment-aware Prompt Vision Transformer for Domain Generalization in Skin Lesion RecognitionCode1
Generic Knowledge Boosted Pre-training For Remote Sensing ImagesCode1
Show:102550
← PrevPage 2 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81Unverified