SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 399 papers

TitleStatusHype
Training Compute-Optimal Large Language ModelsCode6
Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric PerspectivesCode5
RAGEval: Scenario Specific RAG Evaluation Dataset Generation FrameworkCode3
Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud LearningCode3
Beyond Specialization: Assessing the Capabilities of MLLMs in Age and Gender EstimationCode3
Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context AccurayCode3
SAM Fails to Segment Anything? -- SAM-Adapter: Adapting SAM in Underperformed Scenes: Camouflage, Shadow, Medical Image Segmentation, and MoreCode3
A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and MultimodalCode3
Cascade Prompt Learning for Vision-Language Model AdaptationCode3
VoiceBench: Benchmarking LLM-Based Voice AssistantsCode3
The Breeze 2 Herd of Models: Traditional Chinese LLMs Based on Llama with Vision-Aware and Function-Calling CapabilitiesCode3
CoIN: A Benchmark of Continual Instruction tuNing for Multimodel Large Language ModelCode2
Adapting a Language Model While Preserving its General KnowledgeCode2
Imagine Before Go: Self-Supervised Generative Map for Object Goal NavigationCode2
MMRL++: Parameter-Efficient and Interaction-Aware Representation Learning for Vision-Language ModelsCode2
Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation LearningCode2
ConceptNet 5.5: An Open Multilingual Graph of General KnowledgeCode2
Scaling Language Models: Methods, Analysis & Insights from Training GopherCode2
Continual Pre-training of Language ModelsCode2
Selective Aggregation for Low-Rank Adaptation in Federated LearningCode2
ConceptNet at SemEval-2017 Task 2: Extending Word Embeddings with Multilingual Relational KnowledgeCode2
CyberMetric: A Benchmark Dataset based on Retrieval-Augmented Generation for Evaluating LLMs in Cybersecurity KnowledgeCode2
A Survey of Personalized Large Language Models: Progress and Future DirectionsCode2
MMA: Multi-Modal Adapter for Vision-Language ModelsCode2
Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalCode2
Keeping Yourself is Important in Downstream Tuning Multimodal Large Language ModelCode2
F-LMM: Grounding Frozen Large Multimodal ModelsCode2
LLM-RG4: Flexible and Factual Radiology Report Generation across Diverse Input ContextsCode2
Exploring the Potential of Large Language Models (LLMs) in Learning on GraphsCode2
GeoGalactica: A Scientific Large Language Model in GeoscienceCode1
Generic Knowledge Boosted Pre-training For Remote Sensing ImagesCode1
GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language ModelCode1
FuseChat-3.0: Preference Optimization Meets Heterogeneous Model FusionCode1
A Dual-Space Framework for General Knowledge Distillation of Large Language ModelsCode1
Generative Pre-Training from MoleculesCode1
Go From the General to the Particular: Multi-Domain Translation with Domain Transformation NetworksCode1
A New Learning Paradigm for Foundation Model-based Remote Sensing Change DetectionCode1
Decoupling General and Personalized Knowledge in Federated Learning via Additive and Low-Rank DecompositionCode1
DA-Ada: Learning Domain-Aware Adapter for Domain Adaptive Object DetectionCode1
Bert4XMR: Cross-Market Recommendation with Bidirectional Encoder Representations from TransformerCode1
DIAGen: Diverse Image Augmentation with Generative ModelsCode1
DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented GenerationCode1
HAE-RAE Bench: Evaluation of Korean Knowledge in Language ModelsCode1
Benchmarking Large Language Models for Persian: A Preliminary Study Focusing on ChatGPTCode1
BEAR: A Unified Framework for Evaluating Relational Knowledge in Causal and Masked Language ModelsCode1
BEAMetrics: A Benchmark for Language Generation Evaluation EvaluationCode1
E2Map: Experience-and-Emotion Map for Self-Reflective Robot Navigation with Language ModelsCode1
Better Question-Answering Models on a BudgetCode1
Aligning Medical Images with General Knowledge from Large Language ModelsCode1
ElecBench: a Power Dispatch Evaluation Benchmark for Large Language ModelsCode1
Show:102550
← PrevPage 1 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3—Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8—Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2—Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1—Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9—Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3—Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8—Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81—Unverified