SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 399 papers

TitleStatusHype
Importance-based Neuron Allocation for Multilingual Neural Machine TranslationCode1
Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to DoCode1
Show, Attend and Distill:Knowledge Distillation via Attention-based Feature MatchingCode1
KGPT: Knowledge-Grounded Pre-Training for Data-to-Text GenerationCode1
Transformers as Soft Reasoners over LanguageCode1
Go From the General to the Particular: Multi-Domain Translation with Domain Transformation NetworksCode1
RDF2Vec: RDF Graph Embeddings and Their ApplicationsCode1
Automated Phrase Mining from Massive Text CorporaCode1
PROL : Rehearsal Free Continual Learning in Streaming Data via Prompt Online LearningCode0
Reinforcement Fine-Tuning Naturally Mitigates Forgetting in Continual Post-Training—0
Unveiling Causal Reasoning in Large Language Models: Reality or Mirage?Code0
Intelligent Design 4.0: Paradigm Evolution Toward the Agentic AI Era—0
Improving Personalized Search with Regularized Low-Rank Parameter UpdatesCode0
MobiEdit: Resource-efficient Knowledge Editing for Personalized On-device LLMs—0
HSSBench: Benchmarking Humanities and Social Sciences Ability for Multimodal Large Language ModelsCode0
STELLA: Towards Protein Function Prediction with Multimodal LLMs Integrating Sequence-Structure Representations—0
BnMMLU: Measuring Massive Multitask Language Understanding in BengaliCode0
Does Localization Inform Unlearning? A Rigorous Examination of Local Parameter Attribution for Knowledge Unlearning in Language Models—0
Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives—0
Who You Are Matters: Bridging Topics and Social Roles via LLM-Enhanced Logical Recommendation—0
GenKnowSub: Improving Modularity and Reusability of LLMs through General Knowledge SubtractionCode0
From Knowledge to Reasoning: Evaluating LLMs for Ionic Liquids Research in Chemical and Biological EngineeringCode0
Latte: Transfering LLMs` Latent-level Knowledge for Few-shot Tabular Learning—0
Enhancing Target-unspecific Tasks through a Features Matrix—0
VLM Q-Learning: Aligning Vision-Language Models for Interactive Decision-Making—0
Learning Unknown Spoof Prompts for Generalized Face Anti-Spoofing Using Only Real Face Images—0
SAM-Guided Robust Representation Learning for One-Shot 3D Medical Image Segmentation—0
Multi-task Federated Learning with Encoder-Decoder Structure: Enabling Collaborative Learning Across Different Tasks—0
PASS-FC: Progressive and Adaptive Search Scheme for Fact Checking of Comprehensive Claims—0
Knowledge Distillation for Underwater Feature Extraction and Matching via GAN-synthesized Images—0
Universal Item Tokenization for Transferable Generative Recommendation—0
Planning Safety Trajectories with Dual-Phase, Physics-Informed, and Transportation Knowledge-Driven Large Language ModelsCode0
Generative Retrieval and Alignment Model: A New Paradigm for E-commerce Retrieval—0
Understanding Inequality of LLM Fact-Checking over Geographic Regions with Agent and Retrieval models—0
A Self-Supervised Learning of a Foundation Model for Analog Layout Design Automation—0
Effective Skill Unlearning through Intervention and AbstentionCode0
Distilling Stereo Networks for Performant and Efficient Leaner NetworksCode0
LoRASculpt: Sculpting LoRA for Harmonizing General and Specialized Knowledge in Multimodal Large Language Models—0
How Robust Are Router-LLMs? Analysis of the Fragility of LLM Routing CapabilitiesCode0
Disentangling Fine-Tuning from Pre-Training in Visual Captioning with Hybrid Markov LogicCode0
Foundation X: Integrating Classification, Localization, and Segmentation through Lock-Release Pretraining Strategy for Chest X-ray AnalysisCode0
Proceedings of the ISCA/ITG Workshop on Diversity in Large Speech and Language Models—0
AnomalyPainter: Vision-Language-Diffusion Synergy for Zero-Shot Realistic and Diverse Industrial Anomaly Synthesis—0
Semi-Supervised Medical Image Segmentation via Knowledge Mining from Large Models—0
AILS-NTUA at SemEval-2025 Task 4: Parameter-Efficient Unlearning for Large Language Models using Data Chunking—0
Evaluating Polish linguistic and cultural competency in large language models—0
GeoEdit: Geometric Knowledge Editing for Large Language Models—0
Sculpting [CLS] Features for Pre-Trained Model-Based Class-Incremental Learning—0
Mol-LLaMA: Towards General Understanding of Molecules in Large Molecular Language Model—0
Sens-Merging: Sensitivity-Guided Parameter Balancing for Merging Large Language Models—0
Show:102550
← PrevPage 3 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3—Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8—Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2—Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1—Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9—Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3—Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8—Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81—Unverified