SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 399 papers

TitleStatusHype
MM-Eval: A Hierarchical Benchmark for Modern Mongolian Evaluation in LLMsCode0
Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small ModelsCode0
Pruning neural network models for gene regulatory dynamics using data and domain knowledgeCode0
Patching as Translation: the Data and the MetaphorCode0
PELMS: Pre-training for Effective Low-Shot Multi-Document SummarizationCode0
Planning Safety Trajectories with Dual-Phase, Physics-Informed, and Transportation Knowledge-Driven Large Language ModelsCode0
PROL : Rehearsal Free Continual Learning in Streaming Data via Prompt Online LearningCode0
Quantized Prompt for Efficient Generalization of Vision-Language ModelsCode0
REFinD: Relation Extraction Financial DatasetCode0
RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference ContentCode0
SciDeBERTa: Learning DeBERTa for Science Technology Documents and Fine-Tuning Information Extraction TasksCode0
Should We Really Edit Language Models? On the Evaluation of Edited Language ModelsCode0
Survey on Abstractive Text Summarization: Dataset, Models, and MetricsCode0
Task-Driven and Experience-Based Question Answering Corpus for In-Home Robot Application in the House3D Virtual EnvironmentCode0
Test-Time Self-Adaptive Small Language Models for Question AnsweringCode0
Towards Knowledge-Augmented Visual Question AnsweringCode0
Unveiling Causal Reasoning in Large Language Models: Reality or Mirage?Code0
Visual Question Answering: A Survey of Methods and DatasetsCode0
What Does My QA Model Know? Devising Controlled Probes using Expert KnowledgeCode0
What Makes Cryptic Crosswords Challenging for LLMs?Code0
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language ModelsCode0
World Knowledge in Multiple Choice Reading ComprehensionCode0
Dobby: A Conversational Service Robot Driven by GPT-4—0
Towards Few-shot Out-of-Distribution Detection—0
How to Complete Domain Tuning while Keeping General Ability in LLM: Adaptive Layer-wise and Element-wise Regularization—0
Towards Generalizable Agents in Text-Based Educational Environments: A Study of Integrating RL with LLMs—0
DKT: Diverse Knowledge Transfer Transformer for Class Incremental Learning—0
Igea: a Decoder-Only Language Model for Biomedical Text Generation in Italian—0
Image Captioning and Visual Question Answering Based on Attributes and External Knowledge—0
Distributed Fine-tuning of Language Models on Private Data—0
Disentangling Knowledge-based and Visual Reasoning by Question Decomposition in KB-VQA—0
What's a Good Prediction? Challenges in evaluating an agent's knowledge—0
Improving Multi-label Emotion Classification by Integrating both General and Domain-specific Knowledge—0
Towards Ontology Reshaping for KG Generation with User-in-the-Loop: Applied to Bosch Welding—0
INCPrompt: Task-Aware incremental Prompting for Rehearsal-Free Class-incremental Learning—0
Inductive Graph Alignment Prompt: Bridging the Gap between Graph Pre-training and Inductive Fine-tuning From Spectral Perspective—0
A new algorithm for Subgroup Set Discovery based on Information Gain—0
Insect-Foundation: A Foundation Model and Large Multimodal Dataset for Vision-Language Insect Understanding—0
Acquiring Knowledge from Pre-trained Model to Neural Machine Translation—0
Integration of Imitation Learning using GAIL and Reinforcement Learning using Task-achievement Rewards via Probabilistic Graphical Model—0
Intelligent Conversational Bot for Massive Online Open Courses (MOOCs)—0
Intelligent Design 4.0: Paradigm Evolution Toward the Agentic AI Era—0
Investigating Forgetting in Pre-Trained Representations Through Continual Learning—0
Investigating Pre-trained Language Models on Cross-Domain Datasets, a Step Closer to General AI—0
AcademicGPT: Empowering Academic Research—0
Joint Embedding Learning of Educational Knowledge Graphs—0
Juru: Legal Brazilian Large Language Model from Reputable Sources—0
KAER: A Knowledge Augmented Pre-Trained Language Model for Entity Resolution—0
KALA: Knowledge-Augmented Language Model Adaptation—0
DiPrompT: Disentangled Prompt Tuning for Multiple Latent Domain Generalization in Federated Learning—0
Show:102550
← PrevPage 4 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3—Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8—Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2—Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1—Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9—Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3—Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8—Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81—Unverified