SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 399 papers

TitleStatusHype
What Would You Ask When You First Saw a^2+b^2=c^2? Evaluating LLM on Curiosity-Driven Questioning—0
Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination—0
Can LVLMs Obtain a Driver's License? A Benchmark Towards Reliable AGI for Autonomous Driving—0
Biomedical Large Languages Models Seem not to be Superior to Generalist Models on Unseen Medical Data—0
CoRA: Collaborative Information Perception by Large Language Model's Weights for Recommendation—0
Molecular Graph Representation Learning Integrating Large Language Models with Domain-specific Small ModelsCode0
PMoE: Progressive Mixture of Experts with Asymmetric Transformer for Continual Learning—0
Prompting Encoder Models for Zero-Shot Classification: A Cross-Domain Study in Italian—0
Constructing Enhanced Mutual Information for Online Class-Incremental Learning—0
An Ad-hoc graph node vector embedding algorithm for general knowledge graphs using Kinetica-Graph—0
Quantized Prompt for Efficient Generalization of Vision-Language ModelsCode0
All Roads Lead to Rome: Unveiling the Trajectory of Recommender Systems Across the LLM Era—0
Microsoft Cloud-based Digitization Workflow with Rich Metadata Acquisition for Cultural Heritage Objects—0
Igea: a Decoder-Only Language Model for Biomedical Text Generation in Italian—0
SAM-Med3D-MoE: Towards a Non-Forgetting Segment Anything Model via Mixture of Experts for 3D Medical Image Segmentation—0
SAFT: Towards Out-of-Distribution Generalization in Fine-Tuning—0
BAPO: Base-Anchored Preference Optimization for Overcoming Forgetting in Large Language Models Personalization—0
Leveraging Large Language Models for enhanced personalised user experience in Smart Homes—0
Disentangling Knowledge-based and Visual Reasoning by Question Decomposition in KB-VQA—0
Exploring Safety-Utility Trade-Offs in Personalized Language Models—0
Are Large Language Models a Good Replacement of Taxonomies?Code0
RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference ContentCode0
Avoiding Copyright Infringement via Large Language Model UnlearningCode0
Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programming—0
Learning from Natural Language Explanations for Generalizable Entity Matching—0
Generative Explore-Exploit: Training-free Optimization of Generative Recommender Systems using LLM Optimizers—0
ContextFlow++: Generalist-Specialist Flow-based Generative Models with Mixed-Variable Context EncodingCode0
SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge—0
MoST: Multi-modality Scene Tokenization for Motion Prediction—0
Towards Generalizable Agents in Text-Based Educational Environments: A Study of Integrating RL with LLMs—0
Enhancing Action Recognition from Low-Quality Skeleton Data via Part-Level Knowledge Distillation—0
Evaluating Consistency and Reasoning Capabilities of Large Language Models—0
Learning Electromagnetic Metamaterial Physics With ChatGPT—0
When Life gives you LLMs, make LLM-ADE: Large Language Models with Adaptive Data Engineering—0
Pretraining and Updates of Domain-Specific LLM: A Case Study in the Japanese Business Domain—0
Knowledge graphs for empirical concept retrievalCode0
Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful KnowledgeCode0
Juru: Legal Brazilian Large Language Model from Reputable Sources—0
Are LLMs Good Cryptic Crossword Solvers?—0
DiPrompT: Disentangled Prompt Tuning for Multiple Latent Domain Generalization in Federated Learning—0
Deep Prompt Multi-task Network for Abuse Language Detection—0
K-Link: Knowledge-Link Graph from LLMs for Enhanced Representation Learning in Multivariate Time-Series Data—0
Pruning neural network models for gene regulatory dynamics using data and domain knowledgeCode0
Bootstrapping Cognitive Agents with a Large Language Model—0
Inductive Graph Alignment Prompt: Bridging the Gap between Graph Pre-training and Inductive Fine-tuning From Spectral Perspective—0
GALA: Generating Animatable Layered Assets from a Single Scan—0
INCPrompt: Task-Aware incremental Prompting for Rehearsal-Free Class-incremental Learning—0
KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling—0
A Unified Industrial Large Knowledge Model Framework in Industry 4.0 and Smart Manufacturing—0
Fed-CO2: Cooperation of Online and Offline Models for Severe Data Heterogeneity in Federated LearningCode0
Show:102550
← PrevPage 5 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3—Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8—Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2—Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1—Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9—Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3—Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8—Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81—Unverified