SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Showing 101150 of 399 papers

TitleStatusHype
FuseChat-3.0: Preference Optimization Meets Heterogeneous Model FusionCode1
Structured Chemistry Reasoning with Large Language ModelsCode1
TaxoAdapt: Aligning LLM-Based Multidimensional Taxonomy Construction to Evolving Research CorporaCode1
Transformers as Soft Reasoners over LanguageCode1
Point-PRC: A Prompt Learning Based Regulation Framework for Generalizable Point Cloud AnalysisCode1
Prediction and Control in Continual Reinforcement LearningCode1
Time Travelling Pixels: Bitemporal Features Integration with Foundation Model for Remote Sensing Image Change DetectionCode1
A New Learning Paradigm for Foundation Model-based Remote Sensing Change DetectionCode1
SciDeBERTa: Learning DeBERTa for Science Technology Documents and Fine-Tuning Information Extraction TasksCode0
Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful KnowledgeCode0
Are Large Language Models a Good Replacement of Taxonomies?Code0
Should We Really Edit Language Models? On the Evaluation of Edited Language ModelsCode0
REFinD: Relation Extraction Financial DatasetCode0
Efficient Transfer Learning for Video-language Foundation ModelsCode0
Efficient Relation-aware Neighborhood Aggregation in Graph Neural Networks via Tensor DecompositionCode0
Effective Skill Unlearning through Intervention and AbstentionCode0
RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference ContentCode0
Can ChatGPT Enable ITS? The Case of Mixed Traffic Control via Reinforcement LearningCode0
BnMMLU: Measuring Massive Multitask Language Understanding in BengaliCode0
PROL : Rehearsal Free Continual Learning in Streaming Data via Prompt Online LearningCode0
Domain Generalization via Model-Agnostic Learning of Semantic FeaturesCode0
Planning Safety Trajectories with Dual-Phase, Physics-Informed, and Transportation Knowledge-Driven Large Language ModelsCode0
Dive into the Resolution Augmentations and Metrics in Low Resolution Face Recognition: A Plain yet Effective New BaselineCode0
Distribution-aware Noisy-label Crack SegmentationCode0
Distilling Stereo Networks for Performant and Efficient Leaner NetworksCode0
Patching as Translation: the Data and the MetaphorCode0
Disentangling Fine-Tuning from Pre-Training in Visual Captioning with Hybrid Markov LogicCode0
Pruning neural network models for gene regulatory dynamics using data and domain knowledgeCode0
PELMS: Pre-training for Effective Low-Shot Multi-Document SummarizationCode0
Quantized Prompt for Efficient Generalization of Vision-Language ModelsCode0
Luminoso at SemEval-2018 Task 10: Distinguishing Attributes Using Text Corpora and Relational KnowledgeCode0
DAGPrompT: Pushing the Limits of Graph Prompting with a Distribution-aware Graph Prompt Tuning ApproachCode0
MM-Eval: A Hierarchical Benchmark for Modern Mongolian Evaluation in LLMsCode0
Avoiding Copyright Infringement via Large Language Model UnlearningCode0
Learning to Understand Phrases by Embedding the DictionaryCode0
ContextFlow++: Generalist-Specialist Flow-based Generative Models with Mixed-Variable Context EncodingCode0
GenKnowSub: Improving Modularity and Reusability of LLMs through General Knowledge SubtractionCode0
Learning to Learn Variational Semantic MemoryCode0
Leveraging Large Language Models for Automated Dialogue AnalysisCode0
Connecting a French Dictionary from the Beginning of the 20th Century to WikidataCode0
Knowledge Distillation for Detection Transformer with Consistent Distillation Points SamplingCode0
Joey NMT: A Minimalist NMT Toolkit for NovicesCode0
Foundation X: Integrating Classification, Localization, and Segmentation through Lock-Release Pretraining Strategy for Chest X-ray AnalysisCode0
Integrating Semantic Knowledge to Tackle Zero-shot Text ClassificationCode0
Commonsense Knowledge in Word Associations and ConceptNetCode0
Towards Difficulty-Agnostic Efficient Transfer Learning for Vision-Language ModelsCode0
Fed-CO2: Cooperation of Online and Offline Models for Severe Data Heterogeneity in Federated LearningCode0
Improving Personalized Search with Regularized Low-Rank Parameter UpdatesCode0
Comprehensive Fair Meta-learned Recommender SystemCode0
Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained ModelCode0
Show:102550
← PrevPage 3 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81Unverified