SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Showing 301325 of 399 papers

TitleStatusHype
KMIR: A Benchmark for Evaluating Knowledge Memorization, Identification and Reasoning Abilities of Language Models0
ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hints0
TURNER: The Uncertainty-based Retrieval Framework for Chinese NER0
Low Resource Style Transfer via Domain Adaptive Meta Learning0
Knowledge Matters: Radiology Report Generation with General and Specific Knowledge0
Applying SoftTriple Loss for Supervised Language Model Fine Tuning0
Scaling Language Models: Methods, Analysis & Insights from Training GopherCode2
DAML-ST5: Low Resource Style Transfer via Domain Adaptive Meta Learning0
Hierarchical Inductive Transfer for Continual Dialogue Learning0
GFDC: Graph Function Dependence for Logically Consistent Dialogue Response Beyond Persona Data0
KALA: Knowledge-Augmented Language Model Adaptation0
Transformer Based Bengali Chatbot Using General Knowledge Dataset0
BEAMetrics: A Benchmark for Language Generation Evaluation EvaluationCode1
Successive POI Recommendation via Brain-inspired Spatiotemporal Aware Representation0
An Adaptive Deep Learning Framework for Day-ahead Forecasting of Photovoltaic Power Generation0
Commonsense Knowledge in Word Associations and ConceptNetCode0
Generative Pre-Training from MoleculesCode1
Teaching Uncertainty Quantification in Machine Learning through Use Cases0
Low-Resource Adaptation of Open-Domain Generative Chatbots0
Importance-based Neuron Allocation for Multilingual Neural Machine TranslationCode1
Knowledge Distillation via Instance-level Sequence Learning0
Exploiting Adapters for Cross-lingual Low-resource Speech RecognitionCode0
Explainable Hierarchical Imitation Learning for Robotic Drink Pouring0
Meta-Inductive Node Classification across Graphs0
Spirit Distillation: A Model Compression Method with Multi-domain Knowledge Transfer0
Show:102550
← PrevPage 13 of 16Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81Unverified