SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 301–350 of 399 papers

TitleStatusHype
Autonomous Intelligent Software Development—0
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language ModelsCode0
Knowledge-aware Neural Collective Matrix Factorization for Cross-domain Recommendation—0
Connecting a French Dictionary from the Beginning of the 20th Century to WikidataCode0
Comprehensive Fair Meta-learned Recommender SystemCode0
SciDeBERTa: Learning DeBERTa for Science Technology Documents and Fine-Tuning Information Extraction TasksCode0
Task-Driven and Experience-Based Question Answering Corpus for In-Home Robot Application in the House3D Virtual EnvironmentCode0
Laughter During Cooperative and Competitive Games—0
Low Resource Style Transfer via Domain Adaptive Meta Learning—0
PASH at TREC 2021 Deep Learning Track: Generative Enhanced Model for Multi-stage Ranking—0
Knowledgebra: An Algebraic Learning Framework for Knowledge Graph—0
TOV: The Original Vision Model for Optical Remote Sensing Image Understanding via Self-supervised Learning—0
Hierarchical Inductive Transfer for Continual Dialogue Learning—0
KMIR: A Benchmark for Evaluating Knowledge Memorization, Identification and Reasoning Abilities of Language Models—0
ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hints—0
TURNER: The Uncertainty-based Retrieval Framework for Chinese NER—0
Low Resource Style Transfer via Domain Adaptive Meta Learning—0
Knowledge Matters: Radiology Report Generation with General and Specific Knowledge—0
Applying SoftTriple Loss for Supervised Language Model Fine Tuning—0
Hierarchical Inductive Transfer for Continual Dialogue Learning—0
DAML-ST5: Low Resource Style Transfer via Domain Adaptive Meta Learning—0
GFDC: Graph Function Dependence for Logically Consistent Dialogue Response Beyond Persona Data—0
KALA: Knowledge-Augmented Language Model Adaptation—0
Transformer Based Bengali Chatbot Using General Knowledge Dataset—0
Successive POI Recommendation via Brain-inspired Spatiotemporal Aware Representation—0
An Adaptive Deep Learning Framework for Day-ahead Forecasting of Photovoltaic Power Generation—0
Commonsense Knowledge in Word Associations and ConceptNetCode0
Teaching Uncertainty Quantification in Machine Learning through Use Cases—0
Low-Resource Adaptation of Open-Domain Generative Chatbots—0
Knowledge Distillation via Instance-level Sequence Learning—0
Exploiting Adapters for Cross-lingual Low-resource Speech RecognitionCode0
Explainable Hierarchical Imitation Learning for Robotic Drink Pouring—0
Meta-Inductive Node Classification across Graphs—0
Spirit Distillation: A Model Compression Method with Multi-domain Knowledge Transfer—0
One to Many: Adaptive Instrument Segmentation via Meta Learning and Dynamic Online Adaptation in Robotic Surgical Video—0
Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation—0
Towards Knowledge-Augmented Visual Question AnsweringCode0
Transfer learning of chaotic systems—0
Tencent AI Lab Machine Translation Systems for WMT20 Chat Translation Task—0
Learning Physical Common Sense as Knowledge Graph Completion via BERT Data Augmentation and Constrained Tucker Factorization—0
Learning to Learn Variational Semantic MemoryCode0
Unsupervised Neural Machine Translation for Low-Resource Domains via Meta-Learning—0
Patching as Translation: the Data and the MetaphorCode0
An Energy Ontology for Global City Indicators (ISO 37120)—0
Domain Specific, Semi-Supervised Transfer Learning for Medical Imaging—0
What's a Good Prediction? Challenges in evaluating an agent's knowledge—0
What Does My QA Model Know? Devising Controlled Probes using Expert KnowledgeCode0
Acquiring Knowledge from Pre-trained Model to Neural Machine Translation—0
Joint Embedding Learning of Educational Knowledge Graphs—0
Improving Multi-label Emotion Classification by Integrating both General and Domain-specific Knowledge—0
Show:102550
← PrevPage 7 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3—Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8—Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2—Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1—Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9—Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3—Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8—Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81—Unverified