SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Showing 376–399 of 399 papers

TitleStatusHype
Efficient illumination angle self-calibration in Fourier ptychography—0
A Factoid Question Answering System for Vietnamese—0
Yuanfudao at SemEval-2018 Task 11: Three-way Attention and Relational Knowledge for Commonsense Machine ComprehensionCode0
Towards a Continuous Knowledge Learning Engine for Chatbots—0
Distributed Fine-tuning of Language Models on Private Data—0
Differentially Private Distributed Learning for Language Modeling Tasks—0
Neural Regularized Domain Adaptation for Chinese Word Segmentation—0
Knowledge Completion for Generics using Guided Tensor Factorization—0
Visual Question Answering: A Survey of Methods and DatasetsCode0
Neural Discourse Relation Recognition with Semantic Memory—0
Image Captioning and Visual Question Answering Based on Attributes and External Knowledge—0
TabMCQ: A Dataset of General Knowledge Tables and Multiple-choice Questions—0
Intelligent Conversational Bot for Massive Online Open Courses (MOOCs)—0
Some Epistemological Problems with the Knowledge Level in Cognitive Architectures—0
Ask Me Anything: Free-form Visual Question Answering Based on Knowledge from External Sources—0
Data structuring for the ontological modelling of wind energy systems—0
Learning Knowledge Graphs for Question Answering through Conversational Dialog—0
Learning to Understand Phrases by Embedding the DictionaryCode0
Transaction Logic with (Complex) Events—0
Analysis of Watson's Strategies for Playing Jeopardy!—0
Organizing Linked Data Quality Related Methods—0
Collaborative ontology sharing and editing—0
A Dynamic Approach to Probabilistic Inference—0
The Wisdom of Crowds in the Recollection of Order Information—0
Show:102550
← PrevPage 16 of 16Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3—Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8—Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2—Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1—Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9—Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3—Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8—Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81—Unverified