SOTAVerified

General Knowledge

This task aims to evaluate the ability of a model to answer general-knowledge questions.

Source: BIG-bench

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 351–399 of 399 papers

TitleStatusHype
QuaRTz: An Open-Domain Dataset of Qualitative Relationship Questions—0
GeoSQA: A Benchmark for Scenario-based Question Answering in the Geography Domain at High School Level—0
Joey NMT: A Minimalist NMT Toolkit for NovicesCode0
T-Norms Driven Loss Functions for Machine Learning—0
Integration of Imitation Learning using GAIL and Reinforcement Learning using Task-achievement Rewards via Probabilistic Graphical Model—0
A Joint Planning and Learning Framework for Human-Aided Decision-Making—0
Generating Question Relevant Captions to Aid Visual Question Answering—0
The World in My Mind: Visual Dialog with Adversarial Multi-modal Feature Encoding—0
Integrating Semantic Knowledge to Tackle Zero-shot Text ClassificationCode0
Transferable Natural Language Interface to Structured Queries aided by Adversarial Generation—0
Specifying Conceptual Models Using Restricted Natural Language—0
Learning to Specialize with Knowledge Distillation for Visual Question Answering—0
Visual Question Answering as Reading Comprehension—0
Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering—0
Explicit Utilization of General Knowledge in Machine Reading Comprehension—0
Straight to the Facts: Learning Knowledge Base Retrieval for Factual Visual Question Answering—0
Controversy Rules - Discovering Regions Where Classifiers (Dis-)Agree Exceptionally—0
Knowledge Representation and Extraction at Scale—0
Luminoso at SemEval-2018 Task 10: Distinguishing Attributes Using Text Corpora and Relational KnowledgeCode0
Utilisation d'une base de connaissances de sp\'ecialit\'e et de sens commun pour la simplification de comptes-rendus radiologiques (Radiological text simplification using a general knowledge base)—0
Context and Humor: Understanding Amul advertisements of India—0
Efficient illumination angle self-calibration in Fourier ptychography—0
A Factoid Question Answering System for Vietnamese—0
Yuanfudao at SemEval-2018 Task 11: Three-way Attention and Relational Knowledge for Commonsense Machine ComprehensionCode0
Towards a Continuous Knowledge Learning Engine for Chatbots—0
Distributed Fine-tuning of Language Models on Private Data—0
Differentially Private Distributed Learning for Language Modeling Tasks—0
Neural Regularized Domain Adaptation for Chinese Word Segmentation—0
RDF2Vec: RDF Graph Embeddings and Their ApplicationsCode1
ConceptNet at SemEval-2017 Task 2: Extending Word Embeddings with Multilingual Relational KnowledgeCode2
Automated Phrase Mining from Massive Text CorporaCode1
ConceptNet 5.5: An Open Multilingual Graph of General KnowledgeCode2
Knowledge Completion for Generics using Guided Tensor Factorization—0
Visual Question Answering: A Survey of Methods and DatasetsCode0
Neural Discourse Relation Recognition with Semantic Memory—0
Image Captioning and Visual Question Answering Based on Attributes and External Knowledge—0
TabMCQ: A Dataset of General Knowledge Tables and Multiple-choice Questions—0
Intelligent Conversational Bot for Massive Online Open Courses (MOOCs)—0
Some Epistemological Problems with the Knowledge Level in Cognitive Architectures—0
Ask Me Anything: Free-form Visual Question Answering Based on Knowledge from External Sources—0
Data structuring for the ontological modelling of wind energy systems—0
Learning Knowledge Graphs for Question Answering through Conversational Dialog—0
Learning to Understand Phrases by Embedding the DictionaryCode0
Transaction Logic with (Complex) Events—0
Analysis of Watson's Strategies for Playing Jeopardy!—0
Collaborative ontology sharing and editing—0
Organizing Linked Data Quality Related Methods—0
A Dynamic Approach to Probabilistic Inference—0
The Wisdom of Crowds in the Recollection of Order Information—0
Show:102550
← PrevPage 8 of 8Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy94.3—Unverified
2Gopher-280B (few-shot, k=5)Accuracy93.9—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy 85.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy 84.8—Unverified
5Gopher-280B (few-shot, k=5)Accuracy84.2—Unverified
6Gopher-280B (few-shot, k=5)Accuracy 84.1—Unverified
7Gopher-280B (few-shot, k=5)Accuracy 83.9—Unverified
8Gopher-280B (few-shot, k=5)Accuracy83.3—Unverified
9Gopher-280B (few-shot, k=5)Accuracy 81.8—Unverified
10Gopher-280B (few-shot, k=5)Accuracy 81—Unverified