SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 501550 of 10817 papers

TitleStatusHype
Crosslingual Generalization through Multitask FinetuningCode2
PoseScript: Linking 3D Human Poses and Natural LanguageCode2
MuGER^2: Multi-Granularity Evidence Retrieval and Reasoning for Hybrid Question AnsweringCode2
Perception Test: A Diagnostic Benchmark for Multimodal ModelsCode2
Deep Bidirectional Language-Knowledge Graph PretrainingCode2
Video in 10 Bits: Few-Bit VideoQA for Efficiency and PrivacyCode2
Towards a Unified Multi-Dimensional Evaluator for Text GenerationCode2
Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive LearningCode2
Measuring and Narrowing the Compositionality Gap in Language ModelsCode2
Retrieval Augmented Visual Question Answering with Outside KnowledgeCode2
Ask Me Anything: A simple strategy for prompting language modelsCode2
LambdaKG: A Library for Pre-trained Language Model-Based Knowledge Graph EmbeddingsCode2
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question AnsweringCode2
Atlas: Few-shot Learning with Retrieval Augmented Language ModelsCode2
AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq ModelCode2
Revealing Single Frame Bias for Video-and-Language LearningCode2
Egocentric Video-Language PretrainingCode2
GIT: A Generative Image-to-text Transformer for Vision and LanguageCode2
QAMPARI: An Open-domain Question Answering Benchmark for Questions with Many Answers from Multiple ParagraphsCode2
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-EncoderCode2
Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph CompletionCode2
PaLM: Scaling Language Modeling with PathwaysCode2
LinkBERT: Pretraining Language Models with Document LinksCode2
STaR: Bootstrapping Reasoning With ReasoningCode2
MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question AnsweringCode2
ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningCode2
All in One: Exploring Unified Video-Language Pre-trainingCode2
ScienceWorld: Is your Agent Smarter than a 5th Grader?Code2
QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training QuantizationCode2
UnifiedQA-v2: Stronger Generalization via Broader Cross-Format TrainingCode2
Vision-Language Pre-Training with Triple Contrastive LearningCode2
SGPT: GPT Sentence Embeddings for Semantic SearchCode2
TableQuery: Querying tabular data with natural languageCode2
GreaseLM: Graph REASoning Enhanced Language Models for Question AnsweringCode2
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language ModelsCode2
Scaling Language Models: Methods, Analysis & Insights from Training GopherCode2
DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingCode2
Cross-Task Generalization via Natural Language Crowdsourcing InstructionsCode2
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsCode2
A Replication Study of Dense Passage RetrieverCode2
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient SparsityCode2
Baleen: Robust Multi-Hop Reasoning at Scale via Condensed RetrievalCode2
MDETR - Modulated Detection for End-to-End Multi-Modal UnderstandingCode2
Learning Dense Representations of Phrases at ScaleCode2
Efficient One-Pass End-to-End Entity Linking for QuestionsCode2
What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical ExamsCode2
Relevance-guided Supervision for OpenQA with ColBERTCode2
DeBERTa: Decoding-enhanced BERT with Disentangled AttentionCode2
Beyond Accuracy: Behavioral Testing of NLP models with CheckListCode2
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual TransferCode2
Show:102550
← PrevPage 11 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified