SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 24912500 of 10817 papers

TitleStatusHype
CRAG -- Comprehensive RAG BenchmarkCode3
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuningCode2
ComplexTempQA: A Large-Scale Dataset for Complex Temporal Question AnsweringCode1
MATTER: Memory-Augmented Transformer Using Heterogeneous Knowledge Sources0
Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?0
Synthesizing Conversations from Unlabeled Documents using Automatic Response Segmentation0
M-QALM: A Benchmark to Assess Clinical Reading Comprehension and Knowledge Recall in Large Language Models via Question AnsweringCode0
Understanding Information Storage and Transfer in Multi-modal Large Language Models0
FairytaleQA Translated: Enabling Educational Question and Answer Generation in Less-Resourced LanguagesCode0
Semantically Diverse Language Generation for Uncertainty Estimation in Language ModelsCode1
Show:102550
← PrevPage 250 of 1082Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified