SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 32113220 of 10817 papers

TitleStatusHype
Keep Security! Benchmarking Security Policy Preservation in Large Language Model Contexts Against Indirect Attacks in Question AnsweringCode0
An Empirical Comparison of Generative Approaches for Product Attribute-Value IdentificationCode0
On the Importance of Adaptive Data Collection for Extremely Imbalanced Pairwise TasksCode0
On the Influence of Context Size and Model Choice in Retrieval-Augmented Generation SystemsCode0
DBLP-QuAD: A Question Answering Dataset over the DBLP Scholarly Knowledge GraphCode0
On the Summarization of Consumer Health QuestionsCode0
Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQACode0
K-COMP: Retrieval-Augmented Medical Domain Question Answering With Knowledge-Injected CompressorCode0
An empirical analysis of existing systems and datasets toward general simple question answeringCode0
Dataset and Neural Recurrent Sequence Labeling Model for Open-Domain Factoid Question AnsweringCode0
Show:102550
← PrevPage 322 of 1082Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified