SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 21512160 of 10817 papers

TitleStatusHype
Advancing Chart Question Answering with Robust Chart Component Recognition0
Evaluating language models as risk scoresCode1
Clinical Reading Comprehension with Encoder-Decoder Models Enhanced by Direct Preference Optimization0
RAG-QA Arena: Evaluating Domain Robustness for Long-form Retrieval Augmented Question AnsweringCode2
LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference0
QuIIL at T3 challenge: Towards Automation in Life-Saving Intervention Procedures from First-Person ViewCode0
Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approach0
Visual Haystacks: A Vision-Centric Needle-In-A-Haystack BenchmarkCode1
INDIC QA BENCHMARK: A Multilingual Benchmark to Evaluate Question Answering capability of LLMs for Indic Languages0
Continual Learning for Temporal-Sensitive Question Answering0
Show:102550
← PrevPage 216 of 1082Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified