SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2151–2175 of 10817 papers

TitleStatusHype
Advancing Chart Question Answering with Robust Chart Component Recognition—0
Evaluating language models as risk scoresCode1
LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference—0
Clinical Reading Comprehension with Encoder-Decoder Models Enhanced by Direct Preference Optimization—0
RAG-QA Arena: Evaluating Domain Robustness for Long-form Retrieval Augmented Question AnsweringCode2
Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approach—0
QuIIL at T3 challenge: Towards Automation in Life-Saving Intervention Procedures from First-Person ViewCode0
Visual Haystacks: A Vision-Centric Needle-In-A-Haystack BenchmarkCode1
INDIC QA BENCHMARK: A Multilingual Benchmark to Evaluate Question Answering capability of LLMs for Indic Languages—0
Conversational Query Reformulation with the Guidance of Retrieved Documents—0
Continual Learning for Temporal-Sensitive Question Answering—0
Multimodal Reranking for Knowledge-Intensive Visual Question Answering—0
TurkishMMLU: Measuring Massive Multitask Language Understanding in TurkishCode1
MERLIN: Multimodal Embedding Refinement via LLM-based Iterative Navigation for Text-Video Retrieval-Rerank Pipeline—0
Evaluating Search Engines and Large Language Models for Answering Health QuestionsCode0
ProcTag: Process Tagging for Assessing the Efficacy of Document Instruction Data—0
EchoSight: Advancing Visual-Language Models with Wiki Knowledge—0
BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive RetrievalCode5
Mindful-RAG: A Study of Points of Failure in Retrieval Augmented Generation—0
Scientific QA System with Verifiable AnswersCode2
SPINACH: SPARQL-Based Information Navigation for Challenging Real-World QuestionsCode2
Better RAG using Relevant Information GainCode0
A Comprehensive Evaluation of Large Language Models on Temporal Event Forecasting—0
Localizing and Mitigating Errors in Long-form Question AnsweringCode0
Video-Language Alignment via Spatio-Temporal Graph TransformerCode1
Show:102550
← PrevPage 87 of 433Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified