SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 1025110275 of 10817 papers

TitleStatusHype
ATP: Directed Graph Embedding with Asymmetric Transitivity PreservationCode0
Alignment over Heterogeneous Embeddings for Question AnsweringCode0
MDCure: A Scalable Pipeline for Multi-Document Instruction-FollowingCode0
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over ParagraphsCode0
DrishtiKon: Multi-Granular Visual Grounding for Text-Rich Document ImagesCode0
Diversify, Rationalize, and Combine: Ensembling Multiple QA Strategies for Zero-shot Knowledge-based VQACode0
DramaQA: Character-Centered Video Story Understanding with Hierarchical QACode0
Distantly Supervised Question ParsingCode0
On Subjective Uncertainty Quantification and Calibration in Natural Language GenerationCode0
Answer-level Calibration for Free-form Multiple Choice Question AnsweringCode0
On the Cross-lingual Transferability of Monolingual RepresentationsCode0
DragonVerseQA: Open-Domain Long-Form Context-Aware Question-AnsweringCode0
Is Multihop QA in DiRe Condition? Measuring and Reducing Disconnected ReasoningCode0
Dr3: Ask Large Language Models Not to Give Off-Topic Answers in Open Domain Multi-Hop Question AnsweringCode0
Revisiting Sentence Union Generation as a Testbed for Text ConsolidationCode0
Prompt Space Optimizing Few-shot Reasoning Success with Large Language ModelsCode0
Atomic Consistency Preference Optimization for Long-Form Question AnsweringCode0
Measuring Compositional Generalization: A Comprehensive Method on Realistic DataCode0
Downstream Datasets Make Surprisingly Good Pretraining CorporaCode0
ATM: Adversarial Tuning Multi-agent System Makes a Robust Retrieval-Augmented GeneratorCode0
Measuring Faithful and Plausible Visual Grounding in VQACode0
Down and Across: Introducing Crossword-Solving as a New NLP BenchmarkCode0
Measuring Free-Form Decision-Making Inconsistency of Language Models in Military Crisis SimulationsCode0
On the Efficacy of Adversarial Data Collection for Question Answering: Results from a Large-Scale Randomized StudyCode0
ProMQA: Question Answering Dataset for Multimodal Procedural Activity UnderstandingCode0
Show:102550
← PrevPage 411 of 433Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified