SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 12011250 of 10817 papers

TitleStatusHype
DocVQA: A Dataset for VQA on Document ImagesCode1
Discovering Spatio-Temporal Rationales for Video Question AnsweringCode1
Disentangling 3D Prototypical Networks For Few-Shot Concept LearningCode1
Diversify Question Generation with Retrieval-Augmented Style TransferCode1
Autoregressive Entity RetrievalCode1
AutoQA: From Databases To QA Semantic Parsers With Only Synthetic Training DataCode1
Discourse Analysis via Questions and Answers: Parsing Dependency Structures of Questions Under DiscussionCode1
Attributed Question Answering: Evaluation and Modeling for Attributed Large Language ModelsCode1
RARR: Researching and Revising What Language Models Say, Using Language ModelsCode1
Attribute First, then Generate: Locally-attributable Grounded Text GenerationCode1
DOM-LM: Learning Generalizable Representations for HTML DocumentsCode1
At Which Training Stage Does Code Data Help LLMs Reasoning?Code1
Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset BiasesCode1
DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question AnsweringCode1
Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge GraphsCode1
Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual NoiseCode1
Differentiable Reasoning on Large Knowledge Bases and Natural LanguageCode1
Disfl-QA: A Benchmark Dataset for Understanding Disfluencies in Question AnsweringCode1
AuditWen:An Open-Source Large Language Model for AuditCode1
Augment before You Try: Knowledge-Enhanced Table Question Answering via Table ExpansionCode1
DualVGR: A Dual-Visual Graph Reasoning Unit for Video Question AnsweringCode1
Augmenting Black-box LLMs with Medical Textbooks for Biomedical Question Answering (Published in Findings of EMNLP 2024)Code1
Dynamic Multimodal Evaluation with Flexible Complexity by Vision-Language BootstrappingCode1
Dynamic Relevance Graph Network for Knowledge-Aware Question AnsweringCode1
DialogLM: Pre-trained Model for Long Dialogue Understanding and SummarizationCode1
DynaPipe: Optimizing Multi-task Training through Dynamic PipelinesCode1
Attention in Reasoning: Dataset, Analysis, and ModelingCode1
EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question AnsweringCode1
Integrating UMLS Knowledge into Large Language Models for Medical Question AnsweringCode1
A Unified Encoder-Decoder Framework with Entity MemoryCode1
DEXTER: A Benchmark for open-domain Complex Question Answering using LLMsCode1
Analyzing Knowledge Graph Embedding Methods from a Multi-Embedding Interaction PerspectiveCode1
Dialog Inpainting: Turning Documents into DialogsCode1
Structure-aware Domain Knowledge Injection for Large Language ModelsCode1
Effective Human-AI Teams via Learned Natural Language Rules and OnboardingCode1
A Universal Question-Answering Platform for Knowledge GraphsCode1
DialSim: A Real-Time Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational AgentsCode1
AutoBencher: Creating Salient, Novel, Difficult Datasets for Language ModelsCode1
Detecting Hate Speech in Multi-modal MemesCode1
Development and bilingual evaluation of Japanese medical large language model within reasonably low computational resourcesCode1
ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language TuningCode1
Detecting and Preventing Hallucinations in Large Vision Language ModelsCode1
DeVLBert: Learning Deconfounded Visio-Linguistic RepresentationsCode1
EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language UnderstandingCode1
AutoEval-Video: An Automatic Benchmark for Assessing Large Vision Language Models in Open-Ended Video Question AnsweringCode1
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent ConversationCode1
DebateQA: Evaluating Question Answering on Debatable KnowledgeCode1
EHRXQA: A Multi-Modal Question Answering Dataset for Electronic Health Records with Chest X-ray ImagesCode1
ELECTRAMed: a new pre-trained language representation model for biomedical NLPCode1
Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning StrategiesCode1
Show:102550
← PrevPage 25 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified