SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 751800 of 10817 papers

TitleStatusHype
Are Deep Neural Networks SMARTer than Second Graders?Code1
ECBench: Can Multi-modal Foundation Models Understand the Egocentric World? A Holistic Embodied Cognition BenchmarkCode1
EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language UnderstandingCode1
Engineering flexible machine learning systems by traversing functionally-invariant pathsCode1
ETC: Encoding Long and Structured Inputs in TransformersCode1
GraghVQA: Language-Guided Graph Neural Networks for Graph-based Visual Question AnsweringCode1
Dynamic Language Binding in Relational Visual ReasoningCode1
DUAL: Discrete Spoken Unit Adaptive Learning for Textless Spoken Question AnsweringCode1
Dual Reader-Parser on Hybrid Textual and Tabular Evidence for Open Domain Question AnsweringCode1
DualVGR: A Dual-Visual Graph Reasoning Unit for Video Question AnsweringCode1
Dynamic Multimodal Evaluation with Flexible Complexity by Vision-Language BootstrappingCode1
DSPNet: Dual-vision Scene Perception for Robust 3D Question AnsweringCode1
DrugEHRQA: A Question Answering Dataset on Structured and Unstructured Electronic Health Records For Medicine Related QueriesCode1
Dual-Key Multimodal Backdoors for Visual Question AnsweringCode1
DyGKT: Dynamic Graph Learning for Knowledge TracingCode1
Dynamically Fused Graph Network for Multi-hop ReasoningCode1
Dynamic Relevance Graph Network for Knowledge-Aware Question AnsweringCode1
DrBenchmark: A Large Language Understanding Evaluation Benchmark for French Biomedical DomainCode1
EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question AnsweringCode1
DREAM: Improving Situational QA by First Elaborating the SituationCode1
ECG-QA: A Comprehensive Question Answering Dataset Combined With ElectrocardiogramCode1
Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World EnvironmentsCode1
Editing Factual Knowledge in Language ModelsCode1
Answering Ambiguous Questions through Generative Evidence Fusion and Round-Trip PredictionCode1
DOM-LM: Learning Generalizable Representations for HTML DocumentsCode1
Towards General Natural Language Understanding with Probabilistic WorldbuildingCode1
Effective Human-AI Teams via Learned Natural Language Rules and OnboardingCode1
Answering Complex Open-Domain Questions with Multi-Hop Dense RetrievalCode1
Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset BiasesCode1
DRESSing Up LLM: Efficient Stylized Question-Answering via Style Subspace EditingCode1
DocVXQA: Context-Aware Visual Explanations for Document Question AnsweringCode1
Does Time Have Its Place? Temporal Heads: Where Language Models Recall Time-specific InformationCode1
3D Vision and Language Pretraining with Large-Scale Synthetic DataCode1
DocVQA: A Dataset for VQA on Document ImagesCode1
Agentic Keyframe Search for Video Question AnsweringCode1
EgoToM: Benchmarking Theory of Mind Reasoning from Egocentric VideosCode1
EHRNoteQA: An LLM Benchmark for Real-World Clinical Practice Using Discharge SummariesCode1
EHRXQA: A Multi-Modal Question Answering Dataset for Electronic Health Records with Chest X-ray ImagesCode1
ELECTRAMed: a new pre-trained language representation model for biomedical NLPCode1
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than GeneratorsCode1
Does Vision-and-Language Pretraining Improve Lexical Grounding?Code1
Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question AnsweringCode1
Empirical Study of Zero-Shot NER with ChatGPTCode1
Empower Entity Set Expansion via Language Model ProbingCode1
Ditch the Gold Standard: Re-evaluating Conversational Question AnsweringCode1
Answering Questions by Meta-Reasoning over Multiple Chains of ThoughtCode1
AfriQA: Cross-lingual Open-Retrieval Question Answering for African LanguagesCode1
Answering Questions on COVID-19 in Real-TimeCode1
Diversify Question Generation with Retrieval-Augmented Style TransferCode1
Distilling Knowledge from Reader to Retriever for Question AnsweringCode1
Show:102550
← PrevPage 16 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified