SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 13511400 of 10817 papers

TitleStatusHype
Disentangling 3D Prototypical Networks For Few-Shot Concept LearningCode1
DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question AnsweringCode1
BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language ModelsCode1
Discovering Spatio-Temporal Rationales for Video Question AnsweringCode1
Disfl-QA: A Benchmark Dataset for Understanding Disfluencies in Question AnsweringCode1
Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual NoiseCode1
GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question AnsweringCode1
Gracefully Filtering Backdoor Samples for Generative Large Language Models without RetrainingCode1
Beyond Memorization: The Challenge of Random Memory Access in Language ModelsCode1
Graphhopper: Multi-Hop Scene Graph Reasoning for Visual Question AnsweringCode1
Graph Optimal Transport for Cross-Domain AlignmentCode1
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionCode1
BioProBench: Comprehensive Dataset and Benchmark in Biological Protocol Understanding and ReasoningCode1
Graphusion: A RAG Framework for Knowledge Graph Construction with a Global PerspectiveCode1
Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge BasesCode1
Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge GraphsCode1
Discourse Analysis via Questions and Answers: Parsing Dependency Structures of Questions Under DiscussionCode1
Distantly-Supervised Dense Retrieval Enables Open-Domain Question Answering without Evidence AnnotationCode1
DialSim: A Real-Time Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational AgentsCode1
Bayesian Attention ModulesCode1
Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning StrategiesCode1
Dialog Inpainting: Turning Documents into DialogsCode1
HAAR: Text-Conditioned Generative Model of 3D Strand-based Human HairstylesCode1
Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge GeneratorsCode1
DialogLM: Pre-trained Model for Long Dialogue Understanding and SummarizationCode1
Differentiable Reasoning on Large Knowledge Bases and Natural LanguageCode1
Hengam: An Adversarially Trained Transformer for Persian Temporal TaggingCode1
End-to-End Beam Retrieval for Multi-Hop Question AnsweringCode1
Hierarchical Conditional Relation Networks for Video Question AnsweringCode1
BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference DatasetCode1
Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive PrinciplesCode1
Beheshti-NER: Persian Named Entity Recognition Using BERTCode1
Development and bilingual evaluation of Japanese medical large language model within reasonably low computational resourcesCode1
Detecting Hate Speech in Multi-modal MemesCode1
DeVLBert: Learning Deconfounded Visio-Linguistic RepresentationsCode1
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference OptimizationCode1
HopWeaver: Synthesizing Authentic Multi-Hop Questions Across Text CorporaCode1
HOSMEL: A Hot-Swappable Modularized Entity Linking Toolkit for ChineseCode1
How Can We Know When Language Models Know? On the Calibration of Language Models for Question AnsweringCode1
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable MaskingCode1
AtomR: Atomic Operator-Empowered Large Language Models for Heterogeneous Knowledge ReasoningCode1
Benchmarking for Biomedical Natural Language Processing Tasks with a Domain Specific ALBERTCode1
DEXTER: A Benchmark for open-domain Complex Question Answering using LLMsCode1
Benchmarking Geospatial Question Answering Engines using the Dataset GeoQuestions1089Code1
Distantly-Supervised Evidence Retrieval Enables Question Answering without Evidence AnnotationCode1
Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model EvaluationCode1
Dense Passage Retrieval for Open-Domain Question AnsweringCode1
H-STAR: LLM-driven Hybrid SQL-Text Adaptive Reasoning on TablesCode1
Densely Connected Attention Propagation for Reading ComprehensionCode1
Describe Anything Model for Visual Question Answering on Text-rich ImagesCode1
Show:102550
← PrevPage 28 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified