SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 13011350 of 10817 papers

TitleStatusHype
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterCode1
Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative ComprehensionCode1
Discourse Analysis via Questions and Answers: Parsing Dependency Structures of Questions Under DiscussionCode1
Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge GeneratorsCode1
An Empirical Study of End-to-End Video-Language Transformers with Masked Visual ModelingCode1
FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive SummarizationCode1
AutoQA: From Databases To QA Semantic Parsers With Only Synthetic Training DataCode1
Autoregressive Entity RetrievalCode1
Discovering Spatio-Temporal Rationales for Video Question AnsweringCode1
Benchmarking Retrieval-Augmented Multimomal Generation for Document Question AnsweringCode1
ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language TuningCode1
Disentangling 3D Prototypical Networks For Few-Shot Concept LearningCode1
Distilled Dual-Encoder Model for Vision-Language UnderstandingCode1
Does Vision-and-Language Pretraining Improve Lexical Grounding?Code1
EAGER: Asking and Answering Questions for Automatic Reward Shaping in Language-guided RLCode1
Fine-grained Image Classification and Retrieval by Combining Visual and Locally Pooled Textual FeaturesCode1
Attention-Based Context Aware Reasoning for Situation RecognitionCode1
Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning StrategiesCode1
Differentiable Reasoning on Large Knowledge Bases and Natural LanguageCode1
Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam DatasetCode1
FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question AnsweringCode1
DialSim: A Real-Time Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational AgentsCode1
Dialog Inpainting: Turning Documents into DialogsCode1
FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food CultureCode1
Formal Query Building with Query Structure Prediction for Complex Question Answering over Knowledge BaseCode1
DEXTER: A Benchmark for open-domain Complex Question Answering using LLMsCode1
DialogLM: Pre-trained Model for Long Dialogue Understanding and SummarizationCode1
3D-Aware Visual Question Answering about Parts, Poses and OcclusionsCode1
Development and bilingual evaluation of Japanese medical large language model within reasonably low computational resourcesCode1
Benchmarking Large Language Models on Answering and Explaining Challenging Medical QuestionsCode1
DeVLBert: Learning Deconfounded Visio-Linguistic RepresentationsCode1
Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge GraphsCode1
Designing a Minimal Retrieve-and-Read System for Open-Domain Question AnsweringCode1
From Representation to Reasoning: Towards both Evidence and Commonsense Reasoning for Video Question-AnsweringCode1
T3: Tree-Autoencoder Constrained Adversarial Text Generation for Targeted AttackCode1
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference OptimizationCode1
FunQA: Towards Surprising Video ComprehensionCode1
Detecting and Preventing Hallucinations in Large Vision Language ModelsCode1
Dense Passage Retrieval for Open-Domain Question AnsweringCode1
Densely Connected Attention Propagation for Reading ComprehensionCode1
BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense EvaluationCode1
GameEval: Evaluating LLMs on Conversational GamesCode1
Describe Anything Model for Visual Question Answering on Text-rich ImagesCode1
Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL ModelsCode1
Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQACode1
Generation-Augmented Retrieval for Open-domain Question AnsweringCode1
Delaying Interaction Layers in Transformer-based Encoders for Efficient Open Domain Question AnsweringCode1
AtomR: Atomic Operator-Empowered Large Language Models for Heterogeneous Knowledge ReasoningCode1
Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder TransformersCode1
DELIFT: Data Efficient Language model Instruction Fine TuningCode1
Show:102550
← PrevPage 27 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified