SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 19512000 of 10817 papers

TitleStatusHype
mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge GraphsCode1
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual ConceptsCode1
Lite Transformer with Long-Short Range AttentionCode1
KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge BaseCode1
The Mirage of Model Editing: Revisiting Evaluation in the WildCode1
The Natural Language Decathlon: Multitask Learning as Question AnsweringCode1
LLaSA: A Multimodal LLM for Human Activity Analysis Through Wearable and Smartphone SensorsCode1
KVLink: Accelerating Large Language Models via Efficient KV Cache ReuseCode1
LIME: Less Is More for MLLM EvaluationCode1
Lila: A Unified Benchmark for Mathematical ReasoningCode1
Linearly Mapping from Image to Text SpaceCode1
A Dataset for Medical Instructional Video Classification and Question AnsweringCode1
Language-Informed Visual Concept LearningCode1
The SIFo Benchmark: Investigating the Sequential Instruction Following Ability of Large Language ModelsCode1
Comprehensive Visual Question Answering on Point Clouds through Compositional Scene ManipulationCode1
CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual ReasoningCode1
AssistSR: Task-oriented Video Segment Retrieval for Personal AI AssistantCode1
LibriSQA: A Novel Dataset and Framework for Spoken Question Answering with Large Language ModelsCode1
A Memory Efficient Baseline for Open Domain Question AnsweringCode1
LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric VideosCode1
A Self-Training Method for Machine Reading Comprehension with Soft Evidence ExtractionCode1
Adapting Pretrained Text-to-Text Models for Long Text SequencesCode1
Compositional Semantic Parsing on Semi-Structured TablesCode1
A Semantic-based Method for Unsupervised Commonsense Question AnsweringCode1
AmbigQA: Answering Ambiguous Open-domain QuestionsCode1
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-TuningCode1
ComQA:Compositional Question Answering via Hierarchical Graph Neural NetworksCode1
TimelineQA: A Benchmark for Question Answering over TimelinesCode1
LifeQA: A Real-life Dataset for Video Question AnsweringCode1
Language Models with Image Descriptors are Strong Few-Shot Video-Language LearnersCode1
Language Quantized AutoEncoders: Towards Unsupervised Text-Image AlignmentCode1
Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQACode1
Linguistic Calibration of Long-Form GenerationsCode1
Complex Temporal Question Answering on Knowledge GraphsCode1
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencesCode1
Clinical Reading Comprehension: A Thorough Analysis of the emrQA DatasetCode1
Large Language Models Encode Clinical KnowledgeCode1
Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global InferenceCode1
ComplexTempQA: A Large-Scale Dataset for Complex Temporal Question AnsweringCode1
CliniQG4QA: Generating Diverse Questions for Domain Adaptation of Clinical Question AnsweringCode1
Leveraging Passage Retrieval with Generative Models for Open Domain Question AnsweringCode1
Leveraging Large Language Models for Concept Graph Recovery and Question Answering in NLP EducationCode1
Compositional 4D Dynamic Scenes Understanding with Physics Priors for Video Question AnsweringCode1
Leveraging Large Language Models for Multiple Choice Question AnsweringCode1
Leveraging Semantic Parsing for Relation Linking over Knowledge BasesCode1
Large Language Models Reflect the Ideology of their CreatorsCode1
Fine-tuned LLMs Know More, Hallucinate Less with Few-Shot Sequence-to-Sequence Semantic Parsing over WikidataCode1
Large language model validity via enhanced conformal prediction methodsCode1
Complex Knowledge Base Question Answering: A SurveyCode1
ConceptBert: Concept-Aware Representation for Visual Question AnsweringCode1
Show:102550
← PrevPage 40 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified