SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 11511200 of 10817 papers

TitleStatusHype
CLEVR-X: A Visual Reasoning Dataset for Natural Language ExplanationsCode1
Clickbait Spoiling via Question Answering and Passage RetrievalCode1
HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal ReasoningCode1
Harvesting and Refining Question-Answer Pairs for Unsupervised QACode1
Collab-RAG: Boosting Retrieval-Augmented Generation for Complex Question Answering via White-Box and Black-Box LLM CollaborationCode1
OK-VQA: A Visual Question Answering Benchmark Requiring External KnowledgeCode1
Connecting Vision and Language with Video Localized NarrativesCode1
CLEVR-Math: A Dataset for Compositional Language, Visual and Mathematical ReasoningCode1
Advances of Transformer-Based Models for News Headline GenerationCode1
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencesCode1
Cross-Modal BERT for Text-Audio Sentiment AnalysisCode1
Hierarchical Conditional Relation Networks for Video Question AnsweringCode1
Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base EmbeddingsCode1
K-Adapter: Infusing Knowledge into Pre-Trained Models with AdaptersCode1
Visual Grounding Methods for VQA are Working for the Wrong Reasons!Code1
ClarQ: A large-scale and diverse dataset for Clarification Question GenerationCode1
An Efficient Memory-Augmented Transformer for Knowledge-Intensive NLP TasksCode1
CKBP v2: Better Annotation and Reasoning for Commonsense Knowledge Base PopulationCode1
CLAPNQ: Cohesive Long-form Answers from Passages in Natural Questions for RAG systemsCode1
GroUSE: A Benchmark to Evaluate Evaluators in Grounded Question AnsweringCode1
Citekit: A Modular Toolkit for Large Language Model Citation GenerationCode1
ChroniclingAmericaQA: A Large-scale Question Answering Dataset based on Historical American Newspaper PagesCode1
Grounded Multi-Hop VideoQA in Long-Form Egocentric VideosCode1
Classification-Regression for Chart ComprehensionCode1
CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City SpaceCode1
Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot LearnersCode1
Greedy Gradient Ensemble for Robust Visual Question AnsweringCode1
Anchor-based Large Language ModelsCode1
Graphusion: Leveraging Large Language Models for Scientific Knowledge Graph Fusion and Construction in NLP EducationCode1
ChiQA: A Large Scale Image-based Real-World Question Answering Dataset for Multi-Modal UnderstandingCode1
GRILLBot In Practice: Lessons and Tradeoffs Deploying Large Language Models for Adaptable Conversational Task AssistantsCode1
ChineseEcomQA: A Scalable E-commerce Concept Evaluation Benchmark for Large Language ModelsCode1
ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human PreferencesCode1
Check It Again:Progressive Visual Question Answering via Visual EntailmentCode1
DebateQA: Evaluating Question Answering on Debatable KnowledgeCode1
ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step VerificationCode1
Graphusion: A RAG Framework for Knowledge Graph Construction with a Global PerspectiveCode1
GRIT: General Robust Image Task BenchmarkCode1
ChatGPT: Jack of all trades, master of noneCode1
ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action ModelCode1
GraphNeT: Graph neural networks for neutrino telescope event reconstructionCode1
Graph Optimal Transport for Cross-Domain AlignmentCode1
ChartInstruct: Instruction Tuning for Chart Comprehension and ReasoningCode1
ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question AnsweringCode1
Graphhopper: Multi-Hop Scene Graph Reasoning for Visual Question AnsweringCode1
GraphOTTER: Evolving LLM-based Graph Reasoning for Complex Table Question AnsweringCode1
An Approach to Solving the Abstraction and Reasoning Corpus (ARC) ChallengeCode1
Characterizing Truthfulness in Large Language Model Generations with Local Intrinsic DimensionCode1
GraghVQA: Language-Guided Graph Neural Networks for Graph-based Visual Question AnsweringCode1
GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question AnsweringCode1
Show:102550
← PrevPage 24 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified