SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2351–2400 of 10817 papers

TitleStatusHype
ReXVQA: A Large-scale Visual Question Answering Benchmark for Generalist Chest X-ray Understanding—0
Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model—0
EgoVLM: Policy Optimization for Egocentric Video UnderstandingCode0
FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure ModesCode0
A Multi-Agent Framework for Mitigating Dialect Biases in Privacy Policy Question-Answering Systems—0
Hanfu-Bench: A Multimodal Benchmark on Cross-Temporal Cultural Understanding and Transcreation—0
iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering—0
ExpertLongBench: Benchmarking Language Models on Expert-Level Long-Form Generation Tasks with Structured Checklists—0
Learning Sparsity for Effective and Efficient Music Performance Question Answering—0
Parameter Efficient Fine Tuning Llama 3.1 for Answering Arabic Legal Questions: A Case Study on Jordanian LawsCode0
Fast or Slow? Integrating Fast Intuition and Deliberate Thinking for Enhancing Visual Question Answering—0
anyECG-chat: A Generalist ECG-MLLM for Flexible ECG Input and Multi-Task Understanding—0
Dynamic Chunking and Selection for Reading Comprehension of Ultra-Long Context in Large Language ModelsCode0
A Graph-Retrieval-Augmented Generation Framework Enhances Decision-Making in the Circular Economy—0
Probing the Geometry of Truth: Consistency and Generalization of Truth Directions in LLMs Across Logical Transformations and Question Answering TasksCode0
MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility—0
A Simple Linear Patch Revives Layer-Pruned Large Language Models—0
ClinBench-HPB: A Clinical Benchmark for Evaluating LLMs in Hepato-Pancreato-Biliary Diseases—0
Exploring the Impact of Occupational Personas on Domain-Specific QA—0
Drop Dropout on Single-Epoch Language Model PretrainingCode0
Revisiting Epistemic Markers in Confidence Estimation: Can Markers Accurately Reflect Large Language Models' Uncertainty?Code0
Vision LLMs Are Bad at Hierarchical Visual Understanding, and LLMs Are the Bottleneck—0
Improving Reliability and Explainability of Medical Question Answering through Atomic Fact Checking in Retrieval-Augmented LLMs—0
Grid-LOGAT: Grid Based Local and Global Area Transcription for Video Question Answering—0
Light as Deception: GPT-driven Natural Relighting Against Vision-Language Pre-training Models—0
Pangu DeepDiver: Adaptive Search Intensity Scaling via Open-Web Reinforcement Learning—0
LGAR: Zero-Shot LLM-Guided Neural Ranking for Abstract Screening in Systematic Literature ReviewsCode0
LaMP-QA: A Benchmark for Personalized Long-form Question Answering—0
VUDG: A Dataset for Video Understanding Domain Generalization—0
Differential Information: An Information-Theoretic Perspective on Preference Optimization—0
Spoken question answering for visual queries—0
ChartMind: A Comprehensive Benchmark for Complex Real-world Multimodal Chart Question Answering—0
MedPAIR: Measuring Physicians and AI Relevance Alignment in Medical Question Answering—0
Synthetic Document Question Answering in HungarianCode0
TCM-Ladder: A Benchmark for Multimodal Question Answering on Traditional Chinese Medicine—0
Fortune: Formula-Driven Reinforcement Learning for Symbolic Table Reasoning in Language Models—0
QLIP: A Dynamic Quadtree Vision Prior Enhances MLLM Performance Without RetrainingCode0
mRAG: Elucidating the Design Space of Multi-modal Retrieval-Augmented Generation—0
Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarking—0
Multi-Sourced Compositional Generalization in Visual Question AnsweringCode0
Let's Reason Formally: Natural-Formal Hybrid Reasoning Enhances LLM's Math Capability—0
Data-efficient Meta-models for Evaluation of Context-based Questions and Answers in LLMs—0
From Chat Logs to Collective Insights: Aggregative Question Answering—0
VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC VideosCode0
Reinforcement Learning for Better Verbalized Confidence in Long-Form Generation—0
Climate Finance BenchCode0
Read Your Own Mind: Reasoning Helps Surface Self-Confidence Signals in LLMs—0
Improving QA Efficiency with DistilBERT: Fine-Tuning and Inference on mobile Intel CPUs—0
Agent-UniRAG: A Trainable Open-Source LLM Agent Framework for Unified Retrieval-Augmented Generation Systems—0
StressTest: Can YOUR Speech LM Handle the Stress?—0
Show:102550
← PrevPage 48 of 217Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified