SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 601650 of 10817 papers

TitleStatusHype
AGI-Elo: How Far Are We From Mastering A Task?Code1
MedAgentBoard: Benchmarking Multi-Agent Collaboration with Conventional Methods for Diverse Medical TasksCode1
LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text InterpretationCode1
MatTools: Benchmarking Large Language Models for Materials Science ToolsCode1
Ranked Voting based Self-Consistency of Large Language ModelsCode1
mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge GraphsCode1
Efficient and Reproducible Biomedical Question Answering using Retrieval Augmented GenerationCode1
ReCDAP: Relation-Based Conditional Diffusion with Attention Pooling for Few-Shot Knowledge Graph CompletionCode1
Kalman Filter Enhanced GRPO for Reinforcement Learning-Based Language Model ReasoningCode1
DocVXQA: Context-Aware Visual Explanations for Document Question AnsweringCode1
BioProBench: Comprehensive Dataset and Benchmark in Biological Protocol Understanding and ReasoningCode1
SmartPilot: A Multiagent CoPilot for Adaptive and Intelligent ManufacturingCode1
MM-Skin: Enhancing Dermatology Vision-Language Model with an Image-Text Dataset Derived from TextbooksCode1
IndicSQuAD: A Comprehensive Multilingual Question Answering Dataset for Indic LanguagesCode1
Invoke Interfaces Only When Needed: Adaptive Invocation for Large Language Models in Question AnsweringCode1
RTV-Bench: Benchmarking MLLM Continuous Perception, Understanding and Reasoning through Real-Time VideoCode1
UniBiomed: A Universal Foundation Model for Grounded Biomedical Image InterpretationCode1
ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step VerificationCode1
TreeHop: Generate and Filter Next Query Embeddings Efficiently for Multi-hop Question AnsweringCode1
VideoMultiAgents: A Multi-Agent Framework for Video Question AnsweringCode1
Benchmarking Multimodal Mathematical Reasoning with Explicit Visual DependencyCode1
Survey of Video Diffusion Models: Foundations, Implementations, and ApplicationsCode1
Walk the Talk? Measuring the Faithfulness of Large Language Model ExplanationsCode1
Learning to Attribute with AttentionCode1
ReasonDrive: Efficient Visual Question Answering for Autonomous Vehicles with Reasoning-Enhanced Small Vision-Language ModelsCode1
A Survey on Efficient Vision-Language ModelsCode1
LMM4LMM: Benchmarking and Evaluating Large-multimodal Image Generation with LMMsCode1
MRD-RAG: Enhancing Medical Diagnosis with Multi-Round Retrieval-Augmented GenerationCode1
Collab-RAG: Boosting Retrieval-Augmented Generation for Complex Question Answering via White-Box and Black-Box LLM CollaborationCode1
ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question AnsweringCode1
SARLANG-1M: A Benchmark for Vision-Language Modeling in SAR Image UnderstandingCode1
Single-Pass Document Scanning for Question AnsweringCode1
STING-BEE: Towards Vision-Language Model for Real-World X-ray Baggage Security InspectionCode1
GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical ReasoningCode1
RefChartQA: Grounding Visual Answer on Chart Images through Instruction TuningCode1
EgoToM: Benchmarking Theory of Mind Reasoning from Egocentric VideosCode1
FaceBench: A Multi-View Multi-Level Facial Attribute VQA Dataset for Benchmarking Face Perception MLLMsCode1
Fine-Grained Evaluation of Large Vision-Language Models in Autonomous DrivingCode1
ReaRAG: Knowledge-guided Reasoning Enhances Factuality of Large Reasoning Models with Iterative Retrieval Augmented GenerationCode1
PAVE: Patching and Adapting Video Large Language ModelsCode1
Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language ModelsCode1
MTBench: A Multimodal Time Series Benchmark for Temporal Reasoning and Question AnsweringCode1
Agentic Keyframe Search for Video Question AnsweringCode1
Optimizing Retrieval Strategies for Financial Question Answering Documents in Retrieval-Augmented Generation SystemsCode1
MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific ResearchCode1
Omnia de EgoTempo: Benchmarking Temporal Understanding of Multi-Modal LLMs in Egocentric VideosCode1
NuPlanQA: A Large-Scale Dataset and Benchmark for Multi-View Driving Scene Understanding in Multi-Modal Large Language ModelsCode1
How Do Multimodal Large Language Models Handle Complex Multimodal Reasoning? Placing Them in An Extensible Escape GameCode1
Question-Aware Gaussian Experts for Audio-Visual Question AnsweringCode1
Cross-modal Causal Relation Alignment for Video Question GroundingCode1
Show:102550
← PrevPage 13 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified