SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 251300 of 10817 papers

TitleStatusHype
CXReasonBench: A Benchmark for Evaluating Structured Diagnostic Reasoning in Chest X-raysCode0
PPT: A Process-based Preference Learning Framework for Self Improving Table Question Answering Models0
FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domain0
Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understanding0
QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement LearningCode4
VEAttack: Downstream-agnostic Vision Encoder Attack against Large Vision Language ModelsCode1
DanmakuTPPBench: A Multi-modal Benchmark for Temporal Point Process Modeling and UnderstandingCode2
MetaGen Blended RAG: Higher Accuracy for Domain-Specific Q&A Without Fine-TuningCode1
PerMedCQA: Benchmarking Large Language Models on Medical Consumer Question Answering in Persian Language0
Task Specific Pruning with LLM-Sieve: How Many Parameters Does Your Task Really Need?0
Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models0
EarthSE: A Benchmark Evaluating Earth Scientific Exploration Capability for Large Language Models0
VoxRAG: A Step Toward Transcription-Free RAG Systems in Spoken Question Answering0
Mitigating Hallucinations in Vision-Language Models through Image-Guided Head SuppressionCode1
CUB: Benchmarking Context Utilisation Techniques for Language Models0
O^2-Searcher: A Searching-based Agent Model for Open-Domain Open-Ended Question AnsweringCode1
Augmenting LLM Reasoning with Dynamic Notes Writing for Complex QA0
Tools in the Loop: Quantifying Uncertainty of LLM Question Answering Systems That Use Tools0
Are the Hidden States Hiding Something? Testing the Limits of Factuality-Encoding Capabilities in LLMs0
Evaluating Large Language Model with Knowledge Oriented Language Specific Simple Question AnsweringCode0
Benchmarking Retrieval-Augmented Multimomal Generation for Document Question AnsweringCode1
Teaching Large Language Models to Maintain Contextual Faithfulness via Synthetic Tasks and Reinforcement LearningCode1
Continually Self-Improving Language Models for Bariatric Surgery Question--Answering0
CT-Agent: A Multimodal-LLM Agent for 3D CT Radiology Question Answering0
Collaboration among Multiple Large Language Models for Medical Question Answering0
Seeing Far and Clearly: Mitigating Hallucinations in MLLMs with Attention Causal Decoding0
Steering LVLMs via Sparse Autoencoder for Hallucination Mitigation0
A Causal Approach to Mitigate Modality Preference Bias in Medical Visual Question Answering0
UNCLE: Uncertainty Expressions in Long-Form Generation0
Zero-Shot Anomaly Detection in Battery Thermal Images Using Visual Question Answering with Prior Knowledge0
Grounding Chest X-Ray Visual Question Answering with Generated Radiology Reports0
SpatialScore: Towards Unified Evaluation for Multimodal Spatial UnderstandingCode2
Human-centered Interactive Learning via MLLMs for Text-to-Image Person Re-identification0
RAVEN: Query-Guided Representation Alignment for Question Answering over Audio, Video, Embedded Sensors, and Natural LanguageCode0
ViQAgent: Zero-Shot Video Question Answering via Agent with Open-Vocabulary Grounding ValidationCode0
BR-TaxQA-R: A Dataset for Question Answering with References for Brazilian Personal Income Tax Law, including case law0
CRAFT: Training-Free Cascaded Retrieval for Tabular QA0
Towards Spoken Mathematical Reasoning: Benchmarking Speech-based Models over Multi-faceted Math Problems0
Leveraging Online Data to Enhance Medical Knowledge in a Small Persian Language ModelCode0
Improving LLM First-Token Predictions in Multiple-Choice Question Answering via Prefilling Attack0
Keep Security! Benchmarking Security Policy Preservation in Large Language Model Contexts Against Indirect Attacks in Question AnsweringCode0
HopWeaver: Synthesizing Authentic Multi-Hop Questions Across Text CorporaCode1
UrduFactCheck: An Agentic Fact-Checking Framework for Urdu with Evidence Boosting and BenchmarkingCode0
KaFT: Knowledge-aware Fine-tuning for Boosting LLMs' Domain-specific Question-Answering Performance0
SNAP: A Benchmark for Testing the Effects of Capture Conditions on Fundamental Vision TasksCode0
The Atlas of In-Context Learning: How Attention Heads Shape In-Context Retrieval AugmentationCode1
ChartCards: A Chart-Metadata Generation Framework for Multi-Task Chart UnderstandingCode0
Traveling Across Languages: Benchmarking Cross-Lingual Consistency in Multimodal LLMsCode0
Set-LLM: A Permutation-Invariant LLM0
From Problem-Solving to Teaching Problem-Solving: Aligning LLMs with Pedagogy using Reinforcement LearningCode1
Show:102550
← PrevPage 6 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified