SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 651700 of 10817 papers

TitleStatusHype
DSPNet: Dual-vision Scene Perception for Robust 3D Question AnsweringCode1
ChineseEcomQA: A Scalable E-commerce Concept Evaluation Benchmark for Large Language ModelsCode1
FSPO: Few-Shot Preference Optimization of Synthetic Preference Data in LLMs Elicits Effective Personalization to Real UsersCode1
UQABench: Evaluating User Embedding for Prompting LLMs in Personalized Question AnsweringCode1
MM-PoisonRAG: Disrupting Multimodal RAG with Local and Global Poisoning AttacksCode1
HIPPO: Enhancing the Table Understanding Capability of Large Language Models through Hybrid-Modal Preference OptimizationCode1
KVLink: Accelerating Large Language Models via Efficient KV Cache ReuseCode1
ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action ModelCode1
How to Get Your LLM to Generate Challenging Problems for EvaluationCode1
Does Time Have Its Place? Temporal Heads: Where Language Models Recall Time-specific InformationCode1
Measuring Faithfulness of Chains of Thought by Unlearning Reasoning StepsCode1
PeerQA: A Scientific Question Answering Dataset from Peer ReviewsCode1
CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City SpaceCode1
MMXU: A Multi-Modal and Multi-X-ray Understanding Dataset for Disease ProgressionCode1
The Mirage of Model Editing: Revisiting Evaluation in the WildCode1
EgoTextVQA: Towards Egocentric Scene-Text Aware Video Question AnsweringCode1
LM2: Large Memory ModelsCode1
Mitigating Unintended Memorization with LoRA in Federated Learning for LLMsCode1
PixFoundation: Are We Heading in the Right Direction with Pixel-level Vision Foundation Models?Code1
TUMTraffic-VideoQA: A Benchmark for Unified Spatio-Temporal Video Understanding in Traffic ScenesCode1
Robust-LLaVA: On the Effectiveness of Large-Scale Robust Image Encoders for Multi-modal Large Language ModelsCode1
-Video: A Training-Free Approach to Long Video Understanding via Continuous-Time Memory ConsolidationCode1
KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree SearchCode1
o3-mini vs DeepSeek-R1: Which One is Safer?Code1
DRESSing Up LLM: Efficient Stylized Question-Answering via Style Subspace EditingCode1
InsQABench: Benchmarking Chinese Insurance Domain Question Answering with Large Language ModelsCode1
MECD+: Unlocking Event-Level Causal Graph Discovery for Video ReasoningCode1
SensorQA: A Question Answering Benchmark for Daily-Life MonitoringCode1
ECBench: Can Multi-modal Foundation Models Understand the Egocentric World? A Holistic Embodied Cognition BenchmarkCode1
VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language ModelsCode1
Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model EvaluationCode1
Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?Code1
Predicting the Performance of Black-box LLMs through Self-QueriesCode1
Notes-guided MLLM Reasoning: Enhancing MLLM with Knowledge and Visual Notes for Visual Question AnsweringCode1
Enhancing Table Recognition with Vision LLMs: A Benchmark and Neighbor-Guided Toolchain ReasonerCode1
Long Context vs. RAG for LLMs: An Evaluation and RevisitsCode1
Interacted Object Grounding in Spatio-Temporal Human-Object InteractionsCode1
Harnessing Large Language Models for Knowledge Graph Question Answering via Adaptive Multi-Aspect Retrieval-AugmentationCode1
CypherBench: Towards Precise Retrieval over Full-scale Modern Knowledge Graphs in the LLM EraCode1
LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and LocatingCode1
Property Enhanced Instruction Tuning for Multi-task Molecule Generation with Large Language ModelsCode1
Resource-Aware Arabic LLM Creation: Model Adaptation, Integration, and Multi-Domain TestingCode1
Beyond End-to-End VLMs: Leveraging Intermediate Text Representations for Superior Flowchart UnderstandingCode1
Defeasible Visual Entailment: Benchmark, Evaluator, and Reward-Driven OptimizationCode1
Knowledge Editing with Dynamic Knowledge Graphs for Multi-Hop Question AnsweringCode1
MedCoT: Medical Chain of Thought via Hierarchical ExpertCode1
EXIT: Context-Aware Extractive Compression for Enhancing Retrieval-Augmented GenerationCode1
MedMax: Mixed-Modal Instruction Tuning for Training Biomedical AssistantsCode1
SCITAT: A Question Answering Benchmark for Scientific Tables and Text Covering Diverse Reasoning TypesCode1
UAlign: Leveraging Uncertainty Estimations for Factuality Alignment on Large Language ModelsCode1
Show:102550
← PrevPage 14 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified