SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 23012350 of 10817 papers

TitleStatusHype
Can We Infer Confidential Properties of Training Data from LLMs?0
SlotPi: Physics-informed Object-centric Reasoning ModelsCode0
MedSeg-R: Reasoning Segmentation in Medical Images with Multimodal Large Language Models0
Monitoring Decomposition Attacks in LLMs with Lightweight Sequential MonitorsCode0
Think before You Simulate: Symbolic Reasoning to Orchestrate Neural Computation for Counterfactual Question AnsweringCode0
HalLoc: Token-level Localization of Hallucinations for Vision Language ModelsCode0
VRBench: A Benchmark for Multi-Step Reasoning in Long Narrative Videos0
Specification and Evaluation of Multi-Agent LLM Systems -- Prototype and Cybersecurity ApplicationsCode0
AC/DC: LLM-based Audio Comprehension via Dialogue Continuation0
EQA-RM: A Generative Embodied Reward Model with Test-time ScalingCode0
CogStream: Context-guided Streaming Video Question Answering0
Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question AnsweringCode0
CheckManual: A New Challenge and Benchmark for Manual-based Appliance Manipulation0
ChartReasoner: Code-Driven Modality Bridging for Long-Chain Reasoning in Chart Question Answering0
OmniDRCA: Parallel Speech-Text Foundation Model via Dual-Resolution Speech Representations and Contrastive AlignmentCode0
Bridging the Gap Between Open-Source and Proprietary LLMs in Table QACode0
Provoking Multi-modal Few-Shot LVLM via Exploration-Exploitation In-Context Learning0
Kvasir-VQA-x1: A Multimodal Dataset for Medical Reasoning and Robust MedVQA in Gastrointestinal EndoscopyCode0
Outside Knowledge Conversational Video (OKCV) Dataset -- Dialoguing over VideosCode0
Med-REFL: Medical Reasoning Enhancement via Self-Corrected Fine-grained ReflectionCode0
Efficient Context Selection for Long-Context QA: No Tuning, No Iteration, Just Adaptive-k0
An Open-Source Software Toolkit & Benchmark Suite for the Evaluation and Adaptation of Multimodal Action Models0
PhyBlock: A Progressive Benchmark for Physical Understanding and Planning via 3D Block Assembly0
WIP: Large Language Model-Enhanced Smart Tutor for Undergraduate Circuit Analysis0
mSTEB: Massively Multilingual Evaluation of LLMs on Speech and Text Tasks0
Improved LLM Agents for Financial Document Question Answering0
VersaVid-R1: A Versatile Video Understanding and Reasoning Model from Question Answering to Captioning Tasks0
Aligning Text, Images, and 3D Structure Token-by-Token0
HAIBU-ReMUD: Reasoning Multimodal Ultrasound Dataset and Model Bridging to General Specific DomainsCode0
Looking Beyond Visible Cues: Implicit Video Question Answering via Dual-Clue ReasoningCode0
LEANN: A Low-Storage Vector Index0
Federated In-Context Learning: Iterative Refinement for Improved Answer Quality0
MEMOIR: Lifelong Model Editing with Minimal Overwrite and Informed Retention for LLMs0
ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving0
Cognitive Weave: Synthesizing Abstracted Knowledge with a Spatio-Temporal Resonance GraphCode0
Learning to Clarify by Reinforcement Learning Through Reward-Weighted Fine-Tuning0
Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning0
Hallucination at a Glance: Controlled Visual Edits and Fine-Grained Multimodal Learning0
The State-of-the-Art in Lifelog Retrieval: A Review of Progress at the ACM Lifelog Search Challenge Workshop 2022-240
Meta-Adaptive Prompt Distillation for Few-Shot Visual Question Answering0
Towards Efficient Multi-LLM Inference: Characterization and Analysis of LLM Routing and Hierarchical Techniques0
BioMol-MQA: A Multi-Modal Question Answering Dataset For LLM Reasoning Over Bio-Molecular Interactions0
DynamicMind: A Tri-Mode Thinking System for Large Language Models0
MAPLE: Multi-Agent Adaptive Planning with Long-Term Memory for Table Reasoning0
Micro-Act: Mitigate Knowledge Conflict in Question Answering via Actionable Self-ReasoningCode0
Does Your 3D Encoder Really Work? When Pretrain-SFT from 2D VLMs Meets 3D VLMs0
Ontology-based knowledge representation for bone disease diagnosis: a foundation for safe and sustainable medical artificial intelligence systems0
Multiple-Choice Question Generation Using Large Language Models: Methodology and Educator Insights0
TextVidBench: A Benchmark for Long Video Scene Text Understanding0
Plugging Schema Graph into Multi-Table QA: A Human-Guided Framework for Reducing LLM Reliance0
Show:102550
← PrevPage 47 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified