SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 401450 of 10817 papers

TitleStatusHype
Relative Overfitting and Accept-Reject Framework0
PLHF: Prompt Optimization with Few-Shot Human Feedback0
BioProBench: Comprehensive Dataset and Benchmark in Biological Protocol Understanding and ReasoningCode1
Overview of the NLPCC 2025 Shared Task 4: Multi-modal, Multilingual, and Multi-hop Medical Instructional Video Question Answering Challenge0
Building a Human-Verified Clinical Reasoning Dataset via a Human LLM Hybrid Pipeline for Trustworthy Medical AI0
Multi-Modal Explainable Medical AI Assistant for Trustworthy Human-AI Collaboration0
OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrieval0
SmartPilot: A Multiagent CoPilot for Adaptive and Intelligent ManufacturingCode1
CellVerse: Do Large Language Models Really Understand Cell Biology?0
Towards Developmentally Plausible Rewards: Communicative Success as a Learning Signal for Interactive Language Models0
A Grounded Memory System For Smart Personal Assistants0
Natural Reflection Backdoor Attack on Vision Language Model for Autonomous Driving0
NeoQA: Evidence-based Question Answering with Generated News EventsCode0
Document Attribution: Examining Citation Relationships using Large Language Models0
MM-Skin: Enhancing Dermatology Vision-Language Model with an Image-Text Dataset Derived from TextbooksCode1
Assessing Robustness to Spurious Correlations in Post-Training Language Models0
Healthy LLMs? Benchmarking LLM Knowledge of UK Government Public Health Information0
Continuous Thought MachinesCode5
Lost in OCR Translation? Vision-Based Approaches to Robust Document Retrieval0
Probabilistic Embeddings for Frozen Vision-Language Models: Uncertainty Quantification with Gaussian Process Latent Variable ModelsCode0
LiTransProQA: an LLM-based Literary Translation evaluation metric with Professional Question AnsweringCode0
An Open-Source Dual-Loss Embedding Model for Semantic Retrieval in Higher Education0
SITE: towards Spatial Intelligence Thorough Evaluation0
Q-Heart: ECG Question Answering via Knowledge-Informed Multimodal LLMs0
HiPerRAG: High-Performance Retrieval Augmented Generation for Scientific Insights0
Fine-Tuning Large Language Models and Evaluating Retrieval Methods for Improved Question Answering on Building Codes0
EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement LearningCode2
A Reasoning-Focused Legal Retrieval Benchmark0
Characterising Topic Familiarity and Query Specificity Using Eye-Tracking DataCode0
VLM Q-Learning: Aligning Vision-Language Models for Interactive Decision-Making0
IndicSQuAD: A Comprehensive Multilingual Question Answering Dataset for Indic LanguagesCode1
DyGEnc: Encoding a Sequence of Textual Scene Graphs to Reason and Answer Questions in Dynamic ScenesCode0
VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language ModelCode4
MedArabiQ: Benchmarking Large Language Models on Arabic Medical TasksCode0
Invoke Interfaces Only When Needed: Adaptive Invocation for Large Language Models in Question AnsweringCode1
Sim2Real Transfer for Vision-Based Grasp VerificationCode0
Structure Causal Models and LLMs Integration in Medical Visual Question Answering0
Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networks0
LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech SynthesisCode3
Compositional Image-Text Matching and Retrieval by Grounding EntitiesCode0
RTV-Bench: Benchmarking MLLM Continuous Perception, Understanding and Reasoning through Real-Time VideoCode1
Adaptive Token Boundaries: Integrating Human Chunking Mechanisms into Multimodal LLMs0
Knowledge-Augmented Language Models Interpreting Structured Chest X-Ray Findings0
OODTE: A Differential Testing Engine for the ONNX Optimizer0
Beyond Attention: Toward Machines with Intrinsic Higher Mental States0
TRAVELER: A Benchmark for Evaluating Temporal Reasoning across Vague, Implicit and Explicit References0
Transferable Adversarial Attacks on Black-Box Vision-Language Models0
Grounding Task Assistance with Multimodal Cues from a Single Demonstration0
AdCare-VLM: Leveraging Large Vision Language Model (LVLM) to Monitor Long-Term Medication Adherence and CareCode0
CSE-SFP: Enabling Unsupervised Sentence Representation Learning via a Single Forward Pass0
Show:102550
← PrevPage 9 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified