SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 24012450 of 10817 papers

TitleStatusHype
VIGNETTE: Socially Grounded Bias Evaluation for Vision-Language ModelsCode0
Agent-UniRAG: A Trainable Open-Source LLM Agent Framework for Unified Retrieval-Augmented Generation Systems0
ER-REASON: A Benchmark Dataset for LLM-Based Clinical Reasoning in the Emergency Room0
NegVQA: Can Vision Language Models Understand Negation?0
3DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Model0
Enhancing Paraphrase Type Generation: The Impact of DPO and RLHF Evaluated with Human-Ranked DataCode0
StressTest: Can YOUR Speech LM Handle the Stress?0
DynamicVL: Benchmarking Multimodal Large Language Models for Dynamic City Understanding0
FRAMES-VQA: Benchmarking Fine-Tuning Robustness across Multi-Modal Shifts in Visual Question AnsweringCode0
SOSBENCH: Benchmarking Safety Alignment on Scientific Knowledge0
Music's Multimodal Complexity in AVQA: Why We Need More than General Multimodal LLMsCode0
Silence is Not Consensus: Disrupting Agreement Bias in Multi-Agent LLMs via Catfish Agent for Clinical Decision Making0
DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving0
Understand, Think, and Answer: Advancing Visual Reasoning with Large Multimodal Models0
Rethinking Information Synthesis in Multimodal Question Answering A Multi-Agent Perspective0
Self-Reflective Planning with Knowledge Graphs: Enhancing LLM Reasoning Reliability for Question Answering0
SIPDO: Closed-Loop Prompt Optimization via Synthetic Data Feedback0
WXImpactBench: A Disruptive Weather Impact Understanding Benchmark for Evaluating Large Language ModelsCode0
CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data SynthesisCode0
GenKI: Enhancing Open-Domain Question Answering with Knowledge Integration and Controllable Generation in Large Language ModelsCode0
ALAS: Measuring Latent Speech-Text Alignment For Spoken Language Understanding In Multimodal LLMs0
Uncertainty-Aware Attention Heads: Efficient Unsupervised Uncertainty Quantification for LLMs0
BizFinBench: A Business-Driven Real-World Financial Benchmark for Evaluating LLMsCode0
MM-Prompt: Cross-Modal Prompt Tuning for Continual Visual Question AnsweringCode0
Interleaved Reasoning for Large Language Models via Reinforcement Learning0
Benchmarking Large Multimodal Models for Ophthalmic Visual Question Answering with OphthalWeChat0
ExAnte: A Benchmark for Ex-Ante Inference in Large Language ModelsCode0
Diagnosing and Mitigating Modality Interference in Multimodal Large Language ModelsCode0
Automated Text-to-Table for Reasoning-Intensive Table QA: Pipeline Design and Benchmarking InsightsCode0
It's High Time: A Survey of Temporal Information Retrieval and Question Answering0
CP-Router: An Uncertainty-Aware Router Between LLM and LRM0
S2LPP: Small-to-Large Prompt Prediction across LLMs0
DGRAG: Distributed Graph-based Retrieval-Augmented Generation in Edge-Cloud Systems0
AMQA: An Adversarial Dataset for Benchmarking Bias of LLMs in Medicine and HealthcareCode0
SpokenNativQA: Multilingual Everyday Spoken Queries for LLMs0
ActiveDPO: Active Direct Preference Optimization for Sample-Efficient Alignment0
Self-Critique Guided Iterative Reasoning for Multi-hop Question AnsweringCode0
SituatedThinker: Grounding LLM Reasoning with Real-World through Situated ThinkingCode0
Weaver: Interweaving SQL and LLM for Table Reasoning0
Medical Large Vision Language Models with Multi-Image Visual AbilityCode0
When Two LLMs Debate, Both Think They'll Win0
UNCERTAINTY-LINE: Length-Invariant Estimation of Uncertainty for Large Language Models0
GC-KBVQA: A New Four-Stage Framework for Enhancing Knowledge Based Visual Question Answering Performance0
Hypercube-RAG: Hypercube-Based Retrieval-Augmented Generation for In-domain Scientific Question-AnsweringCode0
Climate-Eval: A Comprehensive Benchmark for NLP Tasks Related to Climate Change0
BRIT: Bidirectional Retrieval over Unified Image-Text Graph0
Benchmarking Poisoning Attacks against Retrieval-Augmented Generation0
The Silent Saboteur: Imperceptible Adversarial Attacks against Black-Box Retrieval-Augmented Generation Systems0
Multilingual Question Answering in Low-Resource Settings: A Dzongkha-English Benchmark for Foundation ModelsCode0
Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understanding0
Show:102550
← PrevPage 49 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified