SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 101150 of 10817 papers

TitleStatusHype
WIP: Large Language Model-Enhanced Smart Tutor for Undergraduate Circuit Analysis0
mSTEB: Massively Multilingual Evaluation of LLMs on Speech and Text Tasks0
Looking Beyond Visible Cues: Implicit Video Question Answering via Dual-Clue ReasoningCode0
MEMOIR: Lifelong Model Editing with Minimal Overwrite and Informed Retention for LLMs0
Aligning Text, Images, and 3D Structure Token-by-Token0
HAIBU-ReMUD: Reasoning Multimodal Ultrasound Dataset and Model Bridging to General Specific DomainsCode0
Federated In-Context Learning: Iterative Refinement for Improved Answer Quality0
Cognitive Weave: Synthesizing Abstracted Knowledge with a Spatio-Temporal Resonance GraphCode0
ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving0
LEANN: A Low-Storage Vector Index0
Hallucination at a Glance: Controlled Visual Edits and Fine-Grained Multimodal Learning0
Learning to Clarify by Reinforcement Learning Through Reward-Weighted Fine-Tuning0
Multi-Step Visual Reasoning with Visual Tokens Scaling and VerificationCode1
Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning0
The State-of-the-Art in Lifelog Retrieval: A Review of Progress at the ACM Lifelog Search Challenge Workshop 2022-240
Meta-Adaptive Prompt Distillation for Few-Shot Visual Question Answering0
MAPLE: Multi-Agent Adaptive Planning with Long-Term Memory for Table Reasoning0
BioMol-MQA: A Multi-Modal Question Answering Dataset For LLM Reasoning Over Bio-Molecular Interactions0
Towards Efficient Multi-LLM Inference: Characterization and Analysis of LLM Routing and Hierarchical Techniques0
DynamicMind: A Tri-Mode Thinking System for Large Language Models0
TextVidBench: A Benchmark for Long Video Scene Text Understanding0
Does Your 3D Encoder Really Work? When Pretrain-SFT from 2D VLMs Meets 3D VLMs0
Ontology-based knowledge representation for bone disease diagnosis: a foundation for safe and sustainable medical artificial intelligence systems0
ECoRAG: Evidentiality-guided Compression for Long Context RAGCode1
Micro-Act: Mitigate Knowledge Conflict in Question Answering via Actionable Self-ReasoningCode0
Multiple-Choice Question Generation Using Large Language Models: Methodology and Educator Insights0
Plugging Schema Graph into Multi-Table QA: A Human-Guided Framework for Reducing LLM Reliance0
Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model0
ReXVQA: A Large-scale Visual Question Answering Benchmark for Generalist Chest X-ray Understanding0
A Multi-Agent Framework for Mitigating Dialect Biases in Privacy Policy Question-Answering Systems0
OThink-R1: Intrinsic Fast/Slow Thinking Mode Switching for Over-Reasoning MitigationCode1
FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure ModesCode0
EgoVLM: Policy Optimization for Egocentric Video UnderstandingCode0
Hanfu-Bench: A Multimodal Benchmark on Cross-Temporal Cultural Understanding and Transcreation0
iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering0
ExpertLongBench: Benchmarking Language Models on Expert-Level Long-Form Generation Tasks with Structured Checklists0
Learning Sparsity for Effective and Efficient Music Performance Question Answering0
Reasoning-Table: Exploring Reinforcement Learning for Table ReasoningCode2
Parameter Efficient Fine Tuning Llama 3.1 for Answering Arabic Legal Questions: A Case Study on Jordanian LawsCode0
anyECG-chat: A Generalist ECG-MLLM for Flexible ECG Input and Multi-Task Understanding0
Fast or Slow? Integrating Fast Intuition and Deliberate Thinking for Enhancing Visual Question Answering0
Dynamic Chunking and Selection for Reading Comprehension of Ultra-Long Context in Large Language ModelsCode0
A Graph-Retrieval-Augmented Generation Framework Enhances Decision-Making in the Circular Economy0
Probing the Geometry of Truth: Consistency and Generalization of Truth Directions in LLMs Across Logical Transformations and Question Answering TasksCode0
PAKTON: A Multi-Agent Framework for Question Answering in Long Legal AgreementsCode1
MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility0
LaMP-QA: A Benchmark for Personalized Long-form Question Answering0
ClinBench-HPB: A Clinical Benchmark for Evaluating LLMs in Hepato-Pancreato-Biliary Diseases0
VUDG: A Dataset for Video Understanding Domain Generalization0
Pangu DeepDiver: Adaptive Search Intensity Scaling via Open-Web Reinforcement Learning0
Show:102550
← PrevPage 3 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified