SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 26012650 of 10817 papers

TitleStatusHype
VLM Q-Learning: Aligning Vision-Language Models for Interactive Decision-Making0
Sim2Real Transfer for Vision-Based Grasp VerificationCode0
Structure Causal Models and LLMs Integration in Medical Visual Question Answering0
Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networks0
Compositional Image-Text Matching and Retrieval by Grounding EntitiesCode0
OODTE: A Differential Testing Engine for the ONNX Optimizer0
Knowledge-Augmented Language Models Interpreting Structured Chest X-Ray Findings0
Adaptive Token Boundaries: Integrating Human Chunking Mechanisms into Multimodal LLMs0
TRAVELER: A Benchmark for Evaluating Temporal Reasoning across Vague, Implicit and Explicit References0
Transferable Adversarial Attacks on Black-Box Vision-Language Models0
Grounding Task Assistance with Multimodal Cues from a Single Demonstration0
Beyond Attention: Toward Machines with Intrinsic Higher Mental States0
Unlearning Sensitive Information in Multimodal LLMs: Benchmark and Attack-Defense EvaluationCode0
CSE-SFP: Enabling Unsupervised Sentence Representation Learning via a Single Forward Pass0
HalluMix: A Task-Agnostic, Multi-Domain Benchmark for Real-World Hallucination Detection0
AdCare-VLM: Leveraging Large Vision Language Model (LVLM) to Monitor Long-Term Medication Adherence and CareCode0
Talk Before You Retrieve: Agent-Led Discussions for Better RAG in Medical QACode0
Calibrating Uncertainty Quantification of Multi-Modal LLMs using Grounding0
ConSens: Assessing context grounding in open-book question answering0
Zoomer: Adaptive Image Focus Optimization for Black-box MLLM0
LMME3DHF: Benchmarking and Evaluating Multimodal 3D Human Face Generation with LMMs0
SetKE: Knowledge Editing for Knowledge Elements Overlap0
LLM Enhancer: Merged Approach using Vector Embedding for Reducing Large Language Model Hallucinations with External Knowledge0
m-KAILIN: Knowledge-Driven Agentic Scientific Corpus Distillation Framework for Biomedical Large Language Models Training0
Toward Evaluative Thinking: Meta Policy Optimization with Evolving Reward ModelsCode0
OpenTCM: A GraphRAG-Empowered LLM-based System for Traditional Chinese Medicine Knowledge Retrieval and Diagnosis0
Knowledge Distillation of Domain-adapted LLMs for Question-Answering in Telecom0
SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning0
Test It Before You Trust It: Applying Software Testing for Trustworthy In-context LearningCode0
An Empirical Study of Evaluating Long-form Question AnsweringCode0
Pushing the boundary on Natural Language Inference0
A Comprehensive Survey of Knowledge-Based Vision Question Answering Systems: The Lifecycle of Knowledge in Visual Reasoning Task0
Data-Driven Calibration of Prediction Sets in Large Vision-Language Models Based on Inductive Conformal Prediction0
TraveLLaMA: Facilitating Multi-modal Large Language Models to Understand Urban Scenes and Provide Travel Assistance0
FinDER: Financial Dataset for Question Answering and Evaluating Retrieval-Augmented Generation0
Towards Understanding Camera Motions in Any Video0
Efficient Document Retrieval with G-RetrieverCode0
The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models0
Are Vision LLMs Road-Ready? A Comprehensive Benchmark for Safety-Critical Driving Video UnderstandingCode0
FairSteer: Inference Time Debiasing for LLMs with Dynamic Activation Steering0
A Hierarchical Framework for Measuring Scientific Paper Innovation via Large Language Models0
FinSage: A Multi-aspect RAG System for Financial Filings Question Answering0
Neglected Risks: The Disturbing Reality of Children's Images in Datasets and the Urgent Call for Accountability0
CoLoTa: A Dataset for Entity-based Commonsense Reasoning over Long-Tail Knowledge0
SConU: Selective Conformal Uncertainty in Large Language Models0
Bottom-Up Synthesis of Knowledge-Grounded Task-Oriented Dialogues with Iteratively Self-Refined Prompts0
LegalRAG: A Hybrid RAG System for Multilingual Legal Information Retrieval0
Long-context Non-factoid Question Answering in Indic LanguagesCode0
ChartQA-X: Generating Explanations for Charts0
WebLists: Extracting Structured Information From Complex Interactive Websites Using Executable LLM Agents0
Show:102550
← PrevPage 53 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified