SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 12011250 of 10817 papers

TitleStatusHype
FFA Sora, video generation as fundus fluorescein angiography simulator0
VidCtx: Context-aware Video Question Answering with Image ModelsCode0
Multimodal Preference Data Synthetic Alignment with Reward ModelCode0
Evaluating LLM Reasoning in the Operations Research Domain with ORQACode2
MINTQA: A Multi-Hop Question Answering Benchmark for Evaluating LLMs on New and Tail KnowledgeCode0
FriendsQA: A New Large-Scale Deep Video Understanding Dataset with Fine-grained Topic Categorization for Story VideosCode0
Prompting Large Language Models with Rationale Heuristics for Knowledge-based Visual Question Answering0
Beyond End-to-End VLMs: Leveraging Intermediate Text Representations for Superior Flowchart UnderstandingCode1
Application of Multimodal Large Language Models in Autonomous Driving0
DragonVerseQA: Open-Domain Long-Form Context-Aware Question-AnsweringCode0
Automated CVE Analysis: Harnessing Machine Learning In Designing Question-Answering Models For Cybersecurity Information Extraction0
SilVar: Speech Driven Multimodal Model for Reasoning Visual Question Answering and Object LocalizationCode0
STAMPsy: Towards SpatioTemporal-Aware Mixed-Type Dialogues for Psychological Counseling0
Speech Retrieval-Augmented Generation without Automatic Speech Recognition0
Contrastive Learning for Task-Independent SpeechLLM-PretrainingCode0
MRAG: A Modular Retrieval Framework for Time-Sensitive Question Answering0
PolySmart @ TRECVid 2024 Medical Video Question Answering0
HybGRAG: Hybrid Retrieval-Augmented Generation on Textual and Relational Knowledge Bases0
Logical Consistency of Large Language Models in Fact-checking0
NGQA: A Nutritional Graph Question Answering Benchmark for Personalized Health-aware Nutritional Reasoning0
Defeasible Visual Entailment: Benchmark, Evaluator, and Reward-Driven OptimizationCode1
Review-Then-Refine: A Dynamic Framework for Multi-Hop Question Answering with Temporal Adaptability0
Multimodal Hypothetical Summary for Retrieval-based Multi-image Question AnsweringCode0
Query pipeline optimization for cancer patient question answering systems0
GraphEQA: Using 3D Semantic Scene Graphs for Real-time Embodied Question Answering0
Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMs0
AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous DrivingCode2
CodeRepoQA: A Large-scale Benchmark for Software Engineering Question AnsweringCode0
FedPIA -- Permuting and Integrating Adapters leveraging Wasserstein Barycenters for Finetuning Foundation Models in Multi-Modal Federated Learning0
Unveiling Uncertainty: A Deep Dive into Calibration and Performance of Multimodal Large Language ModelsCode0
FiVL: A Framework for Improved Vision-Language AlignmentCode0
EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues0
Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall SpacesCode4
RACQUET: Unveiling the Dangers of Overlooked Referential Ambiguity in Visual LLMsCode0
CAD-Recode: Reverse Engineering CAD Code from Point CloudsCode3
A Cognitive Ideation Support Framework using IBM Watson Services0
MedCoT: Medical Chain of Thought via Hierarchical ExpertCode1
Multi-OphthaLingua: A Multilingual Benchmark for Assessing and Debiasing LLM Ophthalmological QA in LMICs0
Consistency of Compositional Generalization across Multiple LevelsCode0
Knowledge Editing with Dynamic Knowledge Graphs for Multi-Hop Question AnsweringCode1
A Concept-Centric Approach to Multi-Modality Learning0
ARTEMIS-DA: An Advanced Reasoning and Transformation Engine for Multi-Step Insight Synthesis in Data Analytics0
Knowledge Graphs: The Future of Data Integration and Insightful Discovery0
SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented GenerationCode2
On the Structural Memory of LLM AgentsCode0
Question: How do Large Language Models perform on the Question Answering tasks? Answer:0
LLM-based Discriminative Reasoning for Knowledge Graph Question Answering0
Modality-Inconsistent Continual Learning of Multimodal Large Language Models0
Track the Answer: Extending TextVQA from Image to Video with Spatio-Temporal CluesCode0
When to Speak, When to Abstain: Contrastive Decoding with Abstention0
Show:102550
← PrevPage 25 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified