SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 33513400 of 10817 papers

TitleStatusHype
AlignFormer: Modality Matching Can Achieve Better Zero-shot Instruction-Following Speech-LLM0
Eyes on the Road: State-of-the-Art Video Question Answering Models Assessment for Traffic Monitoring TasksCode0
SEAL: Semantic Attention Learning for Long Video Representation0
Unlocking Video-LLM via Agent-of-Thoughts Distillation0
Medchain: Bridging the Gap Between LLM Agents and Clinical Practice through Interactive Sequential Benchmarking0
Understanding the World's Museums through Vision-Language ReasoningCode0
Mastering Board Games by External and Internal Planning with Language Models0
Uhura: A Benchmark for Evaluating Scientific Question Answering and Truthfulness in Low-Resource African Languages0
KnowledgePrompts: Exploring the Abilities of Large Language Models to Solve Proportional Analogies via Knowledge-Enhanced PromptingCode0
Learn to Unlearn: Meta-Learning-Based Knowledge Graph Embedding Unlearning0
Generative Language Models Potential for Requirement Engineering Applications: Insights into Current Strengths and Limitations0
Improving Vietnamese Legal Document Retrieval using Synthetic Data0
DynRank: Improving Passage Retrieval with Dynamic Zero-Shot Prompting Based on Question Classification0
Perception Test 2024: Challenge Summary and a Novel Hour-Long VideoQA Benchmark0
Actions and Objects Pathways for Domain Adaptation in Video Question Answering0
SURE-VQA: Systematic Understanding of Robustness Evaluation in Medical VQA TasksCode0
STEP: Enhancing Video-LLMs' Compositional Reasoning by Spatio-Temporal Graph-guided Self-Training0
Unimib Assistant: designing a student-friendly RAG-based chatbot for all their needs0
DLaVA: Document Language and Vision Assistant for Answer Localization with Enhanced Interpretability and TrustworthinessCode0
TQA-Bench: Evaluating LLMs for Multi-Table Question Answering with Scalable Context and Symbolic ExtensionCode0
COLD: Causal reasOning in cLosed Daily activitiesCode0
Beyond Logit Lens: Contextual Embeddings for Robust Hallucination Detection & Grounding in VLMs0
DIESEL -- Dynamic Inference-Guidance via Evasion of Semantic Embeddings in LLMs0
Sparse Attention Vectors: Generative Multimodal Model Features Are Discriminative Vision-Language Classifiers0
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation0
Can bidirectional encoder become the ultimate winner for downstream applications of foundation models?0
Active Data Curation Effectively Distills Large-Scale Multimodal Models0
ElectroVizQA: How well do Multi-modal LLMs perform in Electronics Visual Question Answering?0
DRS: Deep Question Reformulation With Structured OutputCode0
3D Scene Graph Guided Vision-Language Pre-training0
GeneQuery: A General QA-based Framework for Spatial Gene Expression Predictions from Histology ImagesCode0
Overview of TREC 2024 Biomedical Generative Retrieval (BioGen) Track0
HyperGLM: HyperGraph for Video Scene Graph Generation and Anticipation0
SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generation0
Task Progressive Curriculum Learning for Robust Visual Question Answering0
Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey0
Efficient Multi-modal Large Language Models via Visual Token Grouping0
GEMeX: A Large-Scale, Groundable, and Explainable Medical VQA Benchmark for Chest X-ray Diagnosis0
VideoOrion: Tokenizing Object Dynamics in Videos0
Text-Guided Coarse-to-Fine Fusion Network for Robust Remote Sensing Visual Question Answering0
freePruner: A Training-free Approach for Large Multimodal Model Acceleration0
AfriMed-QA: A Pan-African, Multi-Specialty, Medical Question-Answering Benchmark Dataset0
Document Haystacks: Vision-Language Reasoning Over Piles of 1000+ DocumentsCode0
ReWind: Understanding Long Videos with Instructed Learnable Memory0
FINECAPTION: Compositional Image Captioning Focusing on Wherever You Want at Any Granularity0
KBAlign: Efficient Self Adaptation on Specific Knowledge BasesCode0
Knowledge Graphs, Large Language Models, and Hallucinations: An NLP Perspective0
Visual Contexts Clarify Ambiguous Expressions: A Benchmark DatasetCode0
FastRAG: Retrieval Augmented Generation for Semi-structured Data0
Learning to Reason Iteratively and Parallelly for Complex Visual Reasoning Scenarios0
Show:102550
← PrevPage 68 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified