SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 351375 of 10817 papers

TitleStatusHype
LOVA3: Learning to Visual Question Answering, Asking and AssessmentCode2
AGILE: A Novel Reinforcement Learning Framework of LLM AgentsCode2
Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam GenerationCode2
ProtT3: Protein-to-Text Generation for Text-based Protein UnderstandingCode2
MTVQA: Benchmarking Multilingual Text-Centric Visual Question AnsweringCode2
Grounded 3D-LLM with Referent TokensCode2
FreeVA: Offline MLLM as Training-Free Video AssistantCode2
HMT: Hierarchical Memory Transformer for Long Context Language ProcessingCode2
DALK: Dynamic Co-Augmentation of LLMs and KG to answer Alzheimer's Disease Questions with Scientific LiteratureCode2
Overview of the EHRSQL 2024 Shared Task on Reliable Text-to-SQL Modeling on Electronic Health RecordsCode2
IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic LanguagesCode2
GSCo: Towards Generalizable AI in Medicine via Generalist-Specialist CollaborationCode2
Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question AnsweringCode2
FakeBench: Probing Explainable Fake Image Detection via Large Multimodal ModelsCode2
Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language ModelsCode2
LLoCO: Learning Long Contexts OfflineCode2
Superposition Prompting: Improving and Accelerating Retrieval-Augmented GenerationCode2
Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarksCode2
LongVLM: Efficient Long Video Understanding via Large Language ModelsCode2
Direct Preference Optimization of Video Large Multimodal Models from Language Model RewardCode2
How Much are Large Language Models Contaminated? A Comprehensive Survey and the LLMSanitize LibraryCode2
Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You WantCode2
VHM: Versatile and Honest Vision Language Model for Remote Sensing Image AnalysisCode2
Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language ModelsCode2
Multi-Frame, Lightweight & Efficient Vision-Language Models for Question Answering in Autonomous DrivingCode2
Show:102550
← PrevPage 15 of 433Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified