SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 326350 of 10817 papers

TitleStatusHype
AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous DrivingCode2
Grounded 3D-LLM with Referent TokensCode2
Grounding-IQA: Multimodal Language Grounding Model for Image Quality AssessmentCode2
Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction TuningCode2
Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam GenerationCode2
GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended TasksCode2
VHM: Versatile and Honest Vision Language Model for Remote Sensing Image AnalysisCode2
GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AICode2
Baleen: Robust Multi-Hop Reasoning at Scale via Condensed RetrievalCode2
GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AICode2
Huatuo-26M, a Large-scale Chinese Medical QA DatasetCode2
GOFA: A Generative One-For-All Model for Joint Graph Language ModelingCode2
BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained TransformerCode2
GreaseLM: Graph REASoning Enhanced Language Models for Question AnsweringCode2
How do you know that? Teaching Generative Language Models to Reference Answers to Biomedical QuestionsCode2
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsCode2
Improving Retrieval-Augmented Generation through Multi-Agent Reinforcement LearningCode2
Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QACode2
Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question AnsweringCode2
ISR-DPO: Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPOCode2
Benchmarking Retrieval-Augmented Generation in Multi-Modal ContextsCode2
Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question AnsweringCode2
GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning AbilitiesCode2
From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning TasksCode2
From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language ModelsCode2
Show:102550
← PrevPage 14 of 433Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified