SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 10817 papers

TitleStatusHype
BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive RetrievalCode5
MEIA: Multimodal Embodied Perception and Interaction in Unknown EnvironmentsCode5
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMsCode5
Wings: Learning Multimodal LLMs without Text-only ForgettingCode5
Show-o: One Single Transformer to Unify Multimodal Understanding and GenerationCode5
VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language TasksCode5
LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QACode4
LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One DayCode4
Learning to Generate Instruction Tuning Datasets for Zero-Shot Task AdaptationCode4
Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall SpacesCode4
VideoChat: Chat-Centric Video UnderstandingCode4
Knowledge Fusion of Large Language ModelsCode4
Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Reliable Response Generation in ChineseCode4
FinBen: A Holistic Financial Benchmark for Large Language ModelsCode4
Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video UnderstandingCode4
Holistic Evaluation of Language ModelsCode4
SPHINX: The Joint Mixing of Weights, Tasks, and Visual Embeddings for Multi-modal Large Language ModelsCode4
SQuARE: Sequential Question Answering Reasoning Engine for Enhanced Chain-of-Thought in Large Language ModelsCode4
Chain-of-Discussion: A Multi-Model Framework for Complex Evidence-Based Question AnsweringCode4
The Llama 3 Herd of ModelsCode4
Scaling Up Biomedical Vision-Language Models: Fine-Tuning, Instruction Tuning, and Multi-Modal LearningCode4
GPT-4V(ision) is a Generalist Web Agent, if GroundedCode4
Retrieval-Generation Synergy Augmented Large Language ModelsCode4
BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical TextCode4
GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data GenerationCode4
Sailor: Open Language Models for South-East AsiaCode4
ReAct: Synergizing Reasoning and Acting in Language ModelsCode4
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and MiningCode4
Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented GenerationCode4
QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement LearningCode4
Benchmarking Retrieval-Augmented Generation for MedicineCode4
AlignScore: Evaluating Factual Consistency with a Unified Alignment FunctionCode4
G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question AnsweringCode4
Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksCode4
Flamingo: a Visual Language Model for Few-Shot LearningCode4
Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionCode4
Predicting Subjective Features of Questions of QA Websites using BERTCode4
Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language ModelsCode4
Galactica: A Large Language Model for ScienceCode4
Retrieval-Augmented Generation with Hierarchical KnowledgeCode4
OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual ReasoningCode4
OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and ReasoningCode4
OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMCode4
A Survey on Vision-Language-Action Models for Embodied AICode4
N-Grammer: Augmenting Transformers with latent n-gramsCode4
OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action ModelCode4
Mixtral of ExpertsCode4
Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up QuestionsCode4
MMScan: A Multi-Modal 3D Scene Dataset with Hierarchical Grounded Language AnnotationsCode4
MEDITRON-70B: Scaling Medical Pretraining for Large Language ModelsCode4
Show:102550
← PrevPage 2 of 217Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified