SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 401–450 of 10817 papers

TitleStatusHype
ChatGPT Asks, BLIP-2 Answers: Automatic Questioning Towards Enriched Visual DescriptionsCode2
ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language ModelsCode2
GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning AbilitiesCode2
Frozen Transformers in Language Models Are Effective Visual Encoder LayersCode2
Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question AnsweringCode2
Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question AnsweringCode2
Free Video-LLM: Prompt-guided Visual Perception for Efficient Training-free Video LLMsCode2
Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language ModelsCode2
MovieChat: From Dense Token to Sparse Memory for Long Video UnderstandingCode2
From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language ModelsCode2
MuGER^2: Multi-Granularity Evidence Retrieval and Reasoning for Hybrid Question AnsweringCode2
Multi-Agent Large Language Models for Conversational Task-SolvingCode2
From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning TasksCode2
Multimodal RewardBench: Holistic Evaluation of Reward Models for Vision Language ModelsCode2
F-LMM: Grounding Frozen Large Multimodal ModelsCode2
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model EvaluationCode2
FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character DesignCode2
FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal ReasoningCode2
A Survey on Benchmarks of Multimodal Large Language ModelsCode2
One missing piece in Vision and Language: A Survey on Comics UnderstandingCode2
Fine-grained Late-interaction Multi-modal Retrieval for Retrieval Augmented Visual Question AnsweringCode2
OCRBench: On the Hidden Mystery of OCR in Large Multimodal ModelsCode2
FinBERT-QA: Financial Question Answering with pre-trained BERT Language ModelsCode2
Fine-Grained Human Feedback Gives Better Rewards for Language Model TrainingCode2
PEDANTS: Cheap but Effective and Interpretable Answer EquivalenceCode2
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General TasksCode2
PDF-WuKong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse SamplingCode2
FrameFusion: Combining Similarity and Importance for Video Token Reduction on Large Visual Language ModelsCode2
Pengi: An Audio Language Model for Audio TasksCode2
Perception Test: A Diagnostic Benchmark for Multimodal ModelsCode2
Ask Me Anything: A simple strategy for prompting language modelsCode2
FakeBench: Probing Explainable Fake Image Detection via Large Multimodal ModelsCode2
FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language ModelsCode2
Compressing Context to Enhance Inference Efficiency of Large Language ModelsCode2
ActiveRAG: Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented AgentsCode2
AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction SimulatorCode2
Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerCode2
ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsCode2
EyeCLIP: A visual-language foundation model for multi-modal ophthalmic image analysisCode2
Atlas: Few-shot Learning with Retrieval Augmented Language ModelsCode2
ProtT3: Protein-to-Text Generation for Text-based Protein UnderstandingCode2
Evaluating RAG-Fusion with RAGElo: an Automated Elo-based FrameworkCode2
A Simple Aerial Detection Baseline of Multimodal Language ModelsCode2
QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training QuantizationCode2
AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq ModelCode2
Evaluating LLM Reasoning in the Operations Research Domain with ORQACode2
Explore the Limits of Omni-modal Pretraining at ScaleCode2
FreeVA: Offline MLLM as Training-Free Video AssistantCode2
ERA-CoT: Improving Chain-of-Thought through Entity Relationship AnalysisCode2
A Replication Study of Dense Passage RetrieverCode2
Show:102550
← PrevPage 9 of 217Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified