SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 501550 of 10817 papers

TitleStatusHype
GIT: A Generative Image-to-text Transformer for Vision and LanguageCode2
GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AICode2
GeoChat: Grounded Large Vision-Language Model for Remote SensingCode2
GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question AnsweringCode2
GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AICode2
Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question AnsweringCode2
GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning AbilitiesCode2
From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning TasksCode2
Frozen Transformers in Language Models Are Effective Visual Encoder LayersCode2
A Multimodal Benchmark Dataset and Model for Crop Disease DiagnosisCode2
A Survey on Benchmarks of Multimodal Large Language ModelsCode2
VHM: Versatile and Honest Vision Language Model for Remote Sensing Image AnalysisCode2
FreeVA: Offline MLLM as Training-Free Video AssistantCode2
F-LMM: Grounding Frozen Large Multimodal ModelsCode2
Free Video-LLM: Prompt-guided Visual Perception for Efficient Training-free Video LLMsCode2
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model EvaluationCode2
Fine-grained Late-interaction Multi-modal Retrieval for Retrieval Augmented Visual Question AnsweringCode2
Ask Me Anything: A simple strategy for prompting language modelsCode2
From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language ModelsCode2
Atlas: Few-shot Learning with Retrieval Augmented Language ModelsCode2
FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language ModelsCode2
FinBERT-QA: Financial Question Answering with pre-trained BERT Language ModelsCode2
Evaluating RAG-Fusion with RAGElo: an Automated Elo-based FrameworkCode2
Explore the Limits of Omni-modal Pretraining at ScaleCode2
A Replication Study of Dense Passage RetrieverCode2
Evaluating LLM Reasoning in the Operations Research Domain with ORQACode2
Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerCode2
Fine-Grained Human Feedback Gives Better Rewards for Language Model TrainingCode2
AnyAnomaly: Zero-Shot Customizable Video Anomaly Detection with LVLMCode2
ERA-CoT: Improving Chain-of-Thought through Entity Relationship AnalysisCode2
EyeCLIP: A visual-language foundation model for multi-modal ophthalmic image analysisCode2
FakeBench: Probing Explainable Fake Image Detection via Large Multimodal ModelsCode2
End-to-End Navigation with Vision Language Models: Transforming Spatial Reasoning into Question-AnsweringCode2
Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal ReasoningCode2
End-To-End Memory NetworksCode2
Enhancing Visual-Language Modality Alignment in Large Vision Language Models via Self-ImprovementCode2
AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM AgentsCode2
FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character DesignCode2
A Simple Aerial Detection Baseline of Multimodal Language ModelsCode2
EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health RecordsCode2
FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal ReasoningCode2
FrameFusion: Combining Similarity and Importance for Video Token Reduction on Large Visual Language ModelsCode2
EmbodiedEval: Evaluate Multimodal LLMs as Embodied AgentsCode2
A Pilot Study for Chinese SQL Semantic ParsingCode2
Egocentric Video-Language PretrainingCode2
Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-LearningCode2
E.T. Bench: Towards Open-Ended Event-Level Video-Language UnderstandingCode2
EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent EducationCode2
Efficient One-Pass End-to-End Entity Linking for QuestionsCode2
Dual Diffusion for Unified Image Generation and UnderstandingCode2
Show:102550
← PrevPage 11 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified