SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 351400 of 10817 papers

TitleStatusHype
GIT: A Generative Image-to-text Transformer for Vision and LanguageCode2
GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AICode2
GeoChat: Grounded Large Vision-Language Model for Remote SensingCode2
Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question AnsweringCode2
GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question AnsweringCode2
CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual ScenariosCode2
GOFA: A Generative One-For-All Model for Joint Graph Language ModelingCode2
HMT: Hierarchical Memory Transformer for Long Context Language ProcessingCode2
Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal ReasoningCode2
From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language ModelsCode2
Breaking the Ceiling of the LLM Community by Treating Token Generation as a Classification for EnsemblingCode2
Learning to Filter Context for Retrieval-Augmented GenerationCode2
Learnware of Language Models: Specialized Small Language Models Can Do BigCode2
Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QACode2
A Replication Study of Dense Passage RetrieverCode2
Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene UnderstandingCode2
An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLMCode2
Free Video-LLM: Prompt-guided Visual Perception for Efficient Training-free Video LLMsCode2
From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning TasksCode2
FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal ReasoningCode2
F-LMM: Grounding Frozen Large Multimodal ModelsCode2
FrameFusion: Combining Similarity and Importance for Video Token Reduction on Large Visual Language ModelsCode2
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model EvaluationCode2
FreeVA: Offline MLLM as Training-Free Video AssistantCode2
Frozen Transformers in Language Models Are Effective Visual Encoder LayersCode2
ChatGPT Asks, BLIP-2 Answers: Automatic Questioning Towards Enriched Visual DescriptionsCode2
LLaVA-Scissor: Token Compression with Semantic Connected Components for Video LLMsCode2
ChartGemma: Visual Instruction-tuning for Chart Reasoning in the WildCode2
Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based RetrieversCode2
Chat-Scene: Bridging 3D Scene and Large Language Models with Object IdentifiersCode2
LLoCO: Learning Long Contexts OfflineCode2
A Simple Aerial Detection Baseline of Multimodal Language ModelsCode2
An Embodied Generalist Agent in 3D WorldCode2
Fine-grained Late-interaction Multi-modal Retrieval for Retrieval Augmented Visual Question AnsweringCode2
LongVideoBench: A Benchmark for Long-context Interleaved Video-Language UnderstandingCode2
LongVLM: Efficient Long Video Understanding via Large Language ModelsCode2
LOVA3: Learning to Visual Question Answering, Asking and AssessmentCode2
LSceneLLM: Enhancing Large 3D Scene Understanding Using Adaptive Visual PreferencesCode2
FinBERT-QA: Financial Question Answering with pre-trained BERT Language ModelsCode2
LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language ModelsCode2
BlendSQL: A Scalable Dialect for Unifying Hybrid Question Answering in Relational AlgebraCode2
MASKSEARCH: A Universal Pre-Training Framework to Enhance Agentic Search CapabilityCode2
CHiSafetyBench: A Chinese Hierarchical Safety Benchmark for Large Language ModelsCode2
A Survey on Benchmarks of Multimodal Large Language ModelsCode2
Fine-Grained Human Feedback Gives Better Rewards for Language Model TrainingCode2
MDETR - Modulated Detection for End-to-End Multi-Modal UnderstandingCode2
Measuring and Narrowing the Compositionality Gap in Language ModelsCode2
FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language ModelsCode2
Atlas: Few-shot Learning with Retrieval Augmented Language ModelsCode2
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical DomainsCode2
Show:102550
← PrevPage 8 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified