SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 10817 papers

TitleStatusHype
Holistic Evaluation of Language ModelsCode4
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and MiningCode4
ReAct: Synergizing Reasoning and Acting in Language ModelsCode4
N-Grammer: Augmenting Transformers with latent n-gramsCode4
Flamingo: a Visual Language Model for Few-Shot LearningCode4
What Makes Good In-Context Examples for GPT-3?Code4
Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksCode4
Predicting Subjective Features of Questions of QA Websites using BERTCode4
L0: Reinforcement Learning to Become General AgentsCode3
KVzip: Query-Agnostic KV Cache Compression with Context ReconstructionCode3
Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action ModelsCode3
InfoChartQA: A Benchmark for Multimodal Question Answering on Infographic ChartsCode3
LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech SynthesisCode3
Ai2 Scholar QA: Organized Literature Synthesis with AttributionCode3
Retrieval Augmented Generation and Understanding in Vision: A Survey and New OutlookCode3
MDocAgent: A Multi-Modal Multi-Agent Framework for Document UnderstandingCode3
VideoMind: A Chain-of-LoRA Agent for Long Video ReasoningCode3
Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question AnsweringCode3
SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action AlignmentCode3
EgoLife: Towards Egocentric Life AssistantCode3
MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMsCode3
Baichuan-Audio: A Unified Framework for End-to-End Speech InteractionCode3
Temporal Working Memory: Query-Guided Segment Refinement for Enhanced Multimodal UnderstandingCode3
VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language ModelCode3
CAD-Recode: Reverse Engineering CAD Code from Point CloudsCode3
DARWIN 1.5: Large Language Models as Materials Science Adapted LearnersCode3
Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning AgentCode3
A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessCode3
Meta-Chunking: Learning Text Segmentation and Semantic Completion via Logical PerceptionCode3
LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive MemoryCode3
ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot NavigationCode3
RAGEval: Scenario Specific RAG Evaluation Dataset Generation FrameworkCode3
Odyssey: Empowering Minecraft Agents with Open-World SkillsCode3
Evaluating Large Language Models with fmevalCode3
Searching for Best Practices in Retrieval-Augmented GenerationCode3
Detecting hallucinations in large language models using semantic entropyCode3
VoCo-LLaMA: Towards Vision Compression with Large Language ModelsCode3
AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive ReasoningCode3
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video UnderstandingCode3
Flash-VStream: Memory-Based Real-Time Understanding for Long Video StreamsCode3
Husky: A Unified, Open-Source Language Agent for Multi-Step ReasoningCode3
CRAG -- Comprehensive RAG BenchmarkCode3
GNN-RAG: Graph Neural Retrieval for Large Language Model ReasoningCode3
Hawk: Learning to Understand Open-World Video AnomaliesCode3
Efficient Multimodal Large Language Models: A SurveyCode3
From Matching to Generation: A Survey on Generative Information RetrievalCode3
MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of ExpertsCode3
View Selection for 3D Captioning via Diffusion RankingCode3
MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video UnderstandingCode3
Evaluating Text-to-Visual Generation with Image-to-Text GenerationCode3
Show:102550
← PrevPage 3 of 217Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified