SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 26262650 of 10817 papers

TitleStatusHype
Grounded 3D-LLM with Referent TokensCode2
AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning0
Chameleon: Mixed-Modal Early-Fusion Foundation ModelsCode7
UniRAG: Universal Retrieval Augmentation for Large Vision Language ModelsCode1
SciQAG: A Framework for Auto-Generated Science Question Answering Dataset with Fine-grained EvaluationCode1
When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language ModelsCode7
FinTextQA: A Dataset for Long-form Financial Question Answering0
Conformal Alignment: Knowing When to Trust Foundation Models with GuaranteesCode1
IM-RAG: Multi-Round Retrieval-Augmented Generation Through Learning Inner Monologues0
Prompting-based Synthetic Data Generation for Few-Shot Question AnsweringCode0
STAR: A Benchmark for Situated Reasoning in Real-World Videos0
CinePile: A Long Video Question Answering Dataset and Benchmark0
SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models0
UCCIX: Irish-eXcellence Large Language Model0
MetaReflection: Learning Instructions for Language Agents using Past Reflections0
AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments0
TANQ: An open domain dataset of table answered questionsCode1
Benchmarking Retrieval-Augmented Large Language Models in Biomedical NLP: Application, Robustness, and Self-Awareness0
EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential ReasoningCode0
From Questions to Insightful Answers: Building an Informed Chatbot for University Resources0
KET-QA: A Dataset for Knowledge Enhanced Table Question Answering0
CLIP-Powered TASS: Target-Aware Single-Stream Network for Audio-Visual Question Answering0
FreeVA: Offline MLLM as Training-Free Video AssistantCode2
MedConceptsQA: Open Source Medical Concepts QA BenchmarkCode1
Realizing Visual Question Answering for Education: GPT-4V as a Multimodal AI0
Show:102550
← PrevPage 106 of 433Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified