SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2451–2500 of 10817 papers

TitleStatusHype
TextGrad: Automatic "Differentiation" via TextCode7
Benchmarking Vision-Language Contrastive Methods for Medical Representation LearningCode0
MBBQ: A Dataset for Cross-Lingual Comparison of Stereotypes in Generative LLMsCode0
DARA: Decomposition-Alignment-Reasoning Autonomous Language Agent for Question Answering over Knowledge GraphsCode0
Situational Awareness Matters in 3D Vision Language ReasoningCode1
Scholarly Question Answering using Large Language Models in the NFDI4DataScience GatewayCode0
Paraphrasing in Affirmative Terms Improves Negation Understanding—0
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMsCode5
RS-Agent: Automating Remote Sensing Tasks through Intelligent AgentCode2
DR-RAG: Applying Dynamic Document Relevance to Retrieval-Augmented Generation for Question-Answering—0
BrainChat: Decoding Semantic Information from fMRI using Vision-language Pretrained Models—0
SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific LiteratureCode1
Evaluating the Retrieval Component in LLM-Based Question Answering Systems—0
Harnessing AI for efficient analysis of complex policy documents: a case study of Executive Order 14110—0
HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMs—0
Solution for SMART-101 Challenge of CVPR Multi-modal Algorithmic Reasoning Task 2024—0
Transforming Wearable Data into Health Insights using Large Language Model Agents—0
VCR: A Task for Pixel-Level Complex Reasoning in Vision Language Models via Restoring Occluded TextCode1
Recurrent Context Compression: Efficiently Expanding the Context Window of LLMCode2
Should We Fine-Tune or RAG? Evaluating Different Techniques to Adapt LLMs for DialogueCode0
CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark—0
Husky: A Unified, Open-Source Language Agent for Multi-Step ReasoningCode3
MedExQA: Medical Question Answering Benchmark with Multiple ExplanationsCode0
MrRank: Improving Question Answering Retrieval System through Multi-Result Ranking Model—0
MedREQAL: Examining Medical Knowledge Recall of Large Language Models via Question Answering—0
Zero-Shot End-To-End Spoken Question Answering In Medical Domain—0
Do LLMs Exhibit Human-Like Reasoning? Evaluating Theory of Mind in LLMs for Open-Ended Responses—0
RE-RAG: Improving Open-Domain QA Performance and Interpretability with Relevance Estimator in Retrieval-Augmented GenerationCode0
F-LMM: Grounding Frozen Large Multimodal ModelsCode2
Do LLMs Recognize me, When I is not me: Assessment of LLMs Understanding of Turkish Indexical Pronouns in Indexical Shift Contexts—0
Investigating and Addressing Hallucinations of LLMs in Tasks Involving Negation—0
CERET: Cost-Effective Extrinsic Refinement for Text GenerationCode0
Towards a Benchmark for Causal Business Process Reasoning with LLMsCode0
CaLM: Contrasting Large and Small Language Models to Verify Grounded Generation—0
Venn Diagram Prompting : Accelerating Comprehension with Scaffolding Effect—0
Composition Vision-Language Understanding via Segment and Depth Anything ModelCode0
LinkQ: An LLM-Assisted Visual Interface for Knowledge Graph Question-AnsweringCode1
TCMD: A Traditional Chinese Medicine QA Dataset for Evaluating Large Language Models—0
On Subjective Uncertainty Quantification and Calibration in Natural Language GenerationCode0
CRiskEval: A Chinese Multi-Level Risk Evaluation Benchmark Dataset for Large Language ModelsCode0
CRAG -- Comprehensive RAG BenchmarkCode3
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuningCode2
ComplexTempQA: A Large-Scale Dataset for Complex Temporal Question AnsweringCode1
MATTER: Memory-Augmented Transformer Using Heterogeneous Knowledge Sources—0
Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?—0
Synthesizing Conversations from Unlabeled Documents using Automatic Response Segmentation—0
M-QALM: A Benchmark to Assess Clinical Reading Comprehension and Knowledge Recall in Large Language Models via Question AnsweringCode0
Understanding Information Storage and Transfer in Multi-modal Large Language Models—0
FairytaleQA Translated: Enabling Educational Question and Answer Generation in Less-Resourced LanguagesCode0
Semantically Diverse Language Generation for Uncertainty Estimation in Language ModelsCode1
Show:102550
← PrevPage 50 of 217Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified