SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 851–900 of 10817 papers

TitleStatusHype
SCAR: Efficient Instruction-Tuning for Large Language Models via Style Consistency-Aware Response RankingCode1
FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food CultureCode1
CoLoR-Filter: Conditional Loss Reduction Filtering for Targeted Language Model Pre-trainingCode1
IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerceCode1
VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMsCode1
Large language model validity via enhanced conformal prediction methodsCode1
Vision-Language Models Meet Meteorology: Developing Models for Extreme Weather Events Detection with HeatmapsCode1
Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?Code1
Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QACode1
Towards Reliable Detection of LLM-Generated Texts: A Comprehensive Evaluation Framework with CUDRTCode1
Advancing High Resolution Vision-Language Models in BiomedicineCode1
Situational Awareness Matters in 3D Vision Language ReasoningCode1
SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific LiteratureCode1
VCR: A Task for Pixel-Level Complex Reasoning in Vision Language Models via Restoring Occluded TextCode1
ComplexTempQA: A Large-Scale Dataset for Complex Temporal Question AnsweringCode1
LinkQ: An LLM-Assisted Visual Interface for Knowledge Graph Question-AnsweringCode1
Semantically Diverse Language Generation for Uncertainty Estimation in Language ModelsCode1
Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMsCode1
An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented GenerationCode1
MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical ReasoningCode1
Re-ReST: Reflection-Reinforced Self-Training for Language AgentsCode1
Compositional 4D Dynamic Scenes Understanding with Physics Priors for Video Question AnsweringCode1
Encoding and Controlling Global Semantics for Long-form Video Question AnsweringCode1
One Token Can Help! Learning Scalable and Pluggable Virtual Tokens for Retrieval-Augmented Large Language ModelsCode1
Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQACode1
MathChat: Benchmarking Mathematical Reasoning and Instruction Following in Multi-Turn InteractionsCode1
Reverse Image Retrieval Cues Parametric Memory in Multimodal LLMsCode1
THREAD: Thinking Deeper with Recursive SpawningCode1
Map-based Modular Approach for Zero-shot Embodied Question AnsweringCode1
Semantic Density: Uncertainty Quantification for Large Language Models through Confidence Measurement in Semantic SpaceCode1
PitVQA: Image-grounded Text Embedding LLM for Visual Question Answering in Pituitary SurgeryCode1
OLAPH: Improving Factuality in Biomedical Long-form Question AnsweringCode1
Towards Better Question Generation in QA-based Event ExtractionCode1
Conformal Alignment: Knowing When to Trust Foundation Models with GuaranteesCode1
SciQAG: A Framework for Auto-Generated Science Question Answering Dataset with Fine-grained EvaluationCode1
UniRAG: Universal Retrieval Augmentation for Large Vision Language ModelsCode1
TANQ: An open domain dataset of table answered questionsCode1
MedConceptsQA: Open Source Medical Concepts QA BenchmarkCode1
ERAGent: Enhancing Retrieval-Augmented Language Models with Improved Accuracy, Efficiency, and PersonalizationCode1
Enhancing Contextual Understanding in Large Language Models through Contrastive DecodingCode1
Understanding Figurative Meaning through Explainable Visual EntailmentCode1
BiomedRAG: A Retrieval Augmented Large Language Model for BiomedicineCode1
TableVQA-Bench: A Visual Question Answering Benchmark on Multiple Table DomainsCode1
ViOCRVQA: Novel Benchmark Dataset and Vision Reader for Visual Question Answering by Understanding Vietnamese Text in ImagesCode1
Large Language Models in the Clinic: A Comprehensive BenchmarkCode1
Insights into Alignment: Evaluating DPO and its Variants Across Multiple TasksCode1
LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language ModelsCode1
Simulating Task-Oriented Dialogues with State Transition Graphs and Large Language ModelsCode1
LaPA: Latent Prompt Assist Model For Medical Visual Question AnsweringCode1
Look, Listen, and Answer: Overcoming Biases for Audio-Visual Question AnsweringCode1
Show:102550
← PrevPage 18 of 217Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified