SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2401–2450 of 10817 papers

TitleStatusHype
HiddenTables & PyQTax: A Cooperative Game and Dataset For TableQA to Ensure Scale and Data Privacy Across a Myriad of Taxonomies—0
Multi-LLM QA with Embodied Exploration—0
VCEval: Rethinking What is a Good Educational Video and How to Automatically Evaluate It—0
MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models—0
On the Hardness of Faithful Chain-of-Thought Reasoning in Large Language Models—0
Large Language Models as Interpolated and Extrapolated Event PredictorsCode0
Beyond Raw Videos: Understanding Edited Videos with Large Multimodal ModelCode0
CoLoR-Filter: Conditional Loss Reduction Filtering for Targeted Language Model Pre-trainingCode1
CHiSafetyBench: A Chinese Hierarchical Safety Benchmark for Large Language ModelsCode2
Integrating Large Language Models with Graph-based Reasoning for Conversational Question Answering—0
GLiNER multi-task: Generalist Lightweight Model for Various Information Extraction Tasks—0
EWEK-QA: Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems—0
VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMsCode1
Efficient Prompting for LLM-based Generative Internet of Things—0
CHIRON: Rich Character Representations in Long-Form NarrativesCode0
Enhancing Question Answering on Charts Through Effective Pre-training Tasks—0
Large language model validity via enhanced conformal prediction methodsCode1
Datasets for Multilingual Answer Sentence Selection—0
SHMamba: Structured Hyperbolic State Space Model for Audio-Visual Question Answering—0
Vision-Language Models Meet Meteorology: Developing Models for Extreme Weather Events Detection with HeatmapsCode1
BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-HaystackCode9
Precision Empowers, Excess Distracts: Visual Question Answering With Dynamically Infused Knowledge In Language Models—0
A Training-free Sub-quadratic Cost Transformer Model Serving Framework With Hierarchically Pruned Attention—0
IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerceCode1
Detecting and Evaluating Medical Hallucinations in Large Vision Language Models—0
A Survey of Video Datasets for Grounded Event UnderstandingCode0
Multi-Modal Retrieval For Large Language Model Based Speech Recognition—0
Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMsCode2
Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?Code1
DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding—0
No perspective, no perception!! Perspective-aware Healthcare Answer SummarizationCode0
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video UnderstandingCode3
Explore the Limits of Omni-modal Pretraining at ScaleCode2
Yo'LLaVA: Your Personalized Language and Vision AssistantCode2
Towards Vision-Language Geo-Foundation Model: A SurveyCode2
Optimizing Visual Question Answering Models for Driving: Bridging the Gap Between Human and Machine Attention Patterns—0
Towards Multilingual Audio-Visual Question AnsweringCode0
Towards Reliable Detection of LLM-Generated Texts: A Comprehensive Evaluation Framework with CUDRTCode1
Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMsCode2
MMScan: A Multi-Modal 3D Scene Dataset with Hierarchical Grounded Language AnnotationsCode4
Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QACode1
Advancing High Resolution Vision-Language Models in BiomedicineCode1
VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language TasksCode5
Flash-VStream: Memory-Based Real-Time Understanding for Long Video StreamsCode3
Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generation—0
Research Trends for the Interplay between Large Language Models and Knowledge Graphs—0
Prediction of the Realisation of an Information Need: An EEG Study—0
DistilDoc: Knowledge Distillation for Visually-Rich Document Applications—0
Question-Answering (QA) Model for a Personalized Learning Assistant for Arabic Language—0
Efficient Parallel Multi-Hop Reasoning: A Scalable Approach for Knowledge Graph Analysis—0
Show:102550
← PrevPage 49 of 217Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified