SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 24012425 of 10817 papers

TitleStatusHype
HiddenTables & PyQTax: A Cooperative Game and Dataset For TableQA to Ensure Scale and Data Privacy Across a Myriad of Taxonomies0
Multi-LLM QA with Embodied Exploration0
VCEval: Rethinking What is a Good Educational Video and How to Automatically Evaluate It0
MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models0
Large Language Models as Interpolated and Extrapolated Event PredictorsCode0
On the Hardness of Faithful Chain-of-Thought Reasoning in Large Language Models0
Beyond Raw Videos: Understanding Edited Videos with Large Multimodal ModelCode0
CoLoR-Filter: Conditional Loss Reduction Filtering for Targeted Language Model Pre-trainingCode1
CHiSafetyBench: A Chinese Hierarchical Safety Benchmark for Large Language ModelsCode2
Integrating Large Language Models with Graph-based Reasoning for Conversational Question Answering0
GLiNER multi-task: Generalist Lightweight Model for Various Information Extraction Tasks0
EWEK-QA: Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems0
VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMsCode1
Efficient Prompting for LLM-based Generative Internet of Things0
CHIRON: Rich Character Representations in Long-Form NarrativesCode0
Vision-Language Models Meet Meteorology: Developing Models for Extreme Weather Events Detection with HeatmapsCode1
SHMamba: Structured Hyperbolic State Space Model for Audio-Visual Question Answering0
Large language model validity via enhanced conformal prediction methodsCode1
BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-HaystackCode9
Detecting and Evaluating Medical Hallucinations in Large Vision Language Models0
Enhancing Question Answering on Charts Through Effective Pre-training Tasks0
IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerceCode1
Precision Empowers, Excess Distracts: Visual Question Answering With Dynamically Infused Knowledge In Language Models0
Datasets for Multilingual Answer Sentence Selection0
A Training-free Sub-quadratic Cost Transformer Model Serving Framework With Hierarchically Pruned Attention0
Show:102550
← PrevPage 97 of 433Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified