SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 15011550 of 10817 papers

TitleStatusHype
AVSS: Layer Importance Evaluation in Large Language Models via Activation Variance-Sparsity Analysis0
FactTest: Factuality Testing in Large Language Models with Finite-Sample and Distribution-Free Guarantees0
A Multi-Task Role-Playing Agent Capable of Imitating Character Linguistic Styles0
MILU: A Multi-task Indic Language Understanding BenchmarkCode1
One VLM to Keep it Learning: Generation and Balancing for Data-free Continual Visual Question Answering0
Can Language Models Enable In-Context Database?0
Addressing Uncertainty in LLMs to Enhance Reliability in Generative AI0
Goal-Oriented Semantic Communication for Wireless Visual Question Answering0
RS-MoE: Mixture of Experts for Remote Sensing Image Captioning and Visual Question Answering0
A Visual Question Answering Method for SAR Ship: Breaking the Requirement for Multimodal Dataset Construction and Model Fine-Tuning0
Diagnosing Medical Datasets with Training DynamicsCode0
LoRA-Contextualizing Adaptation of Large Multimodal Models for Long Document Understanding0
Designing a Robust Radiology Report Generation System0
Rationale-Guided Retrieval Augmented Generation for Medical Question AnsweringCode1
Enhancing Question Answering Precision with Optimized Vector Retrieval and Instructions0
Magnitude Pruning of Large Pretrained Transformer Models with a Mixture Gaussian Prior0
GRS-QA -- Graph Reasoning-Structured Question Answering Dataset0
Provenance: A Light-weight Fact-checker for Retrieval Augmented LLM Generation Output0
Latent Paraphrasing: Perturbation on Layers Improves Knowledge Injection in Language ModelsCode0
Right this way: Can VLMs Guide Us to See More to Answer Questions?Code0
AttackQA: Development and Adoption of a Dataset for Assisting Cybersecurity Operations using Fine-tuned and Open-Source LLMs0
Birdie: Advancing State Space Models with Reward-Driven Objectives and CurriculaCode1
JudgeRank: Leveraging Large Language Models for Reasoning-Intensive Reranking0
Dynamic Uncertainty Ranking: Enhancing In-Context Learning for Long-Tail Knowledge in LLMs0
Show Me What and Where has Changed? Question Answering and Grounding for Remote Sensing Change DetectionCode1
Nearest Neighbor Normalization Improves Multimodal RetrievalCode1
LEAF: Learning and Evaluation Augmented by Fact-Checking to Improve Factualness in Large Language Models0
MDCure: A Scalable Pipeline for Multi-Document Instruction-FollowingCode0
Symbolic Graph Inference for Compound Scene Understanding0
SimpsonsVQA: Enhancing Inquiry-Based Learning with a Tailored Dataset0
Danoliteracy of Generative, Large Language Models0
Dynamic Strategy Planning for Efficient Question Answering with Large Language Models0
Improving Uncertainty Quantification in Large Language Models via Semantic Embeddings0
BUZZ: Beehive-structured Sparse KV Cache with Segmented Heavy Hitters for Efficient LLM InferenceCode0
Multi-Agent Large Language Models for Conversational Task-SolvingCode2
NeuroSym-BioCAT: Leveraging Neuro-Symbolic Methods for Biomedical Scholarly Document Categorization and Question Answering0
GRADE: Quantifying Sample Diversity in Text-to-Image Models0
RealCQA-V2 : Visual Premise Proving A Manual COT Dataset for Charts0
AAAR-1.0: Assessing AI's Potential to Assist Research0
Synthetic Data Generation with Large Language Models for Personalized Community Question AnsweringCode0
Distinguishing Ignorance from Error in LLM HallucinationsCode1
Are VLMs Really BlindCode0
Knowledge-Guided Prompt Learning for Request Quality Assurance in Public Code ReviewCode0
Enhancing Financial Question Answering with a Multi-Agent Reflection Framework0
ProMQA: Question Answering Dataset for Multimodal Procedural Activity UnderstandingCode0
Few-Shot Multimodal Explanation for Visual Question AnsweringCode0
SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrieval0
Large Language Model Benchmarks in Medical Tasks0
CT2C-QA: Multimodal Question Answering over Chinese Text, Table and Chart0
Resilience in Knowledge Graph Embeddings0
Show:102550
← PrevPage 31 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified