SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 46014650 of 10817 papers

TitleStatusHype
Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQCode0
Benchmarking Hallucination in Large Language Models based on Unanswerable Math Word ProblemCode0
CLEVR-POC: Reasoning-Intensive Visual Question Answering in Partially Observable Environments0
Evidence-Focused Fact Summarization for Knowledge-Augmented Zero-Shot Question AnsweringCode0
Modeling Collaborator: Enabling Subjective Vision Classification With Minimal Human Effort via LLM Tool-Use0
Enhancing Generalization in Medical Visual Question Answering Tasks via Gradient-Guided Model Perturbation0
A General and Flexible Multi-concept Parsing Framework for Multilingual Semantic Matching0
Reliable, Adaptable, and Attributable Language Models with Retrieval0
MOKA: Open-World Robotic Manipulation through Mark-Based Visual Prompting0
The Claude 3 Model Family: Opus, Sonnet, Haiku0
EEE-QA: Exploring Effective and Efficient Question-Answer RepresentationsCode0
An Improved Traditional Chinese Evaluation Suite for Foundation Model0
Fine Tuning vs. Retrieval Augmented Generation for Less Popular KnowledgeCode0
Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering0
Answerability in Retrieval-Augmented Open-Domain Question Answering0
KorMedMCQA: Multi-Choice Question Answering Benchmark for Korean Healthcare Professional Licensing Examinations0
Automatic Question-Answer Generation for Long-Tail Knowledge0
SyllabusQA: A Course Logistics Question Answering DatasetCode0
Improving Cross-lingual Representation for Semantic Retrieval with Code-switching0
API Is Enough: Conformal Prediction for Large Language Models Without Logit-Access0
VBART: The Turkish LLM0
MediSwift: Efficient Sparse Pre-trained Biomedical Language Models0
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA SystemsCode0
Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Models0
TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoning0
OpenMedLM: Prompt engineering can out-perform fine-tuning in medical question-answering with open-source large language models0
Prompting Explicit and Implicit Knowledge for Multi-hop Question Answering Based on Human Reading Process0
Survey in Characterization of Semantic Change0
Can GPT Improve the State of Prior Authorization via Guideline Based Automated Question Answering?0
A Cognitive Evaluation Benchmark of Image Reasoning and Description for Large Vision-Language Models0
Unsupervised multiple choices question answering via universal corpus0
Fact-and-Reflection (FaR) Improves Confidence Calibration of Large Language ModelsCode0
ArcSin: Adaptive ranged cosine Similarity injected noise for Language-Driven Visual Tasks0
JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering CapabilityCode0
Reasoning in Conversation: Solving Subjective Tasks through Dialogue Simulation for Large Language Models0
MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical ReasoningCode0
VCD: Knowledge Base Guided Visual Commonsense Discovery in Images0
Self-Refinement of Language Models from External Proxy Metrics Feedback0
Researchy Questions: A Dataset of Multi-Perspective, Decompositional Questions for LLM Web Agents0
PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answering0
Read and Think: An Efficient Step-wise Multimodal Language Model for Document Understanding and Reasoning0
Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Models0
Pre-training Cross-lingual Open Domain Question Answering with Large-scale Synthetic SupervisionCode0
Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts0
PAQA: Toward ProActive Open-Retrieval Question Answering0
LLM-Assisted Multi-Teacher Continual Learning for Visual Question Answering in Robotic SurgeryCode0
GigaPevt: Multimodal Medical Assistant0
Deep Learning Approaches for Improving Question Answering Systems in Hepatocellular Carcinoma Research0
Prompt Perturbation Consistency Learning for Robust Language Models0
Multimodal Transformer With a Low-Computational-Cost Guarantee0
Show:102550
← PrevPage 93 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified