SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 30513100 of 10817 papers

TitleStatusHype
VBART: The Turkish LLM0
API Is Enough: Conformal Prediction for Large Language Models Without Logit-Access0
MediSwift: Efficient Sparse Pre-trained Biomedical Language Models0
Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Models0
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA SystemsCode0
TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoning0
Prompting Explicit and Implicit Knowledge for Multi-hop Question Answering Based on Human Reading Process0
Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering BenchmarkCode1
Survey in Characterization of Semantic Change0
OpenMedLM: Prompt engineering can out-perform fine-tuning in medical question-answering with open-source large language models0
Characterizing Truthfulness in Large Language Model Generations with Local Intrinsic DimensionCode1
Learning to Generate Instruction Tuning Datasets for Zero-Shot Task AdaptationCode4
Benchmarking Large Language Models on Answering and Explaining Challenging Medical QuestionsCode1
Can GPT Improve the State of Prior Authorization via Guideline Based Automated Question Answering?0
Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented GenerationCode2
The First Place Solution of WSDM Cup 2024: Leveraging Large Language Models for Conversational Multi-Doc QACode2
A Cognitive Evaluation Benchmark of Image Reasoning and Description for Large Vision-Language Models0
Self-Refinement of Language Models from External Proxy Metrics Feedback0
Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A SurveyCode2
BlendSQL: A Scalable Dialect for Unifying Hybrid Question Answering in Relational AlgebraCode2
JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering CapabilityCode0
ArcSin: Adaptive ranged cosine Similarity injected noise for Language-Driven Visual Tasks0
Can LLM Generate Culturally Relevant Commonsense QA Data? Case Study in Indonesian and SundaneseCode1
Fact-and-Reflection (FaR) Improves Confidence Calibration of Large Language ModelsCode0
Researchy Questions: A Dataset of Multi-Perspective, Decompositional Questions for LLM Web Agents0
NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long DocumentsCode1
Reasoning in Conversation: Solving Subjective Tasks through Dialogue Simulation for Large Language Models0
REAR: A Relevance-Aware Retrieval-Augmented Framework for Open-Domain Question AnsweringCode1
Unsupervised multiple choices question answering via universal corpus0
TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful SpaceCode2
MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical ReasoningCode0
VCD: Knowledge Base Guided Visual Commonsense Discovery in Images0
Evaluating Very Long-Term Conversational Memory of LLM AgentsCode1
Read and Think: An Efficient Step-wise Multimodal Language Model for Document Understanding and Reasoning0
LLM-Assisted Multi-Teacher Continual Learning for Visual Question Answering in Robotic SurgeryCode0
Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Models0
PAQA: Toward ProActive Open-Retrieval Question Answering0
RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question AnsweringCode2
Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts0
GigaPevt: Multimodal Medical Assistant0
Pre-training Cross-lingual Open Domain Question Answering with Large-scale Synthetic SupervisionCode0
Chain-of-Discussion: A Multi-Model Framework for Complex Evidence-Based Question AnsweringCode4
PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answering0
MoZIP: A Multilingual Benchmark to Evaluate Large Language Models in Intellectual PropertyCode1
EHRNoteQA: An LLM Benchmark for Real-World Clinical Practice Using Discharge SummariesCode1
Efficient Temporal Extrapolation of Multimodal Large Language Models with Temporal Grounding BridgeCode1
Deep Learning Approaches for Improving Question Answering Systems in Hepatocellular Carcinoma Research0
Prompt Perturbation Consistency Learning for Robust Language Models0
Bridging the Gap between 2D and 3D Visual Question Answering: A Fusion Approach for 3D VQACode1
DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures0
Show:102550
← PrevPage 62 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified