SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 27012750 of 10817 papers

TitleStatusHype
TableVQA-Bench: A Visual Question Answering Benchmark on Multiple Table DomainsCode1
Multi-hop Question Answering over Knowledge Graphs using Large Language Models0
Suvach -- Generated Hindi QA benchmark0
Multi-Page Document Visual Question Answering using Self-Attention Scoring MechanismCode0
Capabilities of Gemini Models in Medicine0
FREB-TQA: A Fine-Grained Robustness Evaluation Benchmark for Table Question AnsweringCode0
ViOCRVQA: Novel Benchmark Dataset and Vision Reader for Visual Question Answering by Understanding Vietnamese Text in ImagesCode1
Automated Construction of Theme-specific Knowledge Graphs0
QANA: LLM-based Question Generation and Network Analysis for Zero-shot Key Point Analysis and Beyond0
MediFact at MEDIQA-M3G 2024: Medical Question Answering in Dermatology with Multimodal LearningCode0
Tool Calling: Enhancing Medication Consultation via Retrieval-Augmented Large Language Models0
MediFact at MEDIQA-CORR 2024: Why AI Needs a Human TouchCode0
Transfer Learning Enhanced Single-choice Decision for Multi-choice Question Answering0
Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilities0
Retrieval-Augmented Generation with Knowledge Graphs for Customer Service Question Answering0
MovieChat+: Question-aware Sparse Memory for Long Video Question AnsweringCode4
TIGQA:An Expert Annotated Question Answering Dataset in Tigrinya0
From Multiple-Choice to Extractive QA: A Case Study for English and ArabicCode0
2M-NER: Contrastive Learning for Multilingual and Multimodal NER with Language and Modal Fusion0
Large Language Models in the Clinic: A Comprehensive BenchmarkCode1
Türkçe Dil Modellerinin Performans Karşılaştırması Performance Comparison of Turkish Language Models0
Asking and Answering Questions to Extract Event-Argument StructuresCode0
IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic LanguagesCode2
Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Models0
BERT vs GPT for financial engineering0
Porting Large Language Models to Mobile Devices for Question Answering0
Fusion of Domain-Adapted Vision and Language Models for Medical Visual Question Answering0
A Comprehensive Survey on Evaluating Large Language Model Applications in the Medical Industry0
KS-LLM: Knowledge Selection of Large Language Models with Evidence Document for Question Answering0
Knowledge Graph Completion using Structural and Textual EmbeddingsCode0
Assessing The Potential Of Mid-Sized Language Models For Clinical QA0
From Local to Global: A Graph RAG Approach to Query-Focused SummarizationCode14
Evaluating Tool-Augmented Agents in Remote Sensing Platforms0
XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference0
Simulating Task-Oriented Dialogues with State Transition Graphs and Large Language ModelsCode1
Insights into Alignment: Evaluating DPO and its Variants Across Multiple TasksCode1
Wiki-LLaVA: Hierarchical Retrieval-Augmented Generation for Multimodal LLMs0
LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language ModelsCode1
Multi-view Content-aware Indexing for Long Document Retrieval0
Med42 -- Evaluating Fine-Tuning Strategies for Medical LLMs: Full-Parameter vs. Parameter-Efficient Approaches0
Grounded Knowledge-Enhanced Medical VLP for Chest X-Ray0
GSCo: Towards Generalizable AI in Medicine via Generalist-Specialist CollaborationCode2
Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question AnsweringCode2
Bias patterns in the application of LLMs for clinical decision support: A comprehensive studyCode0
From Matching to Generation: A Survey on Generative Information RetrievalCode3
Pegasus-v1 Technical Report0
Retrieval Augmented Generation for Domain-specific Question Answering0
WangLab at MEDIQA-M3G 2024: Multimodal Medical Answer Generation using Large Language Models0
WangLab at MEDIQA-CORR 2024: Optimized LLM-based Programs for Medical Error Detection and Correction0
Optimal Design for Human Preference Elicitation0
Show:102550
← PrevPage 55 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified