SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 1030110350 of 10817 papers

TitleStatusHype
RAVEN: Query-Guided Representation Alignment for Question Answering over Audio, Video, Embedded Sensors, and Natural LanguageCode0
MedExQA: Medical Question Answering Benchmark with Multiple ExplanationsCode0
Do LLMs Implicitly Determine the Suitable Text Difficulty for Users?Code0
RConE: Rough Cone Embedding for Multi-Hop Logical Query Answering on Multi-Modal Knowledge GraphsCode0
Do-GOOD: Towards Distribution Shift Evaluation for Pre-Trained Visual Document Understanding ModelsCode0
MedG-KRP: Medical Graph Knowledge Representation ProbingCode0
RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference ContentCode0
On the Influence of Context Size and Model Choice in Retrieval-Augmented Generation SystemsCode0
A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelsCode0
MedHallTune: An Instruction-Tuning Benchmark for Mitigating Medical Hallucination in Vision-Language ModelsCode0
Answering Naturally: Factoid to Full length Answer GenerationCode0
On the Multilingual Capabilities of Very Large-Scale English Language ModelsCode0
Medical Adaptation of Large Language and Vision-Language Models: Are We Making Progress?Code0
Prosody Modifications for Question-Answering in Voice-Only SettingsCode0
Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image RepresentationsCode0
Medical Large Vision Language Models with Multi-Image Visual AbilityCode0
Medical Question Summarization with Entity-driven Contrastive LearningCode0
Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-SupervisionCode0
Capturing Humans' Mental Models of AI: An Item Response Theory ApproachCode0
On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based MethodCode0
Protecting multimodal large language models against misleading visualizationsCode0
On the Robustness of Question Rewriting Systems to Questions of Varying HardnessCode0
A Survey on Deep Learning for Named Entity RecognitionCode0
Does RAG Introduce Unfairness in LLMs? Evaluating Fairness in Retrieval-Augmented Generation SystemsCode0
On the Structural Memory of LLM AgentsCode0
MediFact at MEDIQA-CORR 2024: Why AI Needs a Human TouchCode0
MediFact at MEDIQA-M3G 2024: Medical Question Answering in Dermatology with Multimodal LearningCode0
Does Chain-of-Thought Reasoning Help Mobile GUI Agent? An Empirical StudyCode0
On the Summarization of Consumer Health QuestionsCode0
Document Haystacks: Vision-Language Reasoning Over Piles of 1000+ DocumentsCode0
DocTabQA: Answering Questions from Long Documents Using TablesCode0
MedLogic-AQA: Enhancing Medical Question Answering with Abstractive Models Focusing on Logical StructuresCode0
DocMIA: Document-Level Membership Inference Attacks against DocVQA ModelsCode0
D-NET: A Pre-Training and Fine-Tuning Framework for Improving the Generalization of Machine Reading ComprehensionCode0
MedMobile: A mobile-sized language model with expert-level clinical capabilitiesCode0
DLP-LoRA: Efficient Task-Specific LoRA Fusion with a Dynamic, Lightweight Plugin for Large Language ModelsCode0
A Survey of Video Datasets for Grounded Event UnderstandingCode0
Answering Diverse Questions via Text Attached with Key Audio-Visual CluesCode0
Med-PMC: Medical Personalized Multi-modal Consultation with a Proactive Ask-First-Observe-Next ParadigmCode0
Med-REFL: Medical Reasoning Enhancement via Self-Corrected Fine-grained ReflectionCode0
Aligning Multilingual Embeddings for Improved Code-switched Natural Language UnderstandingCode0
Answering Count Queries with Explanatory EvidenceCode0
Proximity QA: Unleashing the Power of Multi-Modal Large Language Models for Spatial Proximity AnalysisCode0
A Study on Large Language Models' Limitations in Multiple-Choice Question AnsweringCode0
Answering Complex Questions Using Open Information ExtractionCode0
MedViLaM: A multimodal large language model with advanced generalizability and explainability for medical data understanding and generationCode0
Revisiting Sentence Union Generation as a Testbed for Text ConsolidationCode0
Pruning Pre-trained Language Models with Principled Importance and Self-regularizationCode0
MeeQA: Natural Questions in Meeting TranscriptsCode0
Reading Between the Lanes: Text VideoQA on the RoadCode0
Show:102550
← PrevPage 207 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified