SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 34513500 of 10817 papers

TitleStatusHype
UniGen: A Unified Generative Framework for Retrieval and Question Answering with Large Language Models0
p-Laplacian Adaptation for Generative Pre-trained Vision-Language ModelsCode0
Do LLMs Work on Charts? Designing Few-Shot Prompts for Chart Question Answering and Summarization0
An Evaluation of GPT-4V and Gemini in Online VQA0
LLM-SQL-Solver: Can LLMs Determine SQL Equivalence?Code0
WordScape: a Pipeline to extract multilingual, visually rich Documents with Layout Annotations from Web Crawl DataCode1
Pipeline and Dataset Generation for Automated Fact-checking in Almost Any LanguageCode0
Do Text Simplification Systems Preserve Meaning? A Human Evaluation via Reading ComprehensionCode0
RJUA-QA: A Comprehensive QA Dataset for UrologyCode1
Advancing Surgical VQA with Scene Graph Knowledge0
ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agent0
Lever LM: Configuring In-Context Sequence to Lever Large Vision Language ModelsCode1
Privacy-Aware Document Visual Question AnsweringCode1
Extending Context Window of Large Language Models via Semantic CompressionCode1
GSQA: An End-to-End Model for Generative Spoken Question Answering0
Dynamic Retrieval-Augmented Generation0
VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and GenerationCode1
Large Language Models are Complex Table Parsers0
Look Before You Leap: A Universal Emergent Decomposition of Retrieval Tasks in Language ModelsCode0
Chat-Scene: Bridging 3D Scene and Large Language Models with Object IdentifiersCode2
ViLA: Efficient Video-Language Alignment for Video Question AnsweringCode1
BESTMVQA: A Benchmark Evaluation System for Medical Visual Question Answering0
Large language models in healthcare and medical domain: A review0
Vista-LLaMA: Reliable Video Narrator via Equal Distance to Visual Tokens0
Safety Alignment in NLP Tasks: Weakly Aligned Summarization as an In-Context AttackCode0
SocialStigmaQA: A Benchmark to Uncover Stigma Amplification in Generative Language Models0
Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignment0
Image Content Generation with Causal ReasoningCode0
Evaluating ChatGPT as a Question Answering System: A Comprehensive Analysis and Comparison with Existing Models0
Genixer: Empowering Multimodal Large Language Models as a Powerful Data GeneratorCode1
KnowGPT: Knowledge Graph based Prompting for Large Language Models0
NuScenes-MQA: Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup AnnotationsCode1
Unlocking Anticipatory Text Generation: A Constrained Approach for Large Language Models DecodingCode0
Unifying Text, Tables, and Images for Multimodal Question AnsweringCode0
Causal-CoG: A Causal-Effect Look at Context Generation for Boosting Multi-modal Language Models0
A Review of Hybrid and Ensemble in Deep Learning for Natural Language Processing0
PaperQA: Retrieval-Augmented Generative Agent for Scientific Research0
MoVQA: A Benchmark of Versatile Question-Answering for Long-Form Movie Understanding0
Retrieval-based Video Language Model for Efficient Long Video Question Answering0
DelucionQA: Detecting Hallucinations in Domain-specific Question Answering0
LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric VideosCode1
GYM at Qur’an QA 2023 Shared Task: Multi-Task Transfer Learning for Quranic Passage Retrieval and Question Answering with Large Language ModelsCode0
PCoQA: Persian Conversational Question Answering DatasetCode1
Language Model Knowledge Distillation for Efficient Question Answering in SpanishCode0
OneLLM: One Framework to Align All Modalities with LanguageCode2
Language-Informed Visual Concept LearningCode1
XAIQA: Explainer-Based Data Augmentation for Extractive Question Answering0
Let the LLMs Talk: Simulating Human-to-Human Conversational QA via Zero-Shot LLM-to-LLM InteractionsCode1
CLAMP: Contrastive LAnguage Model Prompt-tuning0
Evaluating Dependencies in Fact Editing for Language Models: Specificity and Implication AwarenessCode0
Show:102550
← PrevPage 70 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified