SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 13511400 of 10817 papers

TitleStatusHype
CLIP-Guided Vision-Language Pre-training for Question Answering in 3D ScenesCode1
CLTR: An End-to-End, Transformer-Based System for Cell Level Table Retrieval and Table Question AnsweringCode1
BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language ModelsCode1
Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision SignalsCode1
D2S: Document-to-Slide Generation Via Query-Based Text SummarizationCode1
BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in BanglaCode1
Improving Retrieval-Augmented Large Language Models via Data Importance LearningCode1
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language GenerationCode1
Improving BERT with Syntax-aware Local AttentionCode1
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencesCode1
Large Scale Multimodal Classification Using an Ensemble of Transformer Models and Co-AttentionCode1
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionCode1
Data Mining in Clinical Trial Text: Transformers for Classification and Question Answering TasksCode1
Improving Embedded Knowledge Graph Multi-hop Question Answering by introducing Relational Chain ReasoningCode1
Lattice CNNs for Matching Based Chinese Question AnsweringCode1
LAVENDER: Unifying Video-Language Understanding as Masked Language ModelingCode1
IMPACT: A Large-scale Integrated Multimodal Patent Analysis and Creation Dataset for Design PatentsCode1
Clinical Reading Comprehension: A Thorough Analysis of the emrQA DatasetCode1
Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language ModelsCode1
Bayesian Attention ModulesCode1
Debiased Visual Question Answering from Feature and Sample PerspectivesCode1
Improving Factual Consistency of Abstractive Summarization via Question AnsweringCode1
Clickbait Spoiling via Question Answering and Passage RetrievalCode1
CLEVR-X: A Visual Reasoning Dataset for Natural Language ExplanationsCode1
BBQ: A Hand-Built Bias Benchmark for Question AnsweringCode1
DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate HallucinationsCode1
Learning Event Graph Knowledge for Abductive ReasoningCode1
End-to-End Beam Retrieval for Multi-Hop Question AnsweringCode1
Decoupled Seg Tokens Make Stronger Reasoning Video Segmenter and GrounderCode1
BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference DatasetCode1
IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language ModelCode1
Beheshti-NER: Persian Named Entity Recognition Using BERTCode1
A Comprehensive Evaluation of GPT-4V on Knowledge-Intensive Visual Question AnsweringCode1
Deep Learning Based Text Classification: A Comprehensive ReviewCode1
CLEVR-Math: A Dataset for Compositional Language, Visual and Mathematical ReasoningCode1
Deep Multimodal Neural Architecture SearchCode1
Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global InferenceCode1
ECONET: Effective Continual Pretraining of Language Models for Event Temporal ReasoningCode1
IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and LanguagesCode1
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data ProcessingCode1
Improving Language Understanding by Generative Pre-TrainingCode1
Benchmarking for Biomedical Natural Language Processing Tasks with a Domain Specific ALBERTCode1
DegreEmbed: incorporating entity embedding into logic rule learning for knowledge graph reasoningCode1
Benchmarking Geospatial Question Answering Engines using the Dataset GeoQuestions1089Code1
CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual ReasoningCode1
Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model EvaluationCode1
Attention in Reasoning: Dataset, Analysis, and ModelingCode1
Lever LM: Configuring In-Context Sequence to Lever Large Vision Language ModelsCode1
Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL ModelsCode1
Comprehensive Visual Question Answering on Point Clouds through Compositional Scene ManipulationCode1
Show:102550
← PrevPage 28 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified