SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 21512200 of 10817 papers

TitleStatusHype
LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language ModelsCode1
Evaluating Multimodal Representations on Visual Semantic Textual SimilarityCode1
Development and bilingual evaluation of Japanese medical large language model within reasonably low computational resourcesCode1
Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge AlignmentCode1
Compositional Semantic Parsing on Semi-Structured TablesCode1
Evaluating Very Long-Term Conversational Memory of LLM AgentsCode1
Evaluation of ChatGPT Family of Models for Biomedical Reasoning and ClassificationCode1
Event Extraction as Question Generation and AnsweringCode1
Dense Hierarchical Retrieval for Open-Domain Question AnsweringCode1
EXAMS: A Multi-Subject High School Examinations Dataset for Cross-Lingual and Multilingual Question AnsweringCode1
Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question AnsweringCode1
Expert Knowledge-Aware Image Difference Graph Representation Learning for Difference-Aware Medical Visual Question AnsweringCode1
Densely Connected Attention Propagation for Reading ComprehensionCode1
Explaining Autonomous Driving Actions with Visual Question AnsweringCode1
Explaining Question Answering Models through Text GenerationCode1
Explicit Planning Helps Language Models in Logical ReasoningCode1
Exploring Dual Encoder Architectures for Question AnsweringCode1
GPT-4V-AD: Exploring Grounding Potential of VQA-oriented GPT-4V for Zero-shot Anomaly DetectionCode1
Exploring Perceptual Limitation of Multimodal Large Language ModelsCode1
Consistency-preserving Visual Question Answering in Medical ImagingCode1
Exploring the Benefits of Training Expert Language Models over Instruction TuningCode1
Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQACode1
ExpMRC: Explainability Evaluation for Machine Reading ComprehensionCode1
Exposing Shallow Heuristics of Relation Extraction Models with Challenge DataCode1
Dense Passage Retrieval for Open-Domain Question AnsweringCode1
DeVLBert: Learning Deconfounded Visio-Linguistic RepresentationsCode1
CogMG: Collaborative Augmentation Between Large Language Model and Knowledge GraphCode1
Delaying Interaction Layers in Transformer-based Encoders for Efficient Open Domain Question AnsweringCode1
FastFiD: Improve Inference Efficiency of Open Domain Question Answering via Sentence SelectionCode1
ConceptBert: Concept-Aware Representation for Visual Question AnsweringCode1
FedMatch: Federated Learning Over Heterogeneous Question Answering DataCode1
DELIFT: Data Efficient Language model Instruction Fine TuningCode1
DeFormer: Decomposing Pre-trained Transformers for Faster Question AnsweringCode1
A Dataset of Information-Seeking Questions and Answers Anchored in Research PapersCode1
Learning Video Context as Interleaved Multimodal SequencesCode1
FewshotQA: A simple framework for few-shot learning of question answering tasks using pre-trained text-to-text modelsCode1
DegreEmbed: incorporating entity embedding into logic rule learning for knowledge graph reasoningCode1
Cross-document Event Coreference Search: Task, Dataset and ModelingCode1
Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning StepsCode1
Fine-Grained Evaluation of Large Vision-Language Models in Autonomous DrivingCode1
ECONET: Effective Continual Pretraining of Language Models for Event Temporal ReasoningCode1
Code-Style In-Context Learning for Knowledge-Based Question AnsweringCode1
Conformal Prediction with Large Language Models for Multi-Choice Question AnsweringCode1
FinQA: A Dataset of Numerical Reasoning over Financial DataCode1
Consistency Regularization for Cross-Lingual Fine-TuningCode1
Connecting Vision and Language with Video Localized NarrativesCode1
Defeasible Visual Entailment: Benchmark, Evaluator, and Reward-Driven OptimizationCode1
Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL ModelsCode1
DEXTER: A Benchmark for open-domain Complex Question Answering using LLMsCode1
DocNLI: A Large-scale Dataset for Document-level Natural Language InferenceCode1
Show:102550
← PrevPage 44 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified