SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 12511300 of 10817 papers

TitleStatusHype
Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question AnsweringCode1
Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge AlignmentCode1
Automated Crossword SolvingCode1
IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and LanguagesCode1
Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive PrinciplesCode1
Improving Factual Consistency of Abstractive Summarization via Question AnsweringCode1
HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language GenerationCode1
Combo of Thinking and Observing for Outside-Knowledge VQACode1
Hidden Backdoors in Human-Centric Language ModelsCode1
Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model EvaluationCode1
Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision SignalsCode1
Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base EmbeddingsCode1
CLAPNQ: Cohesive Long-form Answers from Passages in Natural Questions for RAG systemsCode1
Improving Selective Visual Question Answering by Learning from Your PeersCode1
CompAct: Compressing Retrieved Documents Actively for Question AnsweringCode1
Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-RankingCode1
Hierarchical Conditional Relation Networks for Video Question AnsweringCode1
In Defense of Grid Features for Visual Question AnsweringCode1
Fine-tuned LLMs Know More, Hallucinate Less with Few-Shot Sequence-to-Sequence Semantic Parsing over WikidataCode1
Automatically Generating Cause-and-Effect Questions from PassagesCode1
Complex Temporal Question Answering on Knowledge GraphsCode1
ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step VerificationCode1
An Efficient Memory-Augmented Transformer for Knowledge-Intensive NLP TasksCode1
Compositional 4D Dynamic Scenes Understanding with Physics Priors for Video Question AnsweringCode1
Visual Grounding Methods for VQA are Working for the Wrong Reasons!Code1
Inductive Relation Prediction by Subgraph ReasoningCode1
ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human PreferencesCode1
Automatic Evaluation of Attribution by Large Language ModelsCode1
Advances of Transformer-Based Models for News Headline GenerationCode1
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual ConceptsCode1
ChiQA: A Large Scale Image-based Real-World Question Answering Dataset for Multi-Modal UnderstandingCode1
Continuous Language Generative FlowCode1
OK-VQA: A Visual Question Answering Benchmark Requiring External KnowledgeCode1
Conformal Prediction with Large Language Models for Multi-Choice Question AnsweringCode1
Conformal Language ModelingCode1
Conformal Alignment: Knowing When to Trust Foundation Models with GuaranteesCode1
Connecting Vision and Language with Video Localized NarrativesCode1
Consistency-preserving Visual Question Answering in Medical ImagingCode1
Hierarchical multimodal transformers for Multi-Page DocVQACode1
InsQABench: Benchmarking Chinese Insurance Domain Question Answering with Large Language ModelsCode1
Advancing High Resolution Vision-Language Models in BiomedicineCode1
Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning StepsCode1
Context-Aware Alignment and Mutual Masking for 3D-Language Pre-TrainingCode1
Context-Aware Answer Extraction in Question AnsweringCode1
HittER: Hierarchical Transformers for Knowledge Graph EmbeddingsCode1
Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language ModelsCode1
A Dataset for Interactive Vision-Language Navigation with Unknown Command FeasibilityCode1
Interconnected Question Generation with Coreference Alignment and Conversation Flow ModelingCode1
ConTEXTual Net: A Multimodal Vision-Language Model for Segmentation of PneumothoraxCode1
How Can We Know When Language Models Know? On the Calibration of Language Models for Question AnsweringCode1
Show:102550
← PrevPage 26 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified