SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 14511500 of 10817 papers

TitleStatusHype
DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question AnsweringCode1
Knowledge Infused DecodingCode1
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterCode1
DocNLI: A Large-scale Dataset for Document-level Natural Language InferenceCode1
Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual NoiseCode1
BioProBench: Comprehensive Dataset and Benchmark in Biological Protocol Understanding and ReasoningCode1
Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge GraphsCode1
Discourse Analysis via Questions and Answers: Parsing Dependency Structures of Questions Under DiscussionCode1
L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic ContextCode1
Beyond End-to-End VLMs: Leveraging Intermediate Text Representations for Superior Flowchart UnderstandingCode1
Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning StrategiesCode1
Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge GeneratorsCode1
An Empirical Study of Pre-trained Transformers for Arabic Information ExtractionCode1
Language Guided Visual Question Answering: Elevate Your Multimodal Language Model Using Knowledge-Enriched PromptsCode1
Differentiable Reasoning on Large Knowledge Bases and Natural LanguageCode1
Birdie: Advancing State Space Models with Reward-Driven Objectives and CurriculaCode1
Language Models as Science TutorsCode1
Beyond Memorization: The Challenge of Random Memory Access in Language ModelsCode1
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference OptimizationCode1
Language Models with Image Descriptors are Strong Few-Shot Video-Language LearnersCode1
ByT5: Towards a token-free future with pre-trained byte-to-byte modelsCode1
CABINET: Content Relevance based Noise Reduction for Table Question AnsweringCode1
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question AnsweringCode1
Large Language Models are Temporal and Causal Reasoners for Video Question AnsweringCode1
DialSim: A Real-Time Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational AgentsCode1
Dynamically Fused Graph Network for Multi-hop ReasoningCode1
emrQA: A Large Corpus for Question Answering on Electronic Medical RecordsCode1
Few-shot In-context Learning for Knowledge Base Question AnsweringCode1
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark DatasetsCode1
Large language model validity via enhanced conformal prediction methodsCode1
BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairsCode1
Large Scale Multimodal Classification Using an Ensemble of Transformer Models and Co-AttentionCode1
LaTr: Layout-Aware Transformer for Scene-Text VQACode1
Lattice CNNs for Matching Based Chinese Question AnsweringCode1
Lawformer: A Pre-trained Language Model for Chinese Legal Long DocumentsCode1
Layout and Task Aware Instruction Prompt for Zero-shot Document Image Question AnsweringCode1
Detecting and Preventing Hallucinations in Large Vision Language ModelsCode1
Learning Contextualized Knowledge Structures for Commonsense ReasoningCode1
Bias-Augmented Consistency Training Reduces Biased Reasoning in Chain-of-ThoughtCode1
Learning Dialogue Representations from Consecutive UtterancesCode1
Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as AgentsCode1
Learning Neural Models for Natural Language Processing in the Face of Distributional ShiftCode1
Designing a Minimal Retrieve-and-Read System for Open-Domain Question AnsweringCode1
Bidirectional Attentive Memory Networks for Question Answering over Knowledge BasesCode1
CodeQueries: A Dataset of Semantic Queries over CodeCode1
Learning to Answer Visual Questions from Web VideosCode1
Big Bird: Transformers for Longer SequencesCode1
Learning to Attribute with AttentionCode1
A Symmetric Dual Encoding Dense Retrieval Framework for Knowledge-Intensive Visual Question AnsweringCode1
Detecting Hate Speech in Multi-modal MemesCode1
Show:102550
← PrevPage 30 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified