SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 13011350 of 10817 papers

TitleStatusHype
ControlLM: Crafting Diverse Personalities for Language ModelsCode1
How to Configure Good In-Context Sequence for Visual Question AnsweringCode1
Classification-Regression for Chart ComprehensionCode1
How to Get Your LLM to Generate Challenging Problems for EvaluationCode1
ClarQ: A large-scale and diverse dataset for Clarification Question GenerationCode1
KETM:A Knowledge-Enhanced Text Matching methodCode1
AutoQA: From Databases To QA Semantic Parsers With Only Synthetic Training DataCode1
Autoregressive Entity RetrievalCode1
An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQACode1
CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual ReasoningCode1
A Comparative Study of Pretrained Language Models for Long Clinical TextCode1
Coupling Large Language Models with Logic Programming for Robust and General Reasoning from TextCode1
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencesCode1
How to Train BERT with an Academic BudgetCode1
AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the WebCode1
CoRel: Seed-Guided Topical Taxonomy Construction by Concept Learning and Relation TransferringCode1
KLEJ: Comprehensive Benchmark for Polish Language UnderstandingCode1
Knowing More About Questions Can Help: Improving Calibration in Question AnsweringCode1
DiReCT: Diagnostic Reasoning for Clinical Notes via Large Language ModelsCode1
CoSQA: 20,000+ Web Queries for Code Search and Question AnsweringCode1
Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question AnsweringCode1
CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question AnsweringCode1
HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual DataCode1
Lever LM: Configuring In-Context Sequence to Lever Large Vision Language ModelsCode1
Counterfactual Samples Synthesizing for Robust Visual Question AnsweringCode1
Counterfactual Variable Control for Robust and Interpretable Question AnsweringCode1
ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidenceCode1
3D-Aware Visual Question Answering about Parts, Poses and OcclusionsCode1
COVID-QA: A Question Answering Dataset for COVID-19Code1
COVID-19 event extraction from Twitter via extractive question answering with continuous promptsCode1
CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractionsCode1
Citekit: A Modular Toolkit for Large Language Model Citation GenerationCode1
CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and AugmentationCode1
How Language Model Hallucinations Can SnowballCode1
How Do Multimodal Large Language Models Handle Complex Multimodal Reasoning? Placing Them in An Extensible Escape GameCode1
CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City SpaceCode1
Creating Custom Event Data Without Dictionaries: A Bag-of-TricksCode1
CKBP v2: Better Annotation and Reasoning for Commonsense Knowledge Base PopulationCode1
Baby's CoThought: Leveraging Large Language Models for Enhanced Reasoning in Compact ModelsCode1
CREPE: Open-Domain Question Answering with False PresuppositionsCode1
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable MaskingCode1
Knowledge Infused DecodingCode1
ChiQA: A Large Scale Image-based Real-World Question Answering Dataset for Multi-Modal UnderstandingCode1
ChroniclingAmericaQA: A Large-scale Question Answering Dataset based on Historical American Newspaper PagesCode1
CuriousLLM: Elevating Multi-Document QA with Reasoning-Infused Knowledge Graph PromptingCode1
Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language ModelsCode1
How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer RepresentationsCode1
KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge BaseCode1
Cross-Modal BERT for Text-Audio Sentiment AnalysisCode1
How Much Can CLIP Benefit Vision-and-Language Tasks?Code1
Show:102550
← PrevPage 27 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified