SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 901950 of 10817 papers

TitleStatusHype
SuRe: Summarizing Retrievals using Answer Candidates for Open-domain QA of LLMsCode1
Spiral of Silence: How is Large Language Model Killing Information Retrieval? -- A Case Study on Open Domain Question AnsweringCode1
ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidenceCode1
Constructing Benchmarks and Interventions for Combating Hallucinations in LLMsCode1
TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table DecompositionCode1
TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image UnderstandingCode1
CuriousLLM: Elevating Multi-Document QA with Reasoning-Infused Knowledge Graph PromptingCode1
Enhancing Visual Question Answering through Question-Driven Image Captions as PromptsCode1
OpenBias: Open-set Bias Detection in Text-to-Image Generative ModelsCode1
CBR-RAG: Case-Based Reasoning for Retrieval Augmented Generation in LLMs for Legal Question AnsweringCode1
Multi-Granularity Guided Fusion-in-DecoderCode1
CLAPNQ: Cohesive Long-form Answers from Passages in Natural Questions for RAG systemsCode1
CausalChaos! Dataset for Comprehensive Causal Action Question Answering Over Longer Causal Chains Grounded in Dynamic Visual ScenesCode1
TraveLER: A Modular Multi-LMM Agent Framework for Video Question-AnsweringCode1
Linguistic Calibration of Long-Form GenerationsCode1
Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question AnsweringCode1
JDocQA: Japanese Document Question Answering Dataset for Generative Language ModelsCode1
TriviaHG: A Dataset for Automatic Hint Generation from Factoid QuestionsCode1
Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal PerspectiveCode1
Non-Linear Inference Time Intervention: Improving LLM TruthfulnessCode1
ChroniclingAmericaQA: A Large-scale Question Answering Dataset based on Historical American Newspaper PagesCode1
ArabicaQA: A Comprehensive Dataset for Arabic Question AnsweringCode1
Attribute First, then Generate: Locally-attributable Grounded Text GenerationCode1
Language Repository for Long Video UnderstandingCode1
Multi-Agent VQA: Exploring Multi-Agent Foundation Models in Zero-Shot Visual Question AnsweringCode1
NovelQA: Benchmarking Question Answering on Documents Exceeding 200K TokensCode1
SQ-LLaVA: Self-Questioning for Large Vision-Language AssistantCode1
Forward Learning of Graph Neural NetworksCode1
ChartInstruct: Instruction Tuning for Chart Comprehension and ReasoningCode1
Can We Talk Models Into Seeing the World Differently?Code1
Transformers Get Stable: An End-to-End Signal Propagation Theory for Language ModelsCode1
Retrieval augmented text-to-SQL generation for epidemiological question answering using electronic health recordsCode1
DAM: Dynamic Adapter Merging for Continual Video QA LearningCode1
Beyond Memorization: The Challenge of Random Memory Access in Language ModelsCode1
Complex Reasoning over Logical Queries on Commonsense Knowledge GraphsCode1
ALaRM: Align Language Models via Hierarchical Rewards ModelingCode1
InfiBench: Evaluating the Question-Answering Capabilities of Code Large Language ModelsCode1
Calibrating Large Language Models Using Their Generations OnlyCode1
Can't Remember Details in Long Documents? You Need Some R&RCode1
Bias-Augmented Consistency Training Reduces Biased Reasoning in Chain-of-ThoughtCode1
Harnessing Multi-Role Capabilities of Large Language Models for Open-Domain Question AnsweringCode1
To Generate or to Retrieve? On the Effectiveness of Artificial Contexts for Medical Open-Domain Question AnsweringCode1
Brilla AI: AI Contestant for the National Science and Maths QuizCode1
CR-LT-KGQA: A Knowledge Graph Question Answering Dataset Requiring Commonsense Reasoning and Long-Tail KnowledgeCode1
Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering BenchmarkCode1
Benchmarking Large Language Models on Answering and Explaining Challenging Medical QuestionsCode1
Characterizing Truthfulness in Large Language Model Generations with Local Intrinsic DimensionCode1
Evaluating Very Long-Term Conversational Memory of LLM AgentsCode1
NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long DocumentsCode1
Can LLM Generate Culturally Relevant Commonsense QA Data? Case Study in Indonesian and SundaneseCode1
Show:102550
← PrevPage 19 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified