SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 42014250 of 10817 papers

TitleStatusHype
MedExQA: Medical Question Answering Benchmark with Multiple ExplanationsCode0
Zero-Shot End-To-End Spoken Question Answering In Medical Domain0
Do LLMs Exhibit Human-Like Reasoning? Evaluating Theory of Mind in LLMs for Open-Ended Responses0
RE-RAG: Improving Open-Domain QA Performance and Interpretability with Relevance Estimator in Retrieval-Augmented GenerationCode0
MrRank: Improving Question Answering Retrieval System through Multi-Result Ranking Model0
MedREQAL: Examining Medical Knowledge Recall of Large Language Models via Question Answering0
CERET: Cost-Effective Extrinsic Refinement for Text GenerationCode0
Towards a Benchmark for Causal Business Process Reasoning with LLMsCode0
CaLM: Contrasting Large and Small Language Models to Verify Grounded Generation0
Investigating and Addressing Hallucinations of LLMs in Tasks Involving Negation0
Do LLMs Recognize me, When I is not me: Assessment of LLMs Understanding of Turkish Indexical Pronouns in Indexical Shift Contexts0
Venn Diagram Prompting : Accelerating Comprehension with Scaffolding Effect0
MATTER: Memory-Augmented Transformer Using Heterogeneous Knowledge Sources0
TCMD: A Traditional Chinese Medicine QA Dataset for Evaluating Large Language Models0
CRiskEval: A Chinese Multi-Level Risk Evaluation Benchmark Dataset for Large Language ModelsCode0
On Subjective Uncertainty Quantification and Calibration in Natural Language GenerationCode0
Composition Vision-Language Understanding via Segment and Depth Anything ModelCode0
Understanding Information Storage and Transfer in Multi-modal Large Language Models0
FairytaleQA Translated: Enabling Educational Question and Answer Generation in Less-Resourced LanguagesCode0
Efficient Knowledge Infusion via KG-LLM Alignment0
Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?0
M-QALM: A Benchmark to Assess Clinical Reading Comprehension and Knowledge Recall in Large Language Models via Question AnsweringCode0
Synthesizing Conversations from Unlabeled Documents using Automatic Response Segmentation0
IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models0
Measuring Retrieval Complexity in Question Answering Systems0
Discovering Bias in Latent Space: An Unsupervised Debiasing Approach0
Balancing Performance and Efficiency in Zero-shot Robotic Navigation0
CSS: Contrastive Semantic Similarity for Uncertainty Quantification of LLMsCode0
UniOQA: A Unified Framework for Knowledge Graph Question Answering with Large Language Models0
I've got the "Answer"! Interpretation of LLMs Hidden States in Question Answering0
Chain of Agents: Large Language Models Collaborating on Long-Context Tasks0
ACCORD: Closing the Commonsense Measurability GapCode0
Enhancing Retrieval-Augmented LMs with a Two-stage Consistency Learning Compressor0
Multimodal Reasoning with Multimodal Knowledge Graph0
On the Intrinsic Self-Correction Capability of LLMs: Uncertainty and Latent Concept0
Translation Deserves Better: Analyzing Translation Artifacts in Cross-lingual Visual Question Answering0
Diffusion-Refined VQA Annotations for Semi-Supervised Gaze FollowingCode0
Analyzing Social Biases in Japanese Large Language ModelsCode0
Story Generation from Visual Inputs: Techniques, Related Tasks, and Challenges0
Ask-EDA: A Design Assistant Empowered by LLM, Hybrid RAG and Abbreviation De-hallucination0
Utilizing Large Language Models for Automating Technical Customer Support0
Graph Neural Network Enhanced Retrieval for Question Answering of LLMs0
Explore then Determine: A GNN-LLM Synergy Framework for Reasoning over Knowledge Graph0
Mixture of Rationale: Multi-Modal Reasoning Mixture for Visual Question Answering0
Selectively Answering Visual Questions0
EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphs0
MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answering0
Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language GenerationCode0
Superhuman performance in urology board questions by an explainable large language model enabled for context integration of the European Association of Urology guidelines: the UroBot study0
CMDBench: A Benchmark for Coarse-to-fine Multimodal Data Discovery in Compound AI SystemsCode0
Show:102550
← PrevPage 85 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified