SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 995110000 of 10817 papers

TitleStatusHype
AMQA: An Adversarial Dataset for Benchmarking Bias of LLMs in Medicine and HealthcareCode0
Evaluating Semantic Parsing against a Simple Web-based Question Answering ModelCode0
CMQA: A Dataset of Conditional Question Answering with Multiple-Span AnswersCode0
C-MORE: Pretraining to Answer Open-Domain Questions by Consulting Millions of ReferencesCode0
CMDBench: A Benchmark for Coarse-to-fine Multimodal Data Discovery in Compound AI SystemsCode0
Evaluating Prompt-based Question Answering for Object Prediction in the Open Research Knowledge GraphCode0
Listen and Speak Fairly: A Study on Semantic Gender Bias in Speech Integrated Large Language ModelsCode0
Relation-Aware Question Answering for Heterogeneous Knowledge GraphsCode0
Adding Gradient Noise Improves Learning for Very Deep NetworksCode0
Listen Then See: Video Alignment with Speaker AttentionCode0
PRIV-QA: Privacy-Preserving Question Answering for Cloud Large Language ModelsCode0
CluMo: Cluster-based Modality Fusion Prompt for Continual Learning in Visual Question AnsweringCode0
Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question AnsweringCode0
Evaluating Natural Language Understanding Services for Conversational Question Answering SystemsCode0
NIPS Conversational Intelligence Challenge 2017 Winner System: Skill-based Conversational Agent with Supervised Dialog ManagerCode0
NIR-Prompt: A Multi-task Generalized Neural Information Retrieval Training FrameworkCode0
Enhanced Language Model Truthfulness with Learnable Intervention and Uncertainty ExpressionCode0
NitiBench: A Comprehensive Studies of LLM Frameworks Capabilities for Thai Legal Question AnsweringCode0
LittleMu: Deploying an Online Virtual Teaching Assistant via Heterogeneous Sources Integration and Chain of Teach PromptsCode0
LiveQA: A Question Answering Dataset over Sports LiveCode0
R^3: Reinforced Reader-Ranker for Open-Domain Question AnsweringCode0
Evaluating Large Language Model with Knowledge Oriented Language Specific Simple Question AnsweringCode0
NLEBench+NorGLM: A Comprehensive Empirical Analysis and Benchmark Dataset for Generative Language Models in NorwegianCode0
Fine-Grained Stateful Knowledge Exploration: A Novel Paradigm for Integrating Knowledge Graphs with Large Language ModelsCode0
Probabilistic Embeddings for Frozen Vision-Language Models: Uncertainty Quantification with Gaussian Process Latent Variable ModelsCode0
Evaluating Large Language Models in Semantic Parsing for Conversational Question Answering over Knowledge GraphsCode0
Evaluating Fairness in Large Vision-Language Models Across Diverse Demographic Attributes and PromptsCode0
Evaluating Explanations: How much do explanations from the teacher aid students?Code0
Evaluating Dependencies in Fact Editing for Language Models: Specificity and Implication AwarenessCode0
Evaluating Coreference Resolvers on Community-based Question Answering: From Rule-based to State of the ArtCode0
Evaluating Commonsense in Pre-trained Language ModelsCode0
REVEAL: Retrieval-Augmented Visual-Language Pre-Training with Multi-Source Multimodal Knowledge MemoryCode0
Llama SLayer 8B: Shallow Layers Hold the Key to Knowledge InjectionCode0
Evaluating Attribute Comprehension in Large Vision-Language ModelsCode0
Relation Extraction : A SurveyCode0
NLPContributions: An Annotation Scheme for Machine Reading of Scholarly Contributions in Natural Language Processing LiteratureCode0
EuSQuAD: Automatically Translated and Aligned SQuAD2.0 for BasqueCode0
ETPC - A Paraphrase Identification Corpus Annotated with Extended Paraphrase Typology and NegationCode0
Ethical-Advice Taker: Do Language Models Understand Natural Language Interventions?Code0
ERVQA: A Dataset to Benchmark the Readiness of Large Vision Language Models in Hospital EnvironmentsCode0
Closed-book Question Generation via Contrastive LearningCode0
ERNIE-Layout: Layout-Knowledge Enhanced Multi-modal Pre-training for Document UnderstandingCode0
ERNIE-Doc: A Retrospective Long-Document Modeling TransformerCode0
EQuANt (Enhanced Question Answer Network)Code0
AdCare-VLM: Leveraging Large Vision Language Model (LVLM) to Monitor Long-Term Medication Adherence and CareCode0
Reasoning over Uncertain Text by Generative Large Language ModelsCode0
EQA-RM: A Generative Embodied Reward Model with Test-time ScalingCode0
NLProlog: Reasoning with Weak Unification for Question Answering in Natural LanguageCode0
LLM-as-a-Judge: Reassessing the Performance of LLMs in Extractive QACode0
ClinKD: Cross-Modal Clinical Knowledge Distiller For Multi-Task Medical ImagesCode0
Show:102550
← PrevPage 200 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified