SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 49014950 of 10817 papers

TitleStatusHype
Evaluating the Retrieval Component in LLM-Based Question Answering Systems0
Evaluating the Representational Hub of Language and Vision Models0
Can Transformers Reason About Effects of Actions?0
Evaluating the Performance of ChatGPT for Spam Email Detection0
Evaluating the Performance and Robustness of LLMs in Materials Science Q&A and Property Predictions0
Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought0
Evaluating the Meta- and Object-Level Reasoning of Large Language Models for Question Answering0
Evaluating the Effect of Retrieval Augmentation on Social Biases0
Do Question Answering Modeling Improvements Hold Across Benchmarks?0
Can SAR improve RSVQA performance?0
Evaluating the Capabilities of Multi-modal Reasoning Models with Synthetic Task Data0
Evaluating Text Segmentation using Boundary Edit Distance0
ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering0
Evaluating Span Extraction in Generative Paradigm: A Reflection on Aspect-Based Sentiment Analysis0
Evaluating Self-Generated Documents for Enhancing Retrieval-Augmented Generation with Large Language Models0
Evaluating Recognizing Question Entailment Methods for a Portuguese Community Question-Answering System about Diabetes Mellitus0
Can Question Generation Debias Question Answering Models? A Case Study on Question–Context Lexical Overlap0
A Procedural Definition of Multi-word Lexical Units0
AiFu at SemEval-2019 Task 10: A Symbolic and Sub-symbolic Integrated System for SAT Math Question Answering0
Abductive Matching in Question Answering0
Evaluating Question Answering Evaluation0
Can Pre-training help VQA with Lexical Variations?0
A Probabilistic Model for Joint Learning of Word Embeddings from Texts and Images0
Evaluating Multi-focus Natural Language Queries over Data Services0
Can predicate-argument relationships be extracted from UD trees?0
A Probabilistic-Logic based Commonsense Representation Framework for Modelling Inferences with Multiple Antecedents and Varying Likelihoods0
AIDA: Artificial Intelligent Dialogue Agent0
Evaluating Machine Reading Systems through Comprehension Tests0
Can Open Domain Question Answering Systems Answer Visual Knowledge Questions?0
Evaluating Machine Common Sense via Cloze Testing0
Evaluating LLMs on Document-Based QA: Exact Answer Selection and Numerical Extraction using Cogtale dataset0
A Probabilistic Lexical Model for Ranking Textual Inferences0
Evaluating LLMs Capabilities Towards Understanding Social Dynamics0
A Probabilistic Annotation Model for Crowdsourcing Coreference0
AIA-BDE: A Corpus of FAQs in Portuguese and their Variations0
Can Multimodal LLMs do Visual Temporal Understanding and Reasoning? The answer is No!0
Evaluating Knowledge Graph Based Retrieval Augmented Generation Methods under Knowledge Incompleteness0
A Pretraining Numerical Reasoning Model for Ordinal Constrained Question Answering on Knowledge Base0
Can LLMs Generate Human-Like Wayfinding Instructions? Towards Platform-Agnostic Embodied Instruction Synthesis0
Evaluating Hallucination in Text-to-Image Diffusion Models with Scene-Graph based Question-Answering Agent0
Evaluating Feature Extraction Methods for Knowledge-based Biomedical Word Sense Disambiguation0
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation0
A Preliminary Study of o1 in Medicine: Are We Closer to an AI Doctor?0
Can Large Language Models Unveil the Mysteries? An Exploration of Their Ability to Unlock Information in Complex Scenarios0
Evaluating Consistencies in LLM responses through a Semantic Clustering of Question Answering0
Can Large Language Models Faithfully Express Their Intrinsic Uncertainty in Words?0
A Practical Entity Linking System for Tables in Scientific Literature0
A Practical 2-step Approach to Assist Enterprise Question-Answering Live Chat0
Actively Seeking and Learning from Live Data0
Who Taught You That? Tracing Teachers in Model Distillation0
Show:102550
← PrevPage 99 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified