SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 1000110025 of 10817 papers

TitleStatusHype
Semeval-2013 Task 8: Cross-lingual Textual Entailment for Content Synchronization0
SemEval-2014 Task 10: Multilingual Semantic Textual Similarity0
SemEval-2014 Task 6: Supervised Semantic Parsing of Robotic Spatial Commands0
SemEval-2015 Task 14: Analysis of Clinical Text0
SemEval-2015 Task 17: Taxonomy Extraction Evaluation (TExEval)0
SemEval-2015 Task 2: Semantic Textual Similarity, English, Spanish and Pilot on Interpretability0
SemEval-2015 Task 3: Answer Selection in Community Question Answering0
SemEval-2015 Task 5: QA TempEval - Evaluating Temporal Information Understanding with Question Answering0
SemEval-2016 Task 13: Taxonomy Extraction Evaluation (TExEval-2)0
SemEval-2016 Task 1: Semantic Textual Similarity, Monolingual and Cross-Lingual Evaluation0
SemEval-2016 Task 3: Community Question Answering0
SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation0
SemEval-2017 Task 2: Multilingual and Cross-lingual Semantic Word Similarity0
SemEval 2018 Task 4: Character Identification on Multiparty Dialogues0
SemEval-2018 Task 9: Hypernym Discovery0
SemEval-2022 Task 9: R2VQ – Competence-based Multimodal Question Answering0
Semi-Automatic Construction of a Textual Entailment Dataset: Selecting Candidates with Vector Space Models0
Semi-automatic Korean FrameNet Annotation over KAIST Treebank0
Semi-compositional Method for Synonym Extraction of Multi-Word Terms0
Semi-interactive Attention Network for Answer Understanding in Reverse-QA0
SEMILAR: The Semantic Similarity Toolkit0
Semi-Markov Phrase-Based Monolingual Alignment0
SemioLLM: Assessing Large Language Models for Semiological Analysis in Epilepsy Research0
semiPQA: A Study on Product Question Answering over Semi-structured Data0
Semi-Structured Chain-of-Thought: Integrating Multiple Sources of Knowledge for Improved Language Model Reasoning0
Show:102550
← PrevPage 401 of 433Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified