SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 77017750 of 10817 papers

TitleStatusHype
Iterative Scene Graph Generation with Generative Transformers0
Iterative Multi-document Neural Attention for Multiple Answer Prediction0
Iterative Adversarial Attack on Image-guided Story Ending Generation0
Iterated learning for emergent systematicity in VQA0
Cycle-Consistency for Robust Visual Question Answering0
QA: from Turing Test to Intelligent Information Service0
Automated Testing and Improvement of Named Entity Recognition Systems0
An Effective Contextual Language Modeling Framework for Speech Summarization with Augmented Features0
Is This Just Fantasy? Language Model Representations Reflect Human Judgments of Event Plausibility0
"Is This It?": Towards Ecologically Valid Benchmarks for Situated Collaboration0
CyberBOT: Towards Reliable Cybersecurity Education via Ontology-Grounded Retrieval Augmented Generation0
Is Table Retrieval a Solved Problem? Exploring Join-Aware Multi-Table Retrieval0
Is Summary Useful or Not? An Extrinsic Human Evaluation of Text Summaries on Downstream Tasks0
ISS-MULT: Intelligent Sample Selection for Multi-Task Learning in Question Answering0
Is Sluice Resolution really just Question Answering?0
CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark0
Automated Story Generation as Question-Answering0
ANEC: An Amharic Named Entity Corpus and Transformer Based Recognizer0
ARTEMIS-DA: An Advanced Reasoning and Transformation Engine for Multi-Step Insight Synthesis in Data Analytics0
A Cognitive Ideation Support Framework using IBM Watson Services0
Is Retriever Merely an Approximator of Reader?0
C-VQA: A Compositional Split of the Visual Question Answering (VQA) v1.0 Dataset0
Is Relevance Propagated from Retriever to Generator in RAG?0
Automated Historical Fact-Checking by Passage Retrieval, Word Statistics, and Virtual Question-Answering0
ISO-TimeML Event Extraction in Persian Text0
IslamicPCQA: A Dataset for Persian Multi-hop Complex Question Answering in Islamic Text Resources0
Is It Dish Washer Safe? Automatically Answering ``Yes/No'' Questions Using Customer Reviews0
Cut to the Chase: A Context Zoom-in Network for Reading Comprehension0
Automated Graph Generation at Sentence Level for Reading Comprehension Based on Conceptual Graphs0
Is Graph Structure Necessary for Multi-hop Question Answering?0
Is GPT-3 all you need for Visual Question Answering in Cultural Heritage?0
QCRI: Answer Selection for Community Question Answering - Experiments for Arabic and English0
IS-GGT: Iterative Scene Graph Generation With Generative Transformers0
ISCAS\_NLP at SemEval-2016 Task 1: Sentence Similarity Based on Support Vector Regression using Multiple Features0
Curriculum Script Distillation for Multilingual Visual Question Answering0
Is a Video worth n n Images? A Highly Efficient Approach to Transformer-based Video Question Answering0
Is Aligning Embedding Spaces a Challenging Task? A Study on Heterogeneous Embedding Alignment Methods0
ISAAQ - Mastering Textbook Questions with Pre-trained Transformers and Bottom-Up and Top-Down Attention0
QirK: Question Answering via Intermediate Representation on Knowledge Graphs0
QIRL: Boosting Visual Question Answering via Optimized Question-Image Relation Learning0
Curriculum Learning for Compositional Visual Reasoning0
Curriculum Learning Effectively Improves Low Data VQA0
Automated Factual Benchmarking for In-Car Conversational Systems using Large Language Models0
QnAMaker: Data to Bot in 2 Minutes0
ISAAQ -- Mastering Textbook Questions with Pre-trained Transformers and Bottom-Up and Top-Down Attention0
IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models0
QQATeam at Qur’an QA 2022: Fine-Tunning Arabic QA Models for Qur’an QA Task0
QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanism0
Q-SFT: Q-Learning for Language Models via Supervised Fine-Tuning0
Curriculum Learning Based on Reward Sparseness for Deep Reinforcement Learning of Task Completion Dialogue Management0
Show:102550
← PrevPage 155 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified