SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 23512400 of 10817 papers

TitleStatusHype
MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical ReasoningCode0
MatchZoo: A Learning, Practicing, and Developing System for Neural Text MatchingCode0
Are you tough enough? Framework for Robustness Validation of Machine Comprehension SystemsCode0
MatchZoo: A Toolkit for Deep Text MatchingCode0
Are you tough enough? Framework for Robustness Validation of Machine Comprehension SystemsCode0
Matching Article Pairs with Graphical Decomposition and ConvolutionsCode0
ChiMed: A Chinese Medical Corpus for Question AnsweringCode0
CHIME: Cross-passage Hierarchical Memory Network for Generative Review Question AnsweringCode0
Masking in Multi-hop QA: An Analysis of How Language Models Perform with Context PermutationCode0
Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question AnsweringCode0
Marten: Visual Question Answering with Mask Generation for Multi-modal Document UnderstandingCode0
Masking Orchestration: Multi-task Pretraining for Multi-role Dialogue Representation LearningCode0
MAQA: Evaluating Uncertainty Quantification in LLMs Regarding Data UncertaintyCode0
A Bias-Variance-Covariance Decomposition of Kernel Scores for Generative ModelsCode0
MapQaTor: An Extensible Framework for Efficient Annotation of Map-Based QA DatasetsCode0
Decomposed Prompting to Answer Questions on a Course Discussion BoardCode0
MapEval: A Map-Based Evaluation of Geo-Spatial Reasoning in Foundation ModelsCode0
A Lightweight Method to Generate Unanswerable Questions in EnglishCode0
MANGO: A Benchmark for Evaluating Mapping and Navigation Abilities of Large Language ModelsCode0
Are VLMs Really BlindCode0
Are Visual-Linguistic Models Commonsense Knowledge Bases?Code0
Mamba Fusion: Learning Actions Through QuestioningCode0
ChatGPT as a Math Questioner? Evaluating ChatGPT on Generating Pre-university Math QuestionsCode0
Are Vision LLMs Road-Ready? A Comprehensive Benchmark for Safety-Critical Driving Video UnderstandingCode0
Make Text Unlearnable: Exploiting Effective Patterns to Protect Personal DataCode0
MaMMUT: A Simple Architecture for Joint Learning for MultiModal TasksCode0
Mapping distributional to model-theoretic semantic spaces: a baselineCode0
MBBQ: A Dataset for Cross-Lingual Comparison of Stereotypes in Generative LLMsCode0
AI-TA: Towards an Intelligent Question-Answer Teaching Assistant using Open-Source LLMsCode0
Machine Comprehension by Text-to-Text Neural Question GenerationCode0
Machine Comprehension Using Match-LSTM and Answer PointerCode0
MAFiD: Moving Average Equipped Fusion-in-Decoder for Question Answering over Tabular and Textual DataCode0
M2QA: Multi-domain Multilingual Question AnsweringCode0
A review of Spanish corpora annotated with negationCode0
Macaw: An Extensible Conversational Information Seeking PlatformCode0
LVLM-Compress-Bench: Benchmarking the Broader Impact of Large Vision-Language Model CompressionCode0
LPF: A Language-Prior Feedback Objective Function for De-biased Visual Question AnsweringCode0
LP-LM: No Hallucinations in Question Answering with Logic ProgrammingCode0
A Better Way to Attend: Attention with Trees for Video Question AnsweringCode0
Make LLMs better zero-shot reasoners: Structure-orientated autonomous reasoningCode0
ChartCards: A Chart-Metadata Generation Framework for Multi-Task Chart UnderstandingCode0
Lost in Space: Probing Fine-grained Spatial Understanding in Vision and Language ResamplersCode0
Loss re-scaling VQA: Revisiting the LanguagePrior Problem from a Class-imbalance ViewCode0
Lost in the Middle, and In-Between: Enhancing Language Models' Ability to Reason Over Long Contexts in Multi-Hop QACode0
Character-Level Question Answering with AttentionCode0
Look, Read and Enrich. Learning from Scientific Figures and their CaptionsCode0
Adaptation of Deep Bidirectional Multilingual Transformers for Russian LanguageCode0
Looking Beyond Visible Cues: Implicit Video Question Answering via Dual-Clue ReasoningCode0
Characterizing the Efficiency vs. Accuracy Trade-off for Long-Context NLP ModelsCode0
Are Red Roses Red? Evaluating Consistency of Question-Answering ModelsCode0
Show:102550
← PrevPage 48 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified