SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 12011250 of 10817 papers

TitleStatusHype
Improving Selective Visual Question Answering by Learning from Your PeersCode1
Question Decomposition Tree for Answering Complex Questions over Knowledge BasesCode1
When Do Annotator Demographics Matter? Measuring the Influence of Annotator Demographics with the POPQUORN DatasetCode1
Global and Local Semantic Completion Learning for Vision-Language Pre-trainingCode1
Multi-modal Pre-training for Medical Vision-language Understanding and Generation: An Empirical Study with A New BenchmarkCode1
Modular Visual Question Answering via Code GenerationCode1
Enhancing In-Context Learning with Answer Feedback for Multi-Span Question AnsweringCode1
An Approach to Solving the Abstraction and Reasoning Corpus (ARC) ChallengeCode1
Q: How to Specialize Large Vision-Language Models to Data-Scarce VQA Tasks? A: Self-Train on Unlabeled Images!Code1
Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam DatasetCode1
I^3 Retriever: Incorporating Implicit Interaction in Pre-trained Language Models for Passage RetrievalCode1
Revisiting the Role of Language Priors in Vision-Language ModelsCode1
TimelineQA: A Benchmark for Question Answering over TimelinesCode1
Make Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-TuningCode1
Layout and Task Aware Instruction Prompt for Zero-shot Document Image Question AnsweringCode1
UKP-SQuARE: An Interactive Tool for Teaching Question AnsweringCode1
Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL ModelsCode1
Generating with Confidence: Uncertainty Quantification for Black-box Large Language ModelsCode1
Multi-Scale Attention for Audio Question AnsweringCode1
PaLI-X: On Scaling up a Multilingual Vision and Language ModelCode1
A Critical Evaluation of Evaluations for Long-form Question AnsweringCode1
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark DatasetsCode1
Conformal Prediction with Large Language Models for Multi-Choice Question AnsweringCode1
Plug-and-Play Document Modules for Pre-trained ModelsCode1
CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language TransformersCode1
Exploiting Abstract Meaning Representation for Open-Domain Question AnsweringCode1
Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question AnsweringCode1
Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and MitigationCode1
UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and ReasoningCode1
C-STS: Conditional Semantic Textual SimilarityCode1
Meta-Learning Online Adaptation of Language ModelsCode1
Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language ModelsCode1
MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop QuestionsCode1
The Art of SOCRATIC QUESTIONING: Recursive Thinking with Large Language ModelsCode1
OpenPI2.0: An Improved Dataset for Entity Tracking in TextsCode1
Asking Clarification Questions to Handle Ambiguity in Open-Domain QACode1
Sources of Hallucination by Large Language Models on Inference TasksCode1
On the Risk of Misinformation Pollution with Large Language ModelsCode1
MemeCap: A Dataset for Captioning and Interpreting MemesCode1
Fine-tuned LLMs Know More, Hallucinate Less with Few-Shot Sequence-to-Sequence Semantic Parsing over WikidataCode1
Question Answering as Programming for Solving Time-Sensitive QuestionsCode1
RetICL: Sequential Retrieval of In-Context Examples with Reinforcement LearningCode1
AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the WebCode1
MultiTabQA: Generating Tabular Answers for Multi-Table Question AnsweringCode1
How Language Model Hallucinations Can SnowballCode1
TheoremQA: A Theorem-driven Question Answering datasetCode1
Evaluating Open-QA EvaluationCode1
What Makes for Good Visual Tokenizers for Large Language Models?Code1
VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language ModelsCode1
Enhancing Vision-Language Pre-Training with Jointly Learned Questioner and Dense CaptionerCode1
Show:102550
← PrevPage 25 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified