SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 10011050 of 10817 papers

TitleStatusHype
Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future TrendsCode1
Are self-explanations from Large Language Models faithful?Code1
The Unreasonable Effectiveness of Easy Training Data for Hard TasksCode1
Cross-modal Retrieval for Knowledge-based Visual Question AnsweringCode1
Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing ConstraintCode1
MISS: A Generative Pretraining and Finetuning Approach for Med-VQACode1
Model Editing Harms General Abilities of Large Language Models: Regularization to the RescueCode1
The Critique of CritiqueCode1
Building Efficient and Effective OpenQA Systems for Low-Resource LanguagesCode1
Glance and Focus: Memory Prompting for Multi-Event Video Question AnsweringCode1
Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional SportsCode1
GeoGalactica: A Scientific Large Language Model in GeoscienceCode1
Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence RegularizationCode1
A Simple LLM Framework for Long-Range Video Question-AnsweringCode1
MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model EvaluationCode1
PokeMQA: Programmable knowledge editing for Multi-hop Question AnsweringCode1
Reverse Multi-Choice Dialogue Commonsense Inference with Graph-of-ThoughtCode1
EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question AnsweringCode1
On Early Detection of Hallucinations in Factual Question AnsweringCode1
HAAR: Text-Conditioned Generative Model of 3D Strand-based Human HairstylesCode1
Extending Context Window of Large Language Models via Semantic CompressionCode1
Privacy-Aware Document Visual Question AnsweringCode1
Lever LM: Configuring In-Context Sequence to Lever Large Vision Language ModelsCode1
RJUA-QA: A Comprehensive QA Dataset for UrologyCode1
WordScape: a Pipeline to extract multilingual, visually rich Documents with Layout Annotations from Web Crawl DataCode1
VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and GenerationCode1
ViLA: Efficient Video-Language Alignment for Video Question AnsweringCode1
NuScenes-MQA: Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup AnnotationsCode1
Genixer: Empowering Multimodal Large Language Models as a Powerful Data GeneratorCode1
LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric VideosCode1
PCoQA: Persian Conversational Question Answering DatasetCode1
Language-Informed Visual Concept LearningCode1
Let the LLMs Talk: Simulating Human-to-Human Conversational QA via Zero-Shot LLM-to-LLM InteractionsCode1
Good Questions Help Zero-Shot Image ReasoningCode1
How to Configure Good In-Context Sequence for Visual Question AnsweringCode1
Recursive Visual ProgrammingCode1
Ascle: A Python Natural Language Processing Toolkit for Medical Text GenerationCode1
Emergent Open-Vocabulary Semantic Segmentation from Off-the-shelf Vision-Language ModelsCode1
EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language ModelsCode1
Video-Bench: A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language ModelsCode1
Cerbero-7B: A Leap Forward in Language-Specific LLMs Through Enhanced Chat Corpus Generation and EvaluationCode1
Increasing Coverage and Precision of Textual Information in Multilingual Knowledge GraphsCode1
AutoEval-Video: An Automatic Benchmark for Assessing Large Vision Language Models in Open-Ended Video Question AnsweringCode1
Extracting Definienda in Mathematical Scholarly Articles with TransformersCode1
nach0: Multimodal Natural and Chemical Languages Foundation ModelCode1
CSMeD: Bridging the Dataset Gap in Automated Citation Screening for Systematic Literature ReviewsCode1
Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical TasksCode1
DynaPipe: Optimizing Multi-task Training through Dynamic PipelinesCode1
Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric KnowledgeCode1
ContraDoc: Understanding Self-Contradictions in Documents with Large Language ModelsCode1
Show:102550
← PrevPage 21 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified