SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 37513800 of 10817 papers

TitleStatusHype
Detect, Describe, Discriminate: Moving Beyond VQA for MLLM Evaluation0
Towards Efficient and Robust VQA-NLE Data Generation with Large Vision-Language ModelsCode0
LINKAGE: Listwise Ranking among Varied-Quality References for Non-Factoid QA Evaluation via LLMs0
Evaluating the Performance and Robustness of LLMs in Materials Science Q&A and Property Predictions0
QMOS: Enhancing LLMs for Telecommunication with Question Masked loss and Option ShufflingCode0
Co-occurrence is not Factual Association in Language ModelsCode0
SMART-RAG: Selection using Determinantal Matrices for Augmented Retrieval0
Drift to Remember0
@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology0
AQA: Adaptive Question Answering in a Society of LLMs via Contextual Multi-Armed BanditCode0
Enhancing Large Language Models with Domain-specific Retrieval Augment Generation: A Case Study on Long-form Consumer Health Question Answering in Ophthalmology0
Unlocking Memorization in Large Language Models with Dynamic Soft Prompting0
First Place Solution to the Multiple-choice Video QA Track of The Second Perception Test Challenge0
Beyond Accuracy Optimization: Computer Vision Losses for Large Language Model Fine-TuningCode0
A Multimodal Dense Retrieval Approach for Speech-Based Open-Domain Question Answering0
Vision Language Models Can Parse Floor Plan Maps0
CamelEval: Advancing Culturally Aligned Arabic Language Models and Benchmarks0
TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learning0
Edu-Values: Towards Evaluating the Chinese Education Values of Large Language ModelsCode0
Finetuning Language Models to Emit Linguistic Expressions of Uncertainty0
MQA-KEAL: Multi-hop Question Answering under Knowledge Editing for Arabic Language0
ProSLM : A Prolog Synergized Language Model for explainable Domain Specific Knowledge Based Question Answering0
CAST: Cross-modal Alignment Similarity Test for Vision Language ModelsCode0
Sparks of Artificial General Intelligence(AGI) in Semiconductor Material Science: Early Explorations into the Next Frontier of Generative AI-Assisted Electron Micrograph Analysis0
Mamba Fusion: Learning Actions Through QuestioningCode0
OneEncoder: A Lightweight Framework for Progressive Alignment of Modalities0
Uncertainty-Guided Self-Questioning and Answering for Video-Language Alignment0
Contextual Breach: Assessing the Robustness of Transformer-based QA Models0
HALO: Hallucination Analysis and Learning Optimization to Empower LLMs with Retrieval-Augmented Context for Guided Clinical Decision MakingCode0
StruEdit: Structured Outputs Enable the Fast and Accurate Knowledge Editing for Large Language Models0
NEVLP: Noise-Robust Framework for Efficient Vision-Language Pre-training0
Explore the Hallucination on Low-level Perception for MLLMs0
A Benchmark Dataset with Larger Context for Non-Factoid Question Answering over Islamic Text0
Guiding Vision-Language Model Selection for Visual Question-Answering Across Tasks, Domains, and Knowledge TypesCode0
Active Learning to Guide Labeling Efforts for Question Difficulty EstimationCode0
QTG-VQA: Question-Type-Guided Architectural for VideoQA Systems0
Expediting and Elevating Large Language Model Reasoning via Hidden Chain-of-Thought Decoding0
Electrocardiogram Report Generation and Question Answering via Retrieval-Augmented Self-Supervised Modeling0
KodeXv0.1: A Family of State-of-the-Art Financial Large Language Models0
Contri(e)ve: Context + Retrieve for Scholarly Question Answering0
Contextual Evaluation of Large Language Models for Classifying Tropical and Infectious Diseases0
Experimenting with Legal AI Solutions: The Case of Question-Answering for Access to Justice0
Enhancing Q&A Text Retrieval with Ranking Models: Benchmarking, fine-tuning and deploying Rerankers for RAG0
OmniQuery: Contextually Augmenting Captured Multimodal Memory to Enable Personal Question Answering0
Source2Synth: Synthetic Data Generation and Curation Grounded in Real Data Sources0
An Evaluation Framework for Attributed Information Retrieval using Large Language ModelsCode0
Top-down Activity Representation Learning for Video Question Answering0
Multi-object event graph representation learning for Video Question Answering0
Integrating SPARQL and LLMs for Question Answering over Scholarly Data Sources0
Learning to Compress Contexts for Efficient Knowledge-based Visual Question Answering0
Show:102550
← PrevPage 76 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified