SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 37513775 of 10817 papers

TitleStatusHype
Detect, Describe, Discriminate: Moving Beyond VQA for MLLM Evaluation0
LINKAGE: Listwise Ranking among Varied-Quality References for Non-Factoid QA Evaluation via LLMs0
Using Similarity to Evaluate Factual Consistency in Summaries0
Evaluating the Performance and Robustness of LLMs in Materials Science Q&A and Property Predictions0
QMOS: Enhancing LLMs for Telecommunication with Question Masked loss and Option ShufflingCode0
Co-occurrence is not Factual Association in Language ModelsCode0
SMART-RAG: Selection using Determinantal Matrices for Augmented Retrieval0
Drift to Remember0
@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology0
AQA: Adaptive Question Answering in a Society of LLMs via Contextual Multi-Armed BanditCode0
Unlocking Memorization in Large Language Models with Dynamic Soft Prompting0
Enhancing Large Language Models with Domain-specific Retrieval Augment Generation: A Case Study on Long-form Consumer Health Question Answering in Ophthalmology0
First Place Solution to the Multiple-choice Video QA Track of The Second Perception Test Challenge0
Beyond Accuracy Optimization: Computer Vision Losses for Large Language Model Fine-TuningCode0
A Multimodal Dense Retrieval Approach for Speech-Based Open-Domain Question Answering0
CamelEval: Advancing Culturally Aligned Arabic Language Models and Benchmarks0
TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learning0
Vision Language Models Can Parse Floor Plan Maps0
Edu-Values: Towards Evaluating the Chinese Education Values of Large Language ModelsCode0
Finetuning Language Models to Emit Linguistic Expressions of Uncertainty0
MQA-KEAL: Multi-hop Question Answering under Knowledge Editing for Arabic Language0
CAST: Cross-modal Alignment Similarity Test for Vision Language ModelsCode0
Uncertainty-Guided Self-Questioning and Answering for Video-Language Alignment0
Sparks of Artificial General Intelligence(AGI) in Semiconductor Material Science: Early Explorations into the Next Frontier of Generative AI-Assisted Electron Micrograph Analysis0
OneEncoder: A Lightweight Framework for Progressive Alignment of Modalities0
Show:102550
← PrevPage 151 of 433Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified