SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 20012050 of 10817 papers

TitleStatusHype
Towards Evaluating and Building Versatile Large Language Models for MedicineCode2
MultiMed: Massively Multimodal and Multitask Medical Understanding0
Show-o: One Single Transformer to Unify Multimodal Understanding and GenerationCode5
Assessing Modality Bias in Video Question Answering Benchmarks with Multimodal Large Language Models0
Fine-tuning Smaller Language Models for Question Answering over Financial Documents0
RoundTable: Leveraging Dynamic Schema and Contextual Autocomplete for Enhanced Query Precision in Tabular Question AnsweringCode1
Reasoning and Tools for Human-Level Forecasting0
What are the limits of cross-lingual dense passage retrieval for low-resource languages?0
CluMo: Cluster-based Modality Fusion Prompt for Continual Learning in Visual Question AnsweringCode0
Differentiating Choices via Commonality for Multiple-Choice Question AnsweringCode0
RConE: Rough Cone Embedding for Multi-Hop Logical Query Answering on Multi-Modal Knowledge GraphsCode0
DocTabQA: Answering Questions from Long Documents Using TablesCode0
Leveraging Fine-Tuned Retrieval-Augmented Generation with Long-Context Support: For 3GPP StandardsCode1
Swarm Intelligence in Geo-Localization: A Multi-Agent Large Vision-Language Model Collaborative Framework0
Mathematical Information Retrieval: Search and Question Answering0
Ancient Wisdom, Modern Tools: Exploring Retrieval-Augmented LLMs for Ancient Indian PhilosophyCode0
Multimodal Datasets and Benchmarks for Reasoning about Dynamic Spatio-Temporality in Everyday Environments0
Hierarchical Retrieval-Augmented Generation Model with Rethink for Multi-hop Question AnsweringCode1
ColBERT Retrieval and Ensemble Response Scoring for Language Model Question AnsweringCode0
CoDi: Conversational Distillation for Grounded Question Answering0
GS-KGC: A Generative Subgraph-based Framework for Knowledge Graph Completion with Large Language Models0
V-RoAst: Visual Road Assessment. Can VLM be a Road Safety Assessor Using the iRAP Standard?Code1
Large Language Model Driven Recommendation0
Multilingual Non-Factoid Question Answering with Answer Paragraph SelectionCode0
QUITO-X: A New Perspective on Context Compression from the Information Bottleneck Theory0
Putting People in LLMs' Shoes: Generating Better Answers via Question RewriterCode0
Ranking Generated Answers: On the Agreement of Retrieval Models with Humans on Consumer Health QuestionsCode0
Multilingual Needle in a Haystack: Investigating Long-Context Behavior of Multilingual Large Language ModelsCode0
PA-LLaVA: A Large Language-Vision Assistant for Human Pathology Image UnderstandingCode2
How Susceptible are LLMs to Influence in Prompts?0
TableBench: A Comprehensive and Complex Benchmark for Table Question Answering0
FabricQA-Extractor: A Question Answering System to Extract Information from Documents using Natural Language Questions0
Reference-Guided Verdict: LLMs-as-Judges in Automatic Evaluation of Free-Form Text0
FEDMEKI: A Benchmark for Scaling Medical Foundation Models via Federated Knowledge InjectionCode0
Risks and NLP Design: A Case Study on Procedural Document QA0
Med-PMC: Medical Personalized Multi-modal Consultation with a Proactive Ask-First-Observe-Next ParadigmCode0
Visual Agents as Fast and Slow ThinkersCode1
RealMedQA: A pilot biomedical question answering dataset containing realistic clinical questionsCode0
MuRAR: A Simple and Effective Multimodal Retrieval and Answer Refinement Framework for Multimodal Question Answering0
Beyond the Hype: A dispassionate look at vision-language models in medical scenario0
A Survey on Benchmarks of Multimodal Large Language ModelsCode2
W-RAG: Weakly Supervised Dense Retrieval in RAG for Open-domain Question AnsweringCode1
Assessing and Enhancing Large Language Models in Rare Disease Question-answering0
Evaluating Fine-Tuning Efficiency of Human-Inspired Learning Strategies in Medical Question AnsweringCode0
LLaVA-Surg: Towards Multimodal Surgical Assistant via Structured Surgical Video Learning0
Continuous Perception Benchmark0
IIU: Independent Inference Units for Knowledge-based Visual Question AnsweringCode0
QirK: Question Answering via Intermediate Representation on Knowledge Graphs0
Enhancing Visual Question Answering through Ranking-Based Hybrid Training and Multimodal Fusion0
LLMI3D: Empowering LLM with 3D Perception from a Single 2D Image0
Show:102550
← PrevPage 41 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified