SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 401450 of 10817 papers

TitleStatusHype
PEDANTS: Cheap but Effective and Interpretable Answer EquivalenceCode2
AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction SimulatorCode2
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical DomainsCode2
GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended TasksCode2
Verif.ai: Towards an Open-Source Scientific Generative Question-Answering System with Referenced and Verifiable AnswersCode2
CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular FusionCode2
ScreenAI: A Vision-Language Model for UI and Infographics UnderstandingCode2
Position: What Can Large Language Models Tell Us about Time Series AnalysisCode2
GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question AnsweringCode2
Improving Medical Reasoning through Retrieval and Self-Reflection with Retrieval-Augmented Large Language ModelsCode2
InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with InstructionsCode2
Can AI Assistants Know What They Don't Know?Code2
Tuning Language Models by ProxyCode2
MMToM-QA: Multimodal Theory of Mind Question AnsweringCode2
EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health RecordsCode2
Chain-of-Table: Evolving Tables in the Reasoning Chain for Table UnderstandingCode2
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General TasksCode2
PeFoMed: Parameter Efficient Fine-tuning of Multimodal Large Language Models for Medical ImagingCode2
VCoder: Versatile Vision Encoders for Multimodal Large Language ModelsCode2
LingoQA: Visual Question Answering for Autonomous DrivingCode2
Lookahead: An Inference Acceleration Framework for Large Language Model with Lossless Generation AccuracyCode2
Chat-Scene: Bridging 3D Scene and Large Language Models with Object IdentifiersCode2
OneLLM: One Framework to Align All Modalities with LanguageCode2
Towards Learning a Generalist Model for Embodied NavigationCode2
LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and PlanningCode2
LLaMA-VID: An Image is Worth 2 Tokens in Large Language ModelsCode2
LLMGA: Multimodal Large Language Model based Generation AssistantCode2
GeoChat: Grounded Large Vision-Language Model for Remote SensingCode2
FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character DesignCode2
PG-Video-LLaVA: Pixel Grounding Large Video-Language ModelsCode2
An Embodied Generalist Agent in 3D WorldCode2
Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional TrainingCode2
Learning to Filter Context for Retrieval-Augmented GenerationCode2
Agent Lumos: Unified and Modular Training for Open-Source Language AgentsCode2
DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuningCode2
Frozen Transformers in Language Models Are Effective Visual Encoder LayersCode2
From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language ModelsCode2
ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language ModelsCode2
LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language ModelsCode2
Mini-DALLE3: Interactive Text to Image by Prompting Large Language ModelsCode2
Sheared LLaMA: Accelerating Language Model Pre-training via Structured PruningCode2
Compressing Context to Enhance Inference Efficiency of Large Language ModelsCode2
Language Agent Tree Search Unifies Reasoning Acting and Planning in Language ModelsCode2
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsCode2
Representation Engineering: A Top-Down Approach to AI TransparencyCode2
Fine-grained Late-interaction Multi-modal Retrieval for Retrieval Augmented Visual Question AnsweringCode2
StructChart: On the Schema, Metric, and Augmentation for Visual Chart UnderstandingCode2
Advancing the Evaluation of Traditional Chinese Language Models: Towards a Comprehensive Benchmark SuiteCode2
Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction FollowingCode2
Knowledge Graph Prompting for Multi-Document Question AnsweringCode2
Show:102550
← PrevPage 9 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified