SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 701750 of 10817 papers

TitleStatusHype
RETQA: A Large-Scale Open-Domain Tabular Question Answering Dataset for Real Estate SectorCode1
Unifying AI Tutor Evaluation: An Evaluation Taxonomy for Pedagogical Ability Assessment of LLM-Powered AI TutorsCode1
IMPACT: A Large-scale Integrated Multimodal Patent Analysis and Creation Dataset for Design PatentsCode1
LLaVA-SpaceSGG: Visual Instruct Tuning for Open-vocabulary Scene Graph Generation with Enhanced Spatial RelationsCode1
RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of ExpertsCode1
KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language ModelsCode1
CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual WorldsCode1
Gracefully Filtering Backdoor Samples for Generative Large Language Models without RetrainingCode1
GraphOTTER: Evolving LLM-based Graph Reasoning for Complex Table Question AnsweringCode1
PhysGame: Uncovering Physical Commonsense Violations in Gameplay VideosCode1
PerLA: Perceptive 3D Language AssistantCode1
Cross-modal Information Flow in Multimodal Large Language ModelsCode1
VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction FormatCode1
g3D-LF: Generalizable 3D-Language Feature Fields for Embodied TasksCode1
AtomR: Atomic Operator-Empowered Large Language Models for Heterogeneous Knowledge ReasoningCode1
Context Awareness Gate For Retrieval Augmented GenerationCode1
Seed-Free Synthetic Data Generation Framework for Instruction-Tuning LLMs: A Case Study in ThaiCode1
Teaching VLMs to Localize Specific Objects from In-context ExamplesCode1
A Survey of Medical Vision-and-Language Applications and Their TechniquesCode1
BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense EvaluationCode1
Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer FrameworkCode1
Controllable Context Sensitivity and the Knob Behind ItCode1
DELIFT: Data Efficient Language model Instruction Fine TuningCode1
MEG: Medical Knowledge-Augmented Large Language Models for Question AnsweringCode1
MILU: A Multi-task Indic Language Understanding BenchmarkCode1
Rationale-Guided Retrieval Augmented Generation for Medical Question AnsweringCode1
Birdie: Advancing State Space Models with Reward-Driven Objectives and CurriculaCode1
Show Me What and Where has Changed? Question Answering and Grounding for Remote Sensing Change DetectionCode1
Nearest Neighbor Normalization Improves Multimodal RetrievalCode1
Distinguishing Ignorance from Error in LLM HallucinationsCode1
Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and ReasoningCode1
DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate HallucinationsCode1
Large Language Models Reflect the Ideology of their CreatorsCode1
Graphusion: A RAG Framework for Knowledge Graph Construction with a Global PerspectiveCode1
VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-TuningCode1
ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language TuningCode1
Progressive Compositionality In Text-to-Image Generative ModelsCode1
BRIEF: Bridging Retrieval and Inference for Multi-hop Reasoning via CompressionCode1
Paths-over-Graph: Knowledge Graph Empowered Large Language Model ReasoningCode1
MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart ProblemsCode1
WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global CuisinesCode1
VividMed: Vision Language Model with Versatile Visual Grounding for MedicineCode1
RuleRAG: Rule-guided retrieval-augmented generation with language models for question answeringCode1
TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video ModelsCode1
Towards Foundation Models for 3D Vision: How Close Are We?Code1
Multi-granularity Contrastive Cross-modal Collaborative Generation for End-to-End Long-term Video Question AnsweringCode1
Skipping Computations in Multimodal LLMsCode1
Dynamic Multimodal Evaluation with Flexible Complexity by Vision-Language BootstrappingCode1
SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language ModelsCode1
StablePrompt: Automatic Prompt Tuning using Reinforcement Learning for Large Language ModelsCode1
Show:102550
← PrevPage 15 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified