SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 551600 of 10817 papers

TitleStatusHype
Explore the Limits of Omni-modal Pretraining at ScaleCode2
VHM: Versatile and Honest Vision Language Model for Remote Sensing Image AnalysisCode2
FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language ModelsCode2
E.T. Bench: Towards Open-Ended Event-Level Video-Language UnderstandingCode2
ERA-CoT: Improving Chain-of-Thought through Entity Relationship AnalysisCode2
Evaluating LLM Reasoning in the Operations Research Domain with ORQACode2
A Multimodal Benchmark Dataset and Model for Crop Disease DiagnosisCode2
End-To-End Memory NetworksCode2
End-to-End Navigation with Vision Language Models: Transforming Spatial Reasoning into Question-AnsweringCode2
Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph CompletionCode2
EmbodiedEval: Evaluate Multimodal LLMs as Embodied AgentsCode2
Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-LearningCode2
Enhancing Visual-Language Modality Alignment in Large Vision Language Models via Self-ImprovementCode2
AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous DrivingCode2
Evaluating RAG-Fusion with RAGElo: an Automated Elo-based FrameworkCode2
FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character DesignCode2
GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AICode2
Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image AnalysisCode2
ISR-DPO: Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPOCode2
EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language UnderstandingCode1
EgoTaskQA: Understanding Human Tasks in Egocentric VideosCode1
AllenAct: A Framework for Embodied AI ResearchCode1
MatTools: Benchmarking Large Language Models for Materials Science ToolsCode1
Efficient Passage Retrieval with Hashing for Open-domain Question AnsweringCode1
EgoTextVQA: Towards Egocentric Scene-Text Aware Video Question AnsweringCode1
Effective Human-AI Teams via Learned Natural Language Rules and OnboardingCode1
Efficient and Reproducible Biomedical Question Answering using Retrieval Augmented GenerationCode1
Structure-aware Domain Knowledge Injection for Large Language ModelsCode1
Adaptive Information Seeking for Open-Domain Question AnsweringCode1
Educational Question Generation of Children Storybooks via Question Type Distribution Learning and Event-Centric SummarizationCode1
Beyond NED: Fast and Effective Search Space Reduction for Complex Question Answering over Knowledge BasesCode1
ECoRAG: Evidentiality-guided Compression for Long Context RAGCode1
An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented GenerationCode1
Ranked Voting based Self-Consistency of Large Language ModelsCode1
ECG-QA: A Comprehensive Question Answering Dataset Combined With ElectrocardiogramCode1
Editing Factual Knowledge in Language ModelsCode1
Efficiently Tuned Parameters are Task EmbeddingsCode1
EgoToM: Benchmarking Theory of Mind Reasoning from Egocentric VideosCode1
EAGER: Asking and Answering Questions for Automatic Reward Shaping in Language-guided RLCode1
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-TuningCode1
EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question AnsweringCode1
Adapting Pretrained Text-to-Text Models for Long Text SequencesCode1
EA^2E: Improving Consistency with Event Awareness for Document-Level Argument ExtractionCode1
Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question AnsweringCode1
Dynamic Relevance Graph Network for Knowledge-Aware Question AnsweringCode1
DynaPipe: Optimizing Multi-task Training through Dynamic PipelinesCode1
Dynamic Language Binding in Relational Visual ReasoningCode1
Benchmarking Multimodal Mathematical Reasoning with Explicit Visual DependencyCode1
Dynamic Multimodal Evaluation with Flexible Complexity by Vision-Language BootstrappingCode1
EA^2E: Improving Consistency with Event Awareness for Document-Level Argument ExtractionCode1
Show:102550
← PrevPage 12 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified