SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 301350 of 10817 papers

TitleStatusHype
ktrain: A Low-Code Library for Augmented Machine LearningCode2
LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale InstructionsCode2
AnyAnomaly: Zero-Shot Customizable Video Anomaly Detection with LVLMCode2
Knowledge Graph Prompting for Multi-Document Question AnsweringCode2
Knowledge Representation Learning: A Quantitative ReviewCode2
Language Agent Tree Search Unifies Reasoning Acting and Planning in Language ModelsCode2
Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene UnderstandingCode2
JourneyDB: A Benchmark for Generative Image UnderstandingCode2
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step QuestionsCode2
ISR-DPO: Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPOCode2
Improving Retrieval-Augmented Generation through Multi-Agent Reinforcement LearningCode2
Improving Medical Reasoning through Retrieval and Self-Reflection with Retrieval-Augmented Large Language ModelsCode2
InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with InstructionsCode2
Keeping Yourself is Important in Downstream Tuning Multimodal Large Language ModelCode2
Huatuo-26M, a Large-scale Chinese Medical QA DatasetCode2
How Much are Large Language Models Contaminated? A Comprehensive Survey and the LLMSanitize LibraryCode2
Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph CompletionCode2
HMT: Hierarchical Memory Transformer for Long Context Language ProcessingCode2
Breaking the Ceiling of the LLM Community by Treating Token Generation as a Classification for EnsemblingCode2
BlendSQL: A Scalable Dialect for Unifying Hybrid Question Answering in Relational AlgebraCode2
Hyena Hierarchy: Towards Larger Convolutional Language ModelsCode2
KET-RAG: A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAGCode2
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical DomainsCode2
Grounded 3D-LLM with Referent TokensCode2
VHM: Versatile and Honest Vision Language Model for Remote Sensing Image AnalysisCode2
Advancing the Evaluation of Traditional Chinese Language Models: Towards a Comprehensive Benchmark SuiteCode2
GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended TasksCode2
GreaseLM: Graph REASoning Enhanced Language Models for Question AnsweringCode2
Habitat: A Platform for Embodied AI ResearchCode2
An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLMCode2
Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction TuningCode2
BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical TasksCode2
GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AICode2
Grounding-IQA: Multimodal Language Grounding Model for Image Quality AssessmentCode2
GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AICode2
GOFA: A Generative One-For-All Model for Joint Graph Language ModelingCode2
Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based RetrieversCode2
GeoChat: Grounded Large Vision-Language Model for Remote SensingCode2
How do you know that? Teaching Generative Language Models to Reference Answers to Biomedical QuestionsCode2
BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual QuestionsCode2
GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question AnsweringCode2
Hungry Hungry Hippos: Towards Language Modeling with State Space ModelsCode2
BiMediX2: Bio-Medical EXpert LMM for Diverse Medical ModalitiesCode2
GIT: A Generative Image-to-text Transformer for Vision and LanguageCode2
KG-Rank: Enhancing Large Language Models for Medical QA with Knowledge Graphs and Ranking TechniquesCode2
IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic LanguagesCode2
LingoQA: Visual Question Answering for Autonomous DrivingCode2
An Embodied Generalist Agent in 3D WorldCode2
Iteration of Thought: Leveraging Inner Dialogue for Autonomous Large Language Model ReasoningCode2
From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning TasksCode2
Show:102550
← PrevPage 7 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified