SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 301350 of 10817 papers

TitleStatusHype
BiMediX2: Bio-Medical EXpert LMM for Diverse Medical ModalitiesCode2
LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale InstructionsCode2
Beyond Text: Frozen Large Language Models in Visual Signal ComprehensionCode2
Knowledge Graph Prompting for Multi-Document Question AnsweringCode2
Knowledge Representation Learning: A Quantitative ReviewCode2
ktrain: A Low-Code Library for Augmented Machine LearningCode2
Large Language Models for Information Retrieval: A SurveyCode2
Learnware of Language Models: Specialized Small Language Models Can Do BigCode2
Keeping Yourself is Important in Downstream Tuning Multimodal Large Language ModelCode2
Beyond Accuracy: Behavioral Testing of NLP models with CheckListCode2
KET-RAG: A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAGCode2
Iteration of Thought: Leveraging Inner Dialogue for Autonomous Large Language Model ReasoningCode2
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step QuestionsCode2
JourneyDB: A Benchmark for Generative Image UnderstandingCode2
KG-Rank: Enhancing Large Language Models for Medical QA with Knowledge Graphs and Ranking TechniquesCode2
IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic LanguagesCode2
Improving Medical Reasoning through Retrieval and Self-Reflection with Retrieval-Augmented Large Language ModelsCode2
Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph CompletionCode2
How Much are Large Language Models Contaminated? A Comprehensive Survey and the LLMSanitize LibraryCode2
Hungry Hungry Hippos: Towards Language Modeling with State Space ModelsCode2
Hyena Hierarchy: Towards Larger Convolutional Language ModelsCode2
InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with InstructionsCode2
Habitat: A Platform for Embodied AI ResearchCode2
HMT: Hierarchical Memory Transformer for Long Context Language ProcessingCode2
Advancing the Evaluation of Traditional Chinese Language Models: Towards a Comprehensive Benchmark SuiteCode2
AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous DrivingCode2
Grounded 3D-LLM with Referent TokensCode2
Grounding-IQA: Multimodal Language Grounding Model for Image Quality AssessmentCode2
Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction TuningCode2
Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam GenerationCode2
GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended TasksCode2
VHM: Versatile and Honest Vision Language Model for Remote Sensing Image AnalysisCode2
GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AICode2
Baleen: Robust Multi-Hop Reasoning at Scale via Condensed RetrievalCode2
GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AICode2
Huatuo-26M, a Large-scale Chinese Medical QA DatasetCode2
GOFA: A Generative One-For-All Model for Joint Graph Language ModelingCode2
BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained TransformerCode2
GreaseLM: Graph REASoning Enhanced Language Models for Question AnsweringCode2
How do you know that? Teaching Generative Language Models to Reference Answers to Biomedical QuestionsCode2
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsCode2
Improving Retrieval-Augmented Generation through Multi-Agent Reinforcement LearningCode2
Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QACode2
Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question AnsweringCode2
ISR-DPO: Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPOCode2
Benchmarking Retrieval-Augmented Generation in Multi-Modal ContextsCode2
Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question AnsweringCode2
GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning AbilitiesCode2
From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning TasksCode2
From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language ModelsCode2
Show:102550
← PrevPage 7 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified