SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 451–500 of 10817 papers

TitleStatusHype
BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual QuestionsCode2
MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language ModelsCode2
TeCH: Text-guided Reconstruction of Lifelike Clothed HumansCode2
Large Language Models for Information Retrieval: A SurveyCode2
3D-VisTA: Pre-trained Transformer for 3D Vision and Text AlignmentCode2
EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent EducationCode2
Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical DataCode2
ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior ConstraintsCode2
The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open WorldCode2
MovieChat: From Dense Token to Sparse Memory for Long Video UnderstandingCode2
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic ControlCode2
Med-Flamingo: a Multimodal Medical Few-shot LearnerCode2
Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge GraphCode2
Lost in the Middle: How Language Models Use Long ContextsCode2
JourneyDB: A Benchmark for Generative Image UnderstandingCode2
BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained TransformerCode2
ToolQA: A Dataset for LLM Question Answering with External ToolsCode2
LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language ModelsCode2
PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for FinanceCode2
Fine-Grained Human Feedback Gives Better Rewards for Language Model TrainingCode2
Contextual Object Detection with Multimodal Large Language ModelsCode2
BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical TasksCode2
Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language ModelsCode2
NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving ScenarioCode2
The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-TuningCode2
LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future OpportunitiesCode2
Pengi: An Audio Language Model for Audio TasksCode2
ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool EmbeddingsCode2
StructGPT: A General Framework for Large Language Model to Reason over Structured DataCode2
OCRBench: On the Hidden Mystery of OCR in Large Multimodal ModelsCode2
WebCPM: Interactive Web Search for Chinese Long-form Question AnsweringCode2
RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language ModelsCode2
Huatuo-26M, a Large-scale Chinese Medical QA DatasetCode2
LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale InstructionsCode2
PMC-LLaMA: Towards Building Open-source Language Models for MedicineCode2
Unlocking Context Constraints of LLMs: Enhancing Context Efficiency of LLMs with Self-Information-Based Content FilteringCode2
VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and DatasetCode2
LongForm: Effective Instruction Tuning with Reverse InstructionsCode2
ChatGPT Asks, BLIP-2 Answers: Automatic Questioning Towards Enriched Visual DescriptionsCode2
PaLM-E: An Embodied Multimodal Language ModelCode2
Prophet: Prompting Large Language Models with Complementary Answer Heuristics for Knowledge-based Visual Question AnsweringCode2
Hyena Hierarchy: Towards Larger Convolutional Language ModelsCode2
ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTCode2
MQAG: Multiple-choice Question Answering and Generation for Assessing Information Consistency in SummarizationCode2
PrimeQA: The Prime Repository for State-of-the-Art Multilingual Question Answering Research and DevelopmentCode2
Hungry Hungry Hippos: Towards Language Modeling with State Space ModelsCode2
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step QuestionsCode2
Discovering Latent Knowledge in Language Models Without SupervisionCode2
Visual Programming: Compositional visual reasoning without trainingCode2
RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language ModelsCode2
Show:102550
← PrevPage 10 of 217Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified