SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 351400 of 10817 papers

TitleStatusHype
Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction TuningCode2
GOFA: A Generative One-For-All Model for Joint Graph Language ModelingCode2
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsCode2
AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction SimulatorCode2
GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AICode2
AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous DrivingCode2
GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended TasksCode2
How Much are Large Language Models Contaminated? A Comprehensive Survey and the LLMSanitize LibraryCode2
BlendSQL: A Scalable Dialect for Unifying Hybrid Question Answering in Relational AlgebraCode2
Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based RetrieversCode2
BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual QuestionsCode2
Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A SurveyCode2
Knowledge Representation Learning: A Quantitative ReviewCode2
Learning to Filter Context for Retrieval-Augmented GenerationCode2
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question AnsweringCode2
Learnware of Language Models: Specialized Small Language Models Can Do BigCode2
LongVLM: Efficient Long Video Understanding via Large Language ModelsCode2
Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam GenerationCode2
LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and PlanningCode2
Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question AnsweringCode2
GeoChat: Grounded Large Vision-Language Model for Remote SensingCode2
GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning AbilitiesCode2
From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning TasksCode2
Frozen Transformers in Language Models Are Effective Visual Encoder LayersCode2
GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question AnsweringCode2
Efficient Large Multi-modal Models via Visual Context CompressionCode2
FreeVA: Offline MLLM as Training-Free Video AssistantCode2
LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future OpportunitiesCode2
FrameFusion: Combining Similarity and Importance for Video Token Reduction on Large Visual Language ModelsCode2
Free Video-LLM: Prompt-guided Visual Perception for Efficient Training-free Video LLMsCode2
F-LMM: Grounding Frozen Large Multimodal ModelsCode2
LongForm: Effective Instruction Tuning with Reverse InstructionsCode2
FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal ReasoningCode2
From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language ModelsCode2
Lost in the Middle: How Language Models Use Long ContextsCode2
LOVA3: Learning to Visual Question Answering, Asking and AssessmentCode2
FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character DesignCode2
LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language ModelsCode2
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model EvaluationCode2
CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual ScenariosCode2
Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question AnsweringCode2
GIT: A Generative Image-to-text Transformer for Vision and LanguageCode2
MC-LLaVA: Multi-Concept Personalized Vision-Language ModelCode2
MC-LLaVA: Multi-Concept Personalized Vision-Language ModelCode2
FinBERT-QA: Financial Question Answering with pre-trained BERT Language ModelsCode2
Chain-of-Table: Evolving Tables in the Reasoning Chain for Table UnderstandingCode2
Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image AnalysisCode2
Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMsCode2
A Survey on Benchmarks of Multimodal Large Language ModelsCode2
Ask Me Anything: A simple strategy for prompting language modelsCode2
Show:102550
← PrevPage 8 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified