SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 451500 of 10817 papers

TitleStatusHype
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuningCode2
RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language ModelsCode2
RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language ModelsCode2
Revealing Single Frame Bias for Video-and-Language LearningCode2
Free Video-LLM: Prompt-guided Visual Perception for Efficient Training-free Video LLMsCode2
FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model EvaluationCode2
FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character DesignCode2
A Survey on Benchmarks of Multimodal Large Language ModelsCode2
From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language ModelsCode2
Scientific QA System with Verifiable AnswersCode2
GIT: A Generative Image-to-text Transformer for Vision and LanguageCode2
How do you know that? Teaching Generative Language Models to Reference Answers to Biomedical QuestionsCode2
AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM AgentsCode2
FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language ModelsCode2
Atlas: Few-shot Learning with Retrieval Augmented Language ModelsCode2
ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsCode2
A Replication Study of Dense Passage RetrieverCode2
CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular FusionCode2
FakeBench: Probing Explainable Fake Image Detection via Large Multimodal ModelsCode2
SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented GenerationCode2
Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal ReasoningCode2
Explore the Limits of Omni-modal Pretraining at ScaleCode2
Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerCode2
SPIQA: A Dataset for Multimodal Question Answering on Scientific PapersCode2
Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation EngineeringCode2
Streaming Video Question-Answering with In-context Video KV-Cache RetrievalCode2
Evaluating RAG-Fusion with RAGElo: an Automated Elo-based FrameworkCode2
StructGPT: A General Framework for Large Language Model to Reason over Structured DataCode2
Synthetic QA Corpora Generation with Roundtrip ConsistencyCode2
ANAH: Analytical Annotation of Hallucinations in Large Language ModelsCode2
TableQuery: Querying tabular data with natural languageCode2
TableRAG: A Retrieval Augmented Generation Framework for Heterogeneous Document ReasoningCode2
Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert ReasonerCode2
DALK: Dynamic Co-Augmentation of LLMs and KG to answer Alzheimer's Disease Questions with Scientific LiteratureCode2
DanmakuTPPBench: A Multi-modal Benchmark for Temporal Point Process Modeling and UnderstandingCode2
EyeCLIP: A visual-language foundation model for multi-modal ophthalmic image analysisCode2
FinBERT-QA: Financial Question Answering with pre-trained BERT Language ModelsCode2
Task Me AnythingCode2
DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingCode2
Debiasing Multimodal Large Language ModelsCode2
E.T. Bench: Towards Open-Ended Event-Level Video-Language UnderstandingCode2
ERA-CoT: Improving Chain-of-Thought through Entity Relationship AnalysisCode2
A Pilot Study for Chinese SQL Semantic ParsingCode2
AnyAnomaly: Zero-Shot Customizable Video Anomaly Detection with LVLMCode2
All in One: Exploring Unified Video-Language Pre-trainingCode2
End-to-End Navigation with Vision Language Models: Transforming Spatial Reasoning into Question-AnsweringCode2
End-To-End Memory NetworksCode2
The First Place Solution of WSDM Cup 2024: Leveraging Large Language Models for Conversational Multi-Doc QACode2
Enhancing Visual-Language Modality Alignment in Large Vision Language Models via Self-ImprovementCode2
Evaluating LLM Reasoning in the Operations Research Domain with ORQACode2
Show:102550
← PrevPage 10 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified