SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2301–2350 of 10817 papers

TitleStatusHype
Modulating Language Model Experiences through Frictions—0
Claude 3.5 Sonnet Model Card Addendum—0
Training-Free Exponential Context Extension via Cascading KV CacheCode0
MM-SpuBench: Towards Better Understanding of Spurious Biases in Multimodal LLMs—0
DEXTER: A Benchmark for open-domain Complex Question Answering using LLMsCode1
Attention Instruction: Amplifying Attention in the Middle via PromptingCode0
GPT-4V Explorations: Mining Autonomous Driving—0
UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language UnderstandingCode0
Directed Domain Fine-Tuning: Tailoring Separate Modalities for Specific Training Tasks—0
Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness—0
LLMs Assist NLP Researchers: Critique Paper (Meta-)ReviewingCode1
Context-augmented Retrieval: A Novel Framework for Fast Information Retrieval based Response Generation using Large Language Model—0
SEAM: A Stochastic Benchmark for Multi-Document Tasks—0
HCQA @ Ego4D EgoSchema Challenge 2024Code1
MR-MLLM: Mutual Reinforcement of Multimodal Comprehension and Vision Perception—0
TorchSpatial: A Location Encoding Framework and Benchmark for Spatial Representation LearningCode2
70B-parameter large language models in Japanese medical question-answering—0
Generate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answering—0
UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document AnalysisCode1
Towards Retrieval Augmented Generation over Large Video Libraries—0
Tri-VQA: Triangular Reasoning Medical Visual Question Answering for Multi-Attribute Analysis—0
Prompting Whisper for QA-driven Zero-shot End-to-end Spoken Language Understanding—0
Sports Intelligence: Assessing the Sports Understanding Capabilities of Language Models through Question Answering from Text to Video—0
PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference—0
Understanding Finetuning for Factual Knowledge Extraction—0
A Learn-Then-Reason Model Towards Generalization in Knowledge Base Question Answering—0
TTQA-RS- A break-down prompting approach for Multi-hop Table-Text Question Answering with Reasoning and Summarization—0
SuperGLEBer: German Language Understanding Evaluation BenchmarkCode1
TAGLAS: An atlas of text-attributed graph datasets in the era of large graph and language modelsCode2
Evaluating RAG-Fusion with RAGElo: an Automated Elo-based FrameworkCode2
VGA: Vision GUI Assistant -- Minimizing Hallucinations through Image-Centric Fine-TuningCode0
LLaSA: A Multimodal LLM for Human Activity Analysis Through Wearable and Smartphone SensorsCode1
Investigating Mysteries of CoT-Augmented Distillation—0
Does Object Grounding Really Reduce Hallucination of Large Vision-Language Models?—0
Ranking LLMs by compression—0
SynDARin: Synthesising Datasets for Automated Reasoning in Low-Resource Languages—0
The Fire Thief Is Also the Keeper: Balancing Usability and Privacy in Prompts—0
QPaug: Question and Passage Augmentation for Open-Domain Question Answering of LLMsCode0
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge GraphsCode1
Temporal Knowledge Graph Question Answering: A Survey—0
Timo: Towards Better Temporal Reasoning for Language ModelsCode1
Robust Few-shot Transfer Learning for Knowledge Base Question Answering with Unanswerable Questions—0
Detecting hallucinations in large language models using semantic entropyCode3
LIVE: Learnable In-Context Vector for Visual Question AnsweringCode1
QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanism—0
Transferable speech-to-text large language model alignment module—0
MoreHopQA: More Than Multi-hop ReasoningCode1
AlanaVLM: A Multimodal Embodied AI Foundation Model for Egocentric Video UnderstandingCode1
Factual Confidence of LLMs: on Reliability and Robustness of Current EstimatorsCode1
Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented GenerationCode1
Show:102550
← PrevPage 47 of 217Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified