SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2601–2650 of 10817 papers

TitleStatusHype
CrossCheckGPT: Universal Hallucination Ranking for Multimodal Foundation Models—0
Semantic Density: Uncertainty Quantification for Large Language Models through Confidence Measurement in Semantic SpaceCode1
FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answering—0
Backpropagation-Free Multi-modal On-Device Model Adaptation via Cloud-Device Collaboration—0
Efficient and Interpretable Information Retrieval for Product Question Answering with Heterogeneous DataCode0
MentalQA: An Annotated Arabic Corpus for Questions and Answers of Mental Healthcare—0
Skin-in-the-Game: Decision Making via Multi-Stakeholder Alignment in LLMs—0
ProtT3: Protein-to-Text Generation for Text-based Protein UnderstandingCode2
Dataset and Benchmark for Urdu Natural Scenes Text Detection, Recognition and Visual Question AnsweringCode0
OLAPH: Improving Factuality in Biomedical Long-form Question AnsweringCode1
MTVQA: Benchmarking Multilingual Text-Centric Visual Question AnsweringCode2
Increasing the LLM Accuracy for Question Answering: Ontologies to the Rescue!—0
KG-RAG: Bridging the Gap Between Knowledge and Creativity—0
Inquire, Interact, and Integrate: A Proactive Agent Collaborative Framework for Zero-Shot Multimodal Medical Reasoning—0
Case-Based Reasoning Approach for Solving Financial Question Answering—0
MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing—0
EyeFound: A Multimodal Generalist Foundation Model for Ophthalmic Imaging—0
VideoQA-SC: Adaptive Semantic Communication for Video Question Answering—0
Evaluation of large language model performance on the Biomedical Language Understanding and Reasoning Benchmark—0
Efficient Multimodal Large Language Models: A SurveyCode3
LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions—0
StackOverflowVQA: Stack Overflow Visual Question Answering Dataset—0
Towards Better Question Generation in QA-based Event ExtractionCode1
KnowledgeHub: An end-to-end Tool for Assisted Scientific Discovery—0
Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality—0
Grounded 3D-LLM with Referent TokensCode2
AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning—0
Chameleon: Mixed-Modal Early-Fusion Foundation ModelsCode7
UniRAG: Universal Retrieval Augmentation for Large Vision Language ModelsCode1
SciQAG: A Framework for Auto-Generated Science Question Answering Dataset with Fine-grained EvaluationCode1
When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language ModelsCode7
FinTextQA: A Dataset for Long-form Financial Question Answering—0
Conformal Alignment: Knowing When to Trust Foundation Models with GuaranteesCode1
IM-RAG: Multi-Round Retrieval-Augmented Generation Through Learning Inner Monologues—0
Prompting-based Synthetic Data Generation for Few-Shot Question AnsweringCode0
STAR: A Benchmark for Situated Reasoning in Real-World Videos—0
CinePile: A Long Video Question Answering Dataset and Benchmark—0
SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models—0
UCCIX: Irish-eXcellence Large Language Model—0
MetaReflection: Learning Instructions for Language Agents using Past Reflections—0
AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments—0
TANQ: An open domain dataset of table answered questionsCode1
Benchmarking Retrieval-Augmented Large Language Models in Biomedical NLP: Application, Robustness, and Self-Awareness—0
EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential ReasoningCode0
From Questions to Insightful Answers: Building an Informed Chatbot for University Resources—0
KET-QA: A Dataset for Knowledge Enhanced Table Question Answering—0
CLIP-Powered TASS: Target-Aware Single-Stream Network for Audio-Visual Question Answering—0
FreeVA: Offline MLLM as Training-Free Video AssistantCode2
MedConceptsQA: Open Source Medical Concepts QA BenchmarkCode1
Realizing Visual Question Answering for Education: GPT-4V as a Multimodal AI—0
Show:102550
← PrevPage 53 of 217Next →
All datasetsSQuAD2.0SQuAD1.1HotpotQAPIQABoolQCOPATriviaQASQuAD1.1 devNatural QuestionsOpenBookQATruthfulQAMultiRC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94—Unverified
2FPNet (ensemble)EM90.87—Unverified
3IE-NetV2 (ensemble)EM90.86—Unverified
4SA-Net on Albert (ensemble)EM90.72—Unverified
5SA-Net-V2 (ensemble)EM90.68—Unverified
6FPNet (ensemble)EM90.6—Unverified
7Retro-Reader (ensemble)EM90.58—Unverified
8EntitySpanFocusV2 (ensemble)EM90.52—Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49—Unverified
10EntitySpanFocus+AT (ensemble)EM90.45—Unverified