SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 43014350 of 10817 papers

TitleStatusHype
KG-RAG: Bridging the Gap Between Knowledge and Creativity0
Increasing the LLM Accuracy for Question Answering: Ontologies to the Rescue!0
Inquire, Interact, and Integrate: A Proactive Agent Collaborative Framework for Zero-Shot Multimodal Medical Reasoning0
EyeFound: A Multimodal Generalist Foundation Model for Ophthalmic Imaging0
Case-Based Reasoning Approach for Solving Financial Question Answering0
MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing0
VideoQA-SC: Adaptive Semantic Communication for Video Question Answering0
StackOverflowVQA: Stack Overflow Visual Question Answering Dataset0
Evaluation of large language model performance on the Biomedical Language Understanding and Reasoning Benchmark0
LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions0
FinTextQA: A Dataset for Long-form Financial Question Answering0
Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality0
KnowledgeHub: An end-to-end Tool for Assisted Scientific Discovery0
AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning0
Prompting-based Synthetic Data Generation for Few-Shot Question AnsweringCode0
STAR: A Benchmark for Situated Reasoning in Real-World Videos0
IM-RAG: Multi-Round Retrieval-Augmented Generation Through Learning Inner Monologues0
CinePile: A Long Video Question Answering Dataset and Benchmark0
SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models0
From Questions to Insightful Answers: Building an Informed Chatbot for University Resources0
CLIP-Powered TASS: Target-Aware Single-Stream Network for Audio-Visual Question Answering0
AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments0
EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential ReasoningCode0
KET-QA: A Dataset for Knowledge Enhanced Table Question Answering0
UCCIX: Irish-eXcellence Large Language Model0
Benchmarking Retrieval-Augmented Large Language Models in Biomedical NLP: Application, Robustness, and Self-Awareness0
MetaReflection: Learning Instructions for Language Agents using Past Reflections0
Realizing Visual Question Answering for Education: GPT-4V as a Multimodal AI0
Limited Ability of LLMs to Simulate Human Psychological Behaviours: a Psychometric AnalysisCode0
ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering0
Federated Document Visual Question Answering: A Pilot StudyCode0
Prompting Large Language Models with Knowledge Graphs for Question Answering Involving Long-tail Facts0
Aspect-oriented Consumer Health Answer Summarization0
Parameter-Efficient Fine-Tuning With Adapters0
Redefining Information Retrieval of Structured Database via Large Language Models0
G-SAP: Graph-based Structure-Aware Prompt Learning over Heterogeneous Knowledge for Commonsense Reasoning0
Fine-tuning Pre-trained Named Entity Recognition Models For Indian Languages0
ChatSOS: Vector Database Augmented Generative Question Answering Assistant in Safety Engineering0
Improving Long Text Understanding with Knowledge Distilled from Summarization Model0
CourseGPT-zh: an Educational Large Language Model Based on Knowledge Distillation Incorporating Prompt Optimization0
Is the House Ready For Sleeptime? Generating and Evaluating Situational Queries for Embodied Question Answering0
CleanGraph: Human-in-the-loop Knowledge Graph Refinement and CompletionCode0
ERATTA: Extreme RAG for Table To Answers with Large Language Models0
Switchable Decision: Dynamic Neural Generation Networks0
Mitigating Clickbait: An Approach to Spoiler Generation Using Multitask Learning0
Advancing Multimodal Medical Capabilities of Gemini0
Language-Image Models with 3D Understanding0
Hire Me or Not? Examining Language Model's Behavior with Occupation AttributesCode0
Compressing Long Context for Enhancing RAG with AMR-based Concept Distillation0
VSA4VQA: Scaling a Vector Symbolic Architecture to Visual Question Answering on Natural Images0
Show:102550
← PrevPage 87 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified