SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 16511700 of 10817 papers

TitleStatusHype
WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global CuisinesCode1
RuleRAG: Rule-guided retrieval-augmented generation with language models for question answeringCode1
Telco-DPR: A Hybrid Dataset for Evaluating Retrieval Models of 3GPP Technical Specifications0
LargePiG: Your Large Language Model is Secretly a Pointer Generator0
OMCAT: Omni Context Aware Transformer0
Unleashing the Power of LLMs as Multi-Modal Encoders for Text and Graph-Structured Data0
Causal Reasoning in Large Language Models: A Knowledge Graph Approach0
Empowering Users in Digital Privacy Management through Interactive LLM-Based Agents0
AGENTiGraph: An Interactive Knowledge Graph Platform for LLM-based Chatbots Utilizing Private Data0
SHAKTI: A 2.5 Billion Parameter Small Language Model Optimized for Edge AI and Low-Resource Environments0
Difficult Task Yes but Simple Task No: Unveiling the Laziness in Multimodal LLMsCode0
VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AICode2
FLARE: Faithful Logic-Aided Reasoning and Exploration0
LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive MemoryCode3
QUITE: Quantifying Uncertainty in Natural Language Text in Bayesian Reasoning ScenariosCode0
SensorLLM: Human-Intuitive Alignment of Multivariate Sensor Data with LLMs for Activity RecognitionCode2
KBLaM: Knowledge Base augmented Language ModelCode5
Free Video-LLM: Prompt-guided Visual Perception for Efficient Training-free Video LLMsCode2
EasyRAG: Efficient Retrieval-Augmented Generation Framework for Automated Network OperationsCode4
Eliminating the Language Bias for Visual Question Answering with fine-grained Causal Intervention0
Will LLMs Replace the Encoder-Only Models in Temporal Relation Classification?Code0
TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video ModelsCode1
Towards Foundation Models for 3D Vision: How Close Are We?Code1
BanglaQuAD: A Bengali Open-domain Question Answering Dataset0
ChartKG: A Knowledge-Graph-Based Representation for Chart Images0
Surgical-LLaVA: Toward Surgical Scenario Understanding via Large Language and Vision Models0
A Step Towards Mixture of Grader: Statistical Analysis of Existing Automatic Evaluation Metrics0
MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Models0
LoRE: Logit-Ranked Retriever Ensemble for Enhancing Open-Domain Question Answering0
Enhanced Electronic Health Records Text Summarization Using Large Language Models0
Quebec Automobile Insurance Question-Answering With Retrieval-Augmented GenerationCode0
Synthetic Knowledge Ingestion: Towards Knowledge Refinement and Injection for Enhancing Large Language ModelsCode0
Declarative Knowledge Distillation from Large Language Models for Visual Question Answering DatasetsCode0
Multi-granularity Contrastive Cross-modal Collaborative Generation for End-to-End Long-term Video Question AnsweringCode1
Zero-shot Commonsense Reasoning over Machine ImaginationCode0
Skipping Computations in Multimodal LLMsCode1
Prompting Video-Language Foundation Models with Domain-specific Fine-grained Heuristics for Video Question Answering0
Optimized Biomedical Question-Answering Services with LLM and Multi-BERT Integration0
Generation with Dynamic VocabularyCode0
Retriever-and-Memory: Towards Adaptive Note-Enhanced Retrieval-Augmented GenerationCode2
SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language ModelsCode1
Dynamic Multimodal Evaluation with Flexible Complexity by Vision-Language BootstrappingCode1
Retrieving Contextual Information for Long-Form Question Answering using Weak Supervision0
Measuring the Groundedness of Legal Question-Answering Systems0
ViT3D Alignment of LLaMA3: 3D Medical Image Report Generation0
MedMobile: A mobile-sized language model with expert-level clinical capabilitiesCode0
Accurate and Regret-aware Numerical Problem Solver for Tabular Question AnsweringCode0
ACCEPT: Adaptive Codebook for Composite and Efficient Prompt TuningCode0
StablePrompt: Automatic Prompt Tuning using Reinforcement Learning for Large Language ModelsCode1
Do You Know What You Are Talking About? Characterizing Query-Knowledge Relevance For Reliable Retrieval Augmented Generation0
Show:102550
← PrevPage 34 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified