SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 36013650 of 10817 papers

TitleStatusHype
Difficult Task Yes but Simple Task No: Unveiling the Laziness in Multimodal LLMsCode0
SHAKTI: A 2.5 Billion Parameter Small Language Model Optimized for Edge AI and Low-Resource Environments0
OMCAT: Omni Context Aware Transformer0
QUITE: Quantifying Uncertainty in Natural Language Text in Bayesian Reasoning ScenariosCode0
FLARE: Faithful Logic-Aided Reasoning and Exploration0
Eliminating the Language Bias for Visual Question Answering with fine-grained Causal Intervention0
Will LLMs Replace the Encoder-Only Models in Temporal Relation Classification?Code0
BanglaQuAD: A Bengali Open-domain Question Answering Dataset0
ChartKG: A Knowledge-Graph-Based Representation for Chart Images0
MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Models0
Surgical-LLaVA: Toward Surgical Scenario Understanding via Large Language and Vision Models0
LoRE: Logit-Ranked Retriever Ensemble for Enhancing Open-Domain Question Answering0
A Step Towards Mixture of Grader: Statistical Analysis of Existing Automatic Evaluation Metrics0
Prompting Video-Language Foundation Models with Domain-specific Fine-grained Heuristics for Video Question Answering0
Enhanced Electronic Health Records Text Summarization Using Large Language Models0
Quebec Automobile Insurance Question-Answering With Retrieval-Augmented GenerationCode0
Declarative Knowledge Distillation from Large Language Models for Visual Question Answering DatasetsCode0
Zero-shot Commonsense Reasoning over Machine ImaginationCode0
Synthetic Knowledge Ingestion: Towards Knowledge Refinement and Injection for Enhancing Large Language ModelsCode0
ViT3D Alignment of LLaMA3: 3D Medical Image Report Generation0
MedMobile: A mobile-sized language model with expert-level clinical capabilitiesCode0
Retrieving Contextual Information for Long-Form Question Answering using Weak Supervision0
Optimized Biomedical Question-Answering Services with LLM and Multi-BERT Integration0
Measuring the Groundedness of Legal Question-Answering Systems0
Generation with Dynamic VocabularyCode0
MRAG-Bench: Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models0
Can Knowledge Graphs Make Large Language Models More Trustworthy? An Empirical Study over Open-ended Question Answering0
SAKA: An Intelligent Platform for Semi-automated Knowledge Graph Construction and Application0
Rewriting Conversational Utterances with Instructed Large Language Models0
Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision0
Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System0
Do You Know What You Are Talking About? Characterizing Query-Knowledge Relevance For Reliable Retrieval Augmented Generation0
Sample then Identify: A General Framework for Risk Control and Assessment in Multimodal Large Language Models0
Accurate and Regret-aware Numerical Problem Solver for Tabular Question AnsweringCode0
Increasing the Difficulty of Automatically Generated Questions via Reinforcement Learning with Synthetic Preference0
ACCEPT: Adaptive Codebook for Composite and Efficient Prompt TuningCode0
TVBench: Redesigning Video-Language Evaluation0
Exploring the Readiness of Prominent Small Language Models for the Democratization of Financial LiteracyCode0
Utilize the Flow before Stepping into the Same River Twice: Certainty Represented Knowledge Flow for Refusal-Aware Instruction TuningCode0
Enhancing Multimodal LLM for Detailed and Accurate Video Captioning using Multi-Round Preference Optimization0
PAR: Prompt-Aware Token Reduction Method for Efficient Large Multimodal Models0
Personal Intelligence System UniLM: Hybrid On-Device Small Language Model and Server-Based Large Language Model for Malay Nusantara0
SparseGrad: A Selective Method for Efficient Fine-tuning of MLP LayersCode0
SEGMENT+: Long Text Processing with Short-Context Language Models0
Uncovering Factor Level Preferences to Improve Human-Model Alignment0
Do great minds think alike? Investigating Human-AI Complementarity in Question Answering with CAIMIRA0
FltLM: An Intergrated Long-Context Large Language Model for Effective Context Filtering and Understanding0
Weak-eval-Strong: Evaluating and Eliciting Lateral Thinking of LLMs with Situation PuzzlesCode0
PortLLM: Personalizing Evolving Large Language Models with Training-Free and Portable Model Patches0
ERVQA: A Dataset to Benchmark the Readiness of Large Vision Language Models in Hospital EnvironmentsCode0
Show:102550
← PrevPage 73 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified