SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 29513000 of 10817 papers

TitleStatusHype
Improved Baselines for Data-efficient Perceptual Augmentation of LLMs0
DESIRE-ME: Domain-Enhanced Supervised Information REtrieval using Mixture-of-ExpertsCode0
Polaris: A Safety-focused LLM Constellation Architecture for Healthcare0
PARAMANU-AYN: Pretrain from scratch or Continual Pretraining of LLMs for Legal Domain Adaptation?0
WoLF: Wide-scope Large Language Model Framework for CXR Understanding0
Efficient Encoder-Decoder Transformer Decoding for Decomposable TasksCode0
VL-ICL Bench: The Devil in the Details of Multimodal In-Context LearningCode2
Towards Unsupervised Question Answering System with Multi-level Summarization for Legal Text0
As Firm As Their Foundations: Can open-sourced foundation models be used to create adversarial examples for downstream tasks?0
SEVEN: Pruning Transformer Model by Reserving SentinelsCode0
Dr3: Ask Large Language Models Not to Give Off-Topic Answers in Open Domain Multi-Hop Question AnsweringCode0
AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain FrameworkCode3
SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors0
NovelQA: Benchmarking Question Answering on Documents Exceeding 200K TokensCode1
Syn-QA2: Evaluating False Assumptions in Long-tail Questions with Synthetic QA DatasetsCode0
FlexCap: Describe Anything in Images in Controllable Detail0
Can LLMs Generate Human-Like Wayfinding Instructions? Towards Platform-Agnostic Embodied Instruction Synthesis0
Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning0
FlowMind: Automatic Workflow Generation with LLMs0
Logic Query of Thoughts: Guiding Large Language Models to Answer Complex Logic Queries with Knowledge GraphsCode0
Enhancing Event Causality Identification with Rationale and Structure-Aware Causal Question Answering0
Few-Shot VQA with Frozen LLMs: A Tale of Two Approaches0
SQ-LLaVA: Self-Questioning for Large Vision-Language AssistantCode1
BEnQA: A Question Answering and Reasoning Benchmark for Bengali and EnglishCode0
Forward Learning of Graph Neural NetworksCode1
RetinaQA: A Robust Knowledge Base Question Answering Model for both Answerable and Unanswerable QuestionsCode0
Lost in Overlap: Exploring Logit-based Watermark Collision in LLMs0
Knowledge Condensation and Reasoning for Knowledge-based VQA0
Parameter Efficient Reinforcement Learning from Human Feedback0
Few-Shot Image Classification and Segmentation as Visual Question Answering Using Vision-Language Models0
Team Trifecta at Factify5WQA: Setting the Standard in Fact Verification with Fine-TuningCode0
Can a GPT4-Powered AI Agent Be a Good Enough Performance Attribution Analyst?0
Helpful or Harmful? Exploring the Efficacy of Large Language Models for Online Grooming Prevention0
RAGGED: Towards Informed Design of Retrieval Augmented Generation SystemsCode2
Retrieval augmented text-to-SQL generation for epidemiological question answering using electronic health recordsCode1
Can We Talk Models Into Seeing the World Differently?Code1
ChartInstruct: Instruction Tuning for Chart Comprehension and ReasoningCode1
ProSwitch: Knowledge-Guided Instruction Tuning to Switch Between Professional and Non-Professional Responses0
Adversarial Training with OCR Modality Perturbation for Scene-Text Visual Question AnsweringCode0
Quiet-STaR: Language Models Can Teach Themselves to Think Before SpeakingCode4
Transformers Get Stable: An End-to-End Signal Propagation Theory for Language ModelsCode1
VisionGPT: Vision-Language Understanding Agent Using Generalized Multimodal Framework0
TINA: Think, Interaction, and Action Framework for Zero-Shot Vision Language Navigation0
MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular ComprehensionCode0
DAM: Dynamic Adapter Merging for Continual Video QA LearningCode1
A novel interface for adversarial trivia question-writing0
Fine-tuning Large Language Models with Sequential Instructions0
Mitigating the Impact of Attribute Editing on Face Recognition0
Rethinking Generative Large Language Model Evaluation for Semantic Comprehension0
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM0
Show:102550
← PrevPage 60 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified