SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 11011150 of 10817 papers

TitleStatusHype
Rephrase, Augment, Reason: Visual Grounding of Questions for Vision-Language ModelsCode1
Fine-grained Audio-Visual Joint Representations for Multimodal Large Language ModelsCode1
MinPrompt: Graph-based Minimal Prompt Data Augmentation for Few-shot Question AnsweringCode1
BRAINTEASER: Lateral Thinking Puzzles for Large Language ModelsCode1
An Investigation of LLMs' Inefficacy in Understanding Converse RelationsCode1
RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective AugmentationCode1
MapperGPT: Large Language Models for Linking and Mapping EntitiesCode1
BioBridge: Bridging Biomedical Foundation Models via Knowledge GraphsCode1
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference OptimizationCode1
LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language ModelsCode1
A Long Way to Go: Investigating Length Correlations in RLHFCode1
Integrating UMLS Knowledge into Large Language Models for Medical Question AnsweringCode1
Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human PreferenceCode1
Multimodal Question Answering for Unified Information ExtractionCode1
Fool Your (Vision and) Language Model With Embarrassingly Simple PermutationsCode1
Making Retrieval-Augmented Language Models Robust to Irrelevant ContextCode1
A Framework for Inference Inspired by Human Memory MechanismsCode1
Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language ModelsCode1
VDC: Versatile Data Cleanser based on Visual-Linguistic Inconsistency by Multimodal Large Language ModelsCode1
Toloka Visual Question Answering BenchmarkCode1
At Which Training Stage Does Code Data Help LLMs Reasoning?Code1
Spider4SPARQL: A Complex Benchmark for Evaluating Knowledge Graph Question Answering SystemsCode1
Zero-Shot and Few-Shot Video Question Answering with Multi-Modal PromptsCode1
Physics of Language Models: Part 3.1, Knowledge Storage and ExtractionCode1
BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language ModelsCode1
Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question AnsweringCode1
SCREWS: A Modular Framework for Reasoning with RevisionsCode1
Natural Language Embedded Programs for Hybrid Language Symbolic ReasoningCode1
Fabricator: An Open Source Toolkit for Generating Labeled Training Data with Teacher LLMsCode1
Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and SayingsCode1
Code-Style In-Context Learning for Knowledge-Based Question AnsweringCode1
Augmenting Black-box LLMs with Medical Textbooks for Biomedical Question Answering (Published in Findings of EMNLP 2024)Code1
Can I Trust Your Answer? Visually Grounded Video Question AnsweringCode1
CRUISE-Screening: Living Literature Reviews ToolboxCode1
MedChatZH: a Better Medical Adviser Learns from Better InstructionsCode1
Bridging the KB-Text Gap: Leveraging Structured Knowledge-aware Pre-training for KBQACode1
UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and MemoryCode1
Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIPCode1
Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question AnsweringCode1
CALM : A Multi-task Benchmark for Comprehensive Assessment of Language Model BiasCode1
FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question AnsweringCode1
InstructionGPT-4: A 200-Instruction Paradigm for Fine-Tuning MiniGPT-4Code1
Simple Baselines for Interactive Video Retrieval with Questions and AnswersCode1
RaLLe: A Framework for Developing and Evaluating Retrieval-Augmented Large Language ModelsCode1
LibriSQA: A Novel Dataset and Framework for Spoken Question Answering with Large Language ModelsCode1
ViT-Lens: Initiating Omni-Modal Exploration through 3D InsightsCode1
GameEval: Evaluating LLMs on Conversational GamesCode1
Open-vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering ModelsCode1
End-to-End Beam Retrieval for Multi-Hop Question AnsweringCode1
Uni-NLX: Unifying Textual Explanations for Vision and Vision-Language TasksCode1
Show:102550
← PrevPage 23 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified