SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 36013650 of 10817 papers

TitleStatusHype
VideoCon: Robust Video-Language Alignment via Contrast CaptionsCode1
On the Calibration of Multilingual Question Answering LLMs0
Transformers in the Service of Description Logic-based ContextsCode0
X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects0
German FinBERT: A German Pre-trained Language Model0
Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional TrainingCode2
Llamas Know What GPTs Don't Show: Surrogate Models for Confidence Estimation0
Improving Zero-shot Visual Question Answering via Large Language Models with Reasoning Question PromptsCode0
XplainLLM: A Knowledge-Augmented Dataset for Reliable Grounded Explanations in LLMsCode1
Towards Verifiable Text Generation with Symbolic References0
Rescue: Ranking LLM Responses with Partial Ordering to Improve Response GenerationCode0
Attribute Diversity Determines the Systematicity Gap in VQACode0
Temporal Knowledge Question Answering via Abstract Reasoning InductionCode1
ContraDoc: Understanding Self-Contradictions in Documents with Large Language ModelsCode1
Few-shot Transfer Learning for Knowledge Base Question Answering: Fusing Supervised Models with In-Context LearningCode0
Asking More Informative Questions for Grounded Retrieval0
Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language ModelsCode1
Evaluating LLMs on Document-Based QA: Exact Answer Selection and Numerical Extraction using Cogtale dataset0
Insights into Classifying and Mitigating LLMs' Hallucinations0
The ART of LLM Refinement: Ask, Refine, and Trust0
CPopQA: Ranking Cultural Concept Popularity by LLMs0
Semi-Structured Chain-of-Thought: Integrating Multiple Sources of Knowledge for Improved Language Model Reasoning0
Learning to Filter Context for Retrieval-Augmented GenerationCode2
Bring Your Own KG: Self-Supervised Program Synthesis for Zero-Shot KGQACode1
How Well Do Large Language Models Understand Syntax? An Evaluation by Asking Natural Language QuestionsCode0
TempTabQA: Temporal Question Answering for Semi-Structured Tables0
RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledge0
How good are Large Language Models on African Languages?0
What Large Language Models Bring to Text-rich VQA?0
A Comprehensive Evaluation of GPT-4V on Knowledge-Intensive Visual Question AnsweringCode1
A Step Closer to Comprehensive Answers: Constrained Multi-Stage Question Decomposition with Large Language ModelsCode1
Hallucination Augmented Recitations for Language Models0
A Benchmark to Understand the Role of Knowledge Graphs on Large Language Model's Accuracy for Question Answering on Enterprise SQL Databases0
InCA: Rethinking In-Car Conversational System Assessment Leveraging Large Language Models0
SPHINX: The Joint Mixing of Weights, Tasks, and Visual Embeddings for Multi-modal Large Language ModelsCode4
Large Language Models are In-context Teachers for Knowledge Reasoning0
On the Robustness of Question Rewriting Systems to Questions of Varying HardnessCode0
InfMLLM: A Unified Framework for Visual-Language TasksCode1
AudioChatLlama: Towards General-Purpose Speech Abilities for LLMs0
Visual Commonsense based Heterogeneous Graph Contrastive Learning0
BizBench: A Quantitative Reasoning Benchmark for Business and Finance0
Knowledgeable Preference Alignment for LLMs in Domain-specific Question AnsweringCode1
Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal ModelsCode3
ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human PreferencesCode1
Dialogizer: Context-aware Conversational-QA Dataset Generation from Textual Sources0
Hallucination-minimized Data-to-answer Framework for Financial Decision-makers0
Agent Lumos: Unified and Modular Training for Open-Source Language AgentsCode2
TencentLLMEval: A Hierarchical Evaluation of Real-World Capabilities for Human-Aligned LLMsCode1
NLQxform: A Language Model-based Question to SPARQL TransformerCode0
GENOME: GenerativE Neuro-symbOlic visual reasoning by growing and reusing ModulEsCode1
Show:102550
← PrevPage 73 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified