SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 50015050 of 10817 papers

TitleStatusHype
LLMRefine: Pinpointing and Refining Large Language Models via Fine-Grained Actionable Feedback0
Attribute Diversity Determines the Systematicity Gap in VQACode0
Improving Zero-shot Visual Question Answering via Large Language Models with Reasoning Question PromptsCode0
Transformers in the Service of Description Logic-based ContextsCode0
German FinBERT: A German Pre-trained Language Model0
Few-shot Transfer Learning for Knowledge Base Question Answering: Fusing Supervised Models with In-Context LearningCode0
Asking More Informative Questions for Grounded Retrieval0
RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledge0
Semi-Structured Chain-of-Thought: Integrating Multiple Sources of Knowledge for Improved Language Model Reasoning0
Evaluating LLMs on Document-Based QA: Exact Answer Selection and Numerical Extraction using Cogtale dataset0
The ART of LLM Refinement: Ask, Refine, and Trust0
Insights into Classifying and Mitigating LLMs' Hallucinations0
CPopQA: Ranking Cultural Concept Popularity by LLMs0
How Well Do Large Language Models Understand Syntax? An Evaluation by Asking Natural Language QuestionsCode0
How good are Large Language Models on African Languages?0
TempTabQA: Temporal Question Answering for Semi-Structured Tables0
What Large Language Models Bring to Text-rich VQA?0
A Benchmark to Understand the Role of Knowledge Graphs on Large Language Model's Accuracy for Question Answering on Enterprise SQL Databases0
InCA: Rethinking In-Car Conversational System Assessment Leveraging Large Language Models0
Hallucination Augmented Recitations for Language Models0
AudioChatLlama: Towards General-Purpose Speech Abilities for LLMs0
On the Robustness of Question Rewriting Systems to Questions of Varying HardnessCode0
Large Language Models are In-context Teachers for Knowledge Reasoning0
Visual Commonsense based Heterogeneous Graph Contrastive Learning0
BizBench: A Quantitative Reasoning Benchmark for Business and Finance0
Dialogizer: Context-aware Conversational-QA Dataset Generation from Textual Sources0
Hallucination-minimized Data-to-answer Framework for Financial Decision-makers0
Prompt Sketching for Large Language Models0
Zero-shot Translation of Attention Patterns in VQA Models to Natural LanguageCode0
NLQxform: A Language Model-based Question to SPARQL TransformerCode0
JPAVE: A Generation and Classification-based Model for Joint Product Attribute Prediction and Value ExtractionCode0
Leveraging Structured Information for Explainable Multi-hop Question Answering and ReasoningCode0
Adapting Pre-trained Generative Models for Extractive Question Answering0
In-Context Learning for Knowledge Base Question Answering for Unmanned Systems based on Large Language Models0
CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding0
Tailoring Self-Rationalizers with Multi-Reward DistillationCode0
FloodBrain: Flood Disaster Reporting by Web-based Retrieval Augmented Generation with an LLM0
ChEF: A Comprehensive Evaluation Framework for Standardized Assessment of Multimodal Large Language Models0
AI-TA: Towards an Intelligent Question-Answer Teaching Assistant using Open-Source LLMsCode0
Causal Question Answering with Reinforcement LearningCode0
Divide & Conquer for Entailment-aware Multi-hop Evidence Retrieval0
Perturbation-based Active Learning for Question Answering0
Active Reasoning in an Open-World Environment0
An Introduction to Natural Language Processing Techniques and Framework for Clinical Implementation in Radiation Oncology0
Hint-enhanced In-Context Learning wakes Large Language Models up for knowledge-intensive tasks0
Predicting Question-Answering Performance of Large Language Models through Semantic Consistency0
Long Story Short: a Summarize-then-Search Method for Long Video Question AnsweringCode0
ACQUIRED: A Dataset for Answering Counterfactual Questions In Real-Life VideosCode0
Modular Blended Attention Network for Video Question Answering0
Learn to Refuse: Making Large Language Models More Controllable and Reliable through Knowledge Scope Limitation and Refusal Mechanism0
Show:102550
← PrevPage 101 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified