SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 30013050 of 10817 papers

TitleStatusHype
Beyond Text: Frozen Large Language Models in Visual Signal ComprehensionCode2
Beyond Memorization: The Challenge of Random Memory Access in Language ModelsCode1
Complex Reasoning over Logical Queries on Commonsense Knowledge GraphsCode1
InfiBench: Evaluating the Question-Answering Capabilities of Code Large Language ModelsCode1
SPA: Towards A Computational Friendly Cloud-Base and On-Devices Collaboration Seq2seq Personalized Generation with Casual InferenceCode0
ERA-CoT: Improving Chain-of-Thought through Entity Relationship AnalysisCode2
ALaRM: Align Language Models via Hierarchical Rewards ModelingCode1
Answering Diverse Questions via Text Attached with Key Audio-Visual CluesCode0
From Instructions to Constraints: Language Model Alignment with Automatic Constraint Verification0
KG-Rank: Enhancing Large Language Models for Medical QA with Knowledge Graphs and Ranking TechniquesCode2
Calibrating Large Language Models Using Their Generations OnlyCode1
MP2D: An Automated Topic Shift Dialogue Generation Framework Leveraging Knowledge Graphs0
Debiasing Multimodal Large Language ModelsCode2
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextCode3
Harnessing Multi-Role Capabilities of Large Language Models for Open-Domain Question AnsweringCode1
ChatASU: Evoking LLM's Reflexion to Truly Understand Aspect Sentiment in Dialogues0
Can't Remember Details in Long Documents? You Need Some R&RCode1
Bias-Augmented Consistency Training Reduces Biased Reasoning in Chain-of-ThoughtCode1
Few shot chain-of-thought driven reasoning to prompt LLMs for open ended medical question answeringCode0
CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual ScenariosCode2
Effectiveness Assessment of Recent Large Vision-Language Models0
Advancing Chinese biomedical text mining with community challenges0
TextMonkey: An OCR-Free Large Multimodal Model for Understanding DocumentCode5
HaluEval-Wild: Evaluating Hallucinations of Language Models in the WildCode0
QAQ: Quality Adaptive Quantization for LLM KV CacheCode2
SnapNTell: Enhancing Entity-Centric Visual Question Answering with Retrieval Augmented Multimodal LLM0
Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal ReasoningCode2
Benchmarking Hallucination in Large Language Models based on Unanswerable Math Word ProblemCode0
Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQCode0
CLEVR-POC: Reasoning-Intensive Visual Question Answering in Partially Observable Environments0
Modeling Collaborator: Enabling Subjective Vision Classification With Minimal Human Effort via LLM Tool-Use0
Reliable, Adaptable, and Attributable Language Models with Retrieval0
A General and Flexible Multi-concept Parsing Framework for Multilingual Semantic Matching0
Evidence-Focused Fact Summarization for Knowledge-Augmented Zero-Shot Question AnsweringCode0
MOKA: Open-World Robotic Manipulation through Mark-Based Visual Prompting0
Enhancing Generalization in Medical Visual Question Answering Tasks via Gradient-Guided Model Perturbation0
An Improved Traditional Chinese Evaluation Suite for Foundation Model0
Brilla AI: AI Contestant for the National Science and Maths QuizCode1
Vision-Language Models for Medical Report Generation and Visual Question Answering: A ReviewCode3
The Claude 3 Model Family: Opus, Sonnet, Haiku0
To Generate or to Retrieve? On the Effectiveness of Artificial Contexts for Medical Open-Domain Question AnsweringCode1
EEE-QA: Exploring Effective and Efficient Question-Answer RepresentationsCode0
SyllabusQA: A Course Logistics Question Answering DatasetCode0
KorMedMCQA: Multi-Choice Question Answering Benchmark for Korean Healthcare Professional Licensing Examinations0
Answerability in Retrieval-Augmented Open-Domain Question Answering0
Automatic Question-Answer Generation for Long-Tail Knowledge0
CR-LT-KGQA: A Knowledge Graph Question Answering Dataset Requiring Commonsense Reasoning and Long-Tail KnowledgeCode1
Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering0
Fine Tuning vs. Retrieval Augmented Generation for Less Popular KnowledgeCode0
Improving Cross-lingual Representation for Semantic Retrieval with Code-switching0
Show:102550
← PrevPage 61 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified