SOTAVerified

Question Answering

Question answering can be segmented into domain-specific tasks like community question answering and knowledge-base question answering. Popular benchmark datasets for evaluation question answering systems include SQuAD, HotPotQA, bAbI, TriviaQA, WikiQA, and many others. Models for question answering are typically evaluated on metrics like EM and F1. Some recent top performing models are T5 and XLNet.

( Image credit: SQuAD )

Papers

Showing 34013450 of 10817 papers

TitleStatusHype
MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model EvaluationCode1
AQUALLM: Audio Question Answering Data Generation Using Large Language ModelsCode0
MIVC: Multiple Instance Visual Component for Visual-Language Models0
GUITAR: Gradient Pruning toward Fast Neural Ranking0
OmniDialog: An Omnipotent Pre-training Model for Task-Oriented Dialogue System0
Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges0
Gemini Pro Defeated by GPT-4V: Evidence from Education0
Conversational Question Answering with Reformulations over Knowledge Graph0
S2M: Converting Single-Turn to Multi-Turn Datasets for Conversational Question Answering0
From text to multimodal: a survey of adversarial example generation in question answering systems0
Detection-based Intermediate Supervision for Visual Question Answering0
KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph0
Supervised Knowledge Makes Large Language Models Better In-context LearnersCode0
SecQA: A Concise Question-Answering Dataset for Evaluating Large Language Models in Computer SecurityCode0
PersianLLaMA: Towards Building First Persian Large Language Model0
On the Promises and Challenges of Multimodal Foundation Models for Geographical, Environmental, Agricultural, and Urban Planning Applications0
Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue0
Reverse Multi-Choice Dialogue Commonsense Inference with Graph-of-ThoughtCode1
PokeMQA: Programmable knowledge editing for Multi-hop Question AnsweringCode1
Towards a Unified Multimodal Reasoning FrameworkCode0
Numerical Reasoning for Financial ReportsCode0
Computational Semantics and Evaluation Benchmark for Interrogative Sentences via Combinatory Categorial Grammar0
Typhoon: Thai Large Language Models0
Text2Analysis: A Benchmark of Table Question Answering with Advanced Data Analysis and Unclear Queries0
DriveLM: Driving with Graph Visual Question AnsweringCode3
Shai: A large language model for asset management0
Diversifying Knowledge Enhancement of Biomedical Language Models using Adapter Modules and Knowledge Graphs0
LiDAR-LLM: Exploring the Potential of Large Language Models for 3D LiDAR Understanding0
Reducing Hallucinations: Enhancing VQA for Flood Disaster Damage Assessment with Visual Contexts0
VCoder: Versatile Vision Encoders for Multimodal Large Language ModelsCode2
LingoQA: Visual Question Answering for Autonomous DrivingCode2
Object Attribute Matters in Visual Question AnsweringCode0
DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines0
Interactive Visual Task Learning for Robots0
Multi-Clue Reasoning with Memory Augmentation for Knowledge-based Visual Question Answering0
Lookahead: An Inference Acceleration Framework for Large Language Model with Lossless Generation AccuracyCode2
Perception Test 2023: A Summary of the First Challenge And Outcome0
Object-aware Adaptive-Positivity Learning for Audio-Visual Question AnsweringCode0
Cross-Modal Reasoning with Event Correlation for Video Question Answering0
Generative Multimodal Models are In-Context LearnersCode3
Contextual Code Switching for Machine Translation using Language Models0
On Early Detection of Hallucinations in Factual Question AnsweringCode1
MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRACode0
PEPT: Expert Finding Meets Personalized Pre-training0
Relation-Aware Question Answering for Heterogeneous Knowledge GraphsCode0
VQA4CIR: Boosting Composed Image Retrieval with Visual Question AnsweringCode0
EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question AnsweringCode1
CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update0
OsmLocator: locating overlapping scatter marks with a non-training generative perspectiveCode0
HAAR: Text-Conditioned Generative Model of 3D Strand-based Human HairstylesCode1
Show:102550
← PrevPage 69 of 217Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1IE-Net (ensemble)EM90.94Unverified
2FPNet (ensemble)EM90.87Unverified
3IE-NetV2 (ensemble)EM90.86Unverified
4SA-Net on Albert (ensemble)EM90.72Unverified
5SA-Net-V2 (ensemble)EM90.68Unverified
6FPNet (ensemble)EM90.6Unverified
7Retro-Reader (ensemble)EM90.58Unverified
8EntitySpanFocusV2 (ensemble)EM90.52Unverified
9TransNets + SFVerifier + SFEnsembler (ensemble)EM90.49Unverified
10EntitySpanFocus+AT (ensemble)EM90.45Unverified