SOTAVerified|Agents Browse Leaderboard About

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 81–90 of 265 papers

Title	Date	Tasks	Status	Hype	Score
Decoupling Exploration and Exploitation for Unsupervised Pre-training with Successor Features	May 4, 2024	Unsupervised Pre-training	CodeCode Available	0	5
Data-dependent Initializations of Convolutional Neural Networks	Nov 21, 2015	image-classificationImage Classification	CodeCode Available	0	5
BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning	Feb 7, 2019	Multi-Task LearningNatural Language Inference	CodeCode Available	0	5
Curriculum-Based Self-Training Makes Better Few-Shot Learners for Data-to-Text Generation	Jun 6, 2022	Data-to-Text GenerationText Generation	CodeCode Available	0	5
An Analysis of Unsupervised Pre-training in Light of Recent Advances	Dec 20, 2014	Data AugmentationImage Classification	CodeCode Available	0	5
A Large-Scale Study on Unsupervised Spatiotemporal Representation Learning	Apr 29, 2021	Representation LearningSelf-Supervised Action Recognition	CodeCode Available	0	5
PUNR: Pre-training with User Behavior Modeling for News Recommendation	Apr 25, 2023	News RecommendationUnsupervised Pre-training	CodeCode Available	0	5
Post Training in Deep Learning with Last Kernel	Nov 14, 2016	Deep LearningUnsupervised Pre-training	CodeCode Available	0	5
Pre-train and Learn: Preserve Global Information for Graph Neural Networks	Oct 27, 2019	AttributeNode Classification	CodeCode Available	0	5
Contextual embedding and model weighting by fusing domain knowledge on Biomedical Question Answering	Jun 26, 2022	Cloze TestMachine Reading Comprehension	CodeCode Available	0	5

Show:10 25 50

← PrevPage 9 of 27Next →

All datasets Measles UCI measles

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	15RDLs	Accuracy (%)	95	—	Unverified
2	9RDLs	Accuracy (%)	94	—	Unverified
3	3 RMDL	Accuracy (%)	93	—	Unverified
4	CNN	Accuracy (%)	73	—	Unverified
5	RMDL	Accuracy (%)	0.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMDL (30 RDLs)	Sensitivity (VEB)	90.69	—	Unverified
2		Sensitivity	89.1	—	Unverified
3	RMDL 3 RDLs	Sensitivity	0.87	—	Unverified