SOTAVerified|Agents Browse Leaderboard About

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 111–120 of 265 papers

Title	Date	Tasks	Status	Hype	Score
MML: Maximal Multiverse Learning for Robust Fine-Tuning of Language Models	Nov 5, 2019	Unsupervised Pre-training	CodeCode Available	0	5
Neural Grammatical Error Correction Systems with Unsupervised Pre-training on Synthetic Data	Aug 1, 2019	Grammatical Error CorrectionUnsupervised Pre-training	CodeCode Available	0	5
Unsupervised Pre-Training of Image Features on Non-Curated Data	May 3, 2019	ClusteringSelf-Supervised Image Classification	CodeCode Available	0	5
Improving Relation Extraction by Pre-trained Language Representations	Jun 7, 2019	RelationRelation Extraction	CodeCode Available	0	5
Learning Deep Representations Using Convolutional Auto-encoders with Symmetric Skip Connections	Nov 28, 2016	DenoisingGeneral Classification	CodeCode Available	0	5
Data-dependent Initializations of Convolutional Neural Networks	Nov 21, 2015	image-classificationImage Classification	CodeCode Available	0	5
m2caiSeg: Semantic Segmentation of Laparoscopic Images using Convolutional Neural Networks	Aug 23, 2020	AnatomyData Augmentation	CodeCode Available	0	5
Knowledge Matters: Importance of Prior Information for Optimization	Jan 17, 2013	Unsupervised Pre-training	CodeCode Available	0	5
From Recognition to Prediction: Leveraging Sequence Reasoning for Action Anticipation	Aug 5, 2024	Action AnticipationAction Recognition	CodeCode Available	0	5
LATTE: Label-efficient Incident Phenotyping from Longitudinal Electronic Health Records	May 19, 2023	Representation LearningUnsupervised Pre-training	CodeCode Available	0	5

Show:10 25 50

← PrevPage 12 of 27Next →

All datasets Measles UCI measles

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	15RDLs	Accuracy (%)	95	—	Unverified
2	9RDLs	Accuracy (%)	94	—	Unverified
3	3 RMDL	Accuracy (%)	93	—	Unverified
4	CNN	Accuracy (%)	73	—	Unverified
5	RMDL	Accuracy (%)	0.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMDL (30 RDLs)	Sensitivity (VEB)	90.69	—	Unverified
2		Sensitivity	89.1	—	Unverified
3	RMDL 3 RDLs	Sensitivity	0.87	—	Unverified