SOTAVerified|Agents Browse Leaderboard About

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 91–100 of 265 papers

Title	Date	Tasks	Status	Hype	Score
Self-Supervised Modality-Agnostic Pre-Training of Swin Transformers	May 21, 2024	Computed Tomography (CT)Unsupervised Pre-training	CodeCode Available	0	5
SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discovery	Nov 12, 2019	Drug DiscoveryLanguage Modeling	CodeCode Available	0	5
Post Training in Deep Learning with Last Kernel	Nov 14, 2016	Deep LearningUnsupervised Pre-training	CodeCode Available	0	5
Pre-train and Learn: Preserve Global Information for Graph Neural Networks	Oct 27, 2019	AttributeNode Classification	CodeCode Available	0	5
COLA: COarse LAbel pre-training for 3D semantic segmentation of sparse LiDAR datasets	Feb 14, 2022	3D Semantic SegmentationAutonomous Driving	CodeCode Available	0	5
Neural Grammatical Error Correction Systems with Unsupervised Pre-training on Synthetic Data	Aug 1, 2019	Grammatical Error CorrectionUnsupervised Pre-training	CodeCode Available	0	5
CochCeps-Augment: A Novel Self-Supervised Contrastive Learning Using Cochlear Cepstrum-based Masking for Speech Emotion Recognition	Feb 10, 2024	Contrastive LearningEmotion Recognition	CodeCode Available	0	5
MML: Maximal Multiverse Learning for Robust Fine-Tuning of Language Models	Nov 5, 2019	Unsupervised Pre-training	CodeCode Available	0	5
Unsupervised Pre-Training of Image Features on Non-Curated Data	May 3, 2019	ClusteringSelf-Supervised Image Classification	CodeCode Available	0	5
m2caiSeg: Semantic Segmentation of Laparoscopic Images using Convolutional Neural Networks	Aug 23, 2020	AnatomyData Augmentation	CodeCode Available	0	5

Show:10 25 50

← PrevPage 10 of 27Next →

All datasets Measles UCI measles

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	15RDLs	Accuracy (%)	95	—	Unverified
2	9RDLs	Accuracy (%)	94	—	Unverified
3	3 RMDL	Accuracy (%)	93	—	Unverified
4	CNN	Accuracy (%)	73	—	Unverified
5	RMDL	Accuracy (%)	0.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMDL (30 RDLs)	Sensitivity (VEB)	90.69	—	Unverified
2		Sensitivity	89.1	—	Unverified
3	RMDL 3 RDLs	Sensitivity	0.87	—	Unverified