SOTAVerified|Agents Browse Leaderboard About

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 11–20 of 265 papers

Title	Date	Tasks	Status	Hype
SPACE: Your Genomic Profile Predictor is a Powerful DNA Foundation Model	Jun 2, 2025	Mixture-of-ExpertsUnsupervised Pre-training	CodeCode Available	1
PersonViT: Large-scale Self-supervised Vision Transformer for Person Re-Identification	Aug 10, 2024	Contrastive LearningPerson Re-Identification	CodeCode Available	1
ConStyle v2: A Strong Prompter for All-in-One Image Restoration	Jun 26, 2024	AllGPU	CodeCode Available	1
PEAC: Unsupervised Pre-training for Cross-Embodiment Reinforcement Learning	May 23, 2024	reinforcement-learningReinforcement Learning	CodeCode Available	1
BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers	Apr 29, 2024	RetrievalUnsupervised Pre-training	CodeCode Available	1
Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval	Jan 20, 2024	DecoderPassage Retrieval	CodeCode Available	1
Unified Multi-modal Unsupervised Representation Learning for Skeleton-based Action Understanding	Nov 6, 2023	Action UnderstandingRepresentation Learning	CodeCode Available	1
METRA: Scalable Unsupervised RL with Metric-Aware Abstraction	Oct 13, 2023	Reinforcement Learning (RL)Unsupervised Pre-training	CodeCode Available	1
HIQL: Offline Goal-Conditioned RL with Latent States as Actions	Jul 22, 2023	Reinforcement Learning (RL)Unsupervised Pre-training	CodeCode Available	1
Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning	May 29, 2023	Autonomous DrivingDecoder	CodeCode Available	1

Show:10 25 50

← PrevPage 2 of 27Next →

All datasets Measles UCI measles

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	15RDLs	Accuracy (%)	95	—	Unverified
2	9RDLs	Accuracy (%)	94	—	Unverified
3	3 RMDL	Accuracy (%)	93	—	Unverified
4	CNN	Accuracy (%)	73	—	Unverified
5	RMDL	Accuracy (%)	0.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMDL (30 RDLs)	Sensitivity (VEB)	90.69	—	Unverified
2		Sensitivity	89.1	—	Unverified
3	RMDL 3 RDLs	Sensitivity	0.87	—	Unverified