Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 26–50 of 265 papers

Title	Date	Tasks	Status	Hype
MultiTalent: A Multi-Dataset Approach to Medical Image Segmentation	Mar 25, 2023	Image SegmentationLesion Segmentation	CodeCode Available	1
DocILE Benchmark for Document Information Localization and Extraction	Feb 11, 2023	Key Information ExtractionUnsupervised Pre-training	CodeCode Available	1
ProposalContrast: Unsupervised Pre-training for LiDAR-based 3D Object Detection	Jul 26, 2022	3D Object Detectionobject-detection	CodeCode Available	1
Unsupervised pre-training of graph transformers on patient population graphs	Jul 21, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
CARLANE: A Lane Detection Benchmark for Unsupervised Domain Adaptation from Simulation to multiple Real-World Domains	Jun 16, 2022	2D Semantic SegmentationAutonomous Driving	CodeCode Available	1
Self-Supervised Visual Representation Learning with Semantic Grouping	May 30, 2022	Contrastive LearningInstance Segmentation	CodeCode Available	1
Semi-supervised 3D shape segmentation with multilevel consistency and part substitution	Apr 19, 2022	SegmentationSemantic Segmentation	CodeCode Available	1
ELECTRIcity: An Efficient Transformer for Non-Intrusive Load Monitoring	Apr 11, 2022	Non-Intrusive Load MonitoringUnsupervised Pre-training	CodeCode Available	1
Unsupervised Pre-training for Temporal Action Localization Tasks	Mar 25, 2022	Action LocalizationContrastive Learning	CodeCode Available	1
Reinforcement Learning with Action-Free Pre-Training from Videos	Mar 25, 2022	Predictionreinforcement-learning	CodeCode Available	1
Unsupervised Pre-Training on Patient Population Graphs for Patient-Level Predictions	Mar 23, 2022	Disease PredictionImputation	CodeCode Available	1
Korean-Specific Dataset for Table Question Answering	Jan 17, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
The CLEAR Benchmark: Continual LEArning on Real-World Imagery	Jan 17, 2022	Continual Learningimage-classification	CodeCode Available	1
AI-Bind: Improving Binding Predictions for Novel Protein Targets and Ligands	Dec 25, 2021	Drug DiscoveryUnsupervised Pre-training	CodeCode Available	1
SimIPU: Simple 2D Image and 3D Point Cloud Unsupervised Pre-Training for Spatial-Aware Visual Representations	Dec 9, 2021	Contrastive LearningUnsupervised Pre-training	CodeCode Available	1
Bag of Tricks and A Strong baseline for Image Copy Detection	Nov 13, 2021	Copy DetectionUnsupervised Pre-training	CodeCode Available	1
D^2LV: A Data-Driven and Local-Verification Approach for Image Copy Detection	Nov 13, 2021	Copy DetectionUnsupervised Pre-training	CodeCode Available	1
Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognition	Sep 14, 2021	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	CodeCode Available	1
RandomRooms: Unsupervised Pre-training from Synthetic Shapes and Randomized Layouts for 3D Object Detection	Aug 17, 2021	2D Object Detection3D Object Detection	CodeCode Available	1
PEBBLE: Feedback-Efficient Interactive Reinforcement Learning via Relabeling Experience and Unsupervised Pre-training	Jun 9, 2021	reinforcement-learningReinforcement Learning (RL)	CodeCode Available	1
Exploring the Limits of Out-of-Distribution Detection	Jun 6, 2021	Out-of-Distribution DetectionOut of Distribution (OOD) Detection	CodeCode Available	1
Initialization and Regularization of Factorized Neural Layers	May 3, 2021	Knowledge DistillationModel Compression	CodeCode Available	1
Patient Contrastive Learning: a Performant, Expressive, and Practical Approach to ECG Modeling	Apr 9, 2021	Contrastive LearningElectrocardiography (ECG)	CodeCode Available	1
Pre-training strategies and datasets for facial representation learning	Mar 30, 2021	3D Face Reconstruction3D Facial Landmark Localization	CodeCode Available	1
Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data	Mar 30, 2021	Change DetectionSelf-Supervised Learning	CodeCode Available	1

Show:10 25 50

← PrevPage 2 of 11Next →

All datasets Measles UCI measles

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	15RDLs	Accuracy (%)	95	—	Unverified
2	9RDLs	Accuracy (%)	94	—	Unverified
3	3 RMDL	Accuracy (%)	93	—	Unverified
4	CNN	Accuracy (%)	73	—	Unverified
5	RMDL	Accuracy (%)	0.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMDL (30 RDLs)	Sensitivity (VEB)	90.69	—	Unverified
2		Sensitivity	89.1	—	Unverified
3	RMDL 3 RDLs	Sensitivity	0.87	—	Unverified