SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 171–180 of 265 papers

TitleStatusHype
UP-DETR: Unsupervised Pre-training for Object Detection with TransformersCode1
Bi-tuning of Pre-trained Representations—0
MAGNeto: An Efficient Deep Learning Method for the Extractive Tags Summarization ProblemCode1
Semi-supervised Facial Action Unit Intensity Estimation with Contrastive Learning—0
Image Representations Learned With Unsupervised Pre-Training Contain Human-like BiasesCode1
Accelerating Training of Transformer-Based Language Models with Progressive Layer DroppingCode0
Unsupervised Vision-and-Language Pre-training Without Parallel Images and CaptionsCode1
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method—0
Pre-training Graph Transformer with Multimodal Side Information for Recommendation—0
Self-training and Pre-training are Complementary for Speech RecognitionCode0
Show:102550
← PrevPage 18 of 27Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified