SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–75 of 265 papers

TitleStatusHype
Behavior From the Void: Unsupervised Active Pre-TrainingCode1
ES-Net: An Efficient Stereo Matching NetworkCode1
DOBF: A Deobfuscation Pre-Training Objective for Programming LanguagesCode1
CATE: Computation-aware Neural Architecture Encoding with TransformersCode1
Unsupervised Semantic Segmentation by Contrasting Object Mask ProposalsCode1
FedAUX: Leveraging Unlabeled Auxiliary Data in Federated LearningCode1
SEED: Self-supervised Distillation For Visual RepresentationCode1
End-to-End Training of Neural Retrievers for Open-Domain Question AnsweringCode1
OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised LearningCode1
TabTransformer: Tabular Data Modeling Using Contextual EmbeddingsCode1
Unsupervised Pre-training for Person Re-identificationCode1
UP-DETR: Unsupervised Pre-training for Object Detection with TransformersCode1
MAGNeto: An Efficient Deep Learning Method for the Extractive Tags Summarization ProblemCode1
Image Representations Learned With Unsupervised Pre-Training Contain Human-like BiasesCode1
Unsupervised Vision-and-Language Pre-training Without Parallel Images and CaptionsCode1
A Transformer-based Framework for Multivariate Time Series Representation LearningCode1
Self-training Improves Pre-training for Natural Language UnderstandingCode1
Spatiotemporal Contrastive Video Representation LearningCode1
SeCo: Exploring Sequence Supervision for Unsupervised Representation LearningCode1
PointContrast: Unsupervised Pre-training for 3D Point Cloud UnderstandingCode1
A Further Study of Unsupervised Pre-training for Transformer Based Speech RecognitionCode1
Rolling-Unrolling LSTMs for Action Anticipation from First-Person VideoCode1
TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction TaskCode1
Improving Transformer-based Speech Recognition Using Unsupervised Pre-trainingCode1
Leveraging Pre-trained Checkpoints for Sequence Generation TasksCode1
Show:102550
← PrevPage 3 of 11Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified