SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 265 papers

TitleStatusHype
Pre-training strategies and datasets for facial representation learningCode1
Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors—0
Behavior From the Void: Unsupervised Active Pre-TrainingCode1
ES-Net: An Efficient Stereo Matching NetworkCode1
A Brief Summary of Interactions Between Meta-Learning and Self-Supervised Learning—0
Beyond Fine-Tuning: Transferring Behavior in Reinforcement Learning—0
DOBF: A Deobfuscation Pre-Training Objective for Programming LanguagesCode1
CATE: Computation-aware Neural Architecture Encoding with TransformersCode1
Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised Pre-training and Its Application to Children's ASR—0
Unsupervised Semantic Segmentation by Contrasting Object Mask ProposalsCode1
FedAUX: Leveraging Unlabeled Auxiliary Data in Federated LearningCode1
SEED: Self-supervised Distillation For Visual RepresentationCode1
AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21—0
End-to-End Training of Neural Retrievers for Open-Domain Question AnsweringCode1
Unsupervised Active Pre-Training for Reinforcement Learning—0
R-LAtte: Attention Module for Visual Control via Reinforcement Learning—0
OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised LearningCode1
TabTransformer: Tabular Data Modeling Using Contextual EmbeddingsCode1
Unsupervised Pre-training for Person Re-identificationCode1
Machine Translation Pre-training for Data-to-Text Generation - A Case Study in Czech—0
UP-DETR: Unsupervised Pre-training for Object Detection with TransformersCode1
Bi-tuning of Pre-trained Representations—0
MAGNeto: An Efficient Deep Learning Method for the Extractive Tags Summarization ProblemCode1
Semi-supervised Facial Action Unit Intensity Estimation with Contrastive Learning—0
Image Representations Learned With Unsupervised Pre-Training Contain Human-like BiasesCode1
Accelerating Training of Transformer-Based Language Models with Progressive Layer DroppingCode0
Unsupervised Vision-and-Language Pre-training Without Parallel Images and CaptionsCode1
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method—0
Pre-training Graph Transformer with Multimodal Side Information for Recommendation—0
Self-training and Pre-training are Complementary for Speech RecognitionCode0
Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring—0
A Transformer-based Framework for Multivariate Time Series Representation LearningCode1
Self-training Improves Pre-training for Natural Language UnderstandingCode1
Unsupervised Pre-training for Biomedical Question Answering—0
ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model—0
m2caiSeg: Semantic Segmentation of Laparoscopic Images using Convolutional Neural NetworksCode0
Unsupervised Learning For Sequence-to-sequence Text-to-speech For Low-resource Languages—0
Spatiotemporal Contrastive Video Representation LearningCode1
Functional Regularization for Representation Learning: A Unified Theoretical PerspectiveCode0
Weakly Supervised Construction of ASR Systems with Massive Video Data—0
SeCo: Exploring Sequence Supervision for Unsupervised Representation LearningCode1
PointContrast: Unsupervised Pre-training for 3D Point Cloud UnderstandingCode1
Unsupervised Deep Representation Learning and Few-Shot Classification of PolSAR Images—0
What Makes for Good Views for Contrastive Learning?Code0
A Further Study of Unsupervised Pre-training for Transformer Based Speech RecognitionCode1
Measles Rash Identification Using Residual Deep Convolutional Neural Network—0
Rolling-Unrolling LSTMs for Action Anticipation from First-Person VideoCode1
TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction TaskCode1
Lottery Hypothesis based Unsupervised Pre-training for Model Compression in Federated Learning—0
Pre-training Text Representations as Meta Learning—0
Show:102550
← PrevPage 4 of 6Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified