SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 265 papers

TitleStatusHype
ConStyle v2: A Strong Prompter for All-in-One Image RestorationCode1
Unsupervised Pre-Training For Data-Efficient Text-to-Speech On Low Resource LanguagesCode1
Multilingual Constituency Parsing with Self-Attention and Pre-TrainingCode1
Bag of Tricks and A Strong baseline for Image Copy DetectionCode1
Behavior From the Void: Unsupervised Active Pre-TrainingCode1
D^2LV: A Data-Driven and Local-Verification Approach for Image Copy DetectionCode1
Initialization and Regularization of Factorized Neural LayersCode1
SimIPU: Simple 2D Image and 3D Point Cloud Unsupervised Pre-Training for Spatial-Aware Visual RepresentationsCode1
Exact solutions to the nonlinear dynamics of learning in deep linear neural networksCode1
Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing DataCode1
Patient Contrastive Learning: a Performant, Expressive, and Practical Approach to ECG ModelingCode1
Leveraging Pre-trained Checkpoints for Sequence Generation TasksCode1
BMRetriever: Tuning Large Language Models as Better Biomedical Text RetrieversCode1
MAGNeto: An Efficient Deep Learning Method for the Extractive Tags Summarization ProblemCode1
Image Representations Learned With Unsupervised Pre-Training Contain Human-like BiasesCode1
METRA: Scalable Unsupervised RL with Metric-Aware AbstractionCode1
DOBF: A Deobfuscation Pre-Training Objective for Programming LanguagesCode1
DocILE Benchmark for Document Information Localization and ExtractionCode1
Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful LearnerCode1
MultiTalent: A Multi-Dataset Approach to Medical Image SegmentationCode1
PEAC: Unsupervised Pre-training for Cross-Embodiment Reinforcement LearningCode1
Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage RetrievalCode1
PTGB: Pre-Train Graph Neural Networks for Brain Network AnalysisCode1
Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech RecognitionCode1
Unsupervised Semantic Segmentation by Contrasting Object Mask ProposalsCode1
ELECTRIcity: An Efficient Transformer for Non-Intrusive Load MonitoringCode1
CATE: Computation-aware Neural Architecture Encoding with TransformersCode1
FreePoint: Unsupervised Point Cloud Instance SegmentationCode1
Deep Features for CBIR with Scarce Data using Hebbian Learning—0
BID: Boundary-Interior Decoding for Unsupervised Temporal Action Localization Pre-Trainin—0
Deep Discriminative Model for Video Classification—0
Deep Belief Networks Based Feature Generation and Regression for Predicting Wind Power—0
Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised Pre-training and Its Application to Children's ASR—0
An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS—0
Incomplete Multi-View Multi-label Learning via Disentangled Representation and Label Semantic Embedding—0
4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding—0
Incorporating Unlabelled Data into Bayesian Neural Networks—0
Is MixIT Really Unsuitable for Correlated Sources? Exploring MixIT for Unsupervised Pre-training in Music Source Separation—0
CUPre: Cross-domain Unsupervised Pre-training for Few-Shot Cell Segmentation—0
Cross-Domain Training for Goal-Oriented Conversational Agents—0
Beyond Fine-Tuning: Transferring Behavior in Reinforcement Learning—0
Automatic Sexism Detection with Multilingual Transformer Models—0
A Brief Summary of Interactions Between Meta-Learning and Self-Supervised Learning—0
Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring—0
Convergence of gradient based pre-training in Denoising autoencoders—0
Automated clinical coding using off-the-shelf large language models—0
Foundation Model for Wireless Technology Recognition Using IQ Timeseries—0
On Architectures and Training for Raw Waveform Feature Extraction in ASR—0
Faster learning of deep stacked autoencoders on multi-core systems using synchronized layer-wise pre-training—0
Author2Vec: A Framework for Generating User Embedding—0
Show:102550
← PrevPage 2 of 6Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified