SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–25 of 265 papers

TitleStatusHype
Dynamic data sampler for cross-language transfer learning in large language modelsCode7
Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation ModelsCode5
DepthSplat: Connecting Gaussian Splatting and DepthCode5
Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCICode4
A Survey on Data Selection for Language ModelsCode3
SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite ImageryCode2
CrystalFormer-RL: Reinforcement Fine-Tuning for Materials DesignCode2
Foundation Policies with Hilbert RepresentationsCode2
FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation LearningCode2
Large-Scale Pre-training for Person Re-identification with Noisy LabelsCode2
Exploring the Limits of Out-of-Distribution DetectionCode1
End-to-End Training of Neural Retrievers for Open-Domain Question AnsweringCode1
Behavior From the Void: Unsupervised Active Pre-TrainingCode1
Exact solutions to the nonlinear dynamics of learning in deep linear neural networksCode1
ELECTRIcity: An Efficient Transformer for Non-Intrusive Load MonitoringCode1
ES-Net: An Efficient Stereo Matching NetworkCode1
FedAUX: Leveraging Unlabeled Auxiliary Data in Federated LearningCode1
Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful LearnerCode1
A Transformer-based Framework for Multivariate Time Series Representation LearningCode1
DOBF: A Deobfuscation Pre-Training Objective for Programming LanguagesCode1
A Further Study of Unsupervised Pre-training for Transformer Based Speech RecognitionCode1
DocILE Benchmark for Document Information Localization and ExtractionCode1
AI-Bind: Improving Binding Predictions for Novel Protein Targets and LigandsCode1
Bag of Tricks and A Strong baseline for Image Copy DetectionCode1
Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage RetrievalCode1
Show:102550
← PrevPage 1 of 11Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified