SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 265 papers

TitleStatusHype
Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation ModelsCode5
SPACE: Your Genomic Profile Predictor is a Powerful DNA Foundation ModelCode1
Foundation Model for Wireless Technology Recognition Using IQ Timeseries—0
Is MixIT Really Unsuitable for Correlated Sources? Exploring MixIT for Unsupervised Pre-training in Music Source Separation—0
The Efficiency of Pre-training with Objective Masking in Pseudo Labeling for Semi-Supervised Text Classification—0
Latte: Transfering LLMs` Latent-level Knowledge for Few-shot Tabular Learning—0
Risk Assessment Framework for Code LLMs via Leveraging Internal States—0
ZS-VCOS: Zero-Shot Outperforms Supervised Video Camouflaged Object SegmentationCode0
CrystalFormer-RL: Reinforcement Fine-Tuning for Materials DesignCode2
ZS-VCOS: Zero-Shot Outperforms Supervised Video Camouflaged Object Segmentation with Zero-Shot MethodCode0
How much do LLMs learn from negative examples?Code0
Pretraining Generative Flow Networks with Inexpensive Rewards for Molecular Graph Generation—0
Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models—0
Targeted Forgetting of Image Subgroups in CLIP Models—0
Incomplete Multi-View Multi-label Learning via Disentangled Representation and Label Semantic Embedding—0
HindiLLM: Large Language Model for Hindi—0
FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation LearningCode2
Transferring self-supervised pre-trained models for SHM data anomaly detection with scarce labeled data—0
CLAP: Unsupervised 3D Representation Learning for Fusion 3D Perception via Curvature Sampling and Prototype Learning—0
Point Cloud Unsupervised Pre-training via 3D Gaussian Splatting—0
Take Package as Language: Anomaly Detection Using TransformerCode0
DepthSplat: Connecting Gaussian Splatting and DepthCode5
SynCo: Synthetic Hard Negatives in Contrastive Learning for Better Unsupervised Visual RepresentationsCode0
Calibrating Language Models with Adaptive Temperature ScalingCode0
Range-aware Positional Encoding via High-order Pretraining: Theory and Practice—0
GFlowNet Pretraining with Inexpensive Rewards—0
TraIL-Det: Transformation-Invariant Local Feature Networks for 3D LiDAR Object Detection with Unsupervised Pre-Training—0
PersonViT: Large-scale Self-supervised Vision Transformer for Person Re-IdentificationCode1
From Recognition to Prediction: Leveraging Sequence Reasoning for Action AnticipationCode0
Large Language Model Enabled Semantic Communication Systems—0
Learning Unsupervised Gaze Representation via Eye Mask Driven Information Bottleneck—0
ConStyle v2: A Strong Prompter for All-in-One Image RestorationCode1
ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts—0
An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS—0
Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCICode4
PEAC: Unsupervised Pre-training for Cross-Embodiment Reinforcement LearningCode1
Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance SegmentationCode0
Self-Supervised Modality-Agnostic Pre-Training of Swin TransformersCode0
Dynamic data sampler for cross-language transfer learning in large language modelsCode7
Decoupling Exploration and Exploitation for Unsupervised Pre-training with Successor FeaturesCode0
BMRetriever: Tuning Large Language Models as Better Biomedical Text RetrieversCode1
DPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction—0
VietMed: A Dataset and Benchmark for Automatic Speech Recognition of Vietnamese in the Medical DomainCode0
Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition—0
BID: Boundary-Interior Decoding for Unsupervised Temporal Action Localization Pre-Trainin—0
On the Generalization Ability of Unsupervised Pretraining—0
A Survey on Data Selection for Language ModelsCode3
Foundation Policies with Hilbert RepresentationsCode2
Attention-Guided Masked Autoencoders For Learning Image Representations—0
CLCE: An Approach to Refining Cross-Entropy and Contrastive Learning for Optimized Learning Fusion—0
Show:102550
← PrevPage 1 of 6Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified