SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Showing 2650 of 265 papers

TitleStatusHype
GFlowNet Pretraining with Inexpensive Rewards0
TraIL-Det: Transformation-Invariant Local Feature Networks for 3D LiDAR Object Detection with Unsupervised Pre-Training0
PersonViT: Large-scale Self-supervised Vision Transformer for Person Re-IdentificationCode1
From Recognition to Prediction: Leveraging Sequence Reasoning for Action AnticipationCode0
Large Language Model Enabled Semantic Communication Systems0
Learning Unsupervised Gaze Representation via Eye Mask Driven Information Bottleneck0
ConStyle v2: A Strong Prompter for All-in-One Image RestorationCode1
ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts0
An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS0
Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCICode4
PEAC: Unsupervised Pre-training for Cross-Embodiment Reinforcement LearningCode1
Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance SegmentationCode0
Self-Supervised Modality-Agnostic Pre-Training of Swin TransformersCode0
Dynamic data sampler for cross-language transfer learning in large language modelsCode7
Decoupling Exploration and Exploitation for Unsupervised Pre-training with Successor FeaturesCode0
BMRetriever: Tuning Large Language Models as Better Biomedical Text RetrieversCode1
DPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction0
VietMed: A Dataset and Benchmark for Automatic Speech Recognition of Vietnamese in the Medical DomainCode0
Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition0
BID: Boundary-Interior Decoding for Unsupervised Temporal Action Localization Pre-Trainin0
On the Generalization Ability of Unsupervised Pretraining0
A Survey on Data Selection for Language ModelsCode3
Foundation Policies with Hilbert RepresentationsCode2
Attention-Guided Masked Autoencoders For Learning Image Representations0
CLCE: An Approach to Refining Cross-Entropy and Contrastive Learning for Optimized Learning Fusion0
Show:102550
← PrevPage 2 of 11Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95Unverified
29RDLsAccuracy (%)94Unverified
33 RMDLAccuracy (%)93Unverified
4CNNAccuracy (%)73Unverified
5RMDLAccuracy (%)0.1Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69Unverified
2Sensitivity89.1Unverified
3RMDL 3 RDLsSensitivity0.87Unverified