SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 265 papers

TitleStatusHype
From Recognition to Prediction: Leveraging Sequence Reasoning for Action AnticipationCode0
Large Language Model Enabled Semantic Communication Systems—0
Learning Unsupervised Gaze Representation via Eye Mask Driven Information Bottleneck—0
ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts—0
An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS—0
Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance SegmentationCode0
Self-Supervised Modality-Agnostic Pre-Training of Swin TransformersCode0
Decoupling Exploration and Exploitation for Unsupervised Pre-training with Successor FeaturesCode0
DPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction—0
VietMed: A Dataset and Benchmark for Automatic Speech Recognition of Vietnamese in the Medical DomainCode0
Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition—0
BID: Boundary-Interior Decoding for Unsupervised Temporal Action Localization Pre-Trainin—0
On the Generalization Ability of Unsupervised Pretraining—0
Attention-Guided Masked Autoencoders For Learning Image Representations—0
CLCE: An Approach to Refining Cross-Entropy and Contrastive Learning for Optimized Learning Fusion—0
CochCeps-Augment: A Novel Self-Supervised Contrastive Learning Using Cochlear Cepstrum-based Masking for Speech Emotion RecognitionCode0
MLIP: Enhancing Medical Visual Representation with Divergence Encoder and Knowledge-guided Contrastive Learning—0
Unsupervised Pre-Training for 3D Leaf Instance Segmentation—0
FairSISA: Ensemble Post-Processing to Improve Fairness of Unlearning in LLMs—0
Unsupervised Pre-Training Using Masked Autoencoders for ECG Analysis—0
Semi-Supervised End-To-End Contrastive Learning For Time Series Classification—0
Automated clinical coding using off-the-shelf large language models—0
CUPre: Cross-domain Unsupervised Pre-training for Few-Shot Cell Segmentation—0
Classifying Whole Slide Images: What Matters?—0
Pre-Training and Fine-Tuning Generative Flow Networks—0
Differentially Private Optimization for Non-Decomposable Objective Functions—0
A Brief History of Prompt: Leveraging Language Models. (Through Advanced Prompting)—0
Unsupervised Pre-Training for Vietnamese Automatic Speech Recognition in the HYKIST Project—0
Examining the Effect of Pre-training on Time Series Classification—0
Self-Supervised Pre-Training Boosts Semantic Scene Segmentation on LiDAR DataCode0
Enhancing the vocal range of single-speaker singing voice synthesis with melody-unsupervised pre-training—0
Masked Feature Modelling: Feature Masking for the Unsupervised Pre-training of a Graph Attention Network Block for Bottom-up Video Event Recognition—0
Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learning—0
Towards General Text Embeddings with Multi-stage Contrastive Learning—0
Disentangling Node Attributes from Graph Topology for Improved Generalizability in Link Prediction—0
ECGBERT: Understanding Hidden Language of ECGs with Self-Supervised Representation Learning—0
Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human FeedbackCode0
LATTE: Label-efficient Incident Phenotyping from Longitudinal Electronic Health RecordsCode0
PUNR: Pre-training with User Behavior Modeling for News RecommendationCode0
Incorporating Unlabelled Data into Bayesian Neural Networks—0
Generalized 3D Self-supervised Learning Framework via Prompted Foreground-Aware Feature ContrastCode0
Research on CPI Prediction Based on Natural Language Processing—0
Device Tuning for Multi-Task Large Model—0
A Benchmark of Nested Named Entity Recognition Approaches in Historical Structured Documents—0
Boosting Low-Data Instance Segmentation by Unsupervised Pre-training with Saliency Prompt—0
Self-FuseNet: Data Free Unsupervised Remote Sensing Image Super-Resolution—0
Unsupervised Pre-Training for Vietnamese Automatic Speech Recognition in the HYKIST Project—0
Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document UnderstandingCode0
ACROBAT -- a multi-stain breast cancer histological whole-slide-image data set from routine diagnostics for computational pathology—0
EUCLID: Towards Efficient Unsupervised Reinforcement Learning with Multi-choice Dynamics Model—0
Show:102550
← PrevPage 3 of 6Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified