SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 265 papers

TitleStatusHype
Spiral Contrastive Learning: An Efficient 3D Representation Learning Method for Unannotated CT Lesions—0
Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning—0
Multi-Modal Unsupervised Pre-Training for Surgical Operating Room Workflow Analysis—0
Unsupervised Instance Discriminative Learning for Depression Detection from Speech Signals—0
Contextual embedding and model weighting by fusing domain knowledge on Biomedical Question AnsweringCode0
Curriculum-Based Self-Training Makes Better Few-Shot Learners for Data-to-Text GenerationCode0
Deep Features for CBIR with Scarce Data using Hebbian Learning—0
COLA: COarse LAbel pre-training for 3D semantic segmentation of sparse LiDAR datasetsCode0
Boundary-aware Information Maximization for Self-supervised Medical Image Segmentation—0
3D Intracranial Aneurysm Classification and Segmentation via Unsupervised Dual-branch Learning—0
Unleashing Potential of Unsupervised Pre-Training With Intra-Identity Regularization for Person Re-Identification—0
4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding—0
Unleashing the Potential of Unsupervised Pre-Training with Intra-Identity Regularization for Person Re-IdentificationCode0
Improving Abstractive Dialogue Summarization with Hierarchical Pretraining and Topic Segment—0
GiBERT: Enhancing BERT with Linguistic Information using a Lightweight Gated Injection MethodCode0
SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training—0
Unsupervised Pre-training with Structured Knowledge for Improving Natural Language Inference—0
Triplet Contrastive Learning for Brain Tumor Classification—0
Residual Contrastive Learning for Image Reconstruction: Learning Transferable Representations from Noisy Images—0
Improving On-Screen Sound Separation for Open-Domain Videos with Audio-Visual Self-Attention—0
Learning of feature points without additional supervision improves reinforcement learning from imagesCode0
Automatic Sexism Detection with Multilingual Transformer Models—0
Greedy-layer Pruning: Speeding up Transformer Models for Natural Language ProcessingCode0
Audio Transformers—0
A Large-Scale Study on Unsupervised Spatiotemporal Representation LearningCode0
SYNFIX: Automatically Fixing Syntax Errors using Compiler Diagnostics—0
Representation Learning for Weakly Supervised Relation Extraction—0
On Architectures and Training for Raw Waveform Feature Extraction in ASR—0
Maximal Multiverse Learning for Promoting Cross-Task Generalization of Fine-Tuned Language Models—0
Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors—0
A Brief Summary of Interactions Between Meta-Learning and Self-Supervised Learning—0
Beyond Fine-Tuning: Transferring Behavior in Reinforcement Learning—0
Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised Pre-training and Its Application to Children's ASR—0
AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21—0
R-LAtte: Attention Module for Visual Control via Reinforcement Learning—0
Unsupervised Active Pre-Training for Reinforcement Learning—0
Machine Translation Pre-training for Data-to-Text Generation - A Case Study in Czech—0
Bi-tuning of Pre-trained Representations—0
Semi-supervised Facial Action Unit Intensity Estimation with Contrastive Learning—0
Accelerating Training of Transformer-Based Language Models with Progressive Layer DroppingCode0
Pre-training Graph Transformer with Multimodal Side Information for Recommendation—0
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method—0
Self-training and Pre-training are Complementary for Speech RecognitionCode0
Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring—0
Unsupervised Pre-training for Biomedical Question Answering—0
ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model—0
m2caiSeg: Semantic Segmentation of Laparoscopic Images using Convolutional Neural NetworksCode0
Unsupervised Learning For Sequence-to-sequence Text-to-speech For Low-resource Languages—0
Functional Regularization for Representation Learning: A Unified Theoretical PerspectiveCode0
Weakly Supervised Construction of ASR Systems with Massive Video Data—0
Show:102550
← PrevPage 4 of 6Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified