Unsupervised Semantic Segmentation

Models that learn to segment each image (i.e. assign a class to every pixel) without seeing the ground truth labels.

( Image credit: SegSort: Segmentation by Discriminative Sorting of Segments )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 76–95 of 95 papers

Title	Date	Tasks	Status	Hype
Disentangled Latent Transformer for Interpretable Monocular Height Estimation	Jan 17, 2022	Semantic SegmentationUnsupervised Semantic Segmentation	—Unverified	0
Attention-based Transformation from Latent Features to Point Clouds	Dec 10, 2021	Point Cloud CompletionPoint Cloud Generation	CodeCode Available	1
TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentation	Dec 2, 2021	SegmentationSelf-Supervised Learning	CodeCode Available	1
Multiple Fusion Adaptation: A Strong Framework for Unsupervised Semantic Segmentation Adaptation	Dec 1, 2021	Domain AdaptationPseudo Label	CodeCode Available	1
ViCE: Improving Dense Representation Learning by Superpixelization and Contrasting Cluster Assignment	Nov 24, 2021	Contrastive LearningDomain Generalization	CodeCode Available	0
InfoSeg: Unsupervised Semantic Image Segmentation with Mutual Information Maximization	Oct 7, 2021	Image SegmentationRepresentation Learning	—Unverified	0
Semantic-Guided Zero-Shot Learning for Low-Light Image/Video Enhancement	Oct 3, 2021	Image EnhancementLow-Light Image Enhancement	CodeCode Available	1
Unsupervised Portrait Shadow Removal via Generative Priors	Aug 7, 2021	Shadow RemovalUnsupervised Semantic Segmentation	CodeCode Available	1
Level generation and style enhancement -- deep learning for game development overview	Jul 15, 2021	Deep LearningSemantic Segmentation	—Unverified	0
Segmentation of VHR EO Images using Unsupervised Learning	Jul 9, 2021	Contrastive LearningDeep Clustering	—Unverified	0
Unsupervised Image Segmentation by Mutual Information Maximization and Adversarial Regularization	Jul 1, 2021	Image SegmentationScene Understanding	—Unverified	0
Large-scale Unsupervised Semantic Segmentation	Jun 6, 2021	DiversityRepresentation Learning	CodeCode Available	1
PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering	Mar 30, 2021	ClusteringInductive Bias	CodeCode Available	1
Unsupervised Semantic Segmentation by Contrasting Object Mask Proposals	Feb 11, 2021	ClusteringObject	CodeCode Available	1
Autoregressive Unsupervised Image Segmentation	Jul 16, 2020	ClusteringImage Segmentation	CodeCode Available	1
Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentation	Mar 8, 2020	Domain AdaptationPrediction	CodeCode Available	1
SegSort: Segmentation by Discriminative Sorting of Segments	Oct 15, 2019	ClusteringMetric Learning	CodeCode Available	0
Mumford-Shah Loss Functional for Image Segmentation with Deep Learning	Apr 5, 2019	Deep LearningImage Segmentation	CodeCode Available	1
Invariant Information Clustering for Unsupervised Image Classification and Segmentation	Jul 17, 2018	ClusteringGeneral Classification	CodeCode Available	1
Deep Clustering for Unsupervised Learning of Visual Features	Jul 15, 2018	ClusteringDeep Clustering	CodeCode Available	1

Show:10 25 50

← PrevPage 4 of 4Next →

All datasets COCO-Stuff-27 Cityscapes test PASCAL VOC 2012 val Potsdam-3 COCO-Stuff-3 ImageNet-S-50 COCO-Stuff-171 COCO-Stuff-81 SUIM COCO-Stuff-15 ACDC (Adverse Conditions Dataset with Correspondences)Cityscapes val

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	SGSeg	Clustering [Accuracy]	55.7	—	Unverified
2	DynaSeg - FSF (ResNet-18 FPN)	Clustering [mIoU]	54.1	—	Unverified
3	SAN	Clustering [Accuracy]	52	—	Unverified
4	DiffCut	Clustering [mIoU]	49.1	—	Unverified
5	PiCIE	Clustering [Accuracy]	48.1	—	Unverified
6	HCL (ViT-S/8)	Linear Classifier [mIoU]	47.4	—	Unverified
7	HCL (ViT-S/16)	Linear Classifier [mIoU]	45.8	—	Unverified
8	CAUSE (DINOv2, ViT-B/14)	Clustering [mIoU]	45.3	—	Unverified
9	Ours (SlotCon)	Clustering [Accuracy]	42.36	—	Unverified
10	CAUSE (ViT-B/8)	Clustering [mIoU]	41.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraPix	Pixel Accuracy	64.89	—	Unverified
2	CUPS	mIoU	26.8	—	Unverified
3	ViCE	mIoU	25.2	—	Unverified
4	EAGLE (DINO, ViT-B/8)	mIoU	22.1	—	Unverified
5	EQUSS	mIoU	22	—	Unverified
6	PriMaPs-EM + STEGO (DINO ViT-B/8)	mIoU	21.6	—	Unverified
7	STEGO	mIoU	21	—	Unverified
8	EAGLE (DINO, ViT-S/8)	mIoU	19.7	—	Unverified
9	PriMaPs-EM (DINO ViT-S/8)	mIoU	19.4	—	Unverified
10	HP	mIoU	18.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAUSE (iBOT, ViT-B/16)	Clustering [mIoU]	53.4	—	Unverified
2	CAUSE (ViT-B/8)	Clustering [mIoU]	53.3	—	Unverified
3	CAUSE (DINOv2, ViT-B/14)	Clustering [mIoU]	53.2	—	Unverified
4	MaskDistill+CRF	Clustering [mIoU]	48.9	—	Unverified
5	Leopart (ViT-B/8)	Clustering [mIoU]	47.2	—	Unverified
6	HCL (ViT-S/8)	Clustering [mIoU]	46.3	—	Unverified
7	MaskDistill	Clustering [mIoU]	45.8	—	Unverified
8	MaskContrast (Saliency)	Clustering [mIoU]	44.2	—	Unverified
9	HCL (ViT-S/16)	Clustering [mIoU]	43.2	—	Unverified
10	Leopart (ViT-S/16)	Clustering [mIoU]	41.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PriMaPs-EM+HP (DINO ViT-B/8)	Accuracy	83.3	—	Unverified
2	EAGLE (DINO, ViT-B/8)	Accuracy	83.3	—	Unverified
3	HP	Accuracy	82.4	—	Unverified
4	EQUSS	Accuracy	82	—	Unverified
5	PriMaPs-EM (DINO ViT-B/8)	Accuracy	80.5	—	Unverified
6	STEGO	Accuracy	77	—	Unverified
7	InfoSeg	Pixel Accuracy	71.6	—	Unverified
8	IIC	Accuracy	45.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SAN	Pixel Accuracy	80.3	—	Unverified
2	SGSeg	Pixel Accuracy	74.6	—	Unverified
3	InfoSeg	Pixel Accuracy	73.8	—	Unverified
4	InMARS	Pixel Accuracy	73.1	—	Unverified
5	AC	Pixel Accuracy	72.9	—	Unverified
6	IIC	Pixel Accuracy	72.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PASS (+Saliency map)	mIoU (test)	42.3	—	Unverified
2	PASS	mIoU (test)	32	—	Unverified
3	MaskContrast (+Saliency map)	mIoU (test)	24.2	—	Unverified
4	PiCIE (Supervised pretrain)	mIoU (test)	17.6	—	Unverified
5	MDC (Supervised pretrain)	mIoU (test)	14.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAUSE-TR (ViT-S/8)	mIoU	15.2	—	Unverified
2	TransFGU (ViT-S/8)	mIoU	11.93	—	Unverified
3	PiCIE (ResNet-50)	mIoU	5.6	—	Unverified
4	IIC (ResNet-50)	mIoU	2.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAUSE-TR (ViT-S/8)	mIoU	21.2	—	Unverified
2	CAUSE-MLP (ViT-S/8)	mIoU	19.1	—	Unverified
3	TransFGU (ViT-S/8)	mIoU	12.7	—	Unverified
4	MaskContrast (ResNet-50)	mIoU	3.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DatUS (ViT-B/8) + OC	Pixel Accuracy	69.98	—	Unverified
2	GraPix + AUT	Pixel Accuracy	65.48	—	Unverified
3	DatUS (ViT-B/8)	Pixel Accuracy	64.67	—	Unverified
4	GraPix	Pixel Accuracy	64.06	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	InfoSeg	Pixel Accuracy	38.8	—	Unverified
2	InMARS	Pixel Accuracy	31	—	Unverified
3	IIC	Pixel Accuracy	27.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Segmenter ViT-S/16	mIoU	16.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Segmenter ViT-S/16	mIoU	21.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DenseSiam	mIoU	16.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	InfoSeg	Pixel Accuracy	69.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Segmenter ViT-S/16	mIoU	14.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PASS	mIoU (test)	11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PASS	mIoU (test)	18.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Segmenter ViT-S/16	mIoU	18.9	—	Unverified