Unsupervised Semantic Segmentation

Models that learn to segment each image (i.e. assign a class to every pixel) without seeing the ground truth labels.

( Image credit: SegSort: Segmentation by Discriminative Sorting of Segments )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1–50 of 95 papers

Title	Date	Tasks	Status	Hype
Scene-Centric Unsupervised Panoptic Segmentation	Apr 2, 2025	Instance SegmentationPanoptic Segmentation	CodeCode Available	2
Urban1960SatSeg: Unsupervised Semantic Segmentation of Mid-20^th century Urban Landscapes with Satellite Imageries	Jun 11, 2025	SegmentationSelf-Supervised Learning	CodeCode Available	2
What the DAAM: Interpreting Stable Diffusion Using Cross Attention	Oct 10, 2022	DenoisingDescriptive	CodeCode Available	2
Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization	May 16, 2022	graph partitioningSegmentation	CodeCode Available	2
Unsupervised Universal Image Segmentation	Dec 28, 2023	Image SegmentationInstance Segmentation	CodeCode Available	2
DiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cut	Jun 5, 2024	Image SegmentationSegmentation	CodeCode Available	2
ReCLIP++: Learn to Rectify the Bias of CLIP for Unsupervised Semantic Segmentation	Aug 13, 2024	SegmentationSemantic Segmentation	CodeCode Available	2
Learn to Rectify the Bias of CLIP for Unsupervised Semantic Segmentation	Jan 1, 2024	SegmentationSemantic Segmentation	CodeCode Available	2
Unsupervised Semantic Segmentation by Distilling Feature Correspondences	Mar 16, 2022	FormSemantic Segmentation	CodeCode Available	2
EAGLE: Eigen Aggregation Learning for Object-Centric Unsupervised Semantic Segmentation	Mar 3, 2024	ObjectRepresentation Learning	CodeCode Available	2
Discovering Object Masks with Transformers for Unsupervised Semantic Segmentation	Jun 13, 2022	ObjectSegmentation	CodeCode Available	1
Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation	Mar 21, 2022	Image SegmentationSegmentation	CodeCode Available	1
Unsupervised Portrait Shadow Removal via Generative Priors	Aug 7, 2021	Shadow RemovalUnsupervised Semantic Segmentation	CodeCode Available	1
Attention-based Transformation from Latent Features to Point Clouds	Dec 10, 2021	Point Cloud CompletionPoint Cloud Generation	CodeCode Available	1
Autoregressive Unsupervised Image Segmentation	Jul 16, 2020	ClusteringImage Segmentation	CodeCode Available	1
Boosting Unsupervised Semantic Segmentation with Principal Mask Proposals	Apr 25, 2024	Representation LearningSegmentation	CodeCode Available	1
Causal Unsupervised Semantic Segmentation	Oct 11, 2023	Causal InferencePrediction	CodeCode Available	1
Component-aware anomaly detection framework for adjustable and logical industrial visual inspection	May 15, 2023	Anomaly ClassificationAnomaly Detection	CodeCode Available	1
CrOC: Cross-View Online Clustering for Dense Visual Representation Learning	Mar 23, 2023	ClusteringOnline Clustering	CodeCode Available	1
Deep Clustering for Unsupervised Learning of Visual Features	Jul 15, 2018	ClusteringDeep Clustering	CodeCode Available	1
Deep ContourFlow: Advancing Active Contours with Deep Learning	Jul 15, 2024	Deep LearningImage Segmentation	CodeCode Available	1
Dense Siamese Network for Dense Unsupervised Learning	Mar 21, 2022	Self-Supervised LearningSemantic Segmentation	CodeCode Available	1
SERE: Exploring Feature Self-relation for Self-supervised Transformer	Jun 10, 2022	RelationSelf-Supervised Learning	CodeCode Available	1
GrowSP: Unsupervised Semantic Segmentation of 3D Point Clouds	May 25, 2023	3D Semantic SegmentationSegmentation	CodeCode Available	1
Invariant Information Clustering for Unsupervised Image Classification and Segmentation	Jul 17, 2018	ClusteringGeneral Classification	CodeCode Available	1
iSeg: An Iterative Refinement-based Framework for Training-free Segmentation	Sep 5, 2024	Image GenerationSegmentation	CodeCode Available	1
Large-scale Unsupervised Semantic Segmentation	Jun 6, 2021	DiversityRepresentation Learning	CodeCode Available	1
Leveraging Hidden Positives for Unsupervised Semantic Segmentation	Mar 27, 2023	Contrastive LearningSemantic Segmentation	CodeCode Available	1
LogoSP: Local-global Grouping of Superpoints for Unsupervised Semantic Segmentation of 3D Point Clouds	Jun 9, 2025	3D Semantic SegmentationSegmentation	CodeCode Available	1
Morphology-inspired Unsupervised Gland Segmentation via Selective Semantic Grouping	Jul 22, 2023	PrognosisSegmentation	CodeCode Available	1
Mumford-Shah Loss Functional for Image Segmentation with Deep Learning	Apr 5, 2019	Deep LearningImage Segmentation	CodeCode Available	1
Multiple Fusion Adaptation: A Strong Framework for Unsupervised Semantic Segmentation Adaptation	Dec 1, 2021	Domain AdaptationPseudo Label	CodeCode Available	1
Optical Flow boosts Unsupervised Localization and Segmentation	Jul 25, 2023	Lifelong learningObject	CodeCode Available	1
Peekaboo: Text to Image Diffusion Models are Zero-Shot Segmentors	Nov 23, 2022	SegmentationSemantic Segmentation	CodeCode Available	1
Perceptual Grouping in Contrastive Vision-Language Models	Oct 18, 2022	Object LocalizationRepresentation Learning	CodeCode Available	1
PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering	Mar 30, 2021	ClusteringInductive Bias	CodeCode Available	1
PointDC: Unsupervised Semantic Segmentation of 3D Point Clouds via Cross-Modal Distillation and Super-Voxel Clustering	Jan 1, 2023	ClusteringSegmentation	CodeCode Available	1
Progressive Proxy Anchor Propagation for Unsupervised Semantic Segmentation	Jul 17, 2024	Contrastive LearningSegmentation	CodeCode Available	1
ReCo: Retrieve and Co-segment for Zero-shot Transfer	Jun 14, 2022	RetrievalSegmentation	CodeCode Available	1
Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentation	Mar 8, 2020	Domain AdaptationPrediction	CodeCode Available	1
Self-Supervised Learning of Object Parts for Semantic Segmentation	Apr 27, 2022	Community DetectionImage Segmentation	CodeCode Available	1
Self-Supervised Visual Representation Learning with Semantic Grouping	May 30, 2022	Contrastive LearningInstance Segmentation	CodeCode Available	1
Semantic-Guided Zero-Shot Learning for Low-Light Image/Video Enhancement	Oct 3, 2021	Image EnhancementLow-Light Image Enhancement	CodeCode Available	1
SmooSeg: Smoothness Prior for Unsupervised Semantic Segmentation	Oct 27, 2023	SegmentationSelf-Supervised Learning	CodeCode Available	1
Unsupervised Semantic Segmentation Through Depth-Guided Feature Correlation and Sampling	Sep 21, 2023	Feature CorrelationSemantic Segmentation	CodeCode Available	1
Time Does Tell: Self-Supervised Time-Tuning of Dense Image Representations	Aug 22, 2023	Self-Supervised LearningSemantic Segmentation	CodeCode Available	1
TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentation	Dec 2, 2021	SegmentationSelf-Supervised Learning	CodeCode Available	1
Uncovering the Inner Workings of STEGO for Safe Unsupervised Semantic Segmentation	Apr 14, 2023	Dimensionality ReductionSemantic Segmentation	CodeCode Available	1
Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformers	Apr 25, 2022	ClusteringSegmentation	CodeCode Available	1
Unsupervised Object Localization: Observing the Background to Discover Objects	Dec 15, 2022	Instance SegmentationObject	CodeCode Available	1

Show:10 25 50

← PrevPage 1 of 2Next →

All datasets COCO-Stuff-27 Cityscapes test PASCAL VOC 2012 val Potsdam-3 COCO-Stuff-3 ImageNet-S-50 COCO-Stuff-171 COCO-Stuff-81 SUIM COCO-Stuff-15 ACDC (Adverse Conditions Dataset with Correspondences)Cityscapes val

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	SGSeg	Clustering [Accuracy]	55.7	—	Unverified
2	DynaSeg - FSF (ResNet-18 FPN)	Clustering [mIoU]	54.1	—	Unverified
3	SAN	Clustering [Accuracy]	52	—	Unverified
4	DiffCut	Clustering [mIoU]	49.1	—	Unverified
5	PiCIE	Clustering [Accuracy]	48.1	—	Unverified
6	HCL (ViT-S/8)	Linear Classifier [mIoU]	47.4	—	Unverified
7	HCL (ViT-S/16)	Linear Classifier [mIoU]	45.8	—	Unverified
8	CAUSE (DINOv2, ViT-B/14)	Clustering [mIoU]	45.3	—	Unverified
9	Ours (SlotCon)	Clustering [Accuracy]	42.36	—	Unverified
10	CAUSE (ViT-B/8)	Clustering [mIoU]	41.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraPix	Pixel Accuracy	64.89	—	Unverified
2	CUPS	mIoU	26.8	—	Unverified
3	ViCE	mIoU	25.2	—	Unverified
4	EAGLE (DINO, ViT-B/8)	mIoU	22.1	—	Unverified
5	EQUSS	mIoU	22	—	Unverified
6	PriMaPs-EM + STEGO (DINO ViT-B/8)	mIoU	21.6	—	Unverified
7	STEGO	mIoU	21	—	Unverified
8	EAGLE (DINO, ViT-S/8)	mIoU	19.7	—	Unverified
9	PriMaPs-EM (DINO ViT-S/8)	mIoU	19.4	—	Unverified
10	HP	mIoU	18.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAUSE (iBOT, ViT-B/16)	Clustering [mIoU]	53.4	—	Unverified
2	CAUSE (ViT-B/8)	Clustering [mIoU]	53.3	—	Unverified
3	CAUSE (DINOv2, ViT-B/14)	Clustering [mIoU]	53.2	—	Unverified
4	MaskDistill+CRF	Clustering [mIoU]	48.9	—	Unverified
5	Leopart (ViT-B/8)	Clustering [mIoU]	47.2	—	Unverified
6	HCL (ViT-S/8)	Clustering [mIoU]	46.3	—	Unverified
7	MaskDistill	Clustering [mIoU]	45.8	—	Unverified
8	MaskContrast (Saliency)	Clustering [mIoU]	44.2	—	Unverified
9	HCL (ViT-S/16)	Clustering [mIoU]	43.2	—	Unverified
10	Leopart (ViT-S/16)	Clustering [mIoU]	41.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PriMaPs-EM+HP (DINO ViT-B/8)	Accuracy	83.3	—	Unverified
2	EAGLE (DINO, ViT-B/8)	Accuracy	83.3	—	Unverified
3	HP	Accuracy	82.4	—	Unverified
4	EQUSS	Accuracy	82	—	Unverified
5	PriMaPs-EM (DINO ViT-B/8)	Accuracy	80.5	—	Unverified
6	STEGO	Accuracy	77	—	Unverified
7	InfoSeg	Pixel Accuracy	71.6	—	Unverified
8	IIC	Accuracy	45.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SAN	Pixel Accuracy	80.3	—	Unverified
2	SGSeg	Pixel Accuracy	74.6	—	Unverified
3	InfoSeg	Pixel Accuracy	73.8	—	Unverified
4	InMARS	Pixel Accuracy	73.1	—	Unverified
5	AC	Pixel Accuracy	72.9	—	Unverified
6	IIC	Pixel Accuracy	72.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PASS (+Saliency map)	mIoU (test)	42.3	—	Unverified
2	PASS	mIoU (test)	32	—	Unverified
3	MaskContrast (+Saliency map)	mIoU (test)	24.2	—	Unverified
4	PiCIE (Supervised pretrain)	mIoU (test)	17.6	—	Unverified
5	MDC (Supervised pretrain)	mIoU (test)	14.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAUSE-TR (ViT-S/8)	mIoU	15.2	—	Unverified
2	TransFGU (ViT-S/8)	mIoU	11.93	—	Unverified
3	PiCIE (ResNet-50)	mIoU	5.6	—	Unverified
4	IIC (ResNet-50)	mIoU	2.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAUSE-TR (ViT-S/8)	mIoU	21.2	—	Unverified
2	CAUSE-MLP (ViT-S/8)	mIoU	19.1	—	Unverified
3	TransFGU (ViT-S/8)	mIoU	12.7	—	Unverified
4	MaskContrast (ResNet-50)	mIoU	3.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DatUS (ViT-B/8) + OC	Pixel Accuracy	69.98	—	Unverified
2	GraPix + AUT	Pixel Accuracy	65.48	—	Unverified
3	DatUS (ViT-B/8)	Pixel Accuracy	64.67	—	Unverified
4	GraPix	Pixel Accuracy	64.06	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	InfoSeg	Pixel Accuracy	38.8	—	Unverified
2	InMARS	Pixel Accuracy	31	—	Unverified
3	IIC	Pixel Accuracy	27.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Segmenter ViT-S/16	mIoU	16.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Segmenter ViT-S/16	mIoU	21.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DenseSiam	mIoU	16.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	InfoSeg	Pixel Accuracy	69.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Segmenter ViT-S/16	mIoU	14.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PASS	mIoU (test)	11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PASS	mIoU (test)	18.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Segmenter ViT-S/16	mIoU	18.9	—	Unverified