3D Semantic Segmentation

3D Semantic Segmentation is a computer vision task that involves dividing a 3D point cloud or 3D mesh into semantically meaningful parts or regions. The goal of 3D semantic segmentation is to identify and label different objects and parts within a 3D scene, which can be used for applications such as robotics, autonomous driving, and augmented reality.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 51–75 of 348 papers

Title	Date	Tasks	Status	Hype
ECLAIR: A High-Fidelity Aerial LiDAR Dataset for Semantic Segmentation	Apr 16, 2024	3D Semantic SegmentationManagement	CodeCode Available	1
OpenTrench3D: A Photogrammetric 3D Point Cloud Dataset for Semantic Segmentation of Underground Utilities	Apr 11, 2024	3D Semantic SegmentationSegmentation	CodeCode Available	1
Visual Foundation Models Boost Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentation	Mar 15, 2024	3D Semantic SegmentationAutonomous Driving	CodeCode Available	1
SeSame: Simple, Easy 3D Object Detection with Point-Wise Semantics	Mar 11, 2024	2D Object Detection3D Object Detection	CodeCode Available	1
MM-Point: Multi-View Information-Enhanced Multi-Modal Self-Supervised 3D Point Cloud Understanding	Feb 15, 2024	3D Part Segmentation3D Semantic Segmentation	CodeCode Available	1
PointCT: Point Central Transformer Network for Weakly-supervised Point Cloud Semantic Segmentation	Dec 24, 2023	3D Semantic SegmentationPoint Cloud Segmentation	CodeCode Available	1
WildScenes: A Benchmark for 2D and 3D Semantic Segmentation in Large-scale Natural Environments	Dec 23, 2023	3D Semantic SegmentationDomain Adaptation	CodeCode Available	1
GNeSF: Generalizable Neural Semantic Fields	Oct 24, 2023	3D Semantic SegmentationScene Segmentation	CodeCode Available	1
PanopticNDT: Efficient and Robust Panoptic Mapping	Sep 24, 2023	2D Panoptic Segmentation3D Panoptic Segmentation	CodeCode Available	1
Towards Robust Robot 3D Perception in Urban Environments: The UT Campus Object Dataset	Sep 24, 2023	3D Object Detection3D Semantic Segmentation	CodeCode Available	1
MoPA: Multi-Modal Prior Aided Domain Adaptation for 3D Semantic Segmentation	Sep 21, 2023	3D Semantic SegmentationDomain Adaptation	CodeCode Available	1
Fully Automated Scan-to-BIM Via Point Cloud Instance Segmentation	Sep 11, 2023	3D Instance Segmentation3D Semantic Segmentation	CodeCode Available	1
Less is More: Towards Efficient Few-shot 3D Semantic Segmentation via Training-free Networks	Aug 24, 2023	3D Semantic SegmentationFew-shot 3D semantic segmentation	CodeCode Available	1
MarS3D: A Plug-and-Play Motion-Aware Model for Semantic Segmentation on Multi-Scan 3D Point Clouds	Jul 18, 2023	3D Semantic SegmentationRepresentation Learning	CodeCode Available	1
HRHD-HK: A benchmark dataset of high-rise and high-density urban scenes for 3D semantic segmentation of photogrammetric point clouds	Jul 16, 2023	3D Semantic SegmentationSegmentation	CodeCode Available	1
Point-GCC: Universal Self-supervised 3D Scene Pre-training via Geometry-Color Contrast	May 31, 2023	3D Instance Segmentation3D Object Detection	CodeCode Available	1
GrowSP: Unsupervised Semantic Segmentation of 3D Point Clouds	May 25, 2023	3D Semantic SegmentationSegmentation	CodeCode Available	1
You Never Get a Second Chance To Make a Good First Impression: Seeding Active Learning for 3D Semantic Segmentation	Apr 23, 2023	3D Semantic SegmentationActive Learning	CodeCode Available	1
Exploiting the Complementarity of 2D and 3D Networks to Address Domain-Shift in 3D Semantic Segmentation	Apr 6, 2023	3D Semantic SegmentationAutonomous Driving	CodeCode Available	1
3D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Clouds	Apr 3, 2023	3D Semantic SegmentationAutonomous Driving	CodeCode Available	1
LinK: Linear Kernel for LiDAR-based 3D Perception	Mar 28, 2023	3D Object Detection3D Semantic Segmentation	CodeCode Available	1
Learning Context-aware Classifier for Semantic Segmentation	Mar 21, 2023	3D Semantic SegmentationDecoder	CodeCode Available	1
Less is More: Reducing Task and Model Complexity for 3D Point Cloud Semantic Segmentation	Mar 20, 2023	3D Semantic SegmentationAutonomous Driving	CodeCode Available	1
MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Driving	Mar 15, 2023	3D Semantic SegmentationAutonomous Driving	CodeCode Available	1
Human Vision Based 3D Point Cloud Semantic Segmentation of Large-Scale Outdoor Scene	Jan 30, 2023	3D Semantic SegmentationPhilosophy	CodeCode Available	1

Show:10 25 50

← PrevPage 3 of 14Next →

All datasets SemanticKITTI ScanNet200 DALES KITTI-360 ScanNet SensatUrban Toronto-3D PartNet S3DIS ScribbleKITTI STPLS3D RELLIS-3D Dataset

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	LSK3DNet	test mIoU	75.6	—	Unverified
2	PPT+PTv3	test mIoU	75.5	—	Unverified
3	UniSeg	test mIoU	75.2	—	Unverified
4	SphereFormer	test mIoU	74.8	—	Unverified
5	DITR	test mIoU	74.4	—	Unverified
6	FRNet	test mIoU	73.3	—	Unverified
7	RangeFormer	test mIoU	73.3	—	Unverified
8	2DPASS	test mIoU	72.9	—	Unverified
9	PTv2	test mIoU	72.6	—	Unverified
10	PPT+SparseUNet	val mIoU	71.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DITR	val mIoU	41.2	—	Unverified
2	ODIN	val mIoU	40.5	—	Unverified
3	PTv3 ArKitLabelmaker	val mIoU	40.3	—	Unverified
4	BFANet	val mIoU	37.3	—	Unverified
5	Sonata + PTv3	val mIoU	36.8	—	Unverified
6	Pamba	val mIoU	36.3	—	Unverified
7	PTv3 + PPT	val mIoU	36	—	Unverified
8	OA-CNNs	val mIoU	33.3	—	Unverified
9	LSK3DNet	val mIoU	33.1	—	Unverified
10	OctFormer	val mIoU	32.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KPConv	mIoU	81.1	—	Unverified
2	Superpoint Transformer	mIoU	79.6	—	Unverified
3	EyeNet	mIoU	79.6	—	Unverified
4	SuperCluster	mIoU	77.3	—	Unverified
5	PointNet++	mIoU	68.3	—	Unverified
6	ConvPoint	mIoU	67.4	—	Unverified
7	SPG	mIoU	60.6	—	Unverified
8	PointCNN	mIoU	58.4	—	Unverified
9	ShellNet	mIoU	57.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DA-supervised	miou Val	64.1	—	Unverified
2	CLOUDSPAM	miou Val	63.6	—	Unverified
3	Superpoint Transformer	miou Val	63.5	—	Unverified
4	SuperCluster	miou Val	62.1	—	Unverified
5	DeepViewAgg	miou	58.3	—	Unverified
6	MinkowskiNet	miou	53.92	—	Unverified
7	PointNet++	miou	35.66	—	Unverified
8	PointNet	miou	13.07	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DITR	Top-1 IoU	0.53	—	Unverified
2	Sonata	Top-1 IoU	0.5	—	Unverified
3	PTv3	Top-1 IoU	0.49	—	Unverified
4	CAC	Top-1 IoU	0.48	—	Unverified
5	OA-CNN	Top-1 IoU	0.47	—	Unverified
6	OctFormer	Top-1 IoU	0.46	—	Unverified
7	SpUNet (MinkowskiNet)	Top-1 IoU	0.46	—	Unverified
8	PTv2	Top-1 IoU	0.45	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LCPFormer	mIoU	63.4	—	Unverified
2	EyeNet	mIoU	62.3	—	Unverified
3	BEV-Seg3D-Net	mIoU	61.7	—	Unverified
4	KPConv	mIoU	57.58	—	Unverified
5	SCF-Net	mIoU	55.1	—	Unverified
6	SparseConv	mIoU	42.66	—	Unverified
7	SPGraph	mIoU	37.29	—	Unverified
8	TangentConv	mIoU	33.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SCF-Net	OA	95.5	—	Unverified
2	RandLANet	OA	93.5	—	Unverified
3	KPFCNN	OA	91.71	—	Unverified
4	TGNet	OA	91.64	—	Unverified
5	MS-PCNN	OA	91.53	—	Unverified
6	PointNet++	OA	91.21	—	Unverified
7	DGCNN	OA	89	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CSN	mIOU	62.1	—	Unverified
2	MID-Net	mIOU	60.8	—	Unverified
3	FG-Net	mIOU	58.2	—	Unverified
4	closerlook3D	mIOU	53.8	—	Unverified
5	DeepGCN	mIOU	45.1	—	Unverified
6	PartNet	mIOU	43.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Superpoint Transformer	mIoU (6-Fold)	76	—	Unverified
2	OneFormer3D	mIoU (Area-5)	72.4	—	Unverified
3	PointTransformerV2	mIoU (Area-5)	71.6	—	Unverified
4	PointNext	mIoU (Area-5)	70.5	—	Unverified
5	PointTransformer	mIoU (Area-5)	70.4	—	Unverified
6	PVCNN++	mIoU (6-Fold)	58.98	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IGNet	mIoU	62	—	Unverified
2	SSLSS with Cylinder3D	mIoU	61.3	—	Unverified
3	Cylinder3D	mIoU	57	—	Unverified
4	LiM3D	mIoU-1%	57	—	Unverified
5	LiM3D+SDSC	mIoU-1%	55.8	—	Unverified
6	MinkowskiNet	mIoU	55	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KpConv	mIOU	53.73	—	Unverified
2	PointCT	mIOU	53.2	—	Unverified
3	MinkowskiNet	mIOU	51.3	—	Unverified
4	SCF-Net	mIOU	50.65	—	Unverified
5	Point transformer	mIOU	47.64	—	Unverified
6	PointNet++	mIOU	15.92	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Cylinder3D	Mean IoU (class)	46.07	—	Unverified
2	salsanext	Mean IoU (class)	43.07	—	Unverified
3	Sphereformer	Mean IoU (class)	42.19	—	Unverified
4	kpconv	Mean IoU (class)	19.97	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Cylinder3D	mIoU	40.07	—	Unverified
2	SPVCNN	mIoU	36.78	—	Unverified
3	MinkUNet	mIoU	36.53	—	Unverified
4	SphereFormer	mIoU	33.97	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PTv2	mIoU	82.6	—	Unverified
2	FRNet	mIoU	82.5	—	Unverified
3	AF2S3Net	mIoU	78.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PointVector-XL	mIoU	76.5	—	Unverified
2	PointMetaBase-XXL	mIoU	75.8	—	Unverified
3	PointNeXt-XL	mIoU	70.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PanopticNDT (10cm)	mIoU	45.43	—	Unverified
2	SemanticNDT (10cm)	mIoU	44.31	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DITR	mIoU	73.3	—	Unverified
2	vFusedSeg3D	mIoU	72.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	2D–3D + 3 × 3 × 3	Mean IoU (test)	0.45	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Res16UNet14C	F1	0.85	—	Unverified