Video Object Segmentation

Video object segmentation is a binary labeling problem aiming to separate foreground object(s) from the background region of a video.

For leaderboards please refer to the different subtasks.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 151–175 of 551 papers

Title	Date	Tasks	Status	Hype
Associating Objects with Transformers for Video Object Segmentation	Jun 4, 2021	ObjectOne-shot visual object segmentation	CodeCode Available	1
TransVOS: Video Object Segmentation with Transformers	Jun 1, 2021	ObjectOne-shot visual object segmentation	CodeCode Available	1
Polygonal Point Set Tracking	May 30, 2021	Semantic SegmentationVideo Object Segmentation	CodeCode Available	1
Attention-guided Temporally Coherent Video Object Matting	May 24, 2021	Image MattingObject	CodeCode Available	1
Breaking Shortcut: Exploring Fully Convolutional Cycle-Consistency for Video Correspondence Learning	May 12, 2021	Landmark TrackingPose Tracking	CodeCode Available	1
Emerging Properties in Self-Supervised Vision Transformers	Apr 29, 2021	Copy DetectionImage Classification	CodeCode Available	1
Guided Interactive Video Object Segmentation Using Reliability-Based Attention Maps	Apr 21, 2021	Interactive SegmentationInteractive Video Object Segmentation	CodeCode Available	1
Rethinking Self-supervised Correspondence Learning: A Video Frame-level Similarity Perspective	Mar 31, 2021	Contrastive LearningObject	CodeCode Available	1
Efficient Regional Memory Network for Video Object Segmentation	Mar 24, 2021	ObjectOne-shot visual object segmentation	CodeCode Available	1
Learning to Recommend Frame for Interactive Video Object Segmentation in the Wild	Mar 18, 2021	Deep Reinforcement LearningInteractive Video Object Segmentation	CodeCode Available	1
Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion	Mar 14, 2021	Interactive Video Object SegmentationSemantic Segmentation	CodeCode Available	1
Triple-cooperative Video Shadow Detection	Mar 11, 2021	Saliency DetectionSemantic Segmentation	CodeCode Available	1
SwiftNet: Real-time Video Object Segmentation	Feb 9, 2021	ObjectSegmentation	CodeCode Available	1
Active Boundary Loss for Semantic Segmentation	Feb 4, 2021	SegmentationSemantic Segmentation	CodeCode Available	1
SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation	Jan 21, 2021	Inductive BiasMotion Segmentation	CodeCode Available	1
Learning Motion-Appearance Co-Attention for Zero-Shot Video Object Segmentation	Jan 1, 2021	Semantic SegmentationUnsupervised Video Object Segmentation	CodeCode Available	1
Learning Dynamic Network Using a Reuse Gate Function in Semi-supervised Video Object Segmentation	Dec 21, 2020	One-shot visual object segmentationSegmentation	CodeCode Available	1
Contrastive Transformation for Self-supervised Correspondence Learning	Dec 9, 2020	Object TrackingSelf-Supervised Learning	CodeCode Available	1
Make One-Shot Video Object Segmentation Efficient Again	Dec 3, 2020	Objectobject-detection	CodeCode Available	1
TTVOS: Lightweight Video Object Segmentation with Adaptive Template Attention Module and Temporal Consistency Loss	Nov 9, 2020	ObjectObject Localization	CodeCode Available	1
Delving into the Cyclic Mechanism in Semi-supervised Video Object Segmentation	Oct 23, 2020	ObjectOne-shot visual object segmentation	CodeCode Available	1
Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement	Oct 15, 2020	SegmentationSemantic Segmentation	CodeCode Available	1
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration	Oct 13, 2020	ObjectOne-shot visual object segmentation	CodeCode Available	1
RefVOS: A Closer Look at Referring Expressions for Video Object Segmentation	Oct 1, 2020	Image SegmentationReferring Expression Segmentation	CodeCode Available	1
Learning Spatio-Appearance Memory Network for High-Performance Visual Tracking	Sep 21, 2020	Object TrackingSegmentation	CodeCode Available	1

Show:10 25 50

← PrevPage 7 of 23Next →

All datasets DAVIS 2016 DAVIS 2017 (val)YouTube-VOS 2018 DAVIS-2017 (test-dev)YouTube-VOS 2019 DAVIS 2017 M^3-VOS FBMS YouTube FBMS-59 MOSE SegTrack-v2

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AOC-MF (val)	F-Score	94.7	—	Unverified
2	ISVOS (BL30K, MS)	J&F	93.4	—	Unverified
3	XMem (BL30K, MS)	J&F	93.3	—	Unverified
4	BATMAN (val)	J&F	92.5	—	Unverified
5	STCN (val)	J&F	91.6	—	Unverified
6	XMem	J&F	91.5	—	Unverified
7	MobileVOS (val)	J&F	91.4	—	Unverified
8	AOT (val)	J&F	91.1	—	Unverified
9	LCM (val)	J&F	90.7	—	Unverified
10	RPCMVOS (val)	J&F	90.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	XMem (BLK30K, MS)	Mean Jaccard & F-Measure	89.5	—	Unverified
2	LCM	F-measure	86.5	—	Unverified
3	XMem	Mean Jaccard & F-Measure	86.2	—	Unverified
4	BATMAN	Mean Jaccard & F-Measure	86.2	—	Unverified
5	STCN	Mean Jaccard & F-Measure	85.4	—	Unverified
6	AOT	Mean Jaccard & F-Measure	84.9	—	Unverified
7	STM	F-measure	84.3	—	Unverified
8	TransVOS	Mean Jaccard & F-Measure	83.9	—	Unverified
9	RPCMVOS	Mean Jaccard & F-Measure	83.7	—	Unverified
10	RMN	Mean Jaccard & F-Measure	83.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	XMem (BL30K, MS)	Mean Jaccard & F-Measure	86.9	—	Unverified
2	AOT	Mean Jaccard & F-Measure	84.1	—	Unverified
3	RPCMVOS	Mean Jaccard & F-Measure	84	—	Unverified
4	STCN	Mean Jaccard & F-Measure	83	—	Unverified
5	CFBI+	Mean Jaccard & F-Measure	82.8	—	Unverified
6	RMN	Jaccard (Seen)	82.1	—	Unverified
7	LCM	Mean Jaccard & F-Measure	82	—	Unverified
8	TransVOS	Mean Jaccard & F-Measure	81.8	—	Unverified
9	SST	Mean Jaccard & F-Measure	81.7	—	Unverified
10	LWL	Mean Jaccard & F-Measure	81.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	XMem (BL30K, MS)	Mean Jaccard & F-Measure	83.7	—	Unverified
2	XMem	Mean Jaccard & F-Measure	81	—	Unverified
3	BATMAN	Jaccard	78.4	—	Unverified
4	AOT	Jaccard	75.9	—	Unverified
5	RPCMVOS	Jaccard	75.8	—	Unverified
6	LCM	Jaccard	74.4	—	Unverified
7	KMN	Jaccard	74.1	—	Unverified
8	TransVOS	Jaccard	73	—	Unverified
9	STCN	Jaccard	72.7	—	Unverified
10	RMN	Jaccard	71.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	XMem (BL30K,MS)	Mean Jaccard & F-Measure	86.8	—	Unverified
2	XMem	Mean Jaccard & F-Measure	85.5	—	Unverified
3	BATMAN	Mean Jaccard & F-Measure	85	—	Unverified
4	AOT	Mean Jaccard & F-Measure	84.1	—	Unverified
5	RPCMVOS	Mean Jaccard & F-Measure	83.9	—	Unverified
6	MobileVOS	Mean Jaccard & F-Measure	83.3	—	Unverified
7	STCN	Mean Jaccard & F-Measure	82.7	—	Unverified
8	CFBI+	Mean Jaccard & F-Measure	82.6	—	Unverified
9	SST	Mean Jaccard & F-Measure	81.8	—	Unverified
10	CFBI	Mean Jaccard & F-Measure	81	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AOC-MF (val)	Jaccard (Mean)	81.7	—	Unverified
2	ViTAE-T-Stage	Jaccard (Mean)	79.4	—	Unverified
3	DINO (ViT-B/8, ImageNet retrain)	J&F	71.4	—	Unverified
4	VOSwL (Mask+Language)	mIoU	59	—	Unverified
5	UniTrack	mIoU	58.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ReVOS	Average IOU	75.6	—	Unverified
2	Cutie-base	Average IOU	74.6	—	Unverified
3	XMem	Average IOU	70.4	—	Unverified
4	SAM 2	Average IOU	69.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DFNet	F-Score	82.3	—	Unverified
2	ours	Jaccard (Mean)	76.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Ours	Average	74.9	—	Unverified
2	FEELVOS	mIoU	0.82	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LOCATE	mIoU	68.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Cutie	J&F	68.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LOCATE	mIoU	79.9	—	Unverified