SOTAVerified

One-Shot Video Object Segmentation

2016-11-16CVPR 2017Code Available1· sign in to hype

Sergi Caelles, Kevis-Kokitsi Maninis, Jordi Pont-Tuset, Laura Leal-Taixé, Daniel Cremers, Luc van Gool

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

This paper tackles the task of semi-supervised video object segmentation, i.e., the separation of an object from the background in a video, given the mask of the first frame. We present One-Shot Video Object Segmentation (OSVOS), based on a fully-convolutional neural network architecture that is able to successively transfer generic semantic information, learned on ImageNet, to the task of foreground segmentation, and finally to learning the appearance of a single annotated object of the test sequence (hence one-shot). Although all frames are processed independently, the results are temporally coherent and stable. We perform experiments on two annotated video segmentation databases, which show that OSVOS is fast and improves the state of the art by a significant margin (79.8% vs 68.0%).

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
DAVIS 2016OSVOSJ&F80.2Unverified
DAVIS-2017 (test-dev)OSVOSJ&F50.9Unverified
DAVIS 2017 (val)OSVOSJ&F60.25Unverified
YouTubeOSVOSmIoU0.78Unverified
YouTube-VOS 2018OSVOSOverall58.8Unverified

Reproductions