SOTAVerified

PixelLink: Detecting Scene Text via Instance Segmentation

2018-01-04Code Available0· sign in to hype

Dan Deng, Haifeng Liu, Xuelong. Li, Deng Cai

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Most state-of-the-art scene text detection algorithms are deep learning based methods that depend on bounding box regression and perform at least two kinds of predictions: text/non-text classification and location regression. Regression plays a key role in the acquisition of bounding boxes in these methods, but it is not indispensable because text/non-text prediction can also be considered as a kind of semantic segmentation that contains full location information in itself. However, text instances in scene images often lie very close to each other, making them very difficult to separate via semantic segmentation. Therefore, instance segmentation is needed to address this problem. In this paper, PixelLink, a novel scene text detection algorithm based on instance segmentation, is proposed. Text instances are first segmented out by linking pixels within the same instance together. Text bounding boxes are then extracted directly from the segmentation result without location regression. Experiments show that, compared with regression-based methods, PixelLink can achieve better or comparable performance on several benchmarks, while requiring many fewer training iterations and less training data.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
ICDAR 2013PixelLink+VGG16 2s MSF-Measure88.1Unverified
ICDAR 2015SLPRF-Measure84.5Unverified
MSRA-TD500PixelLink + VGG16 2sF-Measure77.8Unverified

Reproductions