SOTAVerified

RepPoints: Point Set Representation for Object Detection

2019-04-25ICCV 2019Code Available1· sign in to hype

Ze Yang, Shaohui Liu, Han Hu, Li-Wei Wang, Stephen Lin

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Modern object detectors rely heavily on rectangular bounding boxes, such as anchors, proposals and the final predictions, to represent objects at various recognition stages. The bounding box is convenient to use but provides only a coarse localization of objects and leads to a correspondingly coarse extraction of object features. In this paper, we present RepPoints (representative points), a new finer representation of objects as a set of sample points useful for both localization and recognition. Given ground truth localization and recognition targets for training, RepPoints learn to automatically arrange themselves in a manner that bounds the spatial extent of an object and indicates semantically significant local areas. They furthermore do not require the use of anchors to sample a space of bounding boxes. We show that an anchor-free object detector based on RepPoints can be as effective as the state-of-the-art anchor-based detection methods, with 46.5 AP and 67.4 AP_50 on the COCO test-dev detection benchmark, using ResNet-101 model. Code is available at https://github.com/microsoft/RepPoints.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
COCO minivalRPDet (ResNet-50)box AP38.6Unverified
COCO minivalRPDet (ResNeXt-101-DCN)box AP44.5Unverified
COCO minivalRPDet (ResNet-50, multi-scale train)box AP40.8Unverified
COCO minivalRPDet (ResNet-101)box AP40.3Unverified
COCO minivalRPDet (ResNeXt-101-DCN, multi-scale)box AP46.8Unverified
COCO minivalRPDet (ResNet-101-DCN, multi-scale)box AP46.4Unverified
COCO minivalRPDet (ResNet-101-DCN, multi-scale train)box AP44.8Unverified
COCO test-devRPDet (ResNet-101-DCN)box mAP42.8Unverified
COCO test-devRPDet (ResNet-101)box mAP41Unverified
COCO test-devRPDet (ResNet-101-DCN, multi-scale)box mAP46.5Unverified

Reproductions