SOTAVerified

Revisiting Image Pyramid Structure for High Resolution Salient Object Detection

2022-09-20Code Available3· sign in to hype

Taehun Kim, Kunhee Kim, Joonyeong Lee, Dongmin Cha, Jiho Lee, Daijin Kim

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Salient object detection (SOD) has been in the spotlight recently, yet has been studied less for high-resolution (HR) images. Unfortunately, HR images and their pixel-level annotations are certainly more labor-intensive and time-consuming compared to low-resolution (LR) images and annotations. Therefore, we propose an image pyramid-based SOD framework, Inverse Saliency Pyramid Reconstruction Network (InSPyReNet), for HR prediction without any of HR datasets. We design InSPyReNet to produce a strict image pyramid structure of saliency map, which enables to ensemble multiple results with pyramid-based image blending. For HR prediction, we design a pyramid blending method which synthesizes two different image pyramids from a pair of LR and HR scale from the same image to overcome effective receptive field (ERF) discrepancy. Our extensive evaluations on public LR and HR SOD benchmarks demonstrate that InSPyReNet surpasses the State-of-the-Art (SotA) methods on various SOD metrics and boundary accuracy.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
DAVIS-SInSPyReNet (DUTS, HRSOD)S-measure0.97Unverified
DAVIS-SInSPyReNetS-measure0.96Unverified
DUT-OMRONInSPyReNetS-Measure0.88Unverified
DUTS-TEInSPyReNetS-Measure0.93Unverified
ECSSDInSPyReNetS-Measure0.94Unverified
HKU-ISInSPyReNetS-Measure0.94Unverified
HRSODInSPyReNetS-Measure0.95Unverified
HRSODInSPyReNet (DUTS, HRSOD)S-Measure0.96Unverified
HRSODInSPyReNet (HRSOD, UHRSD)S-Measure0.96Unverified
PASCAL-SInSPyReNetS-Measure0.89Unverified
UHRSDInSPyReNet (HRSOD, UHRSD)S-Measure0.95Unverified
UHRSDInSPyReNetS-Measure0.93Unverified
UHRSDInSPyReNet (DUTS, HRSOD)S-Measure0.94Unverified

Reproductions