SOTAVerified

Iterative Manifold Embedding Layer Learned by Incomplete Data for Large-scale Image Retrieval

2017-07-14Code Available0· sign in to hype

Jian Xu, Chunheng Wang, Chengzuo Qi, Cunzhao Shi, Baihua Xiao

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Existing manifold learning methods are not appropriate for image retrieval task, because most of them are unable to process query image and they have much additional computational cost especially for large scale database. Therefore, we propose the iterative manifold embedding (IME) layer, of which the weights are learned off-line by unsupervised strategy, to explore the intrinsic manifolds by incomplete data. On the large scale database that contains 27000 images, IME layer is more than 120 times faster than other manifold learning methods to embed the original representations at query time. We embed the original descriptors of database images which lie on manifold in a high dimensional space into manifold-based representations iteratively to generate the IME representations in off-line learning stage. According to the original descriptors and the IME representations of database images, we estimate the weights of IME layer by ridge regression. In on-line retrieval stage, we employ the IME layer to map the original representation of query image with ignorable time cost (2 milliseconds). We experiment on five public standard datasets for image retrieval. The proposed IME layer significantly outperforms related dimension reduction methods and manifold learning methods. Without post-processing, Our IME layer achieves a boost in performance of state-of-the-art image retrieval methods with post-processing on most datasets, and needs less computational cost.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
INSTREIME layerMAP82.4Unverified
Oxf105kSIFT+IME layerMAP31.3Unverified
Oxf105kCNN+IME layerMAP87.2Unverified
Oxf5kSIFT+IME layerMAP62.2Unverified
Oxf5kPCA [51]MAP82.6Unverified
Oxf5kIsoMap [32]MAP77.9Unverified
Oxf5kIMEMAP83.5Unverified
Oxf5kLLE [33]MAP51.7Unverified
Oxf5kCNN+IME layerMAP92Unverified
Paris6kIME layermAP96.6Unverified

Reproductions