SOTAVerified

PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Clouds

2021-10-04ICCV 2021Code Available1· sign in to hype

Anh-Quan Cao, Gilles Puy, Alexandre Boulch, Renaud Marlet

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Rigid registration of point clouds with partial overlaps is a longstanding problem usually solved in two steps: (a) finding correspondences between the point clouds; (b) filtering these correspondences to keep only the most reliable ones to estimate the transformation. Recently, several deep nets have been proposed to solve these steps jointly. We built upon these works and propose PCAM: a neural network whose key element is a pointwise product of cross-attention matrices that permits to mix both low-level geometric and high-level contextual information to find point correspondences. These cross-attention matrices also permits the exchange of context information between the point clouds, at each layer, allowing the network construct better matching features within the overlapping regions. The experiments show that PCAM achieves state-of-the-art results among methods which, like us, solve steps (a) and (b) jointly via deepnets. Our code and trained models are available at https://github.com/valeoai/PCAM.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
3DLoMatch (10-30% overlap)PCAM (reported in REGTR)Recall ( correspondence RMSE below 0.2)54.9Unverified
3DMatch (at least 30% overlapped - FCGF setting)PCAM-Sparse (All post-processing)Recall (0.3m, 15 degrees)92.4Unverified
3DMatch (at least 30% overlapped - FCGF setting)PCAM-Soft (All post-processing)Recall (0.3m, 15 degrees)91.3Unverified
3DMatch (at least 30% overlapped - sample 5k interest points)PCAM (reported in REGTR)Recall ( correspondence RMSE below 0.2)85.5Unverified
KITTI (FCGF setting)PCAM-Sparse + ICPRecall (0.6m, 5 degrees)97.4Unverified
KITTI (FCGF setting)PCAM - SoftRecall (0.6m, 5 degrees)97.2Unverified
KITTI (FCGF setting)PCAM-SparseRecall (0.6m, 5 degrees)96.5Unverified
KITTI (FCGF setting)PCAM-soft + ICPRecall (0.6m, 5 degrees)98Unverified

Reproductions