SOTAVerified

GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformer

2023-07-25Code Available0· sign in to hype

Zheng Qin, Hao Yu, Changjian Wang, Yulan Guo, Yuxing Peng, Slobodan Ilic, Dewen Hu, Kai Xu

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

We study the problem of extracting accurate correspondences for point cloud registration. Recent keypoint-free methods have shown great potential through bypassing the detection of repeatable keypoints which is difficult to do especially in low-overlap scenarios. They seek correspondences over downsampled superpoints, which are then propagated to dense points. Superpoints are matched based on whether their neighboring patches overlap. Such sparse and loose matching requires contextual features capturing the geometric structure of the point clouds. We propose Geometric Transformer, or GeoTransformer for short, to learn geometric feature for robust superpoint matching. It encodes pair-wise distances and triplet-wise angles, making it invariant to rigid transformation and robust in low-overlap cases. The simplistic design attains surprisingly high matching accuracy such that no RANSAC is required in the estimation of alignment transformation, leading to 100 times acceleration. Extensive experiments on rich benchmarks encompassing indoor, outdoor, synthetic, multiway and non-rigid demonstrate the efficacy of GeoTransformer. Notably, our method improves the inlier ratio by 1831 percentage points and the registration recall by over 7 points on the challenging 3DLoMatch benchmark. Our code and models are available at https://github.com/qinzheng93/GeoTransformer.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
ETH (trained on 3DMatch)GeoTransformerRecall (30cm, 5 degrees)4.91Unverified
FP-O-EGeoTransformerRecall (3cm, 10 degrees)63.94Unverified
FP-O-HGeoTransformerRecall (3cm, 10 degrees)2.64Unverified
FP-O-MGeoTransformerRecall (3cm, 10 degrees)22.07Unverified
FP-R-EGeoTransformerRecall (3cm, 10 degrees)64.12Unverified
FP-R-HGeoTransformerRecall (3cm, 10 degrees)47.75Unverified
FP-R-MGeoTransformerRecall (3cm, 10 degrees)55.93Unverified
FP-T-EGeoTransformerRecall (3cm, 10 degrees)66.25Unverified
FP-T-HGeoTransformerRecall (3cm, 10 degrees)64.18Unverified
FP-T-MGeoTransformerRecall (3cm, 10 degrees)64.29Unverified
KITTI (trained on 3DMatch)GeoTransformerSuccess Rate67.93Unverified
RotKITTI Registration BenchmarkGeoTransformerRR@(1.5,0.3)78.5Unverified

Reproductions