Deep Graph Matching via Blackbox Differentiation of Combinatorial Solvers
Michal Rolínek, Paul Swoboda, Dominik Zietlow, Anselm Paulus, Vít Musil, Georg Martius
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/martius-lab/blackbox-deep-graph-matchingOfficialIn paperpytorch★ 90
- github.com/Thinklab-SJTU/ThinkMatchpytorch★ 877
- github.com/martius-lab/blackbox-backproppytorch★ 351
- github.com/LPMP/LPMPpytorch★ 67
- github.com/q3erf/topo_bbgmpytorch★ 0
Abstract
Building on recent progress at the intersection of combinatorial optimization and deep learning, we propose an end-to-end trainable architecture for deep graph matching that contains unmodified combinatorial solvers. Using the presence of heavily optimized combinatorial solvers together with some improvements in architecture design, we advance state-of-the-art on deep graph matching benchmarks for keypoint correspondence. In addition, we highlight the conceptual advantages of incorporating solvers into deep learning architectures, such as the possibility of post-processing with a strong multi-graph matching solver or the indifference to changes in the training setting. Finally, we propose two new challenging experimental setups. The code is available at https://github.com/martius-lab/blackbox-deep-graph-matching
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| PASCAL VOC | BBGM-Multi | F1 score | 0.63 | — | Unverified |
| PASCAL VOC | BBGM | F1 score | 0.61 | — | Unverified |
| SPair-71k | BBGM | matching accuracy | 0.82 | — | Unverified |
| Willow Object Class | BBGM | matching accuracy | 0.97 | — | Unverified |