Deep Graph Matching under Quadratic Constraint
Quankai Gao, Fudong Wang, Nan Xue, Jin-Gang Yu, Gui-Song Xia
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/Zerg-Overmind/QC-DGMOfficialpytorch★ 63
Abstract
Recently, deep learning based methods have demonstrated promising results on the graph matching problem, by relying on the descriptive capability of deep features extracted on graph nodes. However, one main limitation with existing deep graph matching (DGM) methods lies in their ignorance of explicit constraint of graph structures, which may lead the model to be trapped into local minimum in training. In this paper, we propose to explicitly formulate pairwise graph structures as a quadratic constraint incorporated into the DGM framework. The quadratic constraint minimizes the pairwise structural discrepancy between graphs, which can reduce the ambiguities brought by only using the extracted CNN features. Moreover, we present a differentiable implementation to the quadratic constrained-optimization such that it is compatible with the unconstrained deep learning optimizer. To give more precise and proper supervision, a well-designed false matching loss against class imbalance is proposed, which can better penalize the false negatives and false positives with less overfitting. Exhaustive experiments demonstrate that our method competitive performance on real-world datasets.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| PASCAL VOC | qc-DGM2 | matching accuracy | 0.7 | — | Unverified |
| PASCAL VOC | qc-DGM1 | matching accuracy | 0.69 | — | Unverified |
| Willow Object Class | qc-DGM2 | matching accuracy | 0.98 | — | Unverified |
| Willow Object Class | qc-DGM1 | matching accuracy | 0.96 | — | Unverified |