TransBoost: Improving the Best ImageNet Performance using Deep Transduction
Omer Belhasin, Guy Bar-Shalom, Ran El-Yaniv
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/omerb01/transboostOfficialIn paperpytorch★ 7
Abstract
This paper deals with deep transductive learning, and proposes TransBoost as a procedure for fine-tuning any deep neural model to improve its performance on any (unlabeled) test set provided at training time. TransBoost is inspired by a large margin principle and is efficient and simple to use. Our method significantly improves the ImageNet classification performance on a wide range of architectures, such as ResNets, MobileNetV3-L, EfficientNetB0, ViT-S, and ConvNext-T, leading to state-of-the-art transductive performance. Additionally we show that TransBoost is effective on a wide variety of image classification datasets. The implementation of TransBoost is provided at: https://github.com/omerb01/TransBoost .
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| CIFAR-10 | TransBoost-ResNet50 | Percentage correct | 97.61 | — | Unverified |
| DTD | TransBoost-ResNet50 | Accuracy | 76.49 | — | Unverified |
| FGVC-Aircraft | TransBoost-ResNet50 | Accuracy | 83.8 | — | Unverified |
| Flowers-102 | TransBoost-ResNet50 | Accuracy | 97.85 | — | Unverified |
| Food-101 | TransBoost-ResNet50 | Accuracy (%) | 84.3 | — | Unverified |
| ImageNet | TransBoost-ResNet18 | Top 1 Accuracy | 73.36 | — | Unverified |
| ImageNet | TransBoost-ResNet34 | Top 1 Accuracy | 76.7 | — | Unverified |
| ImageNet | TransBoost-MobileNetV3-L | Top 1 Accuracy | 76.81 | — | Unverified |
| ImageNet | TransBoost-ViT-S | Top 1 Accuracy | 83.67 | — | Unverified |
| ImageNet | TransBoost-ConvNext-T | Top 1 Accuracy | 82.46 | — | Unverified |
| ImageNet | TransBoost-Swin-T | Top 1 Accuracy | 82.16 | — | Unverified |
| ImageNet | TransBoost-ResNet50-StrikesBack | Top 1 Accuracy | 81.15 | — | Unverified |
| ImageNet | TransBoost-ResNet152 | Top 1 Accuracy | 80.64 | — | Unverified |
| ImageNet | TransBoost-ResNet101 | Top 1 Accuracy | 79.86 | — | Unverified |
| ImageNet | TransBoost-ResNet50 | Top 1 Accuracy | 79.03 | — | Unverified |
| ImageNet | TransBoost-EfficientNetB0 | Top 1 Accuracy | 78.6 | — | Unverified |
| Stanford Cars | TransBoost-ResNet50 | Accuracy | 90.8 | — | Unverified |
| SUN397 | TransBoost-ResNet50 | Accuracy | 95.94 | — | Unverified |