SOTAVerified

TransBoost: Improving the Best ImageNet Performance using Deep Transduction

2022-05-26Code Available0· sign in to hype

Omer Belhasin, Guy Bar-Shalom, Ran El-Yaniv

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

This paper deals with deep transductive learning, and proposes TransBoost as a procedure for fine-tuning any deep neural model to improve its performance on any (unlabeled) test set provided at training time. TransBoost is inspired by a large margin principle and is efficient and simple to use. Our method significantly improves the ImageNet classification performance on a wide range of architectures, such as ResNets, MobileNetV3-L, EfficientNetB0, ViT-S, and ConvNext-T, leading to state-of-the-art transductive performance. Additionally we show that TransBoost is effective on a wide variety of image classification datasets. The implementation of TransBoost is provided at: https://github.com/omerb01/TransBoost .

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CIFAR-10TransBoost-ResNet50Percentage correct97.61Unverified
DTDTransBoost-ResNet50Accuracy76.49Unverified
FGVC-AircraftTransBoost-ResNet50Accuracy83.8Unverified
Flowers-102TransBoost-ResNet50Accuracy97.85Unverified
Food-101TransBoost-ResNet50Accuracy (%)84.3Unverified
ImageNetTransBoost-ResNet18Top 1 Accuracy73.36Unverified
ImageNetTransBoost-ResNet34Top 1 Accuracy76.7Unverified
ImageNetTransBoost-MobileNetV3-LTop 1 Accuracy76.81Unverified
ImageNetTransBoost-ViT-STop 1 Accuracy83.67Unverified
ImageNetTransBoost-ConvNext-TTop 1 Accuracy82.46Unverified
ImageNetTransBoost-Swin-TTop 1 Accuracy82.16Unverified
ImageNetTransBoost-ResNet50-StrikesBackTop 1 Accuracy81.15Unverified
ImageNetTransBoost-ResNet152Top 1 Accuracy80.64Unverified
ImageNetTransBoost-ResNet101Top 1 Accuracy79.86Unverified
ImageNetTransBoost-ResNet50Top 1 Accuracy79.03Unverified
ImageNetTransBoost-EfficientNetB0Top 1 Accuracy78.6Unverified
Stanford CarsTransBoost-ResNet50Accuracy90.8Unverified
SUN397TransBoost-ResNet50Accuracy95.94Unverified

Reproductions