SOTAVerified

A Comprehensive Study on Torchvision Pre-trained Models for Fine-grained Inter-species Classification

2021-10-14Code Available1· sign in to hype

Feras Albardi, H M Dipu Kabir, Md Mahbub Islam Bhuiyan, Parham M. Kebria, Abbas Khosravi, Saeid Nahavandi

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

This study aims to explore different pre-trained models offered in the Torchvision package which is available in the PyTorch library. And investigate their effectiveness on fine-grained images classification. Transfer Learning is an effective method of achieving extremely good performance with insufficient training data. In many real-world situations, people cannot collect sufficient data required to train a deep neural network model efficiently. Transfer Learning models are pre-trained on a large data set, and can bring a good performance on smaller datasets with significantly lower training time. Torchvision package offers us many models to apply the Transfer Learning on smaller datasets. Therefore, researchers may need a guideline for the selection of a good model. We investigate Torchvision pre-trained models on four different data sets: 10 Monkey Species, 225 Bird Species, Fruits 360, and Oxford 102 Flowers. These data sets have images of different resolutions, class numbers, and different achievable accuracies. We also apply their usual fully-connected layer and the Spinal fully-connected layer to investigate the effectiveness of SpinalNet. The Spinal fully-connected layer brings better performance in most situations. We apply the same augmentation for different models for the same data set for a fair comparison. This paper may help future Computer Vision researchers in choosing a proper Transfer Learning model.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
10 Monkey SpeciesInception-v3 (Spinal FC)Accuracy99.26Unverified
10 Monkey SpeciesWideResNet-101(Spinal FC)Accuracy99.26Unverified
10 Monkey SpeciesVGG-19_bnAccuracy98.9Unverified
Bird-225WideResNet-101 (Spinal FC)Accuracy99.56Unverified
Bird-225WideResNet-101Accuracy99.38Unverified
Fruits 360ResNeXt-101Accuracy (%)99.98Unverified
Oxford 102 FlowersDenseNet-201Accuracy98.29Unverified
Oxford 102 FlowersDenseNet-201(Spinal FC)Accuracy98.36Unverified

Reproductions