Improved Regularization of Convolutional Neural Networks with Cutout

Code

• github.com/uoguelph-mlrg/Cutout
  OfficialIn paperpytorch★ 555
• github.com/albumentations-team/albumentations
  pytorch★ 15,288
• github.com/PaddlePaddle/PaddleClas
  paddle★ 5,788
• github.com/kschwethelm/hyperboliccv
  pytorch★ 78
• github.com/mingsun-tse/good-da-in-kd
  pytorch★ 37
• github.com/eaguaida/TF_EnsNet-
  tf★ 5
• github.com/senthilva/CNN_CIFAR10_gradcam_cutout
  none★ 1
• github.com/KentaItakura/CNN-classification-using-random-erasing-and-cut-out
  none★ 0
• github.com/lyxxn0414/test-data-generation
  tf★ 0
• github.com/felixgwu/img_classification_pk_pytorch
  pytorch★ 0

Abstract

Convolutional neural networks are capable of learning powerful representational spaces, which are necessary for tackling complex learning tasks. However, due to the model capacity required to capture such representations, they are often susceptible to overfitting and therefore require proper regularization in order to generalize well. In this paper, we show that the simple regularization technique of randomly masking out square regions of input during training, which we call cutout, can be used to improve the robustness and overall performance of convolutional neural networks. Not only is this method extremely easy to implement, but we also demonstrate that it can be used in conjunction with existing forms of data augmentation and other regularizers to further improve model performance. We evaluate this method by applying it to current state-of-the-art architectures on the CIFAR-10, CIFAR-100, and SVHN datasets, yielding new state-of-the-art results of 2.56%, 15.20%, and 1.30% test error respectively. Code is available at https://github.com/uoguelph-mlrg/Cutout

Tasks

Benchmark Results

Reproductions