SITT

The repo contains official PyTorch Implementation of the paper Single Image Texture Translation for Data Augmentation.

Authors:

• Boyi Li
• Yin Cui
• Tsung-Yi Lin
• Serge Belongie

Overview

Recent advances in image synthesis enables one to translate images by learning the mapping between a source domain and a target domain. Existing methods tend to learn the distributions by training a model on a variety of datasets, with results evaluated largely in a subjective manner. Relatively few works in this area, however, study the potential use of semantic image translation methods for image recognition tasks. In this paper, we explore the use of Single Image Texture Translation (SITT) for data augmentation. We first propose a lightweight model for translating texture to images based on a single input of source texture, allowing for fast training and testing. Based on SITT, we then explore the use of augmented data in long-tailed and few-shot image classification tasks. We find the proposed method is capable of translating input data into a target domain, leading to consistent improved image recognition performance. Finally, we examine how SITT and related image translation methods can provide a basis for a data-efficient, augmentation engineering approach to model training.

Usage

Environment

CUDA 10.1, pytorch 1.3.1

Dataset Preparation

Running

bash run.sh

More will be updated

If you find this repo useful, please cite:

@article{li2021single,
  title={Single Image Texture Translation for Data Augmentation},
  author={Li, Boyi and Cui, Yin and Lin, Tsung-Yi and Belongie, Serge},
  journal={arXiv preprint arXiv:2106.13804},
  year={2021}
}