This repository contains PyTorch tutorial on parallel model training. The code is the same as in the official PyTorch tutorials but only a little modularized.