Multi-gpu training

[zhengzhezhe]

Hello, I want to use two or four more Gpus to finetune the model to reduce the training time of the model, may I ask how should I modify the code，or do you have a script for multi-gpus training?

[Plachtaa]

single gpu training script is clear enough
for multi-gpu training, someone who has the will knows how to do it ✋