Skip to content

Commit

Permalink
fix type error
Browse files Browse the repository at this point in the history
  • Loading branch information
Anton Emelyanov committed Aug 12, 2021
1 parent bb5cacf commit 25719f1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -339,7 +339,7 @@ def load_checkpoint(model, optimizer, lr_scheduler, args, deepspeed=False):
else:
# Try load deepspeed checkpoint with only megatron
checkpoint_name = os.path.join(
args.load, iteration,
args.load, str(iteration),
'mp_rank_{:02d}_model_states.pt'.format(mpu.get_model_parallel_rank())
)
sd = torch.load(checkpoint_name, map_location='cpu')
Expand Down

0 comments on commit 25719f1

Please sign in to comment.