Update README.md

ruilimit · Mar 3, 2023 · 8c8b4a2 · 8c8b4a2
1 parent e184542
commit 8c8b4a2
Showing 1 changed file with 6 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -13,6 +13,12 @@ Then in this repository
 pip install -e .
 ```
 
+If you are using MPS commit, use these to disable mps backend memory limit + fallback
+```
+export PYTORCH_ENABLE_MPS_FALLBACK=1
+export PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0
+```
+
 ```
 torchrun --nproc_per_node 1 example.py --ckpt_dir $TARGET_FOLDER/model_size --tokenizer_path $TARGET_FOLDER/tokenizer.model
 ```