Commits

Commits on Dec 28, 2022

[diffusion] update readme (hpcaitech#2214 )
1SAA
authoredDec 28, 2022

Commits on Dec 26, 2022

[testing] add beit model for unit testings (hpcaitech#2196 )
1SAA
authoredDec 26, 2022
[zero] fix error for BEiT models (hpcaitech#2169 )
1SAA
authoredDec 26, 2022

Commits on Dec 20, 2022

[example] add zero1, zero2 example in GPT examples (hpcaitech#2146 )
1SAA
authoredDec 20, 2022

Commits on Dec 12, 2022

[optimizer] add div_scale for optimizers (hpcaitech#2117 )
1SAA
authoredDec 12, 2022

Commits on Dec 9, 2022

[zero] add L2 gradient clipping for ZeRO (hpcaitech#2112 )
1SAA
authoredDec 9, 2022

Commits on Nov 30, 2022

[gemini] fix init bugs for modules (hpcaitech#2047 )
1SAA
authoredNov 30, 2022
[gemini] add arguments (hpcaitech#2046 )
1SAA
authoredNov 30, 2022
[zero] fix testing parameters (hpcaitech#2042 )
1SAA
authoredNov 30, 2022
[zero] fix unit-tests (hpcaitech#2039 )
1SAA
authoredNov 30, 2022

Commits on Nov 29, 2022

[testing] fix testing models (hpcaitech#2036 )
1SAA
authoredNov 29, 2022
[zero] test gradient accumulation (hpcaitech#1964 )
1SAA
authoredNov 29, 2022

Commits on Nov 16, 2022

[zero] fix memory leak for zero2 (hpcaitech#1955 )
1SAA
authoredNov 16, 2022

Commits on Nov 11, 2022

[zero] migrate zero1&2 (hpcaitech#1878 )
1SAA
authoredNov 11, 2022

Commits on Nov 10, 2022

[diffusion] fix package conflicts (hpcaitech#1875 )
1SAA
authoredNov 10, 2022

Commits on Nov 9, 2022

[NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py code style (hpcaitech#1845 )

1SAA
authored and
binmakeswell
committedNov 9, 2022

Commits on Nov 2, 2022

[hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (hpcaitech#1786 )
1SAA
authoredNov 2, 2022

Commits on Oct 18, 2022

[zero] add chunk init function for users (hpcaitech#1729 )
1SAA
authoredOct 18, 2022
[pre-commit] update pre-commit (hpcaitech#1726 )
1SAA
authoredOct 18, 2022

Commits on Oct 14, 2022

[zero] add constant placement policy (hpcaitech#1705 )
1SAA
authoredOct 14, 2022

Commits on Oct 9, 2022

[feature] A new ZeRO implementation (hpcaitech#1644 )
1SAA
authoredOct 9, 2022

Commits on Sep 24, 2022

[feature] new zero implementation (hpcaitech#1623 )
1SAA
authoredSep 24, 2022

Commits on Sep 23, 2022

[moe] initialize MoE groups by ProcessGroup (hpcaitech#1640 )
1SAA
authoredSep 23, 2022
[moe] fix moe bugs (hpcaitech#1633 )
1SAA
authoredSep 23, 2022

Commits on Sep 22, 2022

[moe] fix MoE bugs (hpcaitech#1628 )
1SAA
authoredSep 22, 2022

Commits on Aug 11, 2022

[zero] add chunk_managerV2 for all-gather chunk (hpcaitech#1441 )
1SAA
authoredAug 11, 2022
[zero] add chunk size searching algorithm for parameters in different groups (hpcaitech#1436 )
1SAA
authoredAug 11, 2022

Commits on Aug 10, 2022

Commits on Aug 9, 2022

[zero] add unit test for AgChunk's append, close, access (hpcaitech#1423 )
1SAA
authoredAug 9, 2022
[zero] add AgChunk (hpcaitech#1417 )
1SAA
authoredAug 9, 2022

Commits on Aug 2, 2022

[zero] alleviate memory usage in ZeRODDP state_dict (hpcaitech#1398 )
1SAA
authoredAug 2, 2022

Commits on Jul 29, 2022

[hotfix] adapt ProcessGroup and Optimizer to ColoTensor (hpcaitech#1388 )
1SAA
authoredJul 29, 2022
[hotfix] fix a running error in test_colo_checkpoint.py (hpcaitech#1387 )
1SAA
authoredJul 29, 2022

Commits on Jul 28, 2022

[checkpoint] add kwargs for load_state_dict (hpcaitech#1374 )
1SAA
authoredJul 28, 2022