Distributed and decentralized training framework for PyTorch over graph

Evolutionary algorithm toolbox and framework with high performance for Python

Community Documents

Collective communications library with various primitives for multi-machine training.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.