Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Training a Model Implemented in PyTorch
https://github.com/ray-project/ray/tree/master/python/ray/util/sgd/pytorch/examples
Distributed PyTorch Using Apache Ray
RaySGD: Distributed Training Wrappers