Comments¶
Transformations in
torchvision.transformswork on images, tensors (representing images) and possibly on numpy arrays (representing images). However, a transformation (e.g.,ToTensor) might work differently on different input types. So you'd be clear about what exactly a transformation function does. A good practice is to always convert your non-tensor input data to tensors using the transformationToTensor
Popular and Useful Modules and Functions in PyTorch
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Functions
Number Precision in Deep Learning
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
https://www.mathworks.com/company/newsletters/articles/what-is-int8-quantization-and-why-is-it-popular-for-deep-neural-networks.html
https://engineering.fb.com/ai-research/floating-point-math/
Rethinking floating point for deep learning
Training Deep Neural Networks with 8-bit Floating Point Numbers
Tips on TVM
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement! TVM is an open deep learning compiler stack for CPUs, GPUs, and specialized accelerators. It aims to close the gap between the productivity-focused deep learning frameworks, and the performance- or efficiency-oriented …
Public Cloud Offering GPU Support
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
https://lambdalabs.com/
https://www.floydhub.com/
https://colab.research.google.com/notebooks/intro.ipynb#recent=true
Amazon AWS
Below is a list of instances that have 1 GPU on Amazon …
Train PyTorch Distributedly Using Apache Ray
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Training a Model Implemented in PyTorch
https://github.com/ray-project/ray/tree/master/python/ray/util/sgd/pytorch/examples
Distributed PyTorch Using Apache Ray
RaySGD: Distributed Training Wrappers