Ben Chuanlong Du's Blog

It is never too late to learn.

GPU Related Issues and Solutions

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Tips

  1. Training a model requires significantly more CPU/GPU memories than running inference using the model.

  2. torch.cuda.empty_cache() doesn't help if memory is not enough

  3. It is suggested that you …

Use PyTorch on GPU

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

PyTorch on GPU

https://pytorch.org/docs/master/notes/cuda.html

You can use the command torch.cuda.is_available() to check whether GPU is available for PyTorch. Details of GPUs can …

GPU for Web

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

https://github.com/gpuweb/gpuweb This is the repository for the W3C's GPU for the Web Community Group.

gfx-rs

gfx-rs is a low-level, cross-platform graphics and compute abstraction library in Rust …

Machine Learning Libraries, Computing Frames and Programming Languages

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. GPU is more accisible for average individual people. GPU is still the main tool for deep learning right now.

  2. Python Distributed Computing Frameworks (Ray, Modin, etc.) servers as a mid solution …