Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

TVM for deep learning is kind of like LLVM for programming languages.

Nvidia TensorRT

Embedded/Edge AI

Jetson Nano

Google Coral

Intel Neural Compute Stick 2

https://heartbeat.fritz.ai/edge-tpu-google-coral-usb-accelerator-cf0d79c7ec56 …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

List GPU Devices on Linux

You can list GPU devices using the following command on linux.

lspci -v | grep VGA

Machine Learning Frameworks Supporting Managing GPU Resources

• Horovod

• Apache Ray

• ZeRO …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

I encountered an issue with Ubuntu 20.04 on my machine. Ubuntu crashes when I try to open settings or video players. After searching online, it seems that the problem happens …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Docker Images for PyTorch

• pytorch/pytorch:latest (official PyTorch image)
• dclong/jupyterhub-pytorch

PyTorch Tutorials

WELCOME TO PYTORCH TUTORIALS

https://pytorch.org/tutorials/beginner/pytorch_with_examples.html

Initialize Weights and Biases

In general …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Pytorch appears to be crashing due to OOM prematurely?

How to deal with excessive memory usages of PyTorch?

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Tips

1. Training a model requires significantly more CPU/GPU memories than running inference using the model.

2. torch.cuda.empty_cache() doesn't help if memory is not enough

3. It is suggested that you …