Ben Chuanlong Du's Blog

It is never too late to learn.

Visualization for AI Concepts

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Tools for (approximately) visualizing the architures of existing neural networks or for visualizing the traing process (training/validation loss/accuracy, activation, etc.) are extremely helpful! TensorBoard is one of the best …

Common Issues in PyTorch

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Input type (torch.FloatTensor) and weight type (torch.cuda.FloatTensor) should be the same

This means that the input data and the model are on different …

Benchmark of Popular Deep Learning Models

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Memory

  1. ResNet152 inferencing requies about (a little bit less than) 2G GPU memory and training can be done with 8G GPU memory (need to set a small batch size). Deeper ResNet …

Use PyTorch on GPU

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

PyTorch on GPU

https://pytorch.org/docs/master/notes/cuda.html

You can use the command torch.cuda.is_available() to check whether GPU is available for PyTorch. Details of GPUs can …