Ben Chuanlong Du's Blog

It is never too late to learn.

Visualization for AI Concepts

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Tools for (approximately) visualizing the architures of existing neural networks or for visualizing the traing process (training/validation loss/accuracy, activation, etc.) are extremely helpful! TensorBoard is one of the best …

Tips on Scikit-Learn

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. Cross validation in scikit-learn supports pipeline in addition to vanilla models. Please refer to Cross Validation Pipeline for more details.

  2. Label encoding is an easy way to convert a categorical response …

Common Issues in PyTorch

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Input type (torch.FloatTensor) and weight type (torch.cuda.FloatTensor) should be the same

This means that the input data and the model are on different …

Benchmark of Popular Deep Learning Models

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Memory

  1. ResNet152 inferencing requies about (a little bit less than) 2G GPU memory and training can be done with 8G GPU memory (need to set a small batch size). Deeper ResNet …