Ben Chuanlong Du's Blog

It is never too late to learn.

Log Softmax vs Softmax

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

The difference betwen Log Softmax and Softmax should be understood together with the loss function.

References

https://discuss.pytorch.org/t/what-is-the-difference-between-log-softmax-and-softmax/11801

https://discuss.pytorch.org/t/logsoftmax-vs-softmax/21386

https …

Models for Computer Vision

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

torchvision has implementation of popular deep learning models for computer vision.

ResNet-50

ResNet-50 is a 50-layer Residual Neural Network.

ResNet 101

ResNet-101 is a 101-layer Residual Neural Network.

ResNet 152

ResNet-152 …

Interpretation of Neural Networks

** Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

** Please refer to the Interpretations section of the wiki page Deep Learning.

https://github.com/slundberg/shap#methods-unified-by-shap

https://arxiv.org/pdf/1802.03888.pdf

https://github.com/slundberg/shap

References …

Distributed Training of Models on Spark

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

XGBoost

http://www.legendu.net/misc/blog/use-xgboost-with-spark/

LightGBM

http://www.legendu.net/misc/blog/use-lightgbm-with-spark/

BigDL

MMLSpark

Apache Ray

You can run Apache Ray on top of Spark via analytics-zoo …

Debug Code in JupyterLab Notebooks

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Use the %debug Magic

The easiest way to debug a Jupyter notebook is to use the %debug magic command. Whenever you encounter an error or exception, just open a new notebook …

Group-by Plots in HoloViews

There are many ways to achievie groupby in HolovViews.

  1. Directly use the groupby method of HoloViews objects!!!

  2. Use the method HoloMap to create a dictionary of parameters to HoloViews objects.

  3. Use the method dataset.to which has groupby option. However, it seems to me that this doesn't give me options to select which one to show. But with click and transparent parameters configured, you can achieve similar effect ...