Ben Chuanlong Du's Blog

It is never too late to learn.

Compresion of Deep Learning Models

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding

MobileNet

一、网络修剪

网络修剪,采用当网络权重非 …

Difference Between torch.nn.Module and torch.nn.functional

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Modules in torch.nn are internal implemented based on torch.nn.functional. Modules in torch.nn are easier to use while torch.nn.functional is more flexible. It is recommended to …

Log Softmax vs Softmax

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

The difference betwen Log Softmax and Softmax should be understood together with the loss function.

References

https://discuss.pytorch.org/t/what-is-the-difference-between-log-softmax-and-softmax/11801

https://discuss.pytorch.org/t/logsoftmax-vs-softmax/21386

https …

Models for Computer Vision

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

torchvision has implementation of popular deep learning models for computer vision.

ResNet-50

ResNet-50 is a 50-layer Residual Neural Network.

ResNet 101

ResNet-101 is a 101-layer Residual Neural Network.

ResNet 152

ResNet-152 …

Interpretation of Neural Networks

** Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

** Please refer to the Interpretations section of the wiki page Deep Learning.

https://github.com/slundberg/shap#methods-unified-by-shap

https://arxiv.org/pdf/1802.03888.pdf

https://github.com/slundberg/shap

References …

Distributed Training of Models on Spark

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

XGBoost

http://www.legendu.net/misc/blog/use-xgboost-with-spark/

LightGBM

http://www.legendu.net/misc/blog/use-lightgbm-with-spark/

BigDL

MMLSpark

Apache Ray

You can run Apache Ray on top of Spark via analytics-zoo …