Ben Chuanlong Du's Blog

It is never too late to learn.

Save Docker Image in Another Location

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Docker images are saved in /var/lib/docker. You can link the directory to another place to save images elsewhere. Another way is to change the configuration file of Docker. For …

The JAVA_HOME Environment Variable

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Point to the JDK directory if you can. Otherwise, point it to the JRE directory.

References

https://docs.oracle.com/cd/E19182-01/820-7851/inst_cli_jdk_javahome_t/

https://www.quora.com/What-is-the-use-of-JAVA_HOME

Hard Link, Symbolic Link and Bind Mount

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

https://unix.stackexchange.com/questions/198590/what-is-a-bind-mount

Tips on Recommendation Systems

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

User-based Filtering (Memory-based Filtering)

Item-based Filtering (Content-based Filtering)

Non-negative Matrix Factorization

Neural Matrix Factorization

Variational Autoencoder

Hybrid

New methods like VAE, AE, or Deep Collaborative outperform classical methods like NMF on …

Activation Functions in Neural Network

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

GELU

GELU is the best activation function currently (at least in NLP).

$$ GELU(x) == x \Phi(x) $$

,

where \(\Phi(x)\) is the cumulative distribution function of the standard normal distribution.

ReLU …

Tips on Transformer in NLP

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

http://nlp.seas.harvard.edu/2018/04/03/attention.html

https://blog.floydhub.com/the-transformer-in-pytorch/

http://jalammar.github.io/illustrated-transformer/

https://towardsdatascience.com/transformers-141e32e69591