Ben Chuanlong Du's Blog

It is never too late to learn.

Shell in Docker

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Configure the Shell for the RUN Command

https://docs.docker.com/engine/reference/builder/#shell

Configure the Default Shell for Terminals in Docker Containers

Just set the SHELL environment variable in …

Logging in PySpark

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. Excessive logging is better than no logging! This is generally true in distributed big data applications.

  2. Use loguru if it is available. If you have to use the logging module, be …

Markdown vs RestructureText vs MyST for Documentation

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Comparison

  1. Compared to Markdown, RestructuredText is more fully-featured, much more standardized and uniform, and has built-in support for extensions. However, ReStructuredText is also criticized for its complex and confusing syntax. The …