Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Python

docker-py

docker-py is a Python library for the Docker Engine API. It lets you do anything the docker command does, but from within Python apps – run containers, manage containers, manage …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

GitHub Actions

Travis CI

Jenkins

act

Run your GitHub Actions locally.

References

MLOps: Continuous delivery and automation pipelines in machine learning

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

spark-submit and spark-shell

Overwrite the PATH environment variable before invoking spark-submit and/or spark-shell often resolves the issue.

Spark in Jupyter/Lab Notebooks

Remove or reset the environment variable HADOOP_CONF_DIR resolves …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

1. The extension Python Docstring Generator is recommended.

2. The Sphinx docstring style is recommended.

References

https://marketplace.visualstudio.com/items?itemName=njpwerner.autodocstring

https://github.com/NilsJPWerner/autoDocstring