Ben Chuanlong Du's Blog

It is never too late to learn.

Workflow Managing Tools

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Star History of Workflow Management Tools

  1. Apache Airflow is the recommended tool for managing workflows current! A big advantage of Airflow over other workflow managing tools (e.g., UC4) is that the workflow is expressed in (simple …

Job Scheduling and Management Using Apache Airflow

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Installation (MySQL)

  1. Install Apache AirFlow.

    wajig install \
        python3-dev python3-pip \
        mysql-server libmysqlclient-dev
    sudo AIRFLOW_GPL_UNIDECODE=yes pip3 install apache-airflow[mysql]
    
  2. Add the following content into your my.cnf …