Ben Chuanlong Du's Blog

It is never too late to learn.

Get OS and Architecture Information in Shell

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Command Description
uname -a The full info of the machine.
uname The type of OS, e.g., Linux, Darwin, etc.
uname -m The architecture of the machine, e.g., x86_64, etc …

Extended Globbing in Bash

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Enable Extended Globbing

shopt -s extglob

Or you can run bash with the option -O extglob.

/bin/bash -O extglob -c "your command to run"

Set Shell to be Bash with …

Rust and Spark

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

The simplest and best way is to leverage pandas_udf in PySpark. In the pandas UDF, you can call subprocess.run to run any shell command and capture its output.

from pathlib …