Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
https://build-system.fman.io/
https://github.com/mherrmann/fbs-tutorial
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Grafana seems like another great choice!!! https://grafana.com/grafana/download?platform=docker
Prometheus sounds like a good one!
ELKI sounds like a possible tool for monitoring & alerting
Argus another one …
To enable AQE,
you have to set spark.sql.adaptive.enabled to true
(using --conf spark.sql.adaptive.enabled=true in spark-submit
or using `spark.config("spark.sql.adaptive,enabled", "true") in Spark/PySpark code.)
Pandas UDFs are user defined functions
that are executed by Spark using Arrow
to transfer data to Pandas to work with the data,
which allows vectorized operations.
A Pandas UDF is defined using pandas_udf