Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
https://github.com/jhalterman/failsafe
Run Commands on Remote Machines
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
On a Sinsgle Machine
SSH
-
The pipeline command is run locally. If you want the pipeline command to run remotely, place the whole command to be run remotely in double/single …
Hyper Parameter Tuning and Automatical Machine Learning
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Methodology
hyper-parameter tuning, grid search bayesian optimization evolutionary algorithms genetic programming cross validation k-fold Neural Architecture Search with Reinforcement Learning
Libraries
Optuna
auto-sklearn
Ludwig
Ludwig is a toolbox that allows to …
Tips on Optuna
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Optuna is a good framework for hyper parameter tuning in machine learning.
Tips on Apache Arrow
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
[Feather vs Parquet]https://github.com/wesm/feather/issues/188
References
https://github.com/wesm/feather
Hands on the json Module in Python
Tips and Traps¶
It is suggested that you avoid using JSON for serializing and deserializing data. Please refer to Shotcomes of JSON for detailed discussions on this. TOML and YAML are better text-based alternatives to JSON. If serialization and deserialization is done in Python only, pickle