Ben Chuanlong Du's Blog

It is never too late to learn.

Clustering Algorithms in Machine Learning

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Centroid-based Clustering

  • K-means Clustering

  • K-medians Clustering

  • K-mediods Clustering

Hierarchical Clustering

  • Agglomerative Hierarchical Clustering

  • Divisive Hierarchical Clustering

Partional Clustering

Metrics for Machine Learning

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Accuracy

Precision/Recall

F1

Matthrews Correlation Coefficient (MCC)

ROC/AUC

Mean Absolute Error (MAE)

Mean Squared Error (MSE)

Root-mean-square Error (RMSE)

Tips on TPU

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

References

https://cloud.google.com/tpu/docs/tutorials/resnet-alpha-py

https://cloud.google.com/tpu/docs/tutorials

https://towardsdatascience.com/running-pytorch-on-tpu-a-bag-of-tricks-b6d0130bddd4

Regularization in Machine Learning Models

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Regularization add a penalty term to the loss function in machine learning models. The type of regularizatin depends on the type of penalty used (not the type of the objective function …

Optimization Method in Machine Learning

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

L-BFGS converges faster and with better solutions on small datasets. However, ADAM is very robust for relatively large datasets. It usually converges quickly and gives pretty good performance. SGD with momentum …

Tips on XGBoost

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. It is suggested that you use the sklearn wrapper classes XGBClassifier and XGBRegressor so that you can fully leverage other tools of the sklearn package.

  2. There are 2 types of boosters …