Ben Chuanlong Du's Blog

It is never too late to learn.

Handle Categorical Variables in LightGBM

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

LightGBM support pandas columns of category type. As a matter of fact, this is the suggested way of handling categorical columns in LightGBM.

data[feature] = pd.Series(data[feature], dtype="category")

A LightGBM model (which is a Booster object) records categories of each categorical feature. This information is used to set categories of each categorical feature during prediction, which ensures that a LightGBM model can always handle categorical features correctly.

Handling Categorical Variables in Machine Learning

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Categorical variables are very common in a machine learning project. On a high level, there are two ways to handle a categorical variable.

  1. Drop a categorical variable if a categorical variable …

Tips on LightGBM

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. It is strongly suggested that you load data into a pandas DataFrame and handle categorical variables by specifying a dtype of "category" for those categorical variables.

    df.cat_var = df.cat_var.astype …

Fake Face Using AI

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

https://faceswap.dev/ Faceswap is the leading free and Open Source multi-platform Deepfakes software.

https://github.com/iperov/DeepFaceLab DeepFaceLab is the leading software for creating deepfakes.

Compute Vision Tasks

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Task Sub Domain Description Models Data Tools/Applications Papers
Image Classification Image Classification Image Classification Image Classification Image Classification Image Classification Image Classification
Image Localization Image Localization Image Localization Image Localization …

Training Deep Neural Networks

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Rules of Thumb for Training

https://arxiv.org/pdf/1206.5533.pdf**

https://towardsdatascience.com/17-rules-of-thumb-for-building-a-neural-network-93356f9930af

https://hackernoon.com/rules-of-thumb-for-deep-learning-5a3b6d4b0138

https://stats.stackexchange.com/questions/181/how-to-choose-the-number-of-hidden-layers-and-nodes-in-a-feedforward-neural-netw

Batch size affects both …