Ben Chuanlong Du's Blog

It is never too late to learn.

Git Large File Storage

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Installation

Please refer to git-lfs Installation for instructions on how to install git-lfs.

Tips and Traps

  1. Track a large file.

    git lfs track "*.pickle"
    
  2. It seems to be that git-lfs automatically …

Docstring in Python

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Tips and Traps

  1. I personal prefer the sphnix style as it is concise and work well with type annotation.

  2. Improperly escaped \n in docstring causes darglint fail to parse the docstring …

Tips on Darglint

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Tips and Traps

  1. It is suggested that you avoid using darglint directly, but instead you can use flake8 which will automatically call darglint if it exists.

  2. Improperly escaped \n causes darglint …

Tips on sshuttle

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. sudo permission is required to run sshuttle.

  2. It's valid to run sshuttle more than once simultaneously on a single client machine, connecting to a different server every time, so you can …

Tips on Feature Engineering for Machine Learning

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

https://towardsdatascience.com/automatic-feature-engineering-using-deep-learning-and-bayesian-inference-application-to-computer-7b2bb8dc7351

Feature selection Feature extraction Adding features through domain expertise

FeatureTools a Python library for feature engineering Deep neural network can extract features too

whether feature engineering is …

Access Control in Spark SQL

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Grant Permission to Users

GRANT
    priv_type [, priv_type ] ...
    ON database_table_or_view_name
    TO principal_specification [, principal_specification] ...
    [WITH GRANT OPTION];

Examples:

GRANT SELECT ON table1 TO USER user1;
GRANT SELECT ON DATABASE db1 TO USER user1 …