Ben Chuanlong Du's Blog

It is never too late to learn.

Profiling Data Using ydata-profiling

Tips and Traps

  1. It is suggested that you use multiprocessing (e.g., pool_size=8) to speed up data profiling. Note: It seems to me that currently multiprocessing only works when minimal=True.

  2. minimal=True helps reuce consumed memory.

     profile = ProfileReport(
     df, title="Data Profiling Report", 
     explorative=True, minimal=True, pool_size=8
 )

Calling Rust from Python

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Tools

pyo3

Rust bindings for Python, including tools for creating native Python extension modules. Running and interacting with Python code from a Rust binary is also supported.

maturin

Build and publish …

Security Tools in Python

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

bandit

bandit is a tool designed to find common security issues in Python code.

pyarmor

pyarmor is a tool used to obfuscate python scripts, bind obfuscated scripts to fixed machine or …

Hands on ghapi

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Comments

There seem to be issues with the library. It is suggested that you call GitHub REST APIs directly, which is very straightforwad. For more discussions on GitHub APIs, please refer to GitHub API .