Ben Chuanlong Du's Blog

It is never too late to learn.

Python Profiler for JupyterLab Notebooks

%time

Measue the execuation time of the code ONCE.

%timeit

Measure the execuation time of the code (accurately) by running it MULTIPLE TIMES and taking the average.

%prun | %%prun

-D: output the profiling results into a file so that you can other tools (e.g., snakeviz) to visualize it.

Noticd that %prun and %%prun are based on cProfile

Use nbdime to Diff and Merge JupyterLab Notebooks

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

nbdime is a tool for diffing and merging of Jupyter notebooks. Notice that nbdime integrates with git well.

Tips and Traps

If you install nbdime to your local directory, make sure …

Tips on Zeppelin

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. Zepplin notebook directory, if you want to move notebooks to another machine, must place them into the notebook directory.

  2. %sh interpreter is useful!!!

I observe that Hive in Zeppelin is much …

Debug Code in JupyterLab Notebooks

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Use the %debug Magic

The easiest way to debug a Jupyter notebook is to use the %debug magic command. Whenever you encounter an error or exception, just open a new notebook …