Ben Chuanlong Du's Blog

It is never too late to learn.

Python Profiler for JupyterLab Notebooks

%time

Measue the execuation time of the code ONCE.

%timeit

Measure the execuation time of the code (accurately) by running it MULTIPLE TIMES and taking the average.

%prun | %%prun

-D: output the profiling results into a file so that you can other tools (e.g., snakeviz) to visualize it.

Noticd that %prun and %%prun are based on cProfile

Use nbdime to Diff and Merge JupyterLab Notebooks

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

nbdime is a tool for diffing and merging of Jupyter notebooks. Notice that nbdime integrates with git well.

Tips and Traps

If you install nbdime to your local directory, make sure …

Kotlin Kernel for JupyterLab

Tips and Traps

There are multiple Kotlin kernels for JupyterLab. It is is suggested that you use official one released by JetBrains.

Jar Dependencies

You can add a JAR dependency using the following code.

Tips on the Almond Scala Kernel

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. kernel.silent(true) supress outputs of cells.

  2. Currently each line in a cell have an output, which is messy. There are 2 ways to avoid this.

    val resObj = {
        ...
        ...
    }
    
    {{
        ...
        ...
    }}
    

References

Use Spark …