Ben Chuanlong Du's Blog

It is never too late to learn.

JIT and Domain Specific Compilers

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

numba

Hummingbird

Hummingbird compiles trained ML models into tensor computation for faster inference.

jax

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

XLA

deep learning …

Hands on the Python module numba

Installation

numba can be installed using the following command.

:::bash
pip3 install numba

If you need CUDA support, you have to install CUDA drivers.

:::bash
sudo apt-get install cuda-10-1

Instead of going through the hassle of configuring numba for GPU, a better way is to run numba in a Nvidia Docker container. The Docker image nvidia/cuda:10.1-cudnn7-runtime-ubuntu18.04 has CUDA runtime installed, so it is as easy as installing numba on top it and you are ready to go. For more detailed instructions, please refer to