Ben Chuanlong Du's Blog

It is never too late to learn.

High Performance Computing in Python

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Computing Frames

Apache Ray

A fast and simple framework for building and running distributed applications.

Ray does not handle large data well (as of 2018/05/28). Please refer to the …

Hands on the Python module numba

Installation

numba can be installed using the following command.

:::bash
pip3 install numba

If you need CUDA support, you have to install CUDA drivers.

:::bash
sudo apt-get install cuda-10-1

Instead of going through the hassle of configuring numba for GPU, a better way is to run numba in a Nvidia Docker container. The Docker image nvidia/cuda:10.1-cudnn7-runtime-ubuntu18.04 has CUDA runtime installed, so it is as easy as installing numba on top it and you are ready to go. For more detailed instructions, please refer to