Ben Chuanlong Du's Blog

It is never too late to learn.

Improve the Performance of Spark

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Plan Your Work

  1. Have a clear idea about what you want to do is very important, especially when you are working on an explorative project. It often saves you time to …

Profile Performance of Python Applications

Tips

  1. cProfile (implemented in C) is preferred over profile (implemented in Python).

  2. The profiler modules (cProfile and profile) and tools based on them (e.g., %prun and %%prun for notebook) are designed to provide an execution profile for a given program, not for benchmarking purposes (for that, there is time

Profile C++ Code

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

You can use valgrind with the following options

valgrind --tool=callgrind ./(Your binary)

It will generate a file called callgrind.out.x. You can then use kcachegrind tool to read this …