Ben Chuanlong Du's Blog

It is never too late to learn.

Cluster Management Made Easy with the Python Package Fabric

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Ansible is a better alternative to Fabric. It is suggested that you use Ansible instead.

  1. Docstring will be displayed when you type the command fab -l.

  2. Invoke is for local use …

Use the ulimit Command to Control the Stack Size

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

http://en.tldp.org/LDP/solrhe/Securing-Optimizing-Linux-RH-Edition-v1.3/x4733.html

https://stackoverflow.com/questions/14471564/what-does-ulimit-s-unlimited-do

https://access.redhat.com/solutions/384633

Tips on Darknet and Yolo

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

https://pjreddie.com/darknet/tiny-darknet/

https://pjreddie.com/darknet/

Build Spark from Source

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

You can download prebuilt binary Spark at https://spark.apache.org/downloads.html. This is where you should get started and it will likely satisfy your need most of the time …

Subtle Differences Among Spark DataFrame and PySpark Dataframe

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. Besides using the col function to reference a column, Spark/Scala DataFrame supports using $"col_name" (based on implicit conversion and must have import spark.implicit._) while PySpark DataFrame support using …