Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Computer Vision Libraries in Rust
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
resize
resize Image resampling library in pure Rust. - Fast, with support for many pixel formats - No encoders/decoders, meant to be used with some external library - Tuned for resizing to the …
Process Big Data Using Spark
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
General Tips
-
Please refer to Spark SQL for tips specific to Spark SQL.
-
It is almost always a good idea to filter out null value in the joinining columns before joining …
Make Date Show Time of a Specific Timezone in Linux
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
For example, to show the current Pacific time,
TZ=America/Los_Angeles date
Spark Issue: InvalidResourceRequestException
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Symptoms
Final app status: FAILED, exitCode: 10, (reason: Uncaught exception: org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested virtual cores < 0, or requested virtual cores > max configured, requestedVirtualCores=16 …
Memory in JVM
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Stack, heap and off-heap are all memory that stored in a computer's RAM.
Stack
Stack is used for static memory allocation. Variables allocated on the stack are stored directly to the …