Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Shortcomes of JSON

It is suggested that you avoid using the JSON format! TOML and YAML are better text-based alternatives. If readability is not a concern, a binary serialization format is …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

BigQuery on Google Cloud

The free tier seems to be good enough for most personal use cases.

• 1TB of querying per month
• 10GB storage per month

Amazon Always Free Offers

• Amazon …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Plan Your Work

1. Have a clear idea about what you want to do is very important, especially when you are working on an explorative project. It often saves you time to …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

• Upper and lower bounds tests and Inter Quartile Range Checks(IQR) and standard deviations

• Aggregate level checks (after manipulating data, there should still be the ability to explain how the data …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Performance

1. Avoid implicit data convertion! This might cause full table scan which hurts performance badly. For more discussions, please refer to 一条垃圾SQL，把 64 核 CPU 快 …