Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Run your GitHub Actions locally.
MLOps: Continuous delivery and automation pipelines in machine learning
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Faker is a Python package that generates fake data for you.
Hypothesis is a powerful, flexible, and easy to use library for property-based testing.
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Goodbye Print, Hello Debugger! - Nina Zakharenko - Talk
When separate teams/people are developing different components in a big project and unit testing has to be written before …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
It is suggested that you leverage profession CICD tools instead of nox for testing.
https://github.com/theacodes/nox
https://nox.thea.codes/en/stable/index.html
https://cjolowicz.github.io …
If we get the execuation plan, then it is quite easy to analyze ...
https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-rdd-lineage.html
https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-rdd-dependencies.html
http://hydronitrogen.com/in-the-code-spark-sql-query-planning-and-execution.html
You can use Scala testing frameworks ScalaTest (recommended) and Specs, or you can use frameworks/tools developed based on them for Spark specifically. Various discussions suggests that Spark Testing Base is a good one.
https://www.slideshare.net/SparkSummit/beyond-parallelize-and-collect-by-holden-karau
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Use Java reflection to help test private methods.
https://phauer.com/2018/best-practices-unit-testing-kotlin/
https://medium.com/mindorks/how-to-unit-test-private-methods-in-java-and-kotlin-d3cae49dccd