Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

1. venv is a standard Python library and is the recommended way for managing virtual environments in Python3.

2. When developing a Python project, it is recommended that you use Poetry to manage …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Spark DataFrame

Spark DataFrame is a great implementation of distributed DataFrame, if you don't mind having dependency on Spark. It can be used in a non-distributed way of course. Spark DataFrame …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

1. You can suppress warnings of unchecked exceptions by using

   SuppressWarnings("unchecked")
   

   but generally speaking, you cannot suppress warnings of checked exceptions.

2. You can use more than one catch blocks if necessary …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

1. getResource and getResourceAsStream tries to find files in the resources directory under src/main/resources or src/test/resources (depending on whether you are running the application or tests for the …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Error Messages

Error: A JNI error has occurred, please check your installation and try again

Caused by: java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession

Cause

Some dependencies (Spark in this …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

1. Methods of a Kotlin object can be called in a Scala project by KotlinObject.INSTANCE.methodToCall()

2. You might need to provide the Kotlin standard library kotlin-stdlib.jar in order to run …