Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
org.apache.hadoop.security.AccessControlException: Permission denied ...
The user of the Spark application has no permission to the query a table or HDFS path.
Apply to access to …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
org.apache.spark.InsertOperationConflictException: Failed to hold insert operation lock ...
Multiple Spark applications attempts to write to the same directory at the same time.
Resubmit your Spark application …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Container killed by YARN for exceeding memory limits.
22.0 GB of 19 GB physical memory used.
Consider boosting spark.yarn.executor.memoryOverhead
or disabling yarn.nodemanager.vmem-check-enabled …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
org.apache.spark.shuffle.FetchFailedException: Too large frame: 2200180718 Caused by: java.lang.IllegalArgumentException: Too large frame: 2200289525 at org.spark_project.guava.base.Preconditions.checkArgument(Preconditions.java:119)
There …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Type hints cheat sheet (Python 3) is a quick cheat sheet showing how the PEP 484 type annotation notation represents various common types in Python 3.
Notice that the annotation on List and Tuple are different.
List[T] stands for a variable length list of elements with type T