Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
org.apache.spark.sql.AnalysisException: cannot resolve ...
Miss-spell a column name or refer to a column which does not exist in the DataFrame.
Correct the column name or …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
org.apache.spark.sql.AnalysisException: Path does not exist ...
A specified HDFS path does not exist.
Use the correct HDFS path.
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
org.apache.hadoop.security.AccessControlException: Permission denied ...
The user of the Spark application has no permission to the query a table or HDFS path.
Apply to access to …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
org.apache.spark.InsertOperationConflictException: Failed to hold insert operation lock ...
Multiple Spark applications attempts to write to the same directory at the same time.
Resubmit your Spark application …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Container killed by YARN for exceeding memory limits.
22.0 GB of 19 GB physical memory used.
Consider boosting spark.yarn.executor.memoryOverhead
or disabling yarn.nodemanager.vmem-check-enabled …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
org.apache.spark.shuffle.FetchFailedException: Too large frame: 2200180718 Caused by: java.lang.IllegalArgumentException: Too large frame: 2200289525 at org.spark_project.guava.base.Preconditions.checkArgument(Preconditions.java:119)
There …