Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
org.apache.hadoop.security.AccessControlException: Permission denied ...
The user of the Spark application has no permission to the query a table or HDFS path.
Apply to access to …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
org.apache.spark.InsertOperationConflictException: Failed to hold insert operation lock ...
Multiple Spark applications attempts to write to the same directory at the same time.
Resubmit your Spark application …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Container killed by YARN for exceeding memory limits.
22.0 GB of 19 GB physical memory used.
Consider boosting spark.yarn.executor.memoryOverhead
or disabling yarn.nodemanager.vmem-check-enabled …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
16/04/17 11:17:36 ERROR scheduler.TaskSetManager: Total size of serialized results of 126 tasks (1137.3 MB) is bigger than spark.driver.maxResultSize (1024.0 …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
15/12/10 07:44:21 ERROR shuffle.OneForOneBlockFetcher: Failed while starting block fetches
java.lang.RuntimeException: java.io.FileNotFoundException: /hadoop/1/scratch/local/usercache/dclong/appcache/application_1447357188616_340392 …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Please refer to Spark Issue: _Pickle.Picklingerror: Args[0] from Newobj Args Has the Wrong Class for a similar serialization issue in PySpark.
org.apache.spark.SparkException: Job aborted …