Ben Chuanlong Du's Blog

It is never too late to learn.

Spark Issue: Spark Application Submission Is Not Finished

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Error Message

Application submission is not finished, submitted application application__1524215324275_0081 is still in ...

image

Possible Causes

The Resource Manager needs to write too much data to ZooKeeper and hit the buffer limit.

Solution

Ask the Spark Cluster admin to increase the ZooKeeper buffer limit.

Comments