Most likely, you never call sc.stop().
Note that in 1.4, this will happen for you automatically in a shutdown
hook, taken care of by https://issues.apache.org/jira/browse/SPARK-3090
On Wed, May 13, 2015 at 8:04 AM, Yifan LI wrote:
> Hi,
>
> I have some applications finished(but actually failed
Hi,
I have some applications finished(but actually failed before), that in WebUI
show
Application myApp is still in progress.
and, in the eventlog folder, there are several log files like this:
app-20150512***.inprogress
So, I am wondering what the “inprogress” means…
Thanks! :)
Best,
Yifan