Most likely, you never call sc.stop(). Note that in 1.4, this will happen for you automatically in a shutdown hook, taken care of by https://issues.apache.org/jira/browse/SPARK-3090
On Wed, May 13, 2015 at 8:04 AM, Yifan LI <iamyifa...@gmail.com> wrote: > Hi, > > I have some applications finished(but actually failed before), that in > WebUI show > Application myApp is still in progress. > > and, in the eventlog folder, there are several log files like this: > > app-20150512***.inprogress > > So, I am wondering what the “inprogress” means… > > Thanks! :) > > > Best, > Yifan LI > > > > > >
