Re: applications are still in progress?

2015-05-18 Thread Imran Rashid 
Most likely, you never call sc.stop().

Note that in 1.4, this will happen for you automatically in a shutdown
hook, taken care of by https://issues.apache.org/jira/browse/SPARK-3090

On Wed, May 13, 2015 at 8:04 AM, Yifan LI  wrote:

> Hi,
>
> I have some applications finished(but actually failed before), that in
> WebUI show
> Application myApp is still in progress.
>
> and, in the eventlog folder, there are several log files like this:
>
> app-20150512***.inprogress
>
> So, I am wondering what the “inprogress” means…
>
> Thanks! :)
>
>
> Best,
> Yifan LI
>
>
>
>
>
>

applications are still in progress?

2015-05-13 Thread Yifan LI 
Hi,

I have some applications finished(but actually failed before), that in WebUI 
show
Application myApp is still in progress.

and, in the eventlog folder, there are several log files like this:

app-20150512***.inprogress

So, I am wondering what the “inprogress” means…

Thanks! :)


Best,
Yifan LI