Re: Failed jobs show up as succeeded in YARN?

2014-08-19 Thread Arun Ahuja 
We see this all the time as well, I don't the believe there is much a
relationship before the Spark job status and the what Yarn shows as the
status.


On Mon, Aug 11, 2014 at 3:17 PM, Shay Rojansky  wrote:

> Spark 1.0.2, Python, Cloudera 5.1 (Hadoop 2.3.0)
>
> It seems that Python jobs I'm sending to YARN show up as succeeded even if
> they failed... Am I doing something wrong, is this a known issue?
>
> Thanks,
>
> Shay
>

Failed jobs show up as succeeded in YARN?

2014-08-11 Thread Shay Rojansky 
Spark 1.0.2, Python, Cloudera 5.1 (Hadoop 2.3.0)

It seems that Python jobs I'm sending to YARN show up as succeeded even if
they failed... Am I doing something wrong, is this a known issue?

Thanks,

Shay