Re: Spark on K8s : property simillar to yarn.max.application.attempt

[Mich Talebzadeh]

Not as far as I know. If your driver pod fails, then you need to resubmit
the job. I cannot see what else can be done?


HTH


   view my Linkedin profile




*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Fri, 4 Feb 2022 at 10:22, Pralabh Kumar  wrote:

> Hi Spark Team
>
> I am running spark on K8s and looking for a
> property/mechanism similar to  yarn.max.application.attempt . I know this
> is not really a spark question , but i thought if anyone have faced the
> similar issue,
>
> Basically I want if my driver pod fails , it should be retried on a
> different machine . Is there a way to do the same .
>
> Regards
> Pralabh Kumar
>

Spark on K8s : property simillar to yarn.max.application.attempt

[Pralabh Kumar]

Hi Spark Team

I am running spark on K8s and looking for a
property/mechanism similar to  yarn.max.application.attempt . I know this
is not really a spark question , but i thought if anyone have faced the
similar issue,

Basically I want if my driver pod fails , it should be retried on a
different machine . Is there a way to do the same .

Regards
Pralabh Kumar