Pyspark cluster mode on standalone deployment

[خالد القحطاني]

Hi
Can I deploy my Pyspark application on standalone cluster with cluster mode

I believe it was not possible to do that but I searched all the
documentation and I did not find it.

My Spark standalone cluster version is 3.3.1

Re: pyspark cluster mode on standalone deployment

[Ofer Eliassaf]

anyone? please? is this getting any priority?

On Tue, Sep 27, 2016 at 3:38 PM, Ofer Eliassaf 
wrote:

> Is there any plan to support python spark running in "cluster mode" on a
> standalone deployment?
>
> There is this famous survey mentioning that more than 50% of the users are
> using the standalone configuration.
> Making pyspark work in cluster mode with standalone will help a lot for
> high availabilty in python spark.
>
> Cuurently only Yarn deployment supports it. Bringing the huge Yarn
> installation just for this feature is not fun at all
>
> Does someone have time estimation for this?
>
>
>
> --
> Regards,
> Ofer Eliassaf
>



-- 
Regards,
Ofer Eliassaf

pyspark cluster mode on standalone deployment

[Ofer Eliassaf]

Is there any plan to support python spark running in "cluster mode" on a
standalone deployment?

There is this famous survey mentioning that more than 50% of the users are
using the standalone configuration.
Making pyspark work in cluster mode with standalone will help a lot for
high availabilty in python spark.

Cuurently only Yarn deployment supports it. Bringing the huge Yarn
installation just for this feature is not fun at all

Does someone have time estimation for this?



-- 
Regards,
Ofer Eliassaf