Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Mich Talebzadeh
Thanks Bjorn, What are the differences and the functionality Jupyerlab brings in on top of Jupyter notebook? view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Bjørn Jørgensen
Jupyter notebook is replaced with jupyterlab :) man. 5. sep. 2022 kl. 21:10 skrev Holden Karau : > > > On Mon, Sep 5, 2022 at 9:00 AM Mich Talebzadeh > wrote: > >> Thanks for that. >> >> How do you rate the performance of Jupyter W/Spark on K8s compared to the >> same on a cluster of VMs

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
On Mon, Sep 5, 2022 at 9:00 AM Mich Talebzadeh wrote: > Thanks for that. > > How do you rate the performance of Jupyter W/Spark on K8s compared to the > same on a cluster of VMs (example Dataproc). > > Also somehow a related question (may be naive as well). For example, > Google offers a lot of

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Mich Talebzadeh
Thanks for that. How do you rate the performance of Jupyter W/Spark on K8s compared to the same on a cluster of VMs (example Dataproc). Also somehow a related question (may be naive as well). For example, Google offers a lot of standard ML libraries for example built into a data warehouse like

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
I’ve run Jupyter w/Spark on K8s, haven’t tried it with Dataproc personally. The Spark K8s pod scheduler is now more pluggable for Yunikorn and Volcano can be used with less effort. On Mon, Sep 5, 2022 at 7:44 AM Mich Talebzadeh wrote: > > Hi, > > > Has anyone got experience of running Jupyter

Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Mich Talebzadeh
Hi, Has anyone got experience of running Jupyter on dataproc versus Jupyter notebook on GKE (k8). I have not looked at this for a while but my understanding is that Spark on GKE/k8 is not yet performed. This is classic Spark with Python/Pyspark. Also I would like to know the state of spark