Re: Jupyter notebook on Dataproc versus GKE

2022-09-14 Thread Bjørn Jørgensen
Mitch: Why I'm switching from Jupyter Notebooks to JupyterLab...Such a better experience! DegreeTutors.com tir. 6. sep. 2022 kl. 20:28 skrev Holden Karau : > I’ve used Argo for K8s scheduling, for awhile it’s also what Kubeflow used > underneath for scheduling. > >

Re: Jupyter notebook on Dataproc versus GKE

2022-09-06 Thread Holden Karau
I’ve used Argo for K8s scheduling, for awhile it’s also what Kubeflow used underneath for scheduling. On Tue, Sep 6, 2022 at 10:01 AM Mich Talebzadeh wrote: > Thank you all. > > Has anyone used Argo for k8s scheduler by any chance? > > On Tue, 6 Sep 2022 at 13:41, Bjørn Jørgensen > wrote: > >>

Re: Jupyter notebook on Dataproc versus GKE

2022-09-06 Thread Mich Talebzadeh
Thank you all. Has anyone used Argo for k8s scheduler by any chance? On Tue, 6 Sep 2022 at 13:41, Bjørn Jørgensen wrote: > "*JupyterLab is the next-generation user interface for Project Jupyter > offering all the familiar building blocks of the classic Jupyter Notebook > (notebook, terminal, te

Re: Jupyter notebook on Dataproc versus GKE

2022-09-06 Thread Bjørn Jørgensen
"*JupyterLab is the next-generation user interface for Project Jupyter offering all the familiar building blocks of the classic Jupyter Notebook (notebook, terminal, text editor, file browser, rich outputs, etc.) in a flexible and powerful user interface.*" https://github.com/jupyterlab/jupyterlab

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Mich Talebzadeh
Thanks Bjorn, What are the differences and the functionality Jupyerlab brings in on top of Jupyter notebook? view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and a

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Bjørn Jørgensen
Jupyter notebook is replaced with jupyterlab :) man. 5. sep. 2022 kl. 21:10 skrev Holden Karau : > > > On Mon, Sep 5, 2022 at 9:00 AM Mich Talebzadeh > wrote: > >> Thanks for that. >> >> How do you rate the performance of Jupyter W/Spark on K8s compared to the >> same on a cluster of VMs (examp

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
On Mon, Sep 5, 2022 at 9:00 AM Mich Talebzadeh wrote: > Thanks for that. > > How do you rate the performance of Jupyter W/Spark on K8s compared to the > same on a cluster of VMs (example Dataproc). > > Also somehow a related question (may be naive as well). For example, > Google offers a lot of

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Mich Talebzadeh
Thanks for that. How do you rate the performance of Jupyter W/Spark on K8s compared to the same on a cluster of VMs (example Dataproc). Also somehow a related question (may be naive as well). For example, Google offers a lot of standard ML libraries for example built into a data warehouse like B

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
I’ve run Jupyter w/Spark on K8s, haven’t tried it with Dataproc personally. The Spark K8s pod scheduler is now more pluggable for Yunikorn and Volcano can be used with less effort. On Mon, Sep 5, 2022 at 7:44 AM Mich Talebzadeh wrote: > > Hi, > > > Has anyone got experience of running Jupyter o

Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Mich Talebzadeh
Hi, Has anyone got experience of running Jupyter on dataproc versus Jupyter notebook on GKE (k8). I have not looked at this for a while but my understanding is that Spark on GKE/k8 is not yet performed. This is classic Spark with Python/Pyspark. Also I would like to know the state of spark wi