Re: Spark on Kube (virtua) coffee/tea/pop times

Hi all, Has there been any progress on the item list summarised by Holden namely - Inter-Pod security, istio + mTLS - Sidecar management - Docker Images - Add links to more related images - - Helm links - Data Locality concerns - Upgrading Spark Versions - Performance

Re: Spark on Kube (virtua) coffee/tea/pop times

Hi All, First thanks to Holden for organising this open discussion and exchange of ideas. I must apologize for problems with my microphone. Hopefully it should not happen again.. >From my own commercial experience with k8s, mainly Google GKE, there is a main concern that Spark on GKE is work in

Re: Spark on Kube (virtua) coffee/tea/pop times

Some general issues we found common ground around: Inter-Pod security, istio + mTLS Sidecar management Docker Images Add links to more related images - Helm links Data Locality concerns Upgrading Spark Versions Performance issues Thanks to everyone who was able to make the informal coffee chat

Re: Spark on Kube (virtua) coffee/tea/pop times

Great looking forward to it Mich view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other

Re: Spark on Kube (virtua) coffee/tea/pop times

Ok so the first iteration of this is booked: Spark on Kube Coffee Chats Sunday, Feb 12 · 6–7 PM pacific time Google Meet joining info Video call link: https://meet.google.com/wge-tzzd-uyj Assuming that all goes well I’ll send out another doodle pole after this one for the folks who could not

Re: 自动回复: Re: Spark on Kube (virtua) coffee/tea/pop times

Hi, Sounds like we are repeatedly getting out of office messages in Chinese from this member. Is there any way an admin disables this account To save usfrom being spammed? Thanks view my Linkedin profile

Re: Spark on Kube (virtua) coffee/tea/pop times

That sounds like a good plan Holden! Let us go for it view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction

Re: Spark on Kube (virtua) coffee/tea/pop times

My thought here was that it's more focused on getting to understand each other's goals / priorities and less solving any specific problem. For example, I know that some folks running on EKS have different priorities than folks running on-prem. We might (later on) make a roadmap doc if that seems

Re: Spark on Kube (virtua) coffee/tea/pop times

Hi all, Is this going to be a brainstorming meeting or there will be a prior agenda to work around it? thanks view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any

Re: Spark on Kube (virtua) coffee/tea/pop times

Ok Colin thanks for clarification view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other

Re: Spark on Kube (virtua) coffee/tea/pop times

I'm sorry you misunderstood. The context is migrating jobs to Spark on k8s. On Wed, Feb 8, 2023, 8:31 AM Mich Talebzadeh wrote: > Hi Colin, > > Thanks for your reply. > > > I think both Yarn and Kubernetes are cluster managers plus Standalone and > Remotely Mesos. So I gather this discussion

Re: Spark on Kube (virtua) coffee/tea/pop times

Ok y'all so it looks like the majority of interested folks are in pacific timezone with a few in other north american and european timezones. So I've made a doodle with a lot of pacific teams for next week https://doodle.com/meeting/participate/id/e16z3MGa and I was thinking I'll make another

Re: Spark on Kube (virtua) coffee/tea/pop times

Hi Colin, Thanks for your reply. I think both Yarn and Kubernetes are cluster managers plus Standalone and Remotely Mesos. So I gather this discussion will focus on Spark on k8s unless I am mistaken. HTH, Mich view my Linkedin profile

Re: Spark on Kube (virtua) coffee/tea/pop times

Cloud or non cloud. Yarn, etc. On Wed, Feb 8, 2023, 7:57 AM Mich Talebzadeh wrote: > Hi Colin, > > Environments meaning different (cloud) vendors or hosts? > > > >view my Linkedin profile > > > >

Re: Spark on Kube (virtua) coffee/tea/pop times

Hi Colin, Environments meaning different (cloud) vendors or hosts? view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage

Re: Spark on Kube (virtua) coffee/tea/pop times

Please count me in . Can we have spark on k8s with spark-connect feature covered? On Wed, 8 Feb 2023 at 10:03, Kirti Ruge wrote: > Greetings everyone, > I would love to be part of this session. > IST > > > On Wed, 8 Feb 2023 at 9:13 AM, Colin Williams < > colin.williams.seat...@gmail.com>

Re: Spark on Kube (virtua) coffee/tea/pop times

Greetings everyone, I would love to be part of this session. IST On Wed, 8 Feb 2023 at 9:13 AM, Colin Williams < colin.williams.seat...@gmail.com> wrote: > I wouldn't mind attending or viewing a recording depending on > availability. I'm interested in challenges and solutions to porting Spark >

Re: Spark on Kube (virtua) coffee/tea/pop times

I wouldn't mind attending or viewing a recording depending on availability. I'm interested in challenges and solutions to porting Spark jobs between environments. On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov wrote: > Hello, > > I am also interested, please add me to the conf. > > ср, 8 февр.

Re: Spark on Kube (virtua) coffee/tea/pop times

Hello, I am also interested, please add me to the conf. ср, 8 февр. 2023 г., 07:21 Jayabindu Singh : > Greetings everyone! > I am super new to this group and currently leading some work to deploy > spark on k8 for my company o9 Solutions. > I would love to join the discussion. > I am in PST. >

Re: Spark on Kube (virtua) coffee/tea/pop times

Greetings everyone!I am super new to this group and currently leading some work to deploy spark on k8 for my company o9 Solutions.I would love to join the discussion.I am in PST.RegardsJaySent from my iPhoneOn Feb 7, 2023, at 3:57 PM, Mich Talebzadeh wrote:Could be interesting. Need to summarise

Re: Spark on Kube (virtua) coffee/tea/pop times

Could be interesting. Need to summarise where we are with Spark on k8s and what market demands. My personal experience with Volcano was not that impressive 樂. So may be a summary will do.where we are currently with spark on k8s I am on Greenwich Mean Time but I can take part in late sessions if

Re: Spark on Kube (virtua) coffee/tea/pop times

Awesome, count me in! PST On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo wrote: > I'm Central US time (AKA UTC -6:00) > > On Tue, Feb 7, 2023 at 5:32 PM Holden Karau wrote: > > > > Awesome, I guess I should have asked folks for timezones that they’re in. > > > > On Tue, Feb 7, 2023 at 3:30 PM

Re: Spark on Kube (virtua) coffee/tea/pop times

Woohoo, Holden! I’m in (hopefully my schedule allows me) - PST. On Tue, Feb 7, 2023 at 15:34 Andrew Melo wrote: > I'm Central US time (AKA UTC -6:00) > > On Tue, Feb 7, 2023 at 5:32 PM Holden Karau wrote: > > > > Awesome, I guess I should have asked folks for timezones that they’re in. > > >

Re: Spark on Kube (virtua) coffee/tea/pop times

I'm Central US time (AKA UTC -6:00) On Tue, Feb 7, 2023 at 5:32 PM Holden Karau wrote: > > Awesome, I guess I should have asked folks for timezones that they’re in. > > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo wrote: >> >> Hello Holden, >> >> We are interested in Spark on k8s and would like

Re: Spark on Kube (virtua) coffee/tea/pop times

Interested, in PST Il giorno mar 7 feb 2023 alle ore 15:32 Holden Karau ha scritto: > Awesome, I guess I should have asked folks for timezones that they’re in. > > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo wrote: > >> Hello Holden, >> >> We are interested in Spark on k8s and would like the

Re: Spark on Kube (virtua) coffee/tea/pop times

Awesome, I guess I should have asked folks for timezones that they’re in. On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo wrote: > Hello Holden, > > We are interested in Spark on k8s and would like the opportunity to > speak with devs about what we're looking for slash better ways to use > spark. >

Re: Spark on Kube (virtua) coffee/tea/pop times

Hello Holden, We are interested in Spark on k8s and would like the opportunity to speak with devs about what we're looking for slash better ways to use spark. Thanks! Andrew On Tue, Feb 7, 2023 at 5:24 PM Holden Karau wrote: > > Hi Folks, > > It seems like we could maybe use some additional

Spark on Kube (virtua) coffee/tea/pop times

Hi Folks, It seems like we could maybe use some additional shared context around Spark on Kube so I’d like to try and schedule a virtual coffee session. Who all would be interested in virtual adventures around Spark on Kube development? No pressure if the idea of hanging out in a virtual chat