Re: Spark on Kube (virtua) coffee/tea/pop times

2023-06-12 Thread Mich Talebzadeh
Hi all,

Has there been any progress on the item list summarised by Holden namely

   - Inter-Pod security, istio + mTLS
   - Sidecar management
   - Docker Images
   - Add links to more related images
   - - Helm links
   - Data Locality concerns
   - Upgrading  Spark Versions
   - Performance issues


I may have missed some context.

Thanks

Mich Talebzadeh,
Lead Solutions Architect/Engineering Lead
Palantir Technologies Limited
London
United Kingdom


   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Mon, 13 Feb 2023 at 08:24, Holden Karau  wrote:

> Some general issues we found common ground around:
>
> Inter-Pod security, istio + mTLS
> Sidecar management
> Docker Images
> Add links to more related images
> - Helm links
> Data Locality concerns
> Upgrading  Spark Versions
> Performance issues
>
> Thanks to everyone who was able to make the informal coffee chat
>
> I'll try and schedule another one at a more European friendly time so that
> we can all get to chat as well.
>
> On Fri, Feb 10, 2023 at 1:08 PM Mich Talebzadeh 
> wrote:
>
>> Great looking forward to it
>>
>> Mich
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Fri, 10 Feb 2023 at 18:58, Holden Karau  wrote:
>>
>>> Ok so the first iteration of this is booked:
>>>
>>>
>>> Spark on Kube Coffee Chats
>>> Sunday, Feb 12 · 6–7 PM pacific time
>>> Google Meet joining info
>>> Video call link: https://meet.google.com/wge-tzzd-uyj
>>>
>>> Assuming that all goes well I’ll send out another doodle pole after this
>>> one for the folks who could not make this one.
>>>
>>> Looking forward to catching up with y’all :) No prep work necessary but
>>> if anyone wants to write down a brief like two sentence blurb about their
>>> goals for Spark on Kube was thinking we might go around the virtual room
>>> sharing that as our kicking off point for this coffee meeting :)
>>>
>>>
>>> On Wed, Feb 8, 2023 at 12:27 PM Mich Talebzadeh <
>>> mich.talebza...@gmail.com> wrote:
>>>
 That sounds like a good plan Holden!


 Let us go for it


view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* Use it at your own risk. Any and all responsibility for
 any loss, damage or destruction of data or any other property which may
 arise from relying on this email's technical content is explicitly
 disclaimed. The author will in no case be liable for any monetary damages
 arising from such loss, damage or destruction.




 On Wed, 8 Feb 2023 at 20:12, Holden Karau  wrote:

> My thought here was that it's more focused on getting to understand
> each other's goals / priorities and less solving any specific problem.
>
> For example, I know that some folks running on EKS have different
> priorities than folks running on-prem.
>
> We might (later on) make a roadmap doc if that seems necessary, but
> I'm hoping that just an understanding of folks priorities and challenges
> will make it easier for us to all collaborate.
>
> On Wed, Feb 8, 2023 at 11:47 AM Mich Talebzadeh <
> mich.talebza...@gmail.com> wrote:
>
>> Hi all,
>>
>> Is this going to be a brainstorming meeting or there will be a prior
>> agenda to work around it?
>>
>> thanks
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility
>> for any loss, damage or destruction of data or any other property which 
>> may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Feb 2023 at 18:33, Mich Talebzadeh <
>> mich.talebza...@gmail.com> 

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-13 Thread Mich Talebzadeh
Hi All,

First thanks to Holden for organising this open discussion and exchange of
ideas. I must apologize for problems with my microphone. Hopefully it
should not happen again..

>From my own commercial experience  with k8s, mainly Google GKE, there is a
main concern that Spark on GKE is work in progress and not on-par with
Spark on hadoop/yarn example Spark on Google Dataproc. I don't think this
statement is longer true as Spark on K8s has since matured. Albeit the
performance is not 100% there. The commercial motivation for Spark on K9s
is reduction in cost. The assumption is that  it would be cheaper to run
Spark on GKE without Dataproc. Not to forget that there are other non-spark
applications and datatores running on K8s/GKE. So it makes sense to improve
Spark performance on K8s. Another motivation is to break down monolithic
applications into microservices and from the point of ETL/ELT Spark plays a
considerable role.

For those who are still using Spark on Hadoop/yarn, if I recall Colin
mentioned, Google has thought that Spark is important enough to allow the
migration path from Spark on dataproc to  Run a Spark job on Dataproc on
Google Kubernetes Engine. I am not sure other Cloud vendors have been
through this journey. Maybe some members will clarify this.


With regard to authentication there is this workload identity that has
replaced the clumsy secrets file that compromised security and was
available to all nodes of K8s cluster. I am not sure how Spark can
integrate with workload identity. The authentication is at the pod level
rather than node level.




Thanks


   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Mon, 13 Feb 2023 at 08:24, Holden Karau  wrote:

> Some general issues we found common ground around:
>
> Inter-Pod security, istio + mTLS
> Sidecar management
> Docker Images
> Add links to more related images
> - Helm links
> Data Locality concerns
> Upgrading  Spark Versions
> Performance issues
>
> Thanks to everyone who was able to make the informal coffee chat
>
> I'll try and schedule another one at a more European friendly time so that
> we can all get to chat as well.
>
> On Fri, Feb 10, 2023 at 1:08 PM Mich Talebzadeh 
> wrote:
>
>> Great looking forward to it
>>
>> Mich
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Fri, 10 Feb 2023 at 18:58, Holden Karau  wrote:
>>
>>> Ok so the first iteration of this is booked:
>>>
>>>
>>> Spark on Kube Coffee Chats
>>> Sunday, Feb 12 · 6–7 PM pacific time
>>> Google Meet joining info
>>> Video call link: https://meet.google.com/wge-tzzd-uyj
>>>
>>> Assuming that all goes well I’ll send out another doodle pole after this
>>> one for the folks who could not make this one.
>>>
>>> Looking forward to catching up with y’all :) No prep work necessary but
>>> if anyone wants to write down a brief like two sentence blurb about their
>>> goals for Spark on Kube was thinking we might go around the virtual room
>>> sharing that as our kicking off point for this coffee meeting :)
>>>
>>>
>>> On Wed, Feb 8, 2023 at 12:27 PM Mich Talebzadeh <
>>> mich.talebza...@gmail.com> wrote:
>>>
 That sounds like a good plan Holden!


 Let us go for it


view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* Use it at your own risk. Any and all responsibility for
 any loss, damage or destruction of data or any other property which may
 arise from relying on this email's technical content is explicitly
 disclaimed. The author will in no case be liable for any monetary damages
 arising from such loss, damage or destruction.




 On Wed, 8 Feb 2023 at 20:12, Holden Karau  

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-13 Thread Holden Karau
Some general issues we found common ground around:

Inter-Pod security, istio + mTLS
Sidecar management
Docker Images
Add links to more related images
- Helm links
Data Locality concerns
Upgrading  Spark Versions
Performance issues

Thanks to everyone who was able to make the informal coffee chat

I'll try and schedule another one at a more European friendly time so that
we can all get to chat as well.

On Fri, Feb 10, 2023 at 1:08 PM Mich Talebzadeh 
wrote:

> Great looking forward to it
>
> Mich
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Fri, 10 Feb 2023 at 18:58, Holden Karau  wrote:
>
>> Ok so the first iteration of this is booked:
>>
>>
>> Spark on Kube Coffee Chats
>> Sunday, Feb 12 · 6–7 PM pacific time
>> Google Meet joining info
>> Video call link: https://meet.google.com/wge-tzzd-uyj
>>
>> Assuming that all goes well I’ll send out another doodle pole after this
>> one for the folks who could not make this one.
>>
>> Looking forward to catching up with y’all :) No prep work necessary but
>> if anyone wants to write down a brief like two sentence blurb about their
>> goals for Spark on Kube was thinking we might go around the virtual room
>> sharing that as our kicking off point for this coffee meeting :)
>>
>>
>> On Wed, Feb 8, 2023 at 12:27 PM Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>>> That sounds like a good plan Holden!
>>>
>>>
>>> Let us go for it
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Wed, 8 Feb 2023 at 20:12, Holden Karau  wrote:
>>>
 My thought here was that it's more focused on getting to understand
 each other's goals / priorities and less solving any specific problem.

 For example, I know that some folks running on EKS have different
 priorities than folks running on-prem.

 We might (later on) make a roadmap doc if that seems necessary, but I'm
 hoping that just an understanding of folks priorities and challenges will
 make it easier for us to all collaborate.

 On Wed, Feb 8, 2023 at 11:47 AM Mich Talebzadeh <
 mich.talebza...@gmail.com> wrote:

> Hi all,
>
> Is this going to be a brainstorming meeting or there will be a prior
> agenda to work around it?
>
> thanks
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for
> any loss, damage or destruction of data or any other property which may
> arise from relying on this email's technical content is explicitly
> disclaimed. The author will in no case be liable for any monetary damages
> arising from such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Feb 2023 at 18:33, Mich Talebzadeh <
> mich.talebza...@gmail.com> wrote:
>
>> Ok Colin thanks for clarification
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility
>> for any loss, damage or destruction of data or any other property which 
>> may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Feb 2023 at 18:08, Colin Williams <
>> colin.williams.seat...@gmail.com> wrote:
>>
>>> I'm sorry you misunderstood.  The context is migrating jobs to Spark
>>> on k8s.
>>>
>>> On Wed, Feb 8, 2023, 8:31 AM Mich Talebzadeh <
>>> mich.talebza...@gmail.com> wrote:
>>>
 Hi Colin,

 Thanks for your reply.


 I think both Yarn and Kubernetes are cluster managers plus
 

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-10 Thread Mich Talebzadeh
Great looking forward to it

Mich



   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Fri, 10 Feb 2023 at 18:58, Holden Karau  wrote:

> Ok so the first iteration of this is booked:
>
>
> Spark on Kube Coffee Chats
> Sunday, Feb 12 · 6–7 PM pacific time
> Google Meet joining info
> Video call link: https://meet.google.com/wge-tzzd-uyj
>
> Assuming that all goes well I’ll send out another doodle pole after this
> one for the folks who could not make this one.
>
> Looking forward to catching up with y’all :) No prep work necessary but if
> anyone wants to write down a brief like two sentence blurb about their
> goals for Spark on Kube was thinking we might go around the virtual room
> sharing that as our kicking off point for this coffee meeting :)
>
>
> On Wed, Feb 8, 2023 at 12:27 PM Mich Talebzadeh 
> wrote:
>
>> That sounds like a good plan Holden!
>>
>>
>> Let us go for it
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Feb 2023 at 20:12, Holden Karau  wrote:
>>
>>> My thought here was that it's more focused on getting to understand each
>>> other's goals / priorities and less solving any specific problem.
>>>
>>> For example, I know that some folks running on EKS have different
>>> priorities than folks running on-prem.
>>>
>>> We might (later on) make a roadmap doc if that seems necessary, but I'm
>>> hoping that just an understanding of folks priorities and challenges will
>>> make it easier for us to all collaborate.
>>>
>>> On Wed, Feb 8, 2023 at 11:47 AM Mich Talebzadeh <
>>> mich.talebza...@gmail.com> wrote:
>>>
 Hi all,

 Is this going to be a brainstorming meeting or there will be a prior
 agenda to work around it?

 thanks



view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* Use it at your own risk. Any and all responsibility for
 any loss, damage or destruction of data or any other property which may
 arise from relying on this email's technical content is explicitly
 disclaimed. The author will in no case be liable for any monetary damages
 arising from such loss, damage or destruction.




 On Wed, 8 Feb 2023 at 18:33, Mich Talebzadeh 
 wrote:

> Ok Colin thanks for clarification
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for
> any loss, damage or destruction of data or any other property which may
> arise from relying on this email's technical content is explicitly
> disclaimed. The author will in no case be liable for any monetary damages
> arising from such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Feb 2023 at 18:08, Colin Williams <
> colin.williams.seat...@gmail.com> wrote:
>
>> I'm sorry you misunderstood.  The context is migrating jobs to Spark
>> on k8s.
>>
>> On Wed, Feb 8, 2023, 8:31 AM Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>>> Hi Colin,
>>>
>>> Thanks for your reply.
>>>
>>>
>>> I think both Yarn and Kubernetes are cluster managers plus
>>> Standalone and Remotely Mesos. So I gather this discussion will focus on
>>> Spark on k8s unless I am mistaken.
>>>
>>>
>>> HTH,
>>>
>>>
>>> Mich
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility
>>> for any loss, damage or destruction of data or any other property which 
>>> may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for 

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-10 Thread Holden Karau
Ok so the first iteration of this is booked:


Spark on Kube Coffee Chats
Sunday, Feb 12 · 6–7 PM pacific time
Google Meet joining info
Video call link: https://meet.google.com/wge-tzzd-uyj

Assuming that all goes well I’ll send out another doodle pole after this
one for the folks who could not make this one.

Looking forward to catching up with y’all :) No prep work necessary but if
anyone wants to write down a brief like two sentence blurb about their
goals for Spark on Kube was thinking we might go around the virtual room
sharing that as our kicking off point for this coffee meeting :)


On Wed, Feb 8, 2023 at 12:27 PM Mich Talebzadeh 
wrote:

> That sounds like a good plan Holden!
>
>
> Let us go for it
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Feb 2023 at 20:12, Holden Karau  wrote:
>
>> My thought here was that it's more focused on getting to understand each
>> other's goals / priorities and less solving any specific problem.
>>
>> For example, I know that some folks running on EKS have different
>> priorities than folks running on-prem.
>>
>> We might (later on) make a roadmap doc if that seems necessary, but I'm
>> hoping that just an understanding of folks priorities and challenges will
>> make it easier for us to all collaborate.
>>
>> On Wed, Feb 8, 2023 at 11:47 AM Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>>> Hi all,
>>>
>>> Is this going to be a brainstorming meeting or there will be a prior
>>> agenda to work around it?
>>>
>>> thanks
>>>
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Wed, 8 Feb 2023 at 18:33, Mich Talebzadeh 
>>> wrote:
>>>
 Ok Colin thanks for clarification



view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* Use it at your own risk. Any and all responsibility for
 any loss, damage or destruction of data or any other property which may
 arise from relying on this email's technical content is explicitly
 disclaimed. The author will in no case be liable for any monetary damages
 arising from such loss, damage or destruction.




 On Wed, 8 Feb 2023 at 18:08, Colin Williams <
 colin.williams.seat...@gmail.com> wrote:

> I'm sorry you misunderstood.  The context is migrating jobs to Spark
> on k8s.
>
> On Wed, Feb 8, 2023, 8:31 AM Mich Talebzadeh <
> mich.talebza...@gmail.com> wrote:
>
>> Hi Colin,
>>
>> Thanks for your reply.
>>
>>
>> I think both Yarn and Kubernetes are cluster managers plus Standalone
>> and Remotely Mesos. So I gather this discussion will focus on Spark on 
>> k8s
>> unless I am mistaken.
>>
>>
>> HTH,
>>
>>
>> Mich
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility
>> for any loss, damage or destruction of data or any other property which 
>> may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Feb 2023 at 16:02, Colin Williams <
>> colin.williams.seat...@gmail.com> wrote:
>>
>>> Cloud or non cloud. Yarn, etc.
>>>
>>> On Wed, Feb 8, 2023, 7:57 AM Mich Talebzadeh <
>>> mich.talebza...@gmail.com> wrote:
>>>
 Hi Colin,

 Environments meaning different (cloud)  vendors or hosts?



view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* 

Re: 自动回复: Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Mich Talebzadeh
Hi,

Sounds like we are repeatedly getting out of office messages in Chinese
from this member. Is there any way an admin disables this account To save
usfrom  being spammed?


Thanks


   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Wed, 8 Feb 2023 at 19:47, xyqiao  wrote:

> 这是来自QQ邮箱的假期自动回复邮件。
>
> 您好,我最近正在休假中,无法亲自回复您的邮件。我将在假期结束后,尽快给您回复。
>


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Mich Talebzadeh
That sounds like a good plan Holden!


Let us go for it


   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Wed, 8 Feb 2023 at 20:12, Holden Karau  wrote:

> My thought here was that it's more focused on getting to understand each
> other's goals / priorities and less solving any specific problem.
>
> For example, I know that some folks running on EKS have different
> priorities than folks running on-prem.
>
> We might (later on) make a roadmap doc if that seems necessary, but I'm
> hoping that just an understanding of folks priorities and challenges will
> make it easier for us to all collaborate.
>
> On Wed, Feb 8, 2023 at 11:47 AM Mich Talebzadeh 
> wrote:
>
>> Hi all,
>>
>> Is this going to be a brainstorming meeting or there will be a prior
>> agenda to work around it?
>>
>> thanks
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Feb 2023 at 18:33, Mich Talebzadeh 
>> wrote:
>>
>>> Ok Colin thanks for clarification
>>>
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Wed, 8 Feb 2023 at 18:08, Colin Williams <
>>> colin.williams.seat...@gmail.com> wrote:
>>>
 I'm sorry you misunderstood.  The context is migrating jobs to Spark on
 k8s.

 On Wed, Feb 8, 2023, 8:31 AM Mich Talebzadeh 
 wrote:

> Hi Colin,
>
> Thanks for your reply.
>
>
> I think both Yarn and Kubernetes are cluster managers plus Standalone
> and Remotely Mesos. So I gather this discussion will focus on Spark on k8s
> unless I am mistaken.
>
>
> HTH,
>
>
> Mich
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for
> any loss, damage or destruction of data or any other property which may
> arise from relying on this email's technical content is explicitly
> disclaimed. The author will in no case be liable for any monetary damages
> arising from such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Feb 2023 at 16:02, Colin Williams <
> colin.williams.seat...@gmail.com> wrote:
>
>> Cloud or non cloud. Yarn, etc.
>>
>> On Wed, Feb 8, 2023, 7:57 AM Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>>> Hi Colin,
>>>
>>> Environments meaning different (cloud)  vendors or hosts?
>>>
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility
>>> for any loss, damage or destruction of data or any other property which 
>>> may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary 
>>> damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Wed, 8 Feb 2023 at 03:42, Colin Williams <
>>> colin.williams.seat...@gmail.com> wrote:
>>>
 I wouldn't mind attending or viewing a recording depending on
 availability. I'm interested in challenges and solutions to porting 
 Spark
 jobs between environments.

 On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov <
 bolshakov.de...@gmail.com> wrote:

> Hello,
>
> I am also interested, 

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Holden Karau
My thought here was that it's more focused on getting to understand each
other's goals / priorities and less solving any specific problem.

For example, I know that some folks running on EKS have different
priorities than folks running on-prem.

We might (later on) make a roadmap doc if that seems necessary, but I'm
hoping that just an understanding of folks priorities and challenges will
make it easier for us to all collaborate.

On Wed, Feb 8, 2023 at 11:47 AM Mich Talebzadeh 
wrote:

> Hi all,
>
> Is this going to be a brainstorming meeting or there will be a prior
> agenda to work around it?
>
> thanks
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Feb 2023 at 18:33, Mich Talebzadeh 
> wrote:
>
>> Ok Colin thanks for clarification
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Feb 2023 at 18:08, Colin Williams <
>> colin.williams.seat...@gmail.com> wrote:
>>
>>> I'm sorry you misunderstood.  The context is migrating jobs to Spark on
>>> k8s.
>>>
>>> On Wed, Feb 8, 2023, 8:31 AM Mich Talebzadeh 
>>> wrote:
>>>
 Hi Colin,

 Thanks for your reply.


 I think both Yarn and Kubernetes are cluster managers plus Standalone
 and Remotely Mesos. So I gather this discussion will focus on Spark on k8s
 unless I am mistaken.


 HTH,


 Mich


view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* Use it at your own risk. Any and all responsibility for
 any loss, damage or destruction of data or any other property which may
 arise from relying on this email's technical content is explicitly
 disclaimed. The author will in no case be liable for any monetary damages
 arising from such loss, damage or destruction.




 On Wed, 8 Feb 2023 at 16:02, Colin Williams <
 colin.williams.seat...@gmail.com> wrote:

> Cloud or non cloud. Yarn, etc.
>
> On Wed, Feb 8, 2023, 7:57 AM Mich Talebzadeh <
> mich.talebza...@gmail.com> wrote:
>
>> Hi Colin,
>>
>> Environments meaning different (cloud)  vendors or hosts?
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility
>> for any loss, damage or destruction of data or any other property which 
>> may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Feb 2023 at 03:42, Colin Williams <
>> colin.williams.seat...@gmail.com> wrote:
>>
>>> I wouldn't mind attending or viewing a recording depending on
>>> availability. I'm interested in challenges and solutions to porting 
>>> Spark
>>> jobs between environments.
>>>
>>> On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov <
>>> bolshakov.de...@gmail.com> wrote:
>>>
 Hello,

 I am also interested, please add me to the conf.

 ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :

> Greetings everyone!
> I am super new to this group and currently leading some work to
> deploy spark on k8 for my company o9 Solutions.
> I would love to join the discussion.
> I am in PST.
>
> Regards
> Jay
>
> Sent from my iPhone
>
> On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh <
> mich.talebza...@gmail.com> wrote:
>
> 
> Could be interesting. Need to summarise where we are with Spark on
> k8s and what market demands.
>
> My personal experience with Volcano was not that impressive 樂. So

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Mich Talebzadeh
Hi all,

Is this going to be a brainstorming meeting or there will be a prior agenda
to work around it?

thanks



   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Wed, 8 Feb 2023 at 18:33, Mich Talebzadeh 
wrote:

> Ok Colin thanks for clarification
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Feb 2023 at 18:08, Colin Williams <
> colin.williams.seat...@gmail.com> wrote:
>
>> I'm sorry you misunderstood.  The context is migrating jobs to Spark on
>> k8s.
>>
>> On Wed, Feb 8, 2023, 8:31 AM Mich Talebzadeh 
>> wrote:
>>
>>> Hi Colin,
>>>
>>> Thanks for your reply.
>>>
>>>
>>> I think both Yarn and Kubernetes are cluster managers plus Standalone
>>> and Remotely Mesos. So I gather this discussion will focus on Spark on k8s
>>> unless I am mistaken.
>>>
>>>
>>> HTH,
>>>
>>>
>>> Mich
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Wed, 8 Feb 2023 at 16:02, Colin Williams <
>>> colin.williams.seat...@gmail.com> wrote:
>>>
 Cloud or non cloud. Yarn, etc.

 On Wed, Feb 8, 2023, 7:57 AM Mich Talebzadeh 
 wrote:

> Hi Colin,
>
> Environments meaning different (cloud)  vendors or hosts?
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for
> any loss, damage or destruction of data or any other property which may
> arise from relying on this email's technical content is explicitly
> disclaimed. The author will in no case be liable for any monetary damages
> arising from such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Feb 2023 at 03:42, Colin Williams <
> colin.williams.seat...@gmail.com> wrote:
>
>> I wouldn't mind attending or viewing a recording depending on
>> availability. I'm interested in challenges and solutions to porting Spark
>> jobs between environments.
>>
>> On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov <
>> bolshakov.de...@gmail.com> wrote:
>>
>>> Hello,
>>>
>>> I am also interested, please add me to the conf.
>>>
>>> ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :
>>>
 Greetings everyone!
 I am super new to this group and currently leading some work to
 deploy spark on k8 for my company o9 Solutions.
 I would love to join the discussion.
 I am in PST.

 Regards
 Jay

 Sent from my iPhone

 On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh <
 mich.talebza...@gmail.com> wrote:

 
 Could be interesting. Need to summarise where we are with Spark on
 k8s and what market demands.

 My personal experience with Volcano was not that impressive 樂. So
 may be a summary will do.where we are currently with spark on k8s

 I am on  Greenwich Mean Time but I can take part in late sessions
 if needed


 HTH


view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* Use it at your own risk. Any and all responsibility
 for any loss, damage or destruction of data or any other property 
 which may
 arise from relying on this email's technical content is explicitly
 disclaimed. The author will in 

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Mich Talebzadeh
Ok Colin thanks for clarification



   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Wed, 8 Feb 2023 at 18:08, Colin Williams <
colin.williams.seat...@gmail.com> wrote:

> I'm sorry you misunderstood.  The context is migrating jobs to Spark on
> k8s.
>
> On Wed, Feb 8, 2023, 8:31 AM Mich Talebzadeh 
> wrote:
>
>> Hi Colin,
>>
>> Thanks for your reply.
>>
>>
>> I think both Yarn and Kubernetes are cluster managers plus Standalone and
>> Remotely Mesos. So I gather this discussion will focus on Spark on k8s
>> unless I am mistaken.
>>
>>
>> HTH,
>>
>>
>> Mich
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Feb 2023 at 16:02, Colin Williams <
>> colin.williams.seat...@gmail.com> wrote:
>>
>>> Cloud or non cloud. Yarn, etc.
>>>
>>> On Wed, Feb 8, 2023, 7:57 AM Mich Talebzadeh 
>>> wrote:
>>>
 Hi Colin,

 Environments meaning different (cloud)  vendors or hosts?



view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* Use it at your own risk. Any and all responsibility for
 any loss, damage or destruction of data or any other property which may
 arise from relying on this email's technical content is explicitly
 disclaimed. The author will in no case be liable for any monetary damages
 arising from such loss, damage or destruction.




 On Wed, 8 Feb 2023 at 03:42, Colin Williams <
 colin.williams.seat...@gmail.com> wrote:

> I wouldn't mind attending or viewing a recording depending on
> availability. I'm interested in challenges and solutions to porting Spark
> jobs between environments.
>
> On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov <
> bolshakov.de...@gmail.com> wrote:
>
>> Hello,
>>
>> I am also interested, please add me to the conf.
>>
>> ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :
>>
>>> Greetings everyone!
>>> I am super new to this group and currently leading some work to
>>> deploy spark on k8 for my company o9 Solutions.
>>> I would love to join the discussion.
>>> I am in PST.
>>>
>>> Regards
>>> Jay
>>>
>>> Sent from my iPhone
>>>
>>> On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh <
>>> mich.talebza...@gmail.com> wrote:
>>>
>>> 
>>> Could be interesting. Need to summarise where we are with Spark on
>>> k8s and what market demands.
>>>
>>> My personal experience with Volcano was not that impressive 樂. So
>>> may be a summary will do.where we are currently with spark on k8s
>>>
>>> I am on  Greenwich Mean Time but I can take part in late sessions
>>> if needed
>>>
>>>
>>> HTH
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility
>>> for any loss, damage or destruction of data or any other property which 
>>> may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary 
>>> damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:
>>>
 Awesome, count me in!
 PST

 On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo 
 wrote:

> I'm Central US time (AKA UTC -6:00)
>
> On Tue, Feb 7, 2023 at 5:32 PM Holden Karau 
> wrote:
> >
> > Awesome, I guess I should have asked folks for timezones that
> they’re in.
> >
> > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo <
> andrew.m...@gmail.com> wrote:
> >>
> >> Hello Holden,
> >>
> >> We are interested in Spark on k8s and would like the

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Colin Williams
I'm sorry you misunderstood.  The context is migrating jobs to Spark on k8s.

On Wed, Feb 8, 2023, 8:31 AM Mich Talebzadeh 
wrote:

> Hi Colin,
>
> Thanks for your reply.
>
>
> I think both Yarn and Kubernetes are cluster managers plus Standalone and
> Remotely Mesos. So I gather this discussion will focus on Spark on k8s
> unless I am mistaken.
>
>
> HTH,
>
>
> Mich
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Feb 2023 at 16:02, Colin Williams <
> colin.williams.seat...@gmail.com> wrote:
>
>> Cloud or non cloud. Yarn, etc.
>>
>> On Wed, Feb 8, 2023, 7:57 AM Mich Talebzadeh 
>> wrote:
>>
>>> Hi Colin,
>>>
>>> Environments meaning different (cloud)  vendors or hosts?
>>>
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Wed, 8 Feb 2023 at 03:42, Colin Williams <
>>> colin.williams.seat...@gmail.com> wrote:
>>>
 I wouldn't mind attending or viewing a recording depending on
 availability. I'm interested in challenges and solutions to porting Spark
 jobs between environments.

 On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov <
 bolshakov.de...@gmail.com> wrote:

> Hello,
>
> I am also interested, please add me to the conf.
>
> ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :
>
>> Greetings everyone!
>> I am super new to this group and currently leading some work to
>> deploy spark on k8 for my company o9 Solutions.
>> I would love to join the discussion.
>> I am in PST.
>>
>> Regards
>> Jay
>>
>> Sent from my iPhone
>>
>> On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>> 
>> Could be interesting. Need to summarise where we are with Spark on
>> k8s and what market demands.
>>
>> My personal experience with Volcano was not that impressive 樂. So
>> may be a summary will do.where we are currently with spark on k8s
>>
>> I am on  Greenwich Mean Time but I can take part in late sessions if
>> needed
>>
>>
>> HTH
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility
>> for any loss, damage or destruction of data or any other property which 
>> may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:
>>
>>> Awesome, count me in!
>>> PST
>>>
>>> On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo 
>>> wrote:
>>>
 I'm Central US time (AKA UTC -6:00)

 On Tue, Feb 7, 2023 at 5:32 PM Holden Karau 
 wrote:
 >
 > Awesome, I guess I should have asked folks for timezones that
 they’re in.
 >
 > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
 wrote:
 >>
 >> Hello Holden,
 >>
 >> We are interested in Spark on k8s and would like the opportunity
 to
 >> speak with devs about what we're looking for slash better ways
 to use
 >> spark.
 >>
 >> Thanks!
 >> Andrew
 >>
 >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau <
 hol...@pigscanfly.ca> wrote:
 >> >
 >> > Hi Folks,
 >> >
 >> > It seems like we could maybe use some additional shared
 context around Spark on Kube so I’d like to try and schedule a virtual
 coffee session.
 >> >
 >> > Who all would be interested in virtual adventures around Spark
 on Kube development?
 >> >
 >> > No pressure if the idea of hanging out in a virtual chat with
 coffee and Spark devs does not sound like your 

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Holden Karau
Ok y'all so it looks like the majority of interested folks are in pacific
timezone with a few in other north american and european timezones. So I've
made a doodle with a lot of pacific teams for next week
https://doodle.com/meeting/participate/id/e16z3MGa and I was thinking I'll
make another doodle for the following week with more european friendly
times.
Let me know what folks think :)

On Tue, Feb 7, 2023 at 3:23 PM Holden Karau  wrote:

> Hi Folks,
>
> It seems like we could maybe use some additional shared context around
> Spark on Kube so I’d like to try and schedule a virtual coffee session.
>
> Who all would be interested in virtual adventures around Spark on Kube
> development?
>
> No pressure if the idea of hanging out in a virtual chat with coffee and
> Spark devs does not sound like your thing, just trying to make something
> informal so we can have a better understanding of everyone’s goals here.
>
> Cheers,
>
> Holden :)
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9  
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>


-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  
YouTube Live Streams: https://www.youtube.com/user/holdenkarau


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Mich Talebzadeh
Hi Colin,

Thanks for your reply.


I think both Yarn and Kubernetes are cluster managers plus Standalone and
Remotely Mesos. So I gather this discussion will focus on Spark on k8s
unless I am mistaken.


HTH,


Mich


   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Wed, 8 Feb 2023 at 16:02, Colin Williams <
colin.williams.seat...@gmail.com> wrote:

> Cloud or non cloud. Yarn, etc.
>
> On Wed, Feb 8, 2023, 7:57 AM Mich Talebzadeh 
> wrote:
>
>> Hi Colin,
>>
>> Environments meaning different (cloud)  vendors or hosts?
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Feb 2023 at 03:42, Colin Williams <
>> colin.williams.seat...@gmail.com> wrote:
>>
>>> I wouldn't mind attending or viewing a recording depending on
>>> availability. I'm interested in challenges and solutions to porting Spark
>>> jobs between environments.
>>>
>>> On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov <
>>> bolshakov.de...@gmail.com> wrote:
>>>
 Hello,

 I am also interested, please add me to the conf.

 ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :

> Greetings everyone!
> I am super new to this group and currently leading some work to deploy
> spark on k8 for my company o9 Solutions.
> I would love to join the discussion.
> I am in PST.
>
> Regards
> Jay
>
> Sent from my iPhone
>
> On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh 
> wrote:
>
> 
> Could be interesting. Need to summarise where we are with Spark on k8s
> and what market demands.
>
> My personal experience with Volcano was not that impressive 樂. So may
> be a summary will do.where we are currently with spark on k8s
>
> I am on  Greenwich Mean Time but I can take part in late sessions if
> needed
>
>
> HTH
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for
> any loss, damage or destruction of data or any other property which may
> arise from relying on this email's technical content is explicitly
> disclaimed. The author will in no case be liable for any monetary damages
> arising from such loss, damage or destruction.
>
>
>
>
> On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:
>
>> Awesome, count me in!
>> PST
>>
>> On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo 
>> wrote:
>>
>>> I'm Central US time (AKA UTC -6:00)
>>>
>>> On Tue, Feb 7, 2023 at 5:32 PM Holden Karau 
>>> wrote:
>>> >
>>> > Awesome, I guess I should have asked folks for timezones that
>>> they’re in.
>>> >
>>> > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
>>> wrote:
>>> >>
>>> >> Hello Holden,
>>> >>
>>> >> We are interested in Spark on k8s and would like the opportunity
>>> to
>>> >> speak with devs about what we're looking for slash better ways to
>>> use
>>> >> spark.
>>> >>
>>> >> Thanks!
>>> >> Andrew
>>> >>
>>> >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau 
>>> wrote:
>>> >> >
>>> >> > Hi Folks,
>>> >> >
>>> >> > It seems like we could maybe use some additional shared context
>>> around Spark on Kube so I’d like to try and schedule a virtual coffee
>>> session.
>>> >> >
>>> >> > Who all would be interested in virtual adventures around Spark
>>> on Kube development?
>>> >> >
>>> >> > No pressure if the idea of hanging out in a virtual chat with
>>> coffee and Spark devs does not sound like your thing, just trying to 
>>> make
>>> something informal so we can have a better understanding of everyone’s
>>> goals here.
>>> >> >
>>> >> > Cheers,
>>> >> >
>>> >> > Holden :)
>>> >> > --
>>> >> > Twitter: https://twitter.com/holdenkarau
>>> >> > Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9
>>> 

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Colin Williams
Cloud or non cloud. Yarn, etc.

On Wed, Feb 8, 2023, 7:57 AM Mich Talebzadeh 
wrote:

> Hi Colin,
>
> Environments meaning different (cloud)  vendors or hosts?
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Feb 2023 at 03:42, Colin Williams <
> colin.williams.seat...@gmail.com> wrote:
>
>> I wouldn't mind attending or viewing a recording depending on
>> availability. I'm interested in challenges and solutions to porting Spark
>> jobs between environments.
>>
>> On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov 
>> wrote:
>>
>>> Hello,
>>>
>>> I am also interested, please add me to the conf.
>>>
>>> ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :
>>>
 Greetings everyone!
 I am super new to this group and currently leading some work to deploy
 spark on k8 for my company o9 Solutions.
 I would love to join the discussion.
 I am in PST.

 Regards
 Jay

 Sent from my iPhone

 On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh 
 wrote:

 
 Could be interesting. Need to summarise where we are with Spark on k8s
 and what market demands.

 My personal experience with Volcano was not that impressive 樂. So may
 be a summary will do.where we are currently with spark on k8s

 I am on  Greenwich Mean Time but I can take part in late sessions if
 needed


 HTH


view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* Use it at your own risk. Any and all responsibility for
 any loss, damage or destruction of data or any other property which may
 arise from relying on this email's technical content is explicitly
 disclaimed. The author will in no case be liable for any monetary damages
 arising from such loss, damage or destruction.




 On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:

> Awesome, count me in!
> PST
>
> On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo 
> wrote:
>
>> I'm Central US time (AKA UTC -6:00)
>>
>> On Tue, Feb 7, 2023 at 5:32 PM Holden Karau 
>> wrote:
>> >
>> > Awesome, I guess I should have asked folks for timezones that
>> they’re in.
>> >
>> > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
>> wrote:
>> >>
>> >> Hello Holden,
>> >>
>> >> We are interested in Spark on k8s and would like the opportunity to
>> >> speak with devs about what we're looking for slash better ways to
>> use
>> >> spark.
>> >>
>> >> Thanks!
>> >> Andrew
>> >>
>> >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau 
>> wrote:
>> >> >
>> >> > Hi Folks,
>> >> >
>> >> > It seems like we could maybe use some additional shared context
>> around Spark on Kube so I’d like to try and schedule a virtual coffee
>> session.
>> >> >
>> >> > Who all would be interested in virtual adventures around Spark
>> on Kube development?
>> >> >
>> >> > No pressure if the idea of hanging out in a virtual chat with
>> coffee and Spark devs does not sound like your thing, just trying to make
>> something informal so we can have a better understanding of everyone’s
>> goals here.
>> >> >
>> >> > Cheers,
>> >> >
>> >> > Holden :)
>> >> > --
>> >> > Twitter: https://twitter.com/holdenkarau
>> >> > Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9
>> >> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>> >
>> > --
>> > Twitter: https://twitter.com/holdenkarau
>> > Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9
>> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>> --
> John Zhuge
>



Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Mich Talebzadeh
Hi Colin,

Environments meaning different (cloud)  vendors or hosts?



   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Wed, 8 Feb 2023 at 03:42, Colin Williams <
colin.williams.seat...@gmail.com> wrote:

> I wouldn't mind attending or viewing a recording depending on
> availability. I'm interested in challenges and solutions to porting Spark
> jobs between environments.
>
> On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov 
> wrote:
>
>> Hello,
>>
>> I am also interested, please add me to the conf.
>>
>> ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :
>>
>>> Greetings everyone!
>>> I am super new to this group and currently leading some work to deploy
>>> spark on k8 for my company o9 Solutions.
>>> I would love to join the discussion.
>>> I am in PST.
>>>
>>> Regards
>>> Jay
>>>
>>> Sent from my iPhone
>>>
>>> On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh 
>>> wrote:
>>>
>>> 
>>> Could be interesting. Need to summarise where we are with Spark on k8s
>>> and what market demands.
>>>
>>> My personal experience with Volcano was not that impressive 樂. So may
>>> be a summary will do.where we are currently with spark on k8s
>>>
>>> I am on  Greenwich Mean Time but I can take part in late sessions if
>>> needed
>>>
>>>
>>> HTH
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:
>>>
 Awesome, count me in!
 PST

 On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo 
 wrote:

> I'm Central US time (AKA UTC -6:00)
>
> On Tue, Feb 7, 2023 at 5:32 PM Holden Karau 
> wrote:
> >
> > Awesome, I guess I should have asked folks for timezones that
> they’re in.
> >
> > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
> wrote:
> >>
> >> Hello Holden,
> >>
> >> We are interested in Spark on k8s and would like the opportunity to
> >> speak with devs about what we're looking for slash better ways to
> use
> >> spark.
> >>
> >> Thanks!
> >> Andrew
> >>
> >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau 
> wrote:
> >> >
> >> > Hi Folks,
> >> >
> >> > It seems like we could maybe use some additional shared context
> around Spark on Kube so I’d like to try and schedule a virtual coffee
> session.
> >> >
> >> > Who all would be interested in virtual adventures around Spark on
> Kube development?
> >> >
> >> > No pressure if the idea of hanging out in a virtual chat with
> coffee and Spark devs does not sound like your thing, just trying to make
> something informal so we can have a better understanding of everyone’s
> goals here.
> >> >
> >> > Cheers,
> >> >
> >> > Holden :)
> >> > --
> >> > Twitter: https://twitter.com/holdenkarau
> >> > Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9
> >> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
> >
> > --
> > Twitter: https://twitter.com/holdenkarau
> > Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9
> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
> --
 John Zhuge

>>>


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Deepak Sharma
Please count me in .
Can we have spark on k8s with spark-connect feature covered?

On Wed, 8 Feb 2023 at 10:03, Kirti Ruge  wrote:

> Greetings everyone,
> I would love to be part of this session.
> IST
>
>
> On Wed, 8 Feb 2023 at 9:13 AM, Colin Williams <
> colin.williams.seat...@gmail.com> wrote:
>
>> I wouldn't mind attending or viewing a recording depending on
>> availability. I'm interested in challenges and solutions to porting Spark
>> jobs between environments.
>>
>> On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov 
>> wrote:
>>
>>> Hello,
>>>
>>> I am also interested, please add me to the conf.
>>>
>>> ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :
>>>
 Greetings everyone!
 I am super new to this group and currently leading some work to deploy
 spark on k8 for my company o9 Solutions.
 I would love to join the discussion.
 I am in PST.

 Regards
 Jay

 Sent from my iPhone

 On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh 
 wrote:

 
 Could be interesting. Need to summarise where we are with Spark on k8s
 and what market demands.

 My personal experience with Volcano was not that impressive 樂. So may
 be a summary will do.where we are currently with spark on k8s

 I am on  Greenwich Mean Time but I can take part in late sessions if
 needed


 HTH


view my Linkedin profile
 


  https://en.everybodywiki.com/Mich_Talebzadeh



 *Disclaimer:* Use it at your own risk. Any and all responsibility for
 any loss, damage or destruction of data or any other property which may
 arise from relying on this email's technical content is explicitly
 disclaimed. The author will in no case be liable for any monetary damages
 arising from such loss, damage or destruction.




 On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:

> Awesome, count me in!
> PST
>
> On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo 
> wrote:
>
>> I'm Central US time (AKA UTC -6:00)
>>
>> On Tue, Feb 7, 2023 at 5:32 PM Holden Karau 
>> wrote:
>> >
>> > Awesome, I guess I should have asked folks for timezones that
>> they’re in.
>> >
>> > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
>> wrote:
>> >>
>> >> Hello Holden,
>> >>
>> >> We are interested in Spark on k8s and would like the opportunity to
>> >> speak with devs about what we're looking for slash better ways to
>> use
>> >> spark.
>> >>
>> >> Thanks!
>> >> Andrew
>> >>
>> >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau 
>> wrote:
>> >> >
>> >> > Hi Folks,
>> >> >
>> >> > It seems like we could maybe use some additional shared context
>> around Spark on Kube so I’d like to try and schedule a virtual coffee
>> session.
>> >> >
>> >> > Who all would be interested in virtual adventures around Spark
>> on Kube development?
>> >> >
>> >> > No pressure if the idea of hanging out in a virtual chat with
>> coffee and Spark devs does not sound like your thing, just trying to make
>> something informal so we can have a better understanding of everyone’s
>> goals here.
>> >> >
>> >> > Cheers,
>> >> >
>> >> > Holden :)
>> >> > --
>> >> > Twitter: https://twitter.com/holdenkarau
>> >> > Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9
>> >> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>> >
>> > --
>> > Twitter: https://twitter.com/holdenkarau
>> > Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9
>> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>> --
> John Zhuge
>



Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Kirti Ruge
Greetings everyone,
I would love to be part of this session.
IST


On Wed, 8 Feb 2023 at 9:13 AM, Colin Williams <
colin.williams.seat...@gmail.com> wrote:

> I wouldn't mind attending or viewing a recording depending on
> availability. I'm interested in challenges and solutions to porting Spark
> jobs between environments.
>
> On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov 
> wrote:
>
>> Hello,
>>
>> I am also interested, please add me to the conf.
>>
>> ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :
>>
>>> Greetings everyone!
>>> I am super new to this group and currently leading some work to deploy
>>> spark on k8 for my company o9 Solutions.
>>> I would love to join the discussion.
>>> I am in PST.
>>>
>>> Regards
>>> Jay
>>>
>>> Sent from my iPhone
>>>
>>> On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh 
>>> wrote:
>>>
>>> 
>>> Could be interesting. Need to summarise where we are with Spark on k8s
>>> and what market demands.
>>>
>>> My personal experience with Volcano was not that impressive 樂. So may
>>> be a summary will do.where we are currently with spark on k8s
>>>
>>> I am on  Greenwich Mean Time but I can take part in late sessions if
>>> needed
>>>
>>>
>>> HTH
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:
>>>
 Awesome, count me in!
 PST

 On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo 
 wrote:

> I'm Central US time (AKA UTC -6:00)
>
> On Tue, Feb 7, 2023 at 5:32 PM Holden Karau 
> wrote:
> >
> > Awesome, I guess I should have asked folks for timezones that
> they’re in.
> >
> > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
> wrote:
> >>
> >> Hello Holden,
> >>
> >> We are interested in Spark on k8s and would like the opportunity to
> >> speak with devs about what we're looking for slash better ways to
> use
> >> spark.
> >>
> >> Thanks!
> >> Andrew
> >>
> >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau 
> wrote:
> >> >
> >> > Hi Folks,
> >> >
> >> > It seems like we could maybe use some additional shared context
> around Spark on Kube so I’d like to try and schedule a virtual coffee
> session.
> >> >
> >> > Who all would be interested in virtual adventures around Spark on
> Kube development?
> >> >
> >> > No pressure if the idea of hanging out in a virtual chat with
> coffee and Spark devs does not sound like your thing, just trying to make
> something informal so we can have a better understanding of everyone’s
> goals here.
> >> >
> >> > Cheers,
> >> >
> >> > Holden :)
> >> > --
> >> > Twitter: https://twitter.com/holdenkarau
> >> > Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9
> >> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
> >
> > --
> > Twitter: https://twitter.com/holdenkarau
> > Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9
> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
> --
 John Zhuge

>>>


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Colin Williams
I wouldn't mind attending or viewing a recording depending on availability.
I'm interested in challenges and solutions to porting Spark jobs between
environments.

On Tue, Feb 7, 2023 at 7:34 PM Denis Bolshakov 
wrote:

> Hello,
>
> I am also interested, please add me to the conf.
>
> ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :
>
>> Greetings everyone!
>> I am super new to this group and currently leading some work to deploy
>> spark on k8 for my company o9 Solutions.
>> I would love to join the discussion.
>> I am in PST.
>>
>> Regards
>> Jay
>>
>> Sent from my iPhone
>>
>> On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh 
>> wrote:
>>
>> 
>> Could be interesting. Need to summarise where we are with Spark on k8s
>> and what market demands.
>>
>> My personal experience with Volcano was not that impressive 樂. So may be
>> a summary will do.where we are currently with spark on k8s
>>
>> I am on  Greenwich Mean Time but I can take part in late sessions if
>> needed
>>
>>
>> HTH
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:
>>
>>> Awesome, count me in!
>>> PST
>>>
>>> On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo 
>>> wrote:
>>>
 I'm Central US time (AKA UTC -6:00)

 On Tue, Feb 7, 2023 at 5:32 PM Holden Karau 
 wrote:
 >
 > Awesome, I guess I should have asked folks for timezones that they’re
 in.
 >
 > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
 wrote:
 >>
 >> Hello Holden,
 >>
 >> We are interested in Spark on k8s and would like the opportunity to
 >> speak with devs about what we're looking for slash better ways to use
 >> spark.
 >>
 >> Thanks!
 >> Andrew
 >>
 >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau 
 wrote:
 >> >
 >> > Hi Folks,
 >> >
 >> > It seems like we could maybe use some additional shared context
 around Spark on Kube so I’d like to try and schedule a virtual coffee
 session.
 >> >
 >> > Who all would be interested in virtual adventures around Spark on
 Kube development?
 >> >
 >> > No pressure if the idea of hanging out in a virtual chat with
 coffee and Spark devs does not sound like your thing, just trying to make
 something informal so we can have a better understanding of everyone’s
 goals here.
 >> >
 >> > Cheers,
 >> >
 >> > Holden :)
 >> > --
 >> > Twitter: https://twitter.com/holdenkarau
 >> > Books (Learning Spark, High Performance Spark, etc.):
 https://amzn.to/2MaRAG9
 >> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
 >
 > --
 > Twitter: https://twitter.com/holdenkarau
 > Books (Learning Spark, High Performance Spark, etc.):
 https://amzn.to/2MaRAG9
 > YouTube Live Streams: https://www.youtube.com/user/holdenkarau

 -
 To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

 --
>>> John Zhuge
>>>
>>


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Denis Bolshakov
Hello,

I am also interested, please add me to the conf.

ср, 8 февр. 2023 г., 07:21 Jayabindu Singh :

> Greetings everyone!
> I am super new to this group and currently leading some work to deploy
> spark on k8 for my company o9 Solutions.
> I would love to join the discussion.
> I am in PST.
>
> Regards
> Jay
>
> Sent from my iPhone
>
> On Feb 7, 2023, at 3:57 PM, Mich Talebzadeh 
> wrote:
>
> 
> Could be interesting. Need to summarise where we are with Spark on k8s and
> what market demands.
>
> My personal experience with Volcano was not that impressive 樂. So may be
> a summary will do.where we are currently with spark on k8s
>
> I am on  Greenwich Mean Time but I can take part in late sessions if
> needed
>
>
> HTH
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:
>
>> Awesome, count me in!
>> PST
>>
>> On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo  wrote:
>>
>>> I'm Central US time (AKA UTC -6:00)
>>>
>>> On Tue, Feb 7, 2023 at 5:32 PM Holden Karau 
>>> wrote:
>>> >
>>> > Awesome, I guess I should have asked folks for timezones that they’re
>>> in.
>>> >
>>> > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
>>> wrote:
>>> >>
>>> >> Hello Holden,
>>> >>
>>> >> We are interested in Spark on k8s and would like the opportunity to
>>> >> speak with devs about what we're looking for slash better ways to use
>>> >> spark.
>>> >>
>>> >> Thanks!
>>> >> Andrew
>>> >>
>>> >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau 
>>> wrote:
>>> >> >
>>> >> > Hi Folks,
>>> >> >
>>> >> > It seems like we could maybe use some additional shared context
>>> around Spark on Kube so I’d like to try and schedule a virtual coffee
>>> session.
>>> >> >
>>> >> > Who all would be interested in virtual adventures around Spark on
>>> Kube development?
>>> >> >
>>> >> > No pressure if the idea of hanging out in a virtual chat with
>>> coffee and Spark devs does not sound like your thing, just trying to make
>>> something informal so we can have a better understanding of everyone’s
>>> goals here.
>>> >> >
>>> >> > Cheers,
>>> >> >
>>> >> > Holden :)
>>> >> > --
>>> >> > Twitter: https://twitter.com/holdenkarau
>>> >> > Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9
>>> >> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>> >
>>> > --
>>> > Twitter: https://twitter.com/holdenkarau
>>> > Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9
>>> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>
>>> -
>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>
>>> --
>> John Zhuge
>>
>


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Jayabindu Singh
Greetings everyone!I am super new to this group and currently leading some work to deploy spark on k8 for my company o9 Solutions.I would love to join the discussion.I am in PST.RegardsJaySent from my iPhoneOn Feb 7, 2023, at 3:57 PM, Mich Talebzadeh  wrote:Could be interesting. Need to summarise where we are with Spark on k8s and what market demands.My personal experience with Volcano was not that impressive 樂. So may be a summary will do.where we are currently with spark on k8s I am on 

Greenwich Mean Time but I can take part in late sessions if needed

HTH

   view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh

 Disclaimer: Use it at your own risk. Any and all responsibility for any loss, damage or destruction
of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from such
loss, damage or destruction.  

On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:Awesome, count me in! PSTOn Tue, Feb 7, 2023 at 3:34 PM Andrew Melo  wrote:I'm Central US time (AKA UTC -6:00)

On Tue, Feb 7, 2023 at 5:32 PM Holden Karau  wrote:
>
> Awesome, I guess I should have asked folks for timezones that they’re in.
>
> On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo  wrote:
>>
>> Hello Holden,
>>
>> We are interested in Spark on k8s and would like the opportunity to
>> speak with devs about what we're looking for slash better ways to use
>> spark.
>>
>> Thanks!
>> Andrew
>>
>> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau  wrote:
>> >
>> > Hi Folks,
>> >
>> > It seems like we could maybe use some additional shared context around Spark on Kube so I’d like to try and schedule a virtual coffee session.
>> >
>> > Who all would be interested in virtual adventures around Spark on Kube development?
>> >
>> > No pressure if the idea of hanging out in a virtual chat with coffee and Spark devs does not sound like your thing, just trying to make something informal so we can have a better understanding of everyone’s goals here.
>> >
>> > Cheers,
>> >
>> > Holden :)
>> > --
>> > Twitter: https://twitter.com/holdenkarau
>> > Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9
>> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

-- John Zhuge



Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Mich Talebzadeh
Could be interesting. Need to summarise where we are with Spark on k8s and
what market demands.

My personal experience with Volcano was not that impressive 樂. So may be a
summary will do.where we are currently with spark on k8s

I am on  Greenwich Mean Time but I can take part in late sessions if needed


HTH


   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Tue, 7 Feb 2023 at 23:37, John Zhuge  wrote:

> Awesome, count me in!
> PST
>
> On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo  wrote:
>
>> I'm Central US time (AKA UTC -6:00)
>>
>> On Tue, Feb 7, 2023 at 5:32 PM Holden Karau  wrote:
>> >
>> > Awesome, I guess I should have asked folks for timezones that they’re
>> in.
>> >
>> > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
>> wrote:
>> >>
>> >> Hello Holden,
>> >>
>> >> We are interested in Spark on k8s and would like the opportunity to
>> >> speak with devs about what we're looking for slash better ways to use
>> >> spark.
>> >>
>> >> Thanks!
>> >> Andrew
>> >>
>> >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau 
>> wrote:
>> >> >
>> >> > Hi Folks,
>> >> >
>> >> > It seems like we could maybe use some additional shared context
>> around Spark on Kube so I’d like to try and schedule a virtual coffee
>> session.
>> >> >
>> >> > Who all would be interested in virtual adventures around Spark on
>> Kube development?
>> >> >
>> >> > No pressure if the idea of hanging out in a virtual chat with coffee
>> and Spark devs does not sound like your thing, just trying to make
>> something informal so we can have a better understanding of everyone’s
>> goals here.
>> >> >
>> >> > Cheers,
>> >> >
>> >> > Holden :)
>> >> > --
>> >> > Twitter: https://twitter.com/holdenkarau
>> >> > Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9
>> >> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>> >
>> > --
>> > Twitter: https://twitter.com/holdenkarau
>> > Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9
>> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>> --
> John Zhuge
>


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread John Zhuge
Awesome, count me in!
PST

On Tue, Feb 7, 2023 at 3:34 PM Andrew Melo  wrote:

> I'm Central US time (AKA UTC -6:00)
>
> On Tue, Feb 7, 2023 at 5:32 PM Holden Karau  wrote:
> >
> > Awesome, I guess I should have asked folks for timezones that they’re in.
> >
> > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
> wrote:
> >>
> >> Hello Holden,
> >>
> >> We are interested in Spark on k8s and would like the opportunity to
> >> speak with devs about what we're looking for slash better ways to use
> >> spark.
> >>
> >> Thanks!
> >> Andrew
> >>
> >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau 
> wrote:
> >> >
> >> > Hi Folks,
> >> >
> >> > It seems like we could maybe use some additional shared context
> around Spark on Kube so I’d like to try and schedule a virtual coffee
> session.
> >> >
> >> > Who all would be interested in virtual adventures around Spark on
> Kube development?
> >> >
> >> > No pressure if the idea of hanging out in a virtual chat with coffee
> and Spark devs does not sound like your thing, just trying to make
> something informal so we can have a better understanding of everyone’s
> goals here.
> >> >
> >> > Cheers,
> >> >
> >> > Holden :)
> >> > --
> >> > Twitter: https://twitter.com/holdenkarau
> >> > Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9
> >> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
> >
> > --
> > Twitter: https://twitter.com/holdenkarau
> > Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9
> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
> --
John Zhuge


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Denny Lee
Woohoo, Holden!  I’m in (hopefully my schedule allows me) - PST.

On Tue, Feb 7, 2023 at 15:34 Andrew Melo  wrote:

> I'm Central US time (AKA UTC -6:00)
>
> On Tue, Feb 7, 2023 at 5:32 PM Holden Karau  wrote:
> >
> > Awesome, I guess I should have asked folks for timezones that they’re in.
> >
> > On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo 
> wrote:
> >>
> >> Hello Holden,
> >>
> >> We are interested in Spark on k8s and would like the opportunity to
> >> speak with devs about what we're looking for slash better ways to use
> >> spark.
> >>
> >> Thanks!
> >> Andrew
> >>
> >> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau 
> wrote:
> >> >
> >> > Hi Folks,
> >> >
> >> > It seems like we could maybe use some additional shared context
> around Spark on Kube so I’d like to try and schedule a virtual coffee
> session.
> >> >
> >> > Who all would be interested in virtual adventures around Spark on
> Kube development?
> >> >
> >> > No pressure if the idea of hanging out in a virtual chat with coffee
> and Spark devs does not sound like your thing, just trying to make
> something informal so we can have a better understanding of everyone’s
> goals here.
> >> >
> >> > Cheers,
> >> >
> >> > Holden :)
> >> > --
> >> > Twitter: https://twitter.com/holdenkarau
> >> > Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9
> >> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
> >
> > --
> > Twitter: https://twitter.com/holdenkarau
> > Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9
> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Andrew Melo
I'm Central US time (AKA UTC -6:00)

On Tue, Feb 7, 2023 at 5:32 PM Holden Karau  wrote:
>
> Awesome, I guess I should have asked folks for timezones that they’re in.
>
> On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo  wrote:
>>
>> Hello Holden,
>>
>> We are interested in Spark on k8s and would like the opportunity to
>> speak with devs about what we're looking for slash better ways to use
>> spark.
>>
>> Thanks!
>> Andrew
>>
>> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau  wrote:
>> >
>> > Hi Folks,
>> >
>> > It seems like we could maybe use some additional shared context around 
>> > Spark on Kube so I’d like to try and schedule a virtual coffee session.
>> >
>> > Who all would be interested in virtual adventures around Spark on Kube 
>> > development?
>> >
>> > No pressure if the idea of hanging out in a virtual chat with coffee and 
>> > Spark devs does not sound like your thing, just trying to make something 
>> > informal so we can have a better understanding of everyone’s goals here.
>> >
>> > Cheers,
>> >
>> > Holden :)
>> > --
>> > Twitter: https://twitter.com/holdenkarau
>> > Books (Learning Spark, High Performance Spark, etc.): 
>> > https://amzn.to/2MaRAG9
>> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Edmondo Porcu
Interested, in PST

Il giorno mar 7 feb 2023 alle ore 15:32 Holden Karau 
ha scritto:

> Awesome, I guess I should have asked folks for timezones that they’re in.
>
> On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo  wrote:
>
>> Hello Holden,
>>
>> We are interested in Spark on k8s and would like the opportunity to
>> speak with devs about what we're looking for slash better ways to use
>> spark.
>>
>> Thanks!
>> Andrew
>>
>> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau  wrote:
>> >
>> > Hi Folks,
>> >
>> > It seems like we could maybe use some additional shared context around
>> Spark on Kube so I’d like to try and schedule a virtual coffee session.
>> >
>> > Who all would be interested in virtual adventures around Spark on Kube
>> development?
>> >
>> > No pressure if the idea of hanging out in a virtual chat with coffee
>> and Spark devs does not sound like your thing, just trying to make
>> something informal so we can have a better understanding of everyone’s
>> goals here.
>> >
>> > Cheers,
>> >
>> > Holden :)
>> > --
>> > Twitter: https://twitter.com/holdenkarau
>> > Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9
>> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9  
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Holden Karau
Awesome, I guess I should have asked folks for timezones that they’re in.

On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo  wrote:

> Hello Holden,
>
> We are interested in Spark on k8s and would like the opportunity to
> speak with devs about what we're looking for slash better ways to use
> spark.
>
> Thanks!
> Andrew
>
> On Tue, Feb 7, 2023 at 5:24 PM Holden Karau  wrote:
> >
> > Hi Folks,
> >
> > It seems like we could maybe use some additional shared context around
> Spark on Kube so I’d like to try and schedule a virtual coffee session.
> >
> > Who all would be interested in virtual adventures around Spark on Kube
> development?
> >
> > No pressure if the idea of hanging out in a virtual chat with coffee and
> Spark devs does not sound like your thing, just trying to make something
> informal so we can have a better understanding of everyone’s goals here.
> >
> > Cheers,
> >
> > Holden :)
> > --
> > Twitter: https://twitter.com/holdenkarau
> > Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9
> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  
YouTube Live Streams: https://www.youtube.com/user/holdenkarau


Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Andrew Melo
Hello Holden,

We are interested in Spark on k8s and would like the opportunity to
speak with devs about what we're looking for slash better ways to use
spark.

Thanks!
Andrew

On Tue, Feb 7, 2023 at 5:24 PM Holden Karau  wrote:
>
> Hi Folks,
>
> It seems like we could maybe use some additional shared context around Spark 
> on Kube so I’d like to try and schedule a virtual coffee session.
>
> Who all would be interested in virtual adventures around Spark on Kube 
> development?
>
> No pressure if the idea of hanging out in a virtual chat with coffee and 
> Spark devs does not sound like your thing, just trying to make something 
> informal so we can have a better understanding of everyone’s goals here.
>
> Cheers,
>
> Holden :)
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Holden Karau
Hi Folks,

It seems like we could maybe use some additional shared context around
Spark on Kube so I’d like to try and schedule a virtual coffee session.

Who all would be interested in virtual adventures around Spark on Kube
development?

No pressure if the idea of hanging out in a virtual chat with coffee and
Spark devs does not sound like your thing, just trying to make something
informal so we can have a better understanding of everyone’s goals here.

Cheers,

Holden :)
-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  
YouTube Live Streams: https://www.youtube.com/user/holdenkarau