How to use Fair Scheduler Pools

[李杰]

I have two questions to ask:

  I wrote a demo referring to the official 
website(https://spark.apache.org/docs/latest/job-scheduling.html), but it 
didn't meet my expectations. I don't know if there was a problem with my 
writing.I hope that when I use the following fairscheduler.xml, pool1 always 
performs tasks before pool2
   What is the relationship between "spark.scheduler.mode" and "schedulingMode" 
in fairscheduler.xml？

object MultiJobTest {
  def main(args: Array[String]): Unit = {
val conf = new SparkConf()
conf.setAppName("test-pool").setMaster("local[1]")
conf.set("spark.scheduler.mode", "FAIR")
conf.set("spark.scheduler.allocation.file", 
"file:///D:/tmp/input/fairscheduler.xml")val sparkContext = new 
SparkContext(conf)
val data: RDD[String] = 
sparkContext.textFile("file:///D:/tmp/input/input.txt")
val rdd = data.flatMap(_.split(","))
  .map(x => (x(0), x(0)))newThread(() => {


  sparkContext.setLocalProperty("spark.scheduler.pool", "pool1")
  rdd.foreachAsync(x => {
println("1==start==" + new SimpleDateFormat("HH:mm:ss").format(new 
Date()))Thread.sleep(1)
println("1==end==" + new SimpleDateFormat("HH:mm:ss").format(new 
Date()))
  })

}).start()newThread(() => {

  sparkContext.setLocalProperty("spark.scheduler.pool", "pool2")
  rdd.foreachAsync(x => {
println("2==start==" + new SimpleDateFormat("HH:mm:ss").format(new 
Date()))Thread.sleep(1)
println("2==end==" + new SimpleDateFormat("HH:mm:ss").format(new 
Date()))
  })
}).start()


TimeUnit.MINUTES.sleep(2)
sparkContext.stop()

  }
} 

fairscheduler.xml




  
FAIR
100
0
  
  
FAIR
1
0
  
 



input.txt


aa bb 





| |
李杰
|
|
leedd1...@163.com
|

Re: Online classes for spark topics

[Deepak Sharma]

I can prepare some topics and present as well , if we have a prioritised
list of topics already .

On Thu, 9 Mar 2023 at 11:42 AM, Denny Lee  wrote:

> We used to run Spark webinars on the Apache Spark LinkedIn group
>  but
> honestly the turnout was pretty low.  We had dove into various features.
> If there are particular topics that. you would like to discuss during a
> live session, please let me know and we can try to restart them.  HTH!
>
> On Wed, Mar 8, 2023 at 9:45 PM Sofia’s World  wrote:
>
>> +1
>>
>> On Wed, Mar 8, 2023 at 10:40 PM Winston Lai 
>> wrote:
>>
>>> +1, any webinar on Spark related topic is appreciated 
>>>
>>> Thank You & Best Regards
>>> Winston Lai
>>> --
>>> *From:* asma zgolli 
>>> *Sent:* Thursday, March 9, 2023 5:43:06 AM
>>> *To:* karan alang 
>>> *Cc:* Mich Talebzadeh ; ashok34...@yahoo.com
>>> ; User 
>>> *Subject:* Re: Online classes for spark topics
>>>
>>> +1
>>>
>>> Le mer. 8 mars 2023 à 21:32, karan alang  a
>>> écrit :
>>>
>>> +1 .. I'm happy to be part of these discussions as well !
>>>
>>>
>>>
>>>
>>> On Wed, Mar 8, 2023 at 12:27 PM Mich Talebzadeh <
>>> mich.talebza...@gmail.com> wrote:
>>>
>>> Hi,
>>>
>>> I guess I can schedule this work over a course of time. I for myself can
>>> contribute plus learn from others.
>>>
>>> So +1 for me.
>>>
>>> Let us see if anyone else is interested.
>>>
>>> HTH
>>>
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Wed, 8 Mar 2023 at 17:48, ashok34...@yahoo.com 
>>> wrote:
>>>
>>>
>>> Hello Mich.
>>>
>>> Greetings. Would you be able to arrange for Spark Structured Streaming
>>> learning webinar.?
>>>
>>> This is something I haven been struggling with recently. it will be very
>>> helpful.
>>>
>>> Thanks and Regard
>>>
>>> AK
>>> On Tuesday, 7 March 2023 at 20:24:36 GMT, Mich Talebzadeh <
>>> mich.talebza...@gmail.com> wrote:
>>>
>>>
>>> Hi,
>>>
>>> This might  be a worthwhile exercise on the assumption that the
>>> contributors will find the time and bandwidth to chip in so to speak.
>>>
>>> I am sure there are many but on top of my head I can think of Holden
>>> Karau for k8s, and Sean Owen for data science stuff. They are both very
>>> experienced.
>>>
>>> Anyone else 樂
>>>
>>> HTH
>>>
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Tue, 7 Mar 2023 at 19:17, ashok34...@yahoo.com.INVALID
>>>  wrote:
>>>
>>> Hello gurus,
>>>
>>> Does Spark arranges online webinars for special topics like Spark on
>>> K8s, data science and Spark Structured Streaming?
>>>
>>> I would be most grateful if experts can share their experience with
>>> learners with intermediate knowledge like myself. Hopefully we will find
>>> the practical experiences told valuable.
>>>
>>> Respectively,
>>>
>>> AK
>>>
>>>
>>>
>>>
>>

Re: Online classes for spark topics

[Denny Lee]

We used to run Spark webinars on the Apache Spark LinkedIn group
 but
honestly the turnout was pretty low.  We had dove into various features.
If there are particular topics that. you would like to discuss during a
live session, please let me know and we can try to restart them.  HTH!

On Wed, Mar 8, 2023 at 9:45 PM Sofia’s World  wrote:

> +1
>
> On Wed, Mar 8, 2023 at 10:40 PM Winston Lai  wrote:
>
>> +1, any webinar on Spark related topic is appreciated 
>>
>> Thank You & Best Regards
>> Winston Lai
>> --
>> *From:* asma zgolli 
>> *Sent:* Thursday, March 9, 2023 5:43:06 AM
>> *To:* karan alang 
>> *Cc:* Mich Talebzadeh ; ashok34...@yahoo.com <
>> ashok34...@yahoo.com>; User 
>> *Subject:* Re: Online classes for spark topics
>>
>> +1
>>
>> Le mer. 8 mars 2023 à 21:32, karan alang  a
>> écrit :
>>
>> +1 .. I'm happy to be part of these discussions as well !
>>
>>
>>
>>
>> On Wed, Mar 8, 2023 at 12:27 PM Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>> Hi,
>>
>> I guess I can schedule this work over a course of time. I for myself can
>> contribute plus learn from others.
>>
>> So +1 for me.
>>
>> Let us see if anyone else is interested.
>>
>> HTH
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Mar 2023 at 17:48, ashok34...@yahoo.com 
>> wrote:
>>
>>
>> Hello Mich.
>>
>> Greetings. Would you be able to arrange for Spark Structured Streaming
>> learning webinar.?
>>
>> This is something I haven been struggling with recently. it will be very
>> helpful.
>>
>> Thanks and Regard
>>
>> AK
>> On Tuesday, 7 March 2023 at 20:24:36 GMT, Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>>
>> Hi,
>>
>> This might  be a worthwhile exercise on the assumption that the
>> contributors will find the time and bandwidth to chip in so to speak.
>>
>> I am sure there are many but on top of my head I can think of Holden
>> Karau for k8s, and Sean Owen for data science stuff. They are both very
>> experienced.
>>
>> Anyone else 樂
>>
>> HTH
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Tue, 7 Mar 2023 at 19:17, ashok34...@yahoo.com.INVALID
>>  wrote:
>>
>> Hello gurus,
>>
>> Does Spark arranges online webinars for special topics like Spark on K8s,
>> data science and Spark Structured Streaming?
>>
>> I would be most grateful if experts can share their experience with
>> learners with intermediate knowledge like myself. Hopefully we will find
>> the practical experiences told valuable.
>>
>> Respectively,
>>
>> AK
>>
>>
>>
>>
>

Re: Online classes for spark topics

[Sofia’s World]

+1

On Wed, Mar 8, 2023 at 10:40 PM Winston Lai  wrote:

> +1, any webinar on Spark related topic is appreciated 
>
> Thank You & Best Regards
> Winston Lai
> --
> *From:* asma zgolli 
> *Sent:* Thursday, March 9, 2023 5:43:06 AM
> *To:* karan alang 
> *Cc:* Mich Talebzadeh ; ashok34...@yahoo.com <
> ashok34...@yahoo.com>; User 
> *Subject:* Re: Online classes for spark topics
>
> +1
>
> Le mer. 8 mars 2023 à 21:32, karan alang  a écrit :
>
> +1 .. I'm happy to be part of these discussions as well !
>
>
>
>
> On Wed, Mar 8, 2023 at 12:27 PM Mich Talebzadeh 
> wrote:
>
> Hi,
>
> I guess I can schedule this work over a course of time. I for myself can
> contribute plus learn from others.
>
> So +1 for me.
>
> Let us see if anyone else is interested.
>
> HTH
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Mar 2023 at 17:48, ashok34...@yahoo.com 
> wrote:
>
>
> Hello Mich.
>
> Greetings. Would you be able to arrange for Spark Structured Streaming
> learning webinar.?
>
> This is something I haven been struggling with recently. it will be very
> helpful.
>
> Thanks and Regard
>
> AK
> On Tuesday, 7 March 2023 at 20:24:36 GMT, Mich Talebzadeh <
> mich.talebza...@gmail.com> wrote:
>
>
> Hi,
>
> This might  be a worthwhile exercise on the assumption that the
> contributors will find the time and bandwidth to chip in so to speak.
>
> I am sure there are many but on top of my head I can think of Holden Karau
> for k8s, and Sean Owen for data science stuff. They are both very
> experienced.
>
> Anyone else 樂
>
> HTH
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Tue, 7 Mar 2023 at 19:17, ashok34...@yahoo.com.INVALID
>  wrote:
>
> Hello gurus,
>
> Does Spark arranges online webinars for special topics like Spark on K8s,
> data science and Spark Structured Streaming?
>
> I would be most grateful if experts can share their experience with
> learners with intermediate knowledge like myself. Hopefully we will find
> the practical experiences told valuable.
>
> Respectively,
>
> AK
>
>
>
>

Spark Thrift Server - Autoscaling on K8

[Jayabindu Singh]

Hi All,

We are in the process of moving our workloads to K8 and looking for some
guidance to run Spark Thrift Server on K8.
We need the executor pods to autoscale based on the workload vs running it
with a static number of executors.

If any one has done it and can share the details, it will be really
appreciated.

Regards
Jayabindu Singh

How to use Fair Scheduler Pools

[李杰]

I have two questions to ask:

  I wrote a demo referring to the official 
website(https://spark.apache.org/docs/latest/job-scheduling.html), but it 
didn't meet my expectations. I don't know if there was a problem with my 
writing.I hope that when I use the following fairscheduler.xml, pool1 always 
performs tasks before pool2
   What is the relationship between "spark.scheduler.mode" and "schedulingMode" 
in fairscheduler.xml？

object MultiJobTest {
  def main(args: Array[String]): Unit = {
val conf = new SparkConf()
conf.setAppName("test-pool").setMaster("local[1]")
conf.set("spark.scheduler.mode", "FAIR")
conf.set("spark.scheduler.allocation.file", 
"file:///D:/tmp/input/fairscheduler.xml")val sparkContext = new 
SparkContext(conf)
val data: RDD[String] = 
sparkContext.textFile("file:///D:/tmp/input/input.txt")
val rdd = data.flatMap(_.split(","))
  .map(x => (x(0), x(0)))newThread(() => {


  sparkContext.setLocalProperty("spark.scheduler.pool", "pool1")
  rdd.foreachAsync(x => {
println("1==start==" + new SimpleDateFormat("HH:mm:ss").format(new 
Date()))Thread.sleep(1)
println("1==end==" + new SimpleDateFormat("HH:mm:ss").format(new 
Date()))
  })

}).start()newThread(() => {

  sparkContext.setLocalProperty("spark.scheduler.pool", "pool2")
  rdd.foreachAsync(x => {
println("2==start==" + new SimpleDateFormat("HH:mm:ss").format(new 
Date()))Thread.sleep(1)
println("2==end==" + new SimpleDateFormat("HH:mm:ss").format(new 
Date()))
  })
}).start()


TimeUnit.MINUTES.sleep(2)
sparkContext.stop()

  }
} 

fairscheduler.xml




  
FAIR
100
0
  
  
FAIR
1
0
  
 



input.txt


aa bb 





| |
李杰
|
|
leedd1...@163.com
|

[Spark] How to find which type of key is illegal during from_json() function

[hueiyuan su]

*Component*: Spark
*Level*: Advanced
*Scenario*: How-to

-
*Problems Description*
I have nested json string value in someone field of spark dataframe, and I
would like to use from_json() to parse json object. Especially, if one of
key type is not match with our defined struct type, it will return null.
Based on this, could we find which key type is error? Related example
follow as:

*source dataframe:*
| original_json_string |
| -- |
| "{a:{b:"dn", c:"test"}}" |

ps. And we expected the value type of b should be double type. so we
predefined struct type for from_json() to use, but just directly return
null:

*result dataframe after from_json:*
| original_json_string |
| -- |
| null |

In this sample, because value of a have 2 keys, b and c, could we know is
value type of b is error instead of c, which can let me check data quickly
instead just return null.
If we would like to achieve this objective, how to implement it?
if you have and ideas, I will be appreciated it, thank you.

-- 
Best Regards,

Mars Su
*Phone*: 0988-661-013
*Email*: hueiyua...@gmail.com

Re: Online classes for spark topics

[Winston Lai]

+1, any webinar on Spark related topic is appreciated 

Thank You & Best Regards
Winston Lai

From: asma zgolli 
Sent: Thursday, March 9, 2023 5:43:06 AM
To: karan alang 
Cc: Mich Talebzadeh ; ashok34...@yahoo.com 
; User 
Subject: Re: Online classes for spark topics

+1

Le mer. 8 mars 2023 à 21:32, karan alang 
mailto:karan.al...@gmail.com>> a écrit :
+1 .. I'm happy to be part of these discussions as well !




On Wed, Mar 8, 2023 at 12:27 PM Mich Talebzadeh 
mailto:mich.talebza...@gmail.com>> wrote:
Hi,

I guess I can schedule this work over a course of time. I for myself can 
contribute plus learn from others.

So +1 for me.

Let us see if anyone else is interested.

HTH



 
[https://ci3.googleusercontent.com/mail-sig/AIorK4zholKucR2Q9yMrKbHNn-o1TuS4mYXyi2KO6Xmx6ikHPySa9MLaLZ8t2hrA6AUcxSxDgHIwmKE]
   view my Linkedin 
profile


 https://en.everybodywiki.com/Mich_Talebzadeh



Disclaimer: Use it at your own risk. Any and all responsibility for any loss, 
damage or destruction of data or any other property which may arise from 
relying on this email's technical content is explicitly disclaimed. The author 
will in no case be liable for any monetary damages arising from such loss, 
damage or destruction.




On Wed, 8 Mar 2023 at 17:48, ashok34...@yahoo.com 
mailto:ashok34...@yahoo.com>> wrote:

Hello Mich.

Greetings. Would you be able to arrange for Spark Structured Streaming learning 
webinar.?

This is something I haven been struggling with recently. it will be very 
helpful.

Thanks and Regard

AK
On Tuesday, 7 March 2023 at 20:24:36 GMT, Mich Talebzadeh 
mailto:mich.talebza...@gmail.com>> wrote:


Hi,

This might  be a worthwhile exercise on the assumption that the contributors 
will find the time and bandwidth to chip in so to speak.

I am sure there are many but on top of my head I can think of Holden Karau for 
k8s, and Sean Owen for data science stuff. They are both very experienced.

Anyone else 樂

HTH



 
[https://ci3.googleusercontent.com/mail-sig/AIorK4zholKucR2Q9yMrKbHNn-o1TuS4mYXyi2KO6Xmx6ikHPySa9MLaLZ8t2hrA6AUcxSxDgHIwmKE]
   view my Linkedin 
profile


 https://en.everybodywiki.com/Mich_Talebzadeh



Disclaimer: Use it at your own risk. Any and all responsibility for any loss, 
damage or destruction of data or any other property which may arise from 
relying on this email's technical content is explicitly disclaimed. The author 
will in no case be liable for any monetary damages arising from such loss, 
damage or destruction.




On Tue, 7 Mar 2023 at 19:17, ashok34...@yahoo.com.INVALID 
 wrote:
Hello gurus,

Does Spark arranges online webinars for special topics like Spark on K8s, data 
science and Spark Structured Streaming?

I would be most grateful if experts can share their experience with learners 
with intermediate knowledge like myself. Hopefully we will find the practical 
experiences told valuable.

Respectively,

AK

spark-submit: No "driver-" id printed in standalone mode

[Travis Athougies]

Hello,

I'm trying to get Airflow to work with spark in cluster mode. I can
successfully submit jobs via spark-submit and see them complete
successfully.

However, 'spark-submit' doesn't seem to print any driver- ID to the
console. Clearly the drivers have an ID, as they are listed with one in
the spark master. But spark-submit's output is rather terse:

For example, here is what I get from spark-submit:

23/03/08 13:33:42 WARN Utils: Your hostname, epsilon resolves to a
loopback address: 127.0.0.2; using 192.168.1.189 instead (on interface
enp58s0)
23/03/08 13:33:42 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to
another address
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform
(file:/nix/store/vgs0ipwwkl9szmqpjawg5p08y57nq57m-spark-
3.2.2/lib/spark-3.2.2/jars/spark-unsafe_2.12-3.2.2.jar) to constructor
java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further
illegal reflective access operations
WARNING: All illegal access operations will be denied in a future
release
23/03/08 13:33:42 WARN NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where
applicable

If I enable verbose mode, I get more data on stderr, but no driver- id.

The full logs are here:
https://gist.github.com/tathougies/c97a02d7e44379bd03086a9fa4ab39b7

Any idea?

It seems to me that org.apache.spark.deploy.SparkSubmit ought to print
out the driver ID as a matter of habit, but from scouring various
answers online it seems it's just part of the logs.

Travis

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: Online classes for spark topics

[asma zgolli]

+1

Le mer. 8 mars 2023 à 21:32, karan alang  a écrit :

> +1 .. I'm happy to be part of these discussions as well !
>
>
>
>
> On Wed, Mar 8, 2023 at 12:27 PM Mich Talebzadeh 
> wrote:
>
>> Hi,
>>
>> I guess I can schedule this work over a course of time. I for myself can
>> contribute plus learn from others.
>>
>> So +1 for me.
>>
>> Let us see if anyone else is interested.
>>
>> HTH
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 8 Mar 2023 at 17:48, ashok34...@yahoo.com 
>> wrote:
>>
>>>
>>> Hello Mich.
>>>
>>> Greetings. Would you be able to arrange for Spark Structured Streaming
>>> learning webinar.?
>>>
>>> This is something I haven been struggling with recently. it will be very
>>> helpful.
>>>
>>> Thanks and Regard
>>>
>>> AK
>>> On Tuesday, 7 March 2023 at 20:24:36 GMT, Mich Talebzadeh <
>>> mich.talebza...@gmail.com> wrote:
>>>
>>>
>>> Hi,
>>>
>>> This might  be a worthwhile exercise on the assumption that the
>>> contributors will find the time and bandwidth to chip in so to speak.
>>>
>>> I am sure there are many but on top of my head I can think of Holden
>>> Karau for k8s, and Sean Owen for data science stuff. They are both very
>>> experienced.
>>>
>>> Anyone else 樂
>>>
>>> HTH
>>>
>>>
>>>
>>>view my Linkedin profile
>>> 
>>>
>>>
>>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Tue, 7 Mar 2023 at 19:17, ashok34...@yahoo.com.INVALID
>>>  wrote:
>>>
>>> Hello gurus,
>>>
>>> Does Spark arranges online webinars for special topics like Spark on
>>> K8s, data science and Spark Structured Streaming?
>>>
>>> I would be most grateful if experts can share their experience with
>>> learners with intermediate knowledge like myself. Hopefully we will find
>>> the practical experiences told valuable.
>>>
>>> Respectively,
>>>
>>> AK
>>>
>>>

Re: Online classes for spark topics

[karan alang]

+1 .. I'm happy to be part of these discussions as well !




On Wed, Mar 8, 2023 at 12:27 PM Mich Talebzadeh 
wrote:

> Hi,
>
> I guess I can schedule this work over a course of time. I for myself can
> contribute plus learn from others.
>
> So +1 for me.
>
> Let us see if anyone else is interested.
>
> HTH
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Wed, 8 Mar 2023 at 17:48, ashok34...@yahoo.com 
> wrote:
>
>>
>> Hello Mich.
>>
>> Greetings. Would you be able to arrange for Spark Structured Streaming
>> learning webinar.?
>>
>> This is something I haven been struggling with recently. it will be very
>> helpful.
>>
>> Thanks and Regard
>>
>> AK
>> On Tuesday, 7 March 2023 at 20:24:36 GMT, Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>>
>> Hi,
>>
>> This might  be a worthwhile exercise on the assumption that the
>> contributors will find the time and bandwidth to chip in so to speak.
>>
>> I am sure there are many but on top of my head I can think of Holden
>> Karau for k8s, and Sean Owen for data science stuff. They are both very
>> experienced.
>>
>> Anyone else 樂
>>
>> HTH
>>
>>
>>
>>view my Linkedin profile
>> 
>>
>>
>>  https://en.everybodywiki.com/Mich_Talebzadeh
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Tue, 7 Mar 2023 at 19:17, ashok34...@yahoo.com.INVALID
>>  wrote:
>>
>> Hello gurus,
>>
>> Does Spark arranges online webinars for special topics like Spark on K8s,
>> data science and Spark Structured Streaming?
>>
>> I would be most grateful if experts can share their experience with
>> learners with intermediate knowledge like myself. Hopefully we will find
>> the practical experiences told valuable.
>>
>> Respectively,
>>
>> AK
>>
>>

Re: Online classes for spark topics

[Mich Talebzadeh]

Hi,

I guess I can schedule this work over a course of time. I for myself can
contribute plus learn from others.

So +1 for me.

Let us see if anyone else is interested.

HTH



   view my Linkedin profile



 https://en.everybodywiki.com/Mich_Talebzadeh



*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.




On Wed, 8 Mar 2023 at 17:48, ashok34...@yahoo.com 
wrote:

>
> Hello Mich.
>
> Greetings. Would you be able to arrange for Spark Structured Streaming
> learning webinar.?
>
> This is something I haven been struggling with recently. it will be very
> helpful.
>
> Thanks and Regard
>
> AK
> On Tuesday, 7 March 2023 at 20:24:36 GMT, Mich Talebzadeh <
> mich.talebza...@gmail.com> wrote:
>
>
> Hi,
>
> This might  be a worthwhile exercise on the assumption that the
> contributors will find the time and bandwidth to chip in so to speak.
>
> I am sure there are many but on top of my head I can think of Holden Karau
> for k8s, and Sean Owen for data science stuff. They are both very
> experienced.
>
> Anyone else 樂
>
> HTH
>
>
>
>view my Linkedin profile
> 
>
>
>  https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Tue, 7 Mar 2023 at 19:17, ashok34...@yahoo.com.INVALID
>  wrote:
>
> Hello gurus,
>
> Does Spark arranges online webinars for special topics like Spark on K8s,
> data science and Spark Structured Streaming?
>
> I would be most grateful if experts can share their experience with
> learners with intermediate knowledge like myself. Hopefully we will find
> the practical experiences told valuable.
>
> Respectively,
>
> AK
>
>

Re: Online classes for spark topics

[ashok34...@yahoo.com.INVALID]

 
Hello Mich.
Greetings. Would you be able to arrange for Spark Structured Streaming learning 
webinar.?
This is something I haven been struggling with recently. it will be very 
helpful.
Thanks and Regard
AKOn Tuesday, 7 March 2023 at 20:24:36 GMT, Mich Talebzadeh 
 wrote:  
 
 Hi,
This might  be a worthwhile exercise on the assumption that the contributors 
will find the time and bandwidth to chip in so to speak.
I am sure there are many but on top of my head I can think of Holden Karau for 
k8s, and Sean Owen for data science stuff. They are both very experienced.
Anyone else 樂
HTH







   view my Linkedin profile




 https://en.everybodywiki.com/Mich_Talebzadeh

 

Disclaimer: Use it at your own risk. Any and all responsibility for any loss, 
damage or destructionof data or any other property which may arise from relying 
on this email's technical content is explicitly disclaimed.The author will in 
no case be liable for any monetary damages arising from suchloss, damage or 
destruction. 

 


On Tue, 7 Mar 2023 at 19:17, ashok34...@yahoo.com.INVALID 
 wrote:

Hello gurus,
Does Spark arranges online webinars for special topics like Spark on K8s, data 
science and Spark Structured Streaming?
I would be most grateful if experts can share their experience with learners 
with intermediate knowledge like myself. Hopefully we will find the practical 
experiences told valuable.
Respectively,
AK