Re: Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-25 Thread Praveen Devarao
Cool!! Thanks for the clarification Mike. Thanking You - Praveen Devarao Spark Technology Centre IBM India Software Labs - "Co

Re: Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-25 Thread Praveen Devarao
anking You ----- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try again"

Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-24 Thread Praveen Devarao
his that invoke a Job, though they are transformations and not actions? I am on Spark 1.6 Thanking You --------- Praveen Devarao Spark Technology C

Re: Spark structured streaming

2016-03-08 Thread Praveen Devarao
- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try

Spark structured streaming

2016-03-08 Thread Praveen Devarao
a consumability angle. Thanking You - Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Some

IDE for spark development

2016-01-13 Thread Praveen Devarao
Hi, What is the best IDE for spark development? When I say development I would like to make changes in SPARK core and be able to contribute back. I know this question is been asked many times but I don't see a convincing answer anywhere. I use intelliJ but getting the