Re: simultaneous actions

2016-01-18 Thread Mennour Rostom
e action will >>> be reused by the other(s), and repeated calculations will be avoided even >>> without explicitly caching/persisting the RDD. >>> >>> On Sun, Jan 17, 2016 at 8:06 AM, Koert Kuipers <ko...@tresata.com> >>> wrote: >>> >>>> Sa

Re: simultaneous actions

2016-01-17 Thread Mennour Rostom
Hi, Thank you all for your answers, If I correctly understand, actions (in my case foreach) can be run concurrently and simultaneously on the SAME rdd, (which is logical because they are read only object). however, I want to know if the same workers are used for the concurrent analysis ? Thank

Re: Read Accumulator value while running

2016-01-14 Thread Mennour Rostom
Hi Daniel, Andrew Thank you for your answers, So it s not possible to read the accumulator value until the action that manipulate it finishes. it's bad, I ll think to something else. However the main important thing in my application is the ability to lunche 2 (or more) actions in parallel and