Re: Concurrent Read of Accumulator's Value

2016-01-13 Thread Ted Yu
One option is to use a NoSQL data store, such as hbase, for the two actions to exchange status information. Write to data store in action 1 and read from action 2. Cheers On Wed, Jan 13, 2016 at 2:20 AM, Kira wrote: > Hi, > > So i have an action on one RDD that is

Concurrent Read of Accumulator's Value

2016-01-13 Thread Kira
Hi, So i have an action on one RDD that is relatively long, let's call it ac1; what i want to do is to execute another action (ac2) on the same RDD to see the evolution of the first one (ac1); for this end i want to use an accumulator and read it's value progressively to see the changes on it (on