Re: Necessity for rdd replication.

2014-12-04 Thread Sameer Farooqui
, but again.. generally speaking, you shouldn't need to replicate it. On Wed, Dec 3, 2014 at 11:54 PM, rapelly kartheek kartheek.m...@gmail.com wrote: Hi, I was just thinking about necessity for rdd replication. One category could be something like large number of threads requiring same rdd. Even

Necessity for rdd replication.

2014-12-03 Thread rapelly kartheek
Hi, I was just thinking about necessity for rdd replication. One category could be something like large number of threads requiring same rdd. Even though, a single rdd can be shared by multiple threads belonging to same application , I believe we can extract better parallelism if the rdd