Hi Bahubali,
Once RDDs are created, they are immutable (in most cases). In your case you
end up with 3 RDDs:
(1) the original rdd1 that reads from the text file
(2) rdd2, that applies a map function on (1), and
(3) the new rdd1 that applies a map function on (2)
There's no cycle because you
No. The third line creates a third RDD whose reference simply replaces
the reference to the first RDD in your local driver program. The first
RDD still exists.
On Thu, Aug 20, 2015 at 2:15 PM, Bahubali Jain bahub...@gmail.com wrote:
Hi,
How would the DAG look like for the below code
Hi,
How would the DAG look like for the below code
JavaRDDString rdd1 = context.textFile(SOMEPATH);
JavaRDDString rdd2 = rdd1.map(DO something);
rdd1 = rdd2.map(Do SOMETHING);
Does this lead to any kind of cycle?
Thanks,
Baahu
