Storage Locations of an rdd

2014-12-26 Thread rapelly kartheek
Hi,

I need to find the storage locations (node Ids ) of  each  partition of a
replicated rdd in spark. I mean, if an rdd is replicated twice, I want to
find the two nodes for each partition where it is stored.

Spark WebUI has a page wherein it depicts the data distribution of each
rdd. But, I really don't appreciate what it displays.

Can someone please throw some light in this regard?

Thank you
Karthik


Storage Locations of an rdd

2014-12-26 Thread rapelly kartheek
Hi,
I need to find the storage locations (node Ids ) of each partition of a
replicated rdd in spark. I mean, if an rdd is replicated twice, I want to
find the two nodes for each partition where it is stored.
Spark WebUI has a page wherein it depicts the data distribution of each
rdd. But, I need to know the first and second locations of each partition
of the replicated rdd.
Can someone please throw some light in this regard?
Thank you
Karthik