Storage Locations of an rdd
Hi, I need to find the storage locations (node Ids ) of each partition of a replicated rdd in spark. I mean, if an rdd is replicated twice, I want to find the two nodes for each partition where it is stored. Spark WebUI has a page wherein it depicts the data distribution of each rdd. But, I really don't appreciate what it displays. Can someone please throw some light in this regard? Thank you Karthik
Storage Locations of an rdd
Hi, I need to find the storage locations (node Ids ) of each partition of a replicated rdd in spark. I mean, if an rdd is replicated twice, I want to find the two nodes for each partition where it is stored. Spark WebUI has a page wherein it depicts the data distribution of each rdd. But, I need to know the first and second locations of each partition of the replicated rdd. Can someone please throw some light in this regard? Thank you Karthik