Maybe you can create your own subclass of RDD and override the getPreferredLocations() to implement the logic of dynamic changing of the locations. > On Dec 30, 2016, at 12:06, Fei Hu <hufe...@gmail.com> wrote: > > Dear all, > > Is there any way to change the host location for a certain partition of RDD? > > "protected def getPreferredLocations(split: Partition)" can be used to > initialize the location, but how to change it after the initialization? > > > Thanks, > Fei > >
--------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
