On 14 September 2017 at 10:42, <johan.grande....@orange.com> wrote: > val noTs = myData.map(dropTimestamp) > > val scaled = scaler.transform(noTs) > > val projected = (new RowMatrix(scaled)).multiply(principalComponents).rows > > val clusters = myModel.predict(projected) > > val result = myData.zip(clusters) > > > > Do you think there’s a chance that the 4 transformations above would > preserve order so the zip at the end would be correct?
AFAIK, No. The sequence of transformation you have will not guarantee to preserve order. First, apply zip, then you need to keep track of indices in the subsequent transformations, with `_2`, as zip returns tuples. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
