Yeah. Collect was where I had gotten, and was rather sulky about the results.
It does seem like a reduce is going to be necessary. Anybody else have thoughts on this? Sent from my iPhone > On Jul 13, 2014, at 17:58, Anand Avati <[email protected]> wrote: > > collect(), hoping the result fits in memory, and do the reduction in-core. > I think some kind of a reduce operator needs to be introduced for doing > even simple things like scalable kmeans. Haven't thought of how it would > look yet.
