Re: KMeans calls takeSample() twice?

2016-08-30 Thread gsamaras
pen off the top of my head. I don't see anything that failed > here. > > Digging into those two stages and what they executed might give a clue > to what's really going on there. > > On Tue, Aug 30, 2016 at 5:18 PM, gsamaras <[hidden email] > <http:///user/SendEmail.jt

Re: KMeans calls takeSample() twice?

2016-08-30 Thread gsamaras
com> wrote: > I run KMeans with probes and found that takeSample() was called only once > actually. It looks like this issue was caused by mistake display at Spark > UI. > > Thanks > Yanbo > > On Mon, Aug 29, 2016 at 2:34 PM, gsamaras <[hidden email] > <http:

KMeans calls takeSample() twice?

2016-08-29 Thread gsamaras
After reading the internal code of Spark about it, I wasn't able to understand why it calls takeSample() twice? Can someone please explain? There is a relevant StackOverflow question . -- View this message in