---------- Forwarded message ---------- From: Georgios Samaras <georgesamaras...@gmail.com> Date: Tue, Aug 30, 2016 at 9:49 AM Subject: Re: KMeans calls takeSample() twice? To: "Sean Owen [via Apache Spark Developers List]" < ml-node+s1001551n18788...@n3.nabble.com>
I am not sure what you want me to check. Note that I see two takeSample()s being invoked every single time I execute KMeans(). In a current job I have, I did view the details and updated the: StackOverflow question. <http://stackoverflow.com/questions/38986395/sparkkmeans-calls-takesample-twice> On Tue, Aug 30, 2016 at 9:25 AM, Sean Owen [via Apache Spark Developers List] <ml-node+s1001551n18788...@n3.nabble.com> wrote: > I'm not sure it's a UI bug; it really does record two different > stages, the second of which executes quickly. I am not sure why that > would happen off the top of my head. I don't see anything that failed > here. > > Digging into those two stages and what they executed might give a clue > to what's really going on there. > > On Tue, Aug 30, 2016 at 5:18 PM, gsamaras <[hidden email] > <http:///user/SendEmail.jtp?type=node&node=18788&i=0>> wrote: > > Yanbo thank you for your reply. So you are saying that this is a bug in > the > > Spark UI in general, and not in the local Spark UI of our cluster, where > I > > work, right? > > > > George > > --------------------------------------------------------------------- > To unsubscribe e-mail: [hidden email] > <http:///user/SendEmail.jtp?type=node&node=18788&i=1> > > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > http://apache-spark-developers-list.1001551.n3.nabble.com/ > KMeans-calls-takeSample-twice-tp18761p18788.html > To unsubscribe from KMeans calls takeSample() twice?, click here > <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=18761&code=Z2VvcmdlU2FtYXJhc0RJVEBnbWFpbC5jb218MTg3NjF8LTE1MTg1NDIwOQ==> > . > NAML > <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> >
