It could be a GC pause or something, you need to check in the stages tab and see what is taking time, If you upgrade to Spark 1.4, it has better UI and DAG visualization which helps you debug better.
Thanks Best Regards On Mon, Jul 20, 2015 at 8:21 PM, Pa Rö <paul.roewer1...@googlemail.com> wrote: > hi community, > > i have write a spark k-means app. now i run it on a cluster. > my job start and at iteration nine or ten the process stop. > in the spark dashbord all time shown "is running", but nothing > happend, no exceptions. > > my setting is the following: > 1000 input points > k=10 > maxIteration=30 > a tree node cluster (one node have 16GB RAM und 8cores i7) > i use cloudera live 5.4.4 with spark 1.3 > > maybe spark need more memory or i have a wrong setting? > > best regards, > paul >
