Re: History Server renered page not suitable for load balancing

2014-06-30 Thread elyast
Done :) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/History-Server-renered-page-not-suitable-for-load-balancing-tp7447p8550.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: little confused about SPARK_JAVA_OPTS alternatives

2014-06-30 Thread elyast
Hi Andrew, I'm actually using spark-submit, and I tried using spark.executor.extraJavaOpts to configure tachyon client to connect to Tachyon HA master, however the configuration settings were not picked up. On the other hand when I set the same tachyon configuration parameters through

Re: spark job stuck when running on mesos fine grained mode

2014-06-30 Thread elyast
Hi Prabeesh, I've recently moved to mesos 0.18.2 and spark 1.0, so far no problems in fine grained mode, even for grapx or mllib workflows. If u have specific code snippets I can try it out. Best regards Lukasz -- View this message in context:

Re: little confused about SPARK_JAVA_OPTS alternatives

2014-06-11 Thread elyast
Hi, I'm facing similar problem According to: http://tachyon-project.org/Running-Spark-on-Tachyon.html in order to allow tachyon client to connect to tachyon master in HA mode you need to pass 2 system properties: -Dtachyon.zookeeper.address=zookeeperHost1:2181,zookeeperHost2:2181

Re: major Spark performance problem

2014-03-07 Thread elyast
Hi, There is also an option to run spark applications on top of mesos in fine grained mode, then it is possible for fair scheduling (applications will run in parallel and mesos is responsible for scheduling all tasks) so in a sense all applications will progress in parallel, obviously it total in

Running spark 0.9 on mesos 0.15

2014-03-05 Thread elyast
Hi, Quick question do I need to compile spark against exactly same version of mesos library, currently spark depends on 0.13. The problem I am facing is following I am running MLib example with SVM and it works nicely when I use coarse grained mode, however when running fine grained mode on