Hi Evan, Sorry for my replay late. And Thank you for your comment.
> As far as cluster set up goes, I usually launch spot instances with the > spark-ec2 scripts, > and then check out a repo which contains a simple driver application for > my code. > Then I have something crude like bash scripts running my program and > collecting output. It's just as you thought. I agree with you. > You could have a look at the spark-perf repo if you want something a > little better principled/automatic. I overlooked this. I will give it a try. best, ----- -- Yu Ishikawa -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/What-is-the-best-way-to-build-my-developing-Spark-for-testing-on-EC2-tp8638p8677.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
