Re: Spark Cluster Benchmarking Frameworks

2015-06-03 Thread Zhen Jia
for the help! > > Jonathan -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Cluster-Benchmarking-Frameworks-tp12699p23146.html Sent from the Apache Spark User List mailing list archive at Nabble.com. ---

Spark Cluster Benchmarking Frameworks

2014-08-23 Thread Jonathan Hodges
Hi Spark Experts, I am curious what people are using to benchmark their Spark clusters. We are about to start a build (bare metal) vs buy (AWS/Google Cloud/Qubole) project to determine our Hadoop and Spark deployment selection. On the Hadoop side we will test live workloads as well as simulated