Hi, I suggest HiBench and SparkSqlPerf, HiBench features many benchmarks within it that exercise several components of Spark (great for stressing core, sql, MLlib capabilities), SparkSqlPerf features 99 TPC-DS queries (stressing the DataFrame API and therefore the Catalyst optimiser), both work well with Spark 2
HiBench: https://github.com/intel-hadoop/HiBench SparkSqlPerf: https://github.com/databricks/spark-sql-perf From: "Kazuaki Ishizaki" <ishiz...@jp.ibm.com> To: Prasun Ratn <prasun.r...@gmail.com> Cc: Apache Spark Dev <dev@spark.apache.org> Date: 10/01/2017 09:22 Subject: Re: Spark performance tests Hi, You may find several micro-benchmarks under https://github.com/apache/spark/tree/master/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark . Regards, Kazuaki Ishizaki From: Prasun Ratn <prasun.r...@gmail.com> To: Apache Spark Dev <dev@spark.apache.org> Date: 2017/01/10 12:52 Subject: Spark performance tests Hi Are there performance tests or microbenchmarks for Spark - especially directed towards the CPU specific parts? I looked at spark-perf but that doesn't seem to have been updated recently. Thanks Prasun --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
