Re: About Databricks's spark-sql-perf

2015-08-13 Thread Yin Huai
Hi Todd, We have not got a chance to update it. We will update it after 1.5 release. Thanks, Yin On Thu, Aug 13, 2015 at 6:49 AM, Todd bit1...@163.com wrote: Hi, I got a question about the spark-sql-perf project by Databricks at https://github.com/databricks/spark-sql-perf/ The

Re:Re: About Databricks's spark-sql-perf

2015-08-13 Thread Todd
Thanks Michael for the answer. I will watch the project and hope the update will be coming soon, :-) At 2015-08-14 02:13:32, Michael Armbrust mich...@databricks.com wrote: Hey sorry, I've been doing a bunch of refactoring on this project. Most of the data generation was a huge hack (it was

Re: About Databricks's spark-sql-perf

2015-08-13 Thread Michael Armbrust
Hey sorry, I've been doing a bunch of refactoring on this project. Most of the data generation was a huge hack (it was done before we supported partitioning natively) and used some private APIs that don't exist anymore. As a result, while doing the regression tests for 1.5 I deleted a bunch of

About Databricks's spark-sql-perf

2015-08-13 Thread Todd
Hi, I got a question about the spark-sql-perf project by Databricks at https://github.com/databricks/spark-sql-perf/ The Tables.scala (https://github.com/databricks/spark-sql-perf/blob/master/src/main/scala/com/databricks/spark/sql/perf/bigdata/Tables.scala) and BigData