RE: Adaptive Query Execution performance results in 3TB TPC-DS

2020-02-13 Thread Jia, Ke A
ery Execution performance results in 3TB TPC-DS Thanks Jia Ke for the numbers and they look promising. Were any table stats available for TPC-DS during the runs ? On Thu, Feb 13, 2020 at 4:07 AM Wenchen Fan mailto:cloud0...@gmail.com>> wrote: Thanks for providing the benchmark numbers! The resul

Re: Adaptive Query Execution performance results in 3TB TPC-DS

2020-02-13 Thread Wenchen Fan
Thanks for providing the benchmark numbers! The result is very promising and I'm looking forward to seeing more feedback from real-world workloads. On Wed, Feb 12, 2020 at 3:43 PM Jia, Ke A wrote: > Hi all, > > We have completed the Spark 3.0 Adaptive Query Execution(AQE) performance > tests in

Adaptive Query Execution performance results in 3TB TPC-DS

2020-02-11 Thread Jia, Ke A
Hi all, We have completed the Spark 3.0 Adaptive Query Execution(AQE) performance tests in 3TB TPC-DS on 5 node Cascade Lake cluster. 2 queries bring about more than 1.5x performance and 37 queries bring more than 1.1x performance with AQE. There is no query has significant performance