:06 AM
To: Sharma, Prakash (Nokia - IN/Bangalore)
Cc: user@spark.apache.org
Subject: Re: Performance Degradation in Spark 3.0.2 compared to Spark 3.0.1
The problem with these tickets is that it tends to generalise the performance
as opposed to a statement of specifics.
According to the latter
. Please refer below link
for, how we created the tpcds data
https://github.com/hortonworks/hive-testbench/ .
Thanks
From: Mich Talebzadeh
Sent: Tuesday, August 31, 2021 1:06 AM
To: Sharma, Prakash (Nokia - IN/Bangalore)
Cc: user@spark.apache.org
Subject: Re: Performance Degradation in Spark
Talebzadeh
Sent: Monday, August 30, 2021 1:15:07 PM
To: Sharma, Prakash (Nokia - IN/Bangalore)
Cc: user@spark.apache.org
Subject: Re: Performance Degradation in Spark 3.0.2 compared to Spark 3.0.1
Hi,
Any particular reason why you are not using 3.1.1 on Kubernetes?
[https://docs.google.com
Sessional Greetings ,
We're doing tpc-ds query tests using Spark 3.0.2 on kubernetes with data
on HDFS and we're observing delays in query execution time when compared to
Spark 3.0.1 on same environment. We've observed that some stages fail, but
looks like it is taking some time to realise
Sessional Greetings ,
We're doing tpc-ds query tests using Spark 3.0.2 on kubernetes with data
on HDFS and we're observing delays in query execution time when compared to
Spark 3.0.1 on same environment. We've observed that some stages fail, but
looks like it is taking some time to realise
