Re: Help with Shuffle Read performance

2022-09-30 Thread Leszek Reimus
sier when you want full data locality with shortcut HDFS reads. Since as far as I know Spark on Kubernetes stopped talking about that - and in my experience data locality can speed up Spark by large factor. Sincerely, Leszek Reimus On Fri, Sep 30, 2022 at 2:25 AM Sungwoo Park wrote:

Re: Help with Shuffle Read performance

2022-09-29 Thread Leszek Reimus
deployment (even when ran on same k8s cluster) Sincerely, Leszek Reimus On Thu, Sep 29, 2022 at 7:06 PM Gourav Sengupta wrote: > Hi, > > dont containers finally run on systems, and the only advantage of > containers is that you can do better utilisation of system resources by > m