Re: [Issue] Spark SQL - broadcast failure

2024-07-31 Thread Sudharshan V
Hi all, Do we have any idea on this. Thanks On Tue, 23 Jul, 2024, 12:54 pm Sudharshan V, wrote: > We removed the explicit broadcast for that particular table and it took > longer time since the join type changed from BHJ to SMJ. > > I wanted to understand how I can find what wen

Re: [Issue] Spark SQL - broadcast failure

2024-07-15 Thread Sudharshan V
On Mon, 8 Jul, 2024, 7:53 pm Sudharshan V, wrote: > Hi all, > > Been facing a weird issue lately. > In our production code base , we have an explicit broadcast for a small > table. > It is just a look up table that is around 1gb in size in s3 and just had > few million

Contribute to Spark Open source

2023-12-25 Thread Sudharshan V
Hi All, I am new to Open source and have been using spark scala in my organisation for the past couple of years. I would like to contribute to spark open source. I am not exactly sure of how and where to start. Any help would be greatly appreciated. Is there any documentation per se on how to unde