Re: Spark 3.2.0 first RC next week

Thanks for your information, Sean and Min! On Tue, Aug 10, 2021 at 9:59 PM Min Shen wrote: > Hi Gengliang, > > SPARK-36378 (Switch to using RPCResponse to communicate common block push > failures to the client) should be another one. > This introduces a slight protocol change to push-based

Re: Spark 3.2.0 first RC next week

Hi Gengliang, SPARK-36378 (Switch to using RPCResponse to communicate common block push failures to the client) should be another one. This introduces a slight protocol change to push-based shuffle to improve code robustness and performance, and is almost ready to be committed. Because of the

Spark 3.2.0 first RC next week

Hi all, As of now, there are still some open/in-progress blockers for Spark 3.2.0 release: - Prohibit update mode in native support of session window (SPARK-36463 ) - Avoid inlining non-deterministic With-CTEs(SPARK-36447