Re: [VOTE] Release Spark 3.0.1 (RC3)

-1 due to a regression introduced by a fix in 3.0.1. See https://github.com/apache/spark/pull/29602 Xiao On Mon, Aug 31, 2020 at 9:26 AM Tom Graves wrote: > +1 > > Tom > > On Friday, August 28, 2020, 09:02:31 AM CDT, 郑瑞峰 > wrote: > > > Please vote on releasing the following candidate as

Re: [VOTE] Release Spark 3.0.1 (RC3)

+1 Tom On Friday, August 28, 2020, 09:02:31 AM CDT, 郑瑞峰 wrote: Please vote on releasing the following candidate as Apache Spark version 3.0.1. The vote is open until Sep 2nd at 9AM PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this

Re: What's the root cause of not supporting multiple aggregations in structured streaming?

Hi all, I'm also very interested in this feature but the PR is open since January 2019 and was not updated. It raised a design discussion around watermarks and a design doc was written

is it possible to apply AQE rules only on some of nodes?

Hi, Spark devs I am wondering if it is possible to apply AQE on part of the physical plan? e.g. I only want to apply coalesce partitions on a particular ShuffleQueryStageExec? I didn't find a very straightforward way to achieve this, but is there a way to workaround the current limitation?