Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-01-21 Thread Maxim Gekk
Also I am investigating a performance regression in some TPC-DS queries (q88 for instance) that is caused by a recent commit in 3.1, highly likely in the period from 19th November, 2020 to 18th December, 2020. Maxim Gekk Software Engineer Databricks, Inc. On Fri, Jan 22, 2021 at 10:45 AM

Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-01-21 Thread Wenchen Fan
-1 as I just found a regression in 3.1. A self-join query works well in 3.0 but fails in 3.1. It's being fixed at https://github.com/apache/spark/pull/31287 On Fri, Jan 22, 2021 at 4:34 AM Tom Graves wrote: > +1 > > built from tarball, verified sha and regular CI and tests all pass. > > Tom > >

Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-01-21 Thread Tom Graves
+1 built from tarball, verified sha and regular CI and tests all pass. Tom On Monday, January 18, 2021, 06:06:42 AM CST, Hyukjin Kwon wrote: Please vote on releasing the following candidate as Apache Spark version 3.1.1. The vote is open until January 22nd 4PM PST and passes if a

Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-01-21 Thread Holden Karau
Hi folks, Just an FYI -- I've found a potential race condition in this RC with block manager decommissioning and the torrent broadcast factory ( https://issues.apache.org/jira/browse/SPARK-34193 ). I don't think this should block the release (it's not a regression), so my +1 stands as is and I