Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-01-26 Thread Peter Toth
Hey, Sorry for chiming in a bit late, but I would like to suggest my PR ( https://github.com/apache/spark/pull/28885) for review and inclusion into 3.1.1. Currently, invalid reuse reference nodes appear in many queries, causing performance issues and incorrect explain plans. Now that https://gith

Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-01-26 Thread Hyukjin Kwon
It looks like a cool one but it's a pretty big one and affects the plans considerably ... maybe it's best to avoid adding it into 3.1.1 in particular during the RC period if this isn't a clear regression that affects many users. 2021년 1월 26일 (화) 오후 11:23, Peter Toth 님이 작성: > Hey, > > Sorry for ch

Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-01-26 Thread Holden Karau
If were ok waiting for it, I’d like to get https://github.com/apache/spark/pull/31298 in as well (it’s not a regression but it is a bug fix). On Tue, Jan 26, 2021 at 6:38 AM Hyukjin Kwon wrote: > It looks like a cool one but it's a pretty big one and affects the plans > considerably ... maybe it

Re: [VOTE] Release Spark 3.1.1 (RC1)

2021-01-26 Thread Terry Kim
Hi, Please check if the following regression should be included: https://github.com/apache/spark/pull/31352 Thanks, Terry On Tue, Jan 26, 2021 at 7:54 AM Holden Karau wrote: > If were ok waiting for it, I’d like to get > https://github.com/apache/spark/pull/31298 in as well (it’s not a > regre