Re: Time for Spark 3.4.0 release?

2023-01-24 Thread yangjie01
Thanks Xinrong,

发件人: Dongjoon Hyun 
日期: 2023年1月25日 星期三 15:49
收件人: Hyukjin Kwon 
抄送: Xinrong Meng , "dev@spark.apache.org" 

主题: Re: Time for Spark 3.4.0 release?

Great! Thank you so much, Xinrong!

Dongjoon

On Tue, Jan 24, 2023 at 7:17 PM Hyukjin Kwon 
mailto:gurwls...@gmail.com>> wrote:
Thanks Xinrong.

On Wed, 25 Jan 2023 at 12:01, Xinrong Meng 
mailto:xinrong.apa...@gmail.com>> wrote:
Hi All,

Apache Spark 3.4 is cut as 
https://github.com/apache/spark/tree/branch-3.4<https://mailshield.baidu.com/check?q=CfmKbuMe4DzaP7KJbUzyIS5vxslgZH7LONGr%2bkjKE8ZM60M08ljg60mck6HHopkEUoJjfw%3d%3d>.

Thanks,

Xinrong Meng

On Wed, Jan 18, 2023 at 3:45 PM Hyukjin Kwon 
mailto:gurwls...@gmail.com>> wrote:
Yeah, these more look like something we should discuss around RC timing. See 
"Spark 3.4 release window" in 
https://spark.apache.org/versioning-policy.html<https://mailshield.baidu.com/check?q=vctdW221Qpw1RkBH%2baEmJJYTNfyfKdQth%2bXybE4CmiqqiIKDFEKSh0Cm4i6jy9T6ROH2vg%3d%3d>

On Wed, 18 Jan 2023 at 16:28, Enrico Minack 
mailto:i...@enrico.minack.dev>> wrote:
You are saying the RCs are cut from that branch at a later point? What is the 
estimate deadline for that?

Enrico


Am 18.01.23 um 07:59 schrieb Hyukjin Kwon:
These look like we can fix it after the branch-cut so should be fine.

On Wed, 18 Jan 2023 at 15:57, Enrico Minack 
mailto:i...@enrico.minack.dev>> wrote:
Hi Xinrong,

what about regression issue 
https://issues.apache.org/jira/browse/SPARK-40819<https://mailshield.baidu.com/check?q=gZ3KAeNNpk7XguLGPePKKJAyK84uXPe4fnzocke%2f2y4%2fzO6ByMrIp21Vf1l32rN5B1OP7lwF6ms%3d>
and correctness issue 
https://issues.apache.org/jira/browse/SPARK-40885<https://mailshield.baidu.com/check?q=z2yA86joFS%2fjqZi709FzXgLXdy7OrvclJ13oh1IlvKnVtapQL7%2bCOycV85fcP80sV88TtnlLNUQ%3d>?

The latter gets fixed by either 
https://issues.apache.org/jira/browse/SPARK-41959<https://mailshield.baidu.com/check?q=z3WbUXSxLzX6eZpL3523d%2fd30EsadsX4p0AarVy0GKcw3f7xQq3IxwTC65b3jR7QgcHdEeqxnpM%3d>
 or 
https://issues.apache.org/jira/browse/SPARK-42049<https://mailshield.baidu.com/check?q=18pSYaUwqVD9SqVmp73xh%2bvtOyUyH0Qn4N6hLwM1aQGK5CAaBUNh%2f3L973XPNNY3PIyDRRScjaw%3d>.

Are those considered important?

Cheers,
Enrico


Am 18.01.23 um 04:29 schrieb Xinrong Meng:
Hi All,

Considering there are still important issues unresolved (some are as shown 
below), I would suggest to be conservative, we delay the branch-3.4's cut for 
one week.

https://issues.apache.org/jira/browse/SPARK-39375<https://mailshield.baidu.com/check?q=f0X0bxnFXHg8Y1kFcPbNfSX5IwT9tbOERU%2b4SApc%2bXWM46YFYoCON3D0vLZM5BF8HVQVe781IGc%3d>
https://issues.apache.org/jira/browse/SPARK-41589<https://mailshield.baidu.com/check?q=GTt%2fpKnNB43%2f%2bbDHjhj3LgzSI4b0xPjfuNz77vWQJr3%2bgsyLz%2fl9tMDtuX3HKlyuHN6fVKrQauw%3d>
https://issues.apache.org/jira/browse/SPARK-42075<https://mailshield.baidu.com/check?q=t8pBE5c65Q8FRYnCYkf8SWqJM24iys%2bXh5aiMRi6LGoPsJjXr0U0wn%2bbHHS9PaEOuKlJqzURmvo%3d>
https://issues.apache.org/jira/browse/SPARK-25299<https://mailshield.baidu.com/check?q=LBOw4%2f8Q9IBab1bnt%2bKgB4qwSb%2fwB6Fu3wiTYhc08AP8eBYitoA3FIJkPmL6EnqYWnmmOvcV7J8%3d>
https://issues.apache.org/jira/browse/SPARK-41053<https://mailshield.baidu.com/check?q=ExjU%2bgQLn2i%2bt2tQxskz%2fv3R2RNe1SD5b%2bpuWyaJCvWkcoKGo2aMna3imdmsO14YUhT4LUP1GKY%3d>

I plan to cut branch-3.4 at 18:30 PT, January 24, 2023. Please ensure your 
changes for Apache Spark 3.4 to be ready by that time.

Feel free to reply to the email if you have other ongoing big items for Spark 
3.4.

Thanks,

Xinrong Meng

On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon 
mailto:gurwls...@gmail.com>> wrote:
Thanks Xinrong.

On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng 
mailto:xinrong.apa...@gmail.com>> wrote:
The release window for Apache Spark 3.4.0 is updated per 
https://github.com/apache/spark-website/pull/430<https://mailshield.baidu.com/check?q=muUGA4y2q%2b%2fuEQ9xJn9v7fjFtZEL132VCyqFy42iI4dLb1VzE1%2bXo9xkFtYK0K6Uic13NQ%3d%3d>.

Thank you all!

On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk 
mailto:maxim.g...@databricks.com>> wrote:
+1

On Thu, Jan 5, 2023 at 12:25 AM huaxin gao 
mailto:huaxin.ga...@gmail.com>> wrote:
+1 Thanks!

On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh 
mailto:vii...@gmail.com>> wrote:
+1

Thank you!

On Wed, Jan 4, 2023 at 9:13 AM Chao Sun 
mailto:sunc...@apache.org>> wrote:
+1, thanks!

Chao

On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan 
mailto:mri...@gmail.com>> wrote:

+1, Thanks !

Regards,
Mridul

On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang 
mailto:ltn...@gmail.com>> wrote:
+1, thanks for driving the release!


Gengliang

On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun 
mailto:dongjoon.h...@gmail.com>> wrote:
+1

Thank you!

Dongjoon

On Tue, Jan 3, 2023 at 9:44 PM Rui Wang 
mailto:amaliu...@apache.org>> wrote:
+1 to cut the branch star

Re: Time for Spark 3.4.0 release?

2023-01-24 Thread Dongjoon Hyun
Great! Thank you so much, Xinrong!

Dongjoon

On Tue, Jan 24, 2023 at 7:17 PM Hyukjin Kwon  wrote:

> Thanks Xinrong.
>
> On Wed, 25 Jan 2023 at 12:01, Xinrong Meng 
> wrote:
>
>> Hi All,
>>
>> Apache Spark 3.4 is cut as
>> https://github.com/apache/spark/tree/branch-3.4.
>>
>> Thanks,
>>
>> Xinrong Meng
>>
>> On Wed, Jan 18, 2023 at 3:45 PM Hyukjin Kwon  wrote:
>>
>>> Yeah, these more look like something we should discuss around RC timing.
>>> See "Spark 3.4 release window" in
>>> https://spark.apache.org/versioning-policy.html
>>>
>>> On Wed, 18 Jan 2023 at 16:28, Enrico Minack 
>>> wrote:
>>>
>>>> You are saying the RCs are cut from that branch at a later point? What
>>>> is the estimate deadline for that?
>>>>
>>>> Enrico
>>>>
>>>>
>>>> Am 18.01.23 um 07:59 schrieb Hyukjin Kwon:
>>>>
>>>> These look like we can fix it after the branch-cut so should be fine.
>>>>
>>>> On Wed, 18 Jan 2023 at 15:57, Enrico Minack 
>>>> wrote:
>>>>
>>>>> Hi Xinrong,
>>>>>
>>>>> what about regression issue
>>>>> https://issues.apache.org/jira/browse/SPARK-40819
>>>>> and correctness issue
>>>>> https://issues.apache.org/jira/browse/SPARK-40885?
>>>>>
>>>>> The latter gets fixed by either
>>>>> https://issues.apache.org/jira/browse/SPARK-41959 or
>>>>> https://issues.apache.org/jira/browse/SPARK-42049.
>>>>>
>>>>> Are those considered important?
>>>>>
>>>>> Cheers,
>>>>> Enrico
>>>>>
>>>>>
>>>>> Am 18.01.23 um 04:29 schrieb Xinrong Meng:
>>>>>
>>>>> Hi All,
>>>>>
>>>>> Considering there are still important issues unresolved (some are as
>>>>> shown below), I would suggest to be conservative, we delay the 
>>>>> branch-3.4's
>>>>> cut for one week.
>>>>>
>>>>> https://issues.apache.org/jira/browse/SPARK-39375
>>>>> https://issues.apache.org/jira/browse/SPARK-41589
>>>>> https://issues.apache.org/jira/browse/SPARK-42075
>>>>> https://issues.apache.org/jira/browse/SPARK-25299
>>>>> https://issues.apache.org/jira/browse/SPARK-41053
>>>>>
>>>>> I plan to cut *branch-3.4* at *18:30 PT, January 24, 2023*. Please
>>>>> ensure your changes for Apache Spark 3.4 to be ready by that time.
>>>>>
>>>>> Feel free to reply to the email if you have other ongoing big items
>>>>> for Spark 3.4.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Xinrong Meng
>>>>>
>>>>> On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon 
>>>>> wrote:
>>>>>
>>>>>> Thanks Xinrong.
>>>>>>
>>>>>> On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng 
>>>>>> wrote:
>>>>>>
>>>>>>> The release window for Apache Spark 3.4.0 is updated per
>>>>>>> https://github.com/apache/spark-website/pull/430.
>>>>>>>
>>>>>>> Thank you all!
>>>>>>>
>>>>>>> On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> +1
>>>>>>>>
>>>>>>>> On Thu, Jan 5, 2023 at 12:25 AM huaxin gao 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> +1 Thanks!
>>>>>>>>>
>>>>>>>>> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh 
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> +1
>>>>>>>>>>
>>>>>>>>>> Thank you!
>>>>>>>>>>
>>>>>>>>>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun 
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> +1, thanks!
>>>>>>>>>>>
>>>>>>>>>>> Chao
>>>>>>>>>>>
>>>>>>>>>>> On Wed, Jan 4, 2023 at 1:56 A

Re: Time for Spark 3.4.0 release?

2023-01-24 Thread Hyukjin Kwon
Thanks Xinrong.

On Wed, 25 Jan 2023 at 12:01, Xinrong Meng  wrote:

> Hi All,
>
> Apache Spark 3.4 is cut as https://github.com/apache/spark/tree/branch-3.4
> .
>
> Thanks,
>
> Xinrong Meng
>
> On Wed, Jan 18, 2023 at 3:45 PM Hyukjin Kwon  wrote:
>
>> Yeah, these more look like something we should discuss around RC timing.
>> See "Spark 3.4 release window" in
>> https://spark.apache.org/versioning-policy.html
>>
>> On Wed, 18 Jan 2023 at 16:28, Enrico Minack 
>> wrote:
>>
>>> You are saying the RCs are cut from that branch at a later point? What
>>> is the estimate deadline for that?
>>>
>>> Enrico
>>>
>>>
>>> Am 18.01.23 um 07:59 schrieb Hyukjin Kwon:
>>>
>>> These look like we can fix it after the branch-cut so should be fine.
>>>
>>> On Wed, 18 Jan 2023 at 15:57, Enrico Minack 
>>> wrote:
>>>
>>>> Hi Xinrong,
>>>>
>>>> what about regression issue
>>>> https://issues.apache.org/jira/browse/SPARK-40819
>>>> and correctness issue https://issues.apache.org/jira/browse/SPARK-40885
>>>> ?
>>>>
>>>> The latter gets fixed by either
>>>> https://issues.apache.org/jira/browse/SPARK-41959 or
>>>> https://issues.apache.org/jira/browse/SPARK-42049.
>>>>
>>>> Are those considered important?
>>>>
>>>> Cheers,
>>>> Enrico
>>>>
>>>>
>>>> Am 18.01.23 um 04:29 schrieb Xinrong Meng:
>>>>
>>>> Hi All,
>>>>
>>>> Considering there are still important issues unresolved (some are as
>>>> shown below), I would suggest to be conservative, we delay the branch-3.4's
>>>> cut for one week.
>>>>
>>>> https://issues.apache.org/jira/browse/SPARK-39375
>>>> https://issues.apache.org/jira/browse/SPARK-41589
>>>> https://issues.apache.org/jira/browse/SPARK-42075
>>>> https://issues.apache.org/jira/browse/SPARK-25299
>>>> https://issues.apache.org/jira/browse/SPARK-41053
>>>>
>>>> I plan to cut *branch-3.4* at *18:30 PT, January 24, 2023*. Please
>>>> ensure your changes for Apache Spark 3.4 to be ready by that time.
>>>>
>>>> Feel free to reply to the email if you have other ongoing big items for
>>>> Spark 3.4.
>>>>
>>>> Thanks,
>>>>
>>>> Xinrong Meng
>>>>
>>>> On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon 
>>>> wrote:
>>>>
>>>>> Thanks Xinrong.
>>>>>
>>>>> On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng 
>>>>> wrote:
>>>>>
>>>>>> The release window for Apache Spark 3.4.0 is updated per
>>>>>> https://github.com/apache/spark-website/pull/430.
>>>>>>
>>>>>> Thank you all!
>>>>>>
>>>>>> On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk 
>>>>>> wrote:
>>>>>>
>>>>>>> +1
>>>>>>>
>>>>>>> On Thu, Jan 5, 2023 at 12:25 AM huaxin gao 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> +1 Thanks!
>>>>>>>>
>>>>>>>> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> +1
>>>>>>>>>
>>>>>>>>> Thank you!
>>>>>>>>>
>>>>>>>>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun 
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> +1, thanks!
>>>>>>>>>>
>>>>>>>>>> Chao
>>>>>>>>>>
>>>>>>>>>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan <
>>>>>>>>>> mri...@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> +1, Thanks !
>>>>>>>>>>>
>>>>>>>>>>> Regards,
>>>>>>>>>>> Mridul
>>>>>>>>>>>
>>>>>>>>>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang 
>>>>>>>>>>> wrote:
>&g

Re: Time for Spark 3.4.0 release?

2023-01-24 Thread Xinrong Meng
Hi All,

Apache Spark 3.4 is cut as https://github.com/apache/spark/tree/branch-3.4.

Thanks,

Xinrong Meng

On Wed, Jan 18, 2023 at 3:45 PM Hyukjin Kwon  wrote:

> Yeah, these more look like something we should discuss around RC timing.
> See "Spark 3.4 release window" in
> https://spark.apache.org/versioning-policy.html
>
> On Wed, 18 Jan 2023 at 16:28, Enrico Minack 
> wrote:
>
>> You are saying the RCs are cut from that branch at a later point? What is
>> the estimate deadline for that?
>>
>> Enrico
>>
>>
>> Am 18.01.23 um 07:59 schrieb Hyukjin Kwon:
>>
>> These look like we can fix it after the branch-cut so should be fine.
>>
>> On Wed, 18 Jan 2023 at 15:57, Enrico Minack 
>> wrote:
>>
>>> Hi Xinrong,
>>>
>>> what about regression issue
>>> https://issues.apache.org/jira/browse/SPARK-40819
>>> and correctness issue https://issues.apache.org/jira/browse/SPARK-40885?
>>>
>>> The latter gets fixed by either
>>> https://issues.apache.org/jira/browse/SPARK-41959 or
>>> https://issues.apache.org/jira/browse/SPARK-42049.
>>>
>>> Are those considered important?
>>>
>>> Cheers,
>>> Enrico
>>>
>>>
>>> Am 18.01.23 um 04:29 schrieb Xinrong Meng:
>>>
>>> Hi All,
>>>
>>> Considering there are still important issues unresolved (some are as
>>> shown below), I would suggest to be conservative, we delay the branch-3.4's
>>> cut for one week.
>>>
>>> https://issues.apache.org/jira/browse/SPARK-39375
>>> https://issues.apache.org/jira/browse/SPARK-41589
>>> https://issues.apache.org/jira/browse/SPARK-42075
>>> https://issues.apache.org/jira/browse/SPARK-25299
>>> https://issues.apache.org/jira/browse/SPARK-41053
>>>
>>> I plan to cut *branch-3.4* at *18:30 PT, January 24, 2023*. Please
>>> ensure your changes for Apache Spark 3.4 to be ready by that time.
>>>
>>> Feel free to reply to the email if you have other ongoing big items for
>>> Spark 3.4.
>>>
>>> Thanks,
>>>
>>> Xinrong Meng
>>>
>>> On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon  wrote:
>>>
>>>> Thanks Xinrong.
>>>>
>>>> On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng 
>>>> wrote:
>>>>
>>>>> The release window for Apache Spark 3.4.0 is updated per
>>>>> https://github.com/apache/spark-website/pull/430.
>>>>>
>>>>> Thank you all!
>>>>>
>>>>> On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk 
>>>>> wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> On Thu, Jan 5, 2023 at 12:25 AM huaxin gao 
>>>>>> wrote:
>>>>>>
>>>>>>> +1 Thanks!
>>>>>>>
>>>>>>> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> +1
>>>>>>>>
>>>>>>>> Thank you!
>>>>>>>>
>>>>>>>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:
>>>>>>>>
>>>>>>>>> +1, thanks!
>>>>>>>>>
>>>>>>>>> Chao
>>>>>>>>>
>>>>>>>>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan <
>>>>>>>>> mri...@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> +1, Thanks !
>>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Mridul
>>>>>>>>>>
>>>>>>>>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang 
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> +1, thanks for driving the release!
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Gengliang
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun <
>>>>>>>>>>> dongjoon.h...@gmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> +1
>>>>>>>>>&

Re: Time for Spark 3.4.0 release?

2023-01-17 Thread Hyukjin Kwon
Yeah, these more look like something we should discuss around RC timing.
See "Spark 3.4 release window" in
https://spark.apache.org/versioning-policy.html

On Wed, 18 Jan 2023 at 16:28, Enrico Minack  wrote:

> You are saying the RCs are cut from that branch at a later point? What is
> the estimate deadline for that?
>
> Enrico
>
>
> Am 18.01.23 um 07:59 schrieb Hyukjin Kwon:
>
> These look like we can fix it after the branch-cut so should be fine.
>
> On Wed, 18 Jan 2023 at 15:57, Enrico Minack 
> wrote:
>
>> Hi Xinrong,
>>
>> what about regression issue
>> https://issues.apache.org/jira/browse/SPARK-40819
>> and correctness issue https://issues.apache.org/jira/browse/SPARK-40885?
>>
>> The latter gets fixed by either
>> https://issues.apache.org/jira/browse/SPARK-41959 or
>> https://issues.apache.org/jira/browse/SPARK-42049.
>>
>> Are those considered important?
>>
>> Cheers,
>> Enrico
>>
>>
>> Am 18.01.23 um 04:29 schrieb Xinrong Meng:
>>
>> Hi All,
>>
>> Considering there are still important issues unresolved (some are as
>> shown below), I would suggest to be conservative, we delay the branch-3.4's
>> cut for one week.
>>
>> https://issues.apache.org/jira/browse/SPARK-39375
>> https://issues.apache.org/jira/browse/SPARK-41589
>> https://issues.apache.org/jira/browse/SPARK-42075
>> https://issues.apache.org/jira/browse/SPARK-25299
>> https://issues.apache.org/jira/browse/SPARK-41053
>>
>> I plan to cut *branch-3.4* at *18:30 PT, January 24, 2023*. Please
>> ensure your changes for Apache Spark 3.4 to be ready by that time.
>>
>> Feel free to reply to the email if you have other ongoing big items for
>> Spark 3.4.
>>
>> Thanks,
>>
>> Xinrong Meng
>>
>> On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon  wrote:
>>
>>> Thanks Xinrong.
>>>
>>> On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng 
>>> wrote:
>>>
>>>> The release window for Apache Spark 3.4.0 is updated per
>>>> https://github.com/apache/spark-website/pull/430.
>>>>
>>>> Thank you all!
>>>>
>>>> On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk 
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> On Thu, Jan 5, 2023 at 12:25 AM huaxin gao 
>>>>> wrote:
>>>>>
>>>>>> +1 Thanks!
>>>>>>
>>>>>> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh  wrote:
>>>>>>
>>>>>>> +1
>>>>>>>
>>>>>>> Thank you!
>>>>>>>
>>>>>>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:
>>>>>>>
>>>>>>>> +1, thanks!
>>>>>>>>
>>>>>>>> Chao
>>>>>>>>
>>>>>>>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan <
>>>>>>>> mri...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>>
>>>>>>>>> +1, Thanks !
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Mridul
>>>>>>>>>
>>>>>>>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang 
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> +1, thanks for driving the release!
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Gengliang
>>>>>>>>>>
>>>>>>>>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun <
>>>>>>>>>> dongjoon.h...@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> +1
>>>>>>>>>>>
>>>>>>>>>>> Thank you!
>>>>>>>>>>>
>>>>>>>>>>> Dongjoon
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang 
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> +1 to cut the branch starting from a workday!
>>>>>>>>>>>>
>>>>>>>>>>>> Great to see this is happening!
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks Xinrong!
>>>>>>>>>>>>
>>>>>>>>>>>> -Rui
>>>>>>>>>>>>
>>>>>>>>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com <
>>>>>>>>>>>> ruife...@foxmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> +1, thank you Xinrong for driving this release!
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Ruifeng Zheng
>>>>>>>>>>>>> ruife...@foxmail.com
>>>>>>>>>>>>>
>>>>>>>>>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> -- Original --
>>>>>>>>>>>>> *From:* "Hyukjin Kwon" ;
>>>>>>>>>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>>>>>>>>>> *To:* "Xinrong Meng";
>>>>>>>>>>>>> *Cc:* "dev";
>>>>>>>>>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>>>>>>>>>
>>>>>>>>>>>>> SGTM +1
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng <
>>>>>>>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We
>>>>>>>>>>>>>> proposed January 15th per
>>>>>>>>>>>>>> https://spark.apache.org/versioning-policy.html, but I would
>>>>>>>>>>>>>> suggest we postpone one day since January 15th is a Sunday.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I would like to volunteer as the release manager for *Apache
>>>>>>>>>>>>>> Spark 3.4.0*.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Xinrong Meng
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>
>


Re: Time for Spark 3.4.0 release?

2023-01-17 Thread Enrico Minack
*Date:* Wed, Jan 4,
2023 01:15 PM
*To:* "Xinrong
Meng";
*Cc:* 
"dev";
    *Subject:* Re: Time
        for Spark 3.4.0 release?

SGTM +1

On Wed, Jan 4, 2023
at 2:13 PM Xinrong
Meng

wrote:

Hi All,

Shall we cut
*branch-3.4* on
*January 16th,
2023*? We
proposed January
15th per

https://spark.apache.org/versioning-policy.html,
but I would
suggest we
postpone one day
since January
15th is a Sunday.

I would like to
volunteer as the
release manager
for *Apache Spark
3.4.0*.

Thanks,

Xinrong Meng





Re: Time for Spark 3.4.0 release?

2023-01-17 Thread Hyukjin Kwon
These look like we can fix it after the branch-cut so should be fine.

On Wed, 18 Jan 2023 at 15:57, Enrico Minack  wrote:

> Hi Xinrong,
>
> what about regression issue
> https://issues.apache.org/jira/browse/SPARK-40819
> and correctness issue https://issues.apache.org/jira/browse/SPARK-40885?
>
> The latter gets fixed by either
> https://issues.apache.org/jira/browse/SPARK-41959 or
> https://issues.apache.org/jira/browse/SPARK-42049.
>
> Are those considered important?
>
> Cheers,
> Enrico
>
>
> Am 18.01.23 um 04:29 schrieb Xinrong Meng:
>
> Hi All,
>
> Considering there are still important issues unresolved (some are as shown
> below), I would suggest to be conservative, we delay the branch-3.4's cut
> for one week.
>
> https://issues.apache.org/jira/browse/SPARK-39375
> https://issues.apache.org/jira/browse/SPARK-41589
> https://issues.apache.org/jira/browse/SPARK-42075
> https://issues.apache.org/jira/browse/SPARK-25299
> https://issues.apache.org/jira/browse/SPARK-41053
>
> I plan to cut *branch-3.4* at *18:30 PT, January 24, 2023*. Please ensure
> your changes for Apache Spark 3.4 to be ready by that time.
>
> Feel free to reply to the email if you have other ongoing big items for
> Spark 3.4.
>
> Thanks,
>
> Xinrong Meng
>
> On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon  wrote:
>
>> Thanks Xinrong.
>>
>> On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng 
>> wrote:
>>
>>> The release window for Apache Spark 3.4.0 is updated per
>>> https://github.com/apache/spark-website/pull/430.
>>>
>>> Thank you all!
>>>
>>> On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk 
>>> wrote:
>>>
>>>> +1
>>>>
>>>> On Thu, Jan 5, 2023 at 12:25 AM huaxin gao 
>>>> wrote:
>>>>
>>>>> +1 Thanks!
>>>>>
>>>>> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh  wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> Thank you!
>>>>>>
>>>>>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:
>>>>>>
>>>>>>> +1, thanks!
>>>>>>>
>>>>>>> Chao
>>>>>>>
>>>>>>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan 
>>>>>>> wrote:
>>>>>>>
>>>>>>>>
>>>>>>>> +1, Thanks !
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Mridul
>>>>>>>>
>>>>>>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> +1, thanks for driving the release!
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Gengliang
>>>>>>>>>
>>>>>>>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun <
>>>>>>>>> dongjoon.h...@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> +1
>>>>>>>>>>
>>>>>>>>>> Thank you!
>>>>>>>>>>
>>>>>>>>>> Dongjoon
>>>>>>>>>>
>>>>>>>>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang 
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> +1 to cut the branch starting from a workday!
>>>>>>>>>>>
>>>>>>>>>>> Great to see this is happening!
>>>>>>>>>>>
>>>>>>>>>>> Thanks Xinrong!
>>>>>>>>>>>
>>>>>>>>>>> -Rui
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com <
>>>>>>>>>>> ruife...@foxmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> +1, thank you Xinrong for driving this release!
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Ruifeng Zheng
>>>>>>>>>>>> ruife...@foxmail.com
>>>>>>>>>>>>
>>>>>>>>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> -- Original --
>>>>>>>>>>>> *From:* "Hyukjin Kwon" ;
>>>>>>>>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>>>>>>>>> *To:* "Xinrong Meng";
>>>>>>>>>>>> *Cc:* "dev";
>>>>>>>>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>>>>>>>>
>>>>>>>>>>>> SGTM +1
>>>>>>>>>>>>
>>>>>>>>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng <
>>>>>>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We
>>>>>>>>>>>>> proposed January 15th per
>>>>>>>>>>>>> https://spark.apache.org/versioning-policy.html, but I would
>>>>>>>>>>>>> suggest we postpone one day since January 15th is a Sunday.
>>>>>>>>>>>>>
>>>>>>>>>>>>> I would like to volunteer as the release manager for *Apache
>>>>>>>>>>>>> Spark 3.4.0*.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Xinrong Meng
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>


Re: Time for Spark 3.4.0 release?

2023-01-17 Thread Enrico Minack

Hi Xinrong,

what about regression issue 
https://issues.apache.org/jira/browse/SPARK-40819

and correctness issue https://issues.apache.org/jira/browse/SPARK-40885?

The latter gets fixed by either 
https://issues.apache.org/jira/browse/SPARK-41959 or 
https://issues.apache.org/jira/browse/SPARK-42049.


Are those considered important?

Cheers,
Enrico


Am 18.01.23 um 04:29 schrieb Xinrong Meng:

Hi All,

Considering there are still important issues unresolved (some are as 
shown below), I would suggest to be conservative, we delay the 
branch-3.4's cut for one week.


https://issues.apache.org/jira/browse/SPARK-39375
https://issues.apache.org/jira/browse/SPARK-41589
https://issues.apache.org/jira/browse/SPARK-42075
https://issues.apache.org/jira/browse/SPARK-25299
https://issues.apache.org/jira/browse/SPARK-41053

I plan to cut *branch-3.4* at *18:30 PT, January 24, 2023*. Please 
ensure your changes for Apache Spark 3.4 to be ready by that time.


Feel free to reply to the email if you have other ongoing big items 
for Spark 3.4.


Thanks,

Xinrong Meng

On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon  wrote:

Thanks Xinrong.

On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng
 wrote:

The release window for Apache Spark 3.4.0 is updated per
https://github.com/apache/spark-website/pull/430.

Thank you all!

On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk
 wrote:

+1

On Thu, Jan 5, 2023 at 12:25 AM huaxin gao
 wrote:

+1 Thanks!

On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh
 wrote:

+1

Thank you!

On Wed, Jan 4, 2023 at 9:13 AM Chao Sun
 wrote:

+1, thanks!

Chao

On Wed, Jan 4, 2023 at 1:56 AM Mridul
Muralidharan  wrote:


+1, Thanks !

Regards,
Mridul

On Wed, Jan 4, 2023 at 2:20 AM Gengliang
Wang  wrote:

+1, thanks for driving the release!


Gengliang

On Tue, Jan 3, 2023 at 10:55 PM
Dongjoon Hyun
 wrote:

+1

Thank you!

Dongjoon

On Tue, Jan 3, 2023 at 9:44 PM Rui
Wang  wrote:

+1 to cut the branch starting
from a workday!

Great to see this is happening!

Thanks Xinrong!

-Rui

On Tue, Jan 3, 2023 at 9:21 PM
416161...@qq.com
 wrote:

+1, thank you Xinrong for
driving this release!




Ruifeng Zheng
ruife...@foxmail.com


<https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>


--
Original --
*From:* "Hyukjin Kwon"
;
*Date:* Wed, Jan 4, 2023
01:15 PM
*To:* "Xinrong
Meng";
*Cc:* "dev";
        *Subject:* Re: Time for
    Spark 3.4.0 release?

SGTM +1

On Wed, Jan 4, 2023 at
2:13 PM Xinrong Meng

wrote:

Hi All,

Re: Time for Spark 3.4.0 release?

2023-01-17 Thread Jungtaek Lim
+1 on delaying. I see there’s a JIRA ticket about DStream depreciation, we
are working on this - thanks for taking this into account!

2023년 1월 18일 (수) 오후 12:43, Hyukjin Kwon 님이 작성:

> +1. Thanks for driving this, Xinrong.
>
> On Wed, 18 Jan 2023 at 12:31, Xinrong Meng 
> wrote:
>
>> Hi All,
>>
>> Considering there are still important issues unresolved (some are as
>> shown below), I would suggest to be conservative, we delay the branch-3.4's
>> cut for one week.
>>
>> https://issues.apache.org/jira/browse/SPARK-39375
>> https://issues.apache.org/jira/browse/SPARK-41589
>> https://issues.apache.org/jira/browse/SPARK-42075
>> https://issues.apache.org/jira/browse/SPARK-25299
>> https://issues.apache.org/jira/browse/SPARK-41053
>>
>> I plan to cut *branch-3.4* at *18:30 PT, January 24, 2023*. Please
>> ensure your changes for Apache Spark 3.4 to be ready by that time.
>>
>> Feel free to reply to the email if you have other ongoing big items for
>> Spark 3.4.
>>
>> Thanks,
>>
>> Xinrong Meng
>>
>> On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon  wrote:
>>
>>> Thanks Xinrong.
>>>
>>> On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng 
>>> wrote:
>>>
>>>> The release window for Apache Spark 3.4.0 is updated per
>>>> https://github.com/apache/spark-website/pull/430.
>>>>
>>>> Thank you all!
>>>>
>>>> On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk 
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> On Thu, Jan 5, 2023 at 12:25 AM huaxin gao 
>>>>> wrote:
>>>>>
>>>>>> +1 Thanks!
>>>>>>
>>>>>> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh  wrote:
>>>>>>
>>>>>>> +1
>>>>>>>
>>>>>>> Thank you!
>>>>>>>
>>>>>>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:
>>>>>>>
>>>>>>>> +1, thanks!
>>>>>>>>
>>>>>>>> Chao
>>>>>>>>
>>>>>>>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan <
>>>>>>>> mri...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>>
>>>>>>>>> +1, Thanks !
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Mridul
>>>>>>>>>
>>>>>>>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang 
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> +1, thanks for driving the release!
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Gengliang
>>>>>>>>>>
>>>>>>>>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun <
>>>>>>>>>> dongjoon.h...@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> +1
>>>>>>>>>>>
>>>>>>>>>>> Thank you!
>>>>>>>>>>>
>>>>>>>>>>> Dongjoon
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang 
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> +1 to cut the branch starting from a workday!
>>>>>>>>>>>>
>>>>>>>>>>>> Great to see this is happening!
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks Xinrong!
>>>>>>>>>>>>
>>>>>>>>>>>> -Rui
>>>>>>>>>>>>
>>>>>>>>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com <
>>>>>>>>>>>> ruife...@foxmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> +1, thank you Xinrong for driving this release!
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Ruifeng Zheng
>>>>>>>>>>>>> ruife...@foxmail.com
>>>>>>>>>>>>>
>>>>>>>>>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> -- Original --
>>>>>>>>>>>>> *From:* "Hyukjin Kwon" ;
>>>>>>>>>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>>>>>>>>>> *To:* "Xinrong Meng";
>>>>>>>>>>>>> *Cc:* "dev";
>>>>>>>>>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>>>>>>>>>
>>>>>>>>>>>>> SGTM +1
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng <
>>>>>>>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We
>>>>>>>>>>>>>> proposed January 15th per
>>>>>>>>>>>>>> https://spark.apache.org/versioning-policy.html, but I would
>>>>>>>>>>>>>> suggest we postpone one day since January 15th is a Sunday.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I would like to volunteer as the release manager for *Apache
>>>>>>>>>>>>>> Spark 3.4.0*.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Xinrong Meng
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>


Re: Time for Spark 3.4.0 release?

2023-01-17 Thread Hyukjin Kwon
+1. Thanks for driving this, Xinrong.

On Wed, 18 Jan 2023 at 12:31, Xinrong Meng  wrote:

> Hi All,
>
> Considering there are still important issues unresolved (some are as shown
> below), I would suggest to be conservative, we delay the branch-3.4's cut
> for one week.
>
> https://issues.apache.org/jira/browse/SPARK-39375
> https://issues.apache.org/jira/browse/SPARK-41589
> https://issues.apache.org/jira/browse/SPARK-42075
> https://issues.apache.org/jira/browse/SPARK-25299
> https://issues.apache.org/jira/browse/SPARK-41053
>
> I plan to cut *branch-3.4* at *18:30 PT, January 24, 2023*. Please ensure
> your changes for Apache Spark 3.4 to be ready by that time.
>
> Feel free to reply to the email if you have other ongoing big items for
> Spark 3.4.
>
> Thanks,
>
> Xinrong Meng
>
> On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon  wrote:
>
>> Thanks Xinrong.
>>
>> On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng 
>> wrote:
>>
>>> The release window for Apache Spark 3.4.0 is updated per
>>> https://github.com/apache/spark-website/pull/430.
>>>
>>> Thank you all!
>>>
>>> On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk 
>>> wrote:
>>>
>>>> +1
>>>>
>>>> On Thu, Jan 5, 2023 at 12:25 AM huaxin gao 
>>>> wrote:
>>>>
>>>>> +1 Thanks!
>>>>>
>>>>> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh  wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> Thank you!
>>>>>>
>>>>>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:
>>>>>>
>>>>>>> +1, thanks!
>>>>>>>
>>>>>>> Chao
>>>>>>>
>>>>>>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan 
>>>>>>> wrote:
>>>>>>>
>>>>>>>>
>>>>>>>> +1, Thanks !
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Mridul
>>>>>>>>
>>>>>>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> +1, thanks for driving the release!
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Gengliang
>>>>>>>>>
>>>>>>>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun <
>>>>>>>>> dongjoon.h...@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> +1
>>>>>>>>>>
>>>>>>>>>> Thank you!
>>>>>>>>>>
>>>>>>>>>> Dongjoon
>>>>>>>>>>
>>>>>>>>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang 
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> +1 to cut the branch starting from a workday!
>>>>>>>>>>>
>>>>>>>>>>> Great to see this is happening!
>>>>>>>>>>>
>>>>>>>>>>> Thanks Xinrong!
>>>>>>>>>>>
>>>>>>>>>>> -Rui
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com <
>>>>>>>>>>> ruife...@foxmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> +1, thank you Xinrong for driving this release!
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Ruifeng Zheng
>>>>>>>>>>>> ruife...@foxmail.com
>>>>>>>>>>>>
>>>>>>>>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> -- Original --
>>>>>>>>>>>> *From:* "Hyukjin Kwon" ;
>>>>>>>>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>>>>>>>>> *To:* "Xinrong Meng";
>>>>>>>>>>>> *Cc:* "dev";
>>>>>>>>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>>>>>>>>
>>>>>>>>>>>> SGTM +1
>>>>>>>>>>>>
>>>>>>>>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng <
>>>>>>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We
>>>>>>>>>>>>> proposed January 15th per
>>>>>>>>>>>>> https://spark.apache.org/versioning-policy.html, but I would
>>>>>>>>>>>>> suggest we postpone one day since January 15th is a Sunday.
>>>>>>>>>>>>>
>>>>>>>>>>>>> I would like to volunteer as the release manager for *Apache
>>>>>>>>>>>>> Spark 3.4.0*.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Xinrong Meng
>>>>>>>>>>>>>
>>>>>>>>>>>>>


Re: Time for Spark 3.4.0 release?

2023-01-17 Thread Xinrong Meng
Hi All,

Considering there are still important issues unresolved (some are as shown
below), I would suggest to be conservative, we delay the branch-3.4's cut
for one week.

https://issues.apache.org/jira/browse/SPARK-39375
https://issues.apache.org/jira/browse/SPARK-41589
https://issues.apache.org/jira/browse/SPARK-42075
https://issues.apache.org/jira/browse/SPARK-25299
https://issues.apache.org/jira/browse/SPARK-41053

I plan to cut *branch-3.4* at *18:30 PT, January 24, 2023*. Please ensure
your changes for Apache Spark 3.4 to be ready by that time.

Feel free to reply to the email if you have other ongoing big items for
Spark 3.4.

Thanks,

Xinrong Meng

On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon  wrote:

> Thanks Xinrong.
>
> On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng 
> wrote:
>
>> The release window for Apache Spark 3.4.0 is updated per
>> https://github.com/apache/spark-website/pull/430.
>>
>> Thank you all!
>>
>> On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk 
>> wrote:
>>
>>> +1
>>>
>>> On Thu, Jan 5, 2023 at 12:25 AM huaxin gao 
>>> wrote:
>>>
>>>> +1 Thanks!
>>>>
>>>> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh  wrote:
>>>>
>>>>> +1
>>>>>
>>>>> Thank you!
>>>>>
>>>>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:
>>>>>
>>>>>> +1, thanks!
>>>>>>
>>>>>> Chao
>>>>>>
>>>>>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan 
>>>>>> wrote:
>>>>>>
>>>>>>>
>>>>>>> +1, Thanks !
>>>>>>>
>>>>>>> Regards,
>>>>>>> Mridul
>>>>>>>
>>>>>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> +1, thanks for driving the release!
>>>>>>>>
>>>>>>>>
>>>>>>>> Gengliang
>>>>>>>>
>>>>>>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun <
>>>>>>>> dongjoon.h...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> +1
>>>>>>>>>
>>>>>>>>> Thank you!
>>>>>>>>>
>>>>>>>>> Dongjoon
>>>>>>>>>
>>>>>>>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang 
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> +1 to cut the branch starting from a workday!
>>>>>>>>>>
>>>>>>>>>> Great to see this is happening!
>>>>>>>>>>
>>>>>>>>>> Thanks Xinrong!
>>>>>>>>>>
>>>>>>>>>> -Rui
>>>>>>>>>>
>>>>>>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com <
>>>>>>>>>> ruife...@foxmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> +1, thank you Xinrong for driving this release!
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Ruifeng Zheng
>>>>>>>>>>> ruife...@foxmail.com
>>>>>>>>>>>
>>>>>>>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> -- Original --
>>>>>>>>>>> *From:* "Hyukjin Kwon" ;
>>>>>>>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>>>>>>>> *To:* "Xinrong Meng";
>>>>>>>>>>> *Cc:* "dev";
>>>>>>>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>>>>>>>
>>>>>>>>>>> SGTM +1
>>>>>>>>>>>
>>>>>>>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng <
>>>>>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>
>>>>>>>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed
>>>>>>>>>>>> January 15th per
>>>>>>>>>>>> https://spark.apache.org/versioning-policy.html, but I would
>>>>>>>>>>>> suggest we postpone one day since January 15th is a Sunday.
>>>>>>>>>>>>
>>>>>>>>>>>> I would like to volunteer as the release manager for *Apache
>>>>>>>>>>>> Spark 3.4.0*.
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>
>>>>>>>>>>>> Xinrong Meng
>>>>>>>>>>>>
>>>>>>>>>>>>


Re: Time for Spark 3.4.0 release?

2023-01-06 Thread Hyukjin Kwon
Thanks Xinrong.

On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng 
wrote:

> The release window for Apache Spark 3.4.0 is updated per
> https://github.com/apache/spark-website/pull/430.
>
> Thank you all!
>
> On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk 
> wrote:
>
>> +1
>>
>> On Thu, Jan 5, 2023 at 12:25 AM huaxin gao 
>> wrote:
>>
>>> +1 Thanks!
>>>
>>> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh  wrote:
>>>
>>>> +1
>>>>
>>>> Thank you!
>>>>
>>>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:
>>>>
>>>>> +1, thanks!
>>>>>
>>>>> Chao
>>>>>
>>>>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan 
>>>>> wrote:
>>>>>
>>>>>>
>>>>>> +1, Thanks !
>>>>>>
>>>>>> Regards,
>>>>>> Mridul
>>>>>>
>>>>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang 
>>>>>> wrote:
>>>>>>
>>>>>>> +1, thanks for driving the release!
>>>>>>>
>>>>>>>
>>>>>>> Gengliang
>>>>>>>
>>>>>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun <
>>>>>>> dongjoon.h...@gmail.com> wrote:
>>>>>>>
>>>>>>>> +1
>>>>>>>>
>>>>>>>> Thank you!
>>>>>>>>
>>>>>>>> Dongjoon
>>>>>>>>
>>>>>>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> +1 to cut the branch starting from a workday!
>>>>>>>>>
>>>>>>>>> Great to see this is happening!
>>>>>>>>>
>>>>>>>>> Thanks Xinrong!
>>>>>>>>>
>>>>>>>>> -Rui
>>>>>>>>>
>>>>>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com <
>>>>>>>>> ruife...@foxmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> +1, thank you Xinrong for driving this release!
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Ruifeng Zheng
>>>>>>>>>> ruife...@foxmail.com
>>>>>>>>>>
>>>>>>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> -- Original --
>>>>>>>>>> *From:* "Hyukjin Kwon" ;
>>>>>>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>>>>>>> *To:* "Xinrong Meng";
>>>>>>>>>> *Cc:* "dev";
>>>>>>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>>>>>>
>>>>>>>>>> SGTM +1
>>>>>>>>>>
>>>>>>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng <
>>>>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi All,
>>>>>>>>>>>
>>>>>>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed
>>>>>>>>>>> January 15th per
>>>>>>>>>>> https://spark.apache.org/versioning-policy.html, but I would
>>>>>>>>>>> suggest we postpone one day since January 15th is a Sunday.
>>>>>>>>>>>
>>>>>>>>>>> I would like to volunteer as the release manager for *Apache
>>>>>>>>>>> Spark 3.4.0*.
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>>
>>>>>>>>>>> Xinrong Meng
>>>>>>>>>>>
>>>>>>>>>>>


Re: Time for Spark 3.4.0 release?

2023-01-06 Thread Xinrong Meng
The release window for Apache Spark 3.4.0 is updated per
https://github.com/apache/spark-website/pull/430.

Thank you all!

On Thu, Jan 5, 2023 at 2:10 PM Maxim Gekk  wrote:

> +1
>
> On Thu, Jan 5, 2023 at 12:25 AM huaxin gao  wrote:
>
>> +1 Thanks!
>>
>> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh  wrote:
>>
>>> +1
>>>
>>> Thank you!
>>>
>>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:
>>>
>>>> +1, thanks!
>>>>
>>>> Chao
>>>>
>>>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan 
>>>> wrote:
>>>>
>>>>>
>>>>> +1, Thanks !
>>>>>
>>>>> Regards,
>>>>> Mridul
>>>>>
>>>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang 
>>>>> wrote:
>>>>>
>>>>>> +1, thanks for driving the release!
>>>>>>
>>>>>>
>>>>>> Gengliang
>>>>>>
>>>>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun <
>>>>>> dongjoon.h...@gmail.com> wrote:
>>>>>>
>>>>>>> +1
>>>>>>>
>>>>>>> Thank you!
>>>>>>>
>>>>>>> Dongjoon
>>>>>>>
>>>>>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> +1 to cut the branch starting from a workday!
>>>>>>>>
>>>>>>>> Great to see this is happening!
>>>>>>>>
>>>>>>>> Thanks Xinrong!
>>>>>>>>
>>>>>>>> -Rui
>>>>>>>>
>>>>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com <
>>>>>>>> ruife...@foxmail.com> wrote:
>>>>>>>>
>>>>>>>>> +1, thank you Xinrong for driving this release!
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Ruifeng Zheng
>>>>>>>>> ruife...@foxmail.com
>>>>>>>>>
>>>>>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> -- Original --
>>>>>>>>> *From:* "Hyukjin Kwon" ;
>>>>>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>>>>>> *To:* "Xinrong Meng";
>>>>>>>>> *Cc:* "dev";
>>>>>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>>>>>
>>>>>>>>> SGTM +1
>>>>>>>>>
>>>>>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng <
>>>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Hi All,
>>>>>>>>>>
>>>>>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed
>>>>>>>>>> January 15th per
>>>>>>>>>> https://spark.apache.org/versioning-policy.html, but I would
>>>>>>>>>> suggest we postpone one day since January 15th is a Sunday.
>>>>>>>>>>
>>>>>>>>>> I would like to volunteer as the release manager for *Apache
>>>>>>>>>> Spark 3.4.0*.
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>>
>>>>>>>>>> Xinrong Meng
>>>>>>>>>>
>>>>>>>>>>


Re: Time for Spark 3.4.0 release?

2023-01-04 Thread Maxim Gekk
+1

On Thu, Jan 5, 2023 at 12:25 AM huaxin gao  wrote:

> +1 Thanks!
>
> On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh  wrote:
>
>> +1
>>
>> Thank you!
>>
>> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:
>>
>>> +1, thanks!
>>>
>>> Chao
>>>
>>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan 
>>> wrote:
>>>
>>>>
>>>> +1, Thanks !
>>>>
>>>> Regards,
>>>> Mridul
>>>>
>>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang  wrote:
>>>>
>>>>> +1, thanks for driving the release!
>>>>>
>>>>>
>>>>> Gengliang
>>>>>
>>>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun 
>>>>> wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> Thank you!
>>>>>>
>>>>>> Dongjoon
>>>>>>
>>>>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang  wrote:
>>>>>>
>>>>>>> +1 to cut the branch starting from a workday!
>>>>>>>
>>>>>>> Great to see this is happening!
>>>>>>>
>>>>>>> Thanks Xinrong!
>>>>>>>
>>>>>>> -Rui
>>>>>>>
>>>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com <
>>>>>>> ruife...@foxmail.com> wrote:
>>>>>>>
>>>>>>>> +1, thank you Xinrong for driving this release!
>>>>>>>>
>>>>>>>> --
>>>>>>>> Ruifeng Zheng
>>>>>>>> ruife...@foxmail.com
>>>>>>>>
>>>>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> -- Original --
>>>>>>>> *From:* "Hyukjin Kwon" ;
>>>>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>>>>> *To:* "Xinrong Meng";
>>>>>>>> *Cc:* "dev";
>>>>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>>>>
>>>>>>>> SGTM +1
>>>>>>>>
>>>>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng <
>>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi All,
>>>>>>>>>
>>>>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed
>>>>>>>>> January 15th per
>>>>>>>>> https://spark.apache.org/versioning-policy.html, but I would
>>>>>>>>> suggest we postpone one day since January 15th is a Sunday.
>>>>>>>>>
>>>>>>>>> I would like to volunteer as the release manager for *Apache
>>>>>>>>> Spark 3.4.0*.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>>
>>>>>>>>> Xinrong Meng
>>>>>>>>>
>>>>>>>>>


Re: Time for Spark 3.4.0 release?

2023-01-04 Thread huaxin gao
+1 Thanks!

On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh  wrote:

> +1
>
> Thank you!
>
> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:
>
>> +1, thanks!
>>
>> Chao
>>
>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan 
>> wrote:
>>
>>>
>>> +1, Thanks !
>>>
>>> Regards,
>>> Mridul
>>>
>>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang  wrote:
>>>
>>>> +1, thanks for driving the release!
>>>>
>>>>
>>>> Gengliang
>>>>
>>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun 
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> Thank you!
>>>>>
>>>>> Dongjoon
>>>>>
>>>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang  wrote:
>>>>>
>>>>>> +1 to cut the branch starting from a workday!
>>>>>>
>>>>>> Great to see this is happening!
>>>>>>
>>>>>> Thanks Xinrong!
>>>>>>
>>>>>> -Rui
>>>>>>
>>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com 
>>>>>> wrote:
>>>>>>
>>>>>>> +1, thank you Xinrong for driving this release!
>>>>>>>
>>>>>>> --
>>>>>>> Ruifeng Zheng
>>>>>>> ruife...@foxmail.com
>>>>>>>
>>>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> -- Original --
>>>>>>> *From:* "Hyukjin Kwon" ;
>>>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>>>> *To:* "Xinrong Meng";
>>>>>>> *Cc:* "dev";
>>>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>>>
>>>>>>> SGTM +1
>>>>>>>
>>>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng <
>>>>>>> xinrong.apa...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi All,
>>>>>>>>
>>>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed
>>>>>>>> January 15th per
>>>>>>>> https://spark.apache.org/versioning-policy.html, but I would
>>>>>>>> suggest we postpone one day since January 15th is a Sunday.
>>>>>>>>
>>>>>>>> I would like to volunteer as the release manager for *Apache Spark
>>>>>>>> 3.4.0*.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>>
>>>>>>>> Xinrong Meng
>>>>>>>>
>>>>>>>>


Re: Time for Spark 3.4.0 release?

2023-01-04 Thread L. C. Hsieh
+1

Thank you!

On Wed, Jan 4, 2023 at 9:13 AM Chao Sun  wrote:

> +1, thanks!
>
> Chao
>
> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan 
> wrote:
>
>>
>> +1, Thanks !
>>
>> Regards,
>> Mridul
>>
>> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang  wrote:
>>
>>> +1, thanks for driving the release!
>>>
>>>
>>> Gengliang
>>>
>>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun 
>>> wrote:
>>>
>>>> +1
>>>>
>>>> Thank you!
>>>>
>>>> Dongjoon
>>>>
>>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang  wrote:
>>>>
>>>>> +1 to cut the branch starting from a workday!
>>>>>
>>>>> Great to see this is happening!
>>>>>
>>>>> Thanks Xinrong!
>>>>>
>>>>> -Rui
>>>>>
>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com 
>>>>> wrote:
>>>>>
>>>>>> +1, thank you Xinrong for driving this release!
>>>>>>
>>>>>> --
>>>>>> Ruifeng Zheng
>>>>>> ruife...@foxmail.com
>>>>>>
>>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>>
>>>>>>
>>>>>>
>>>>>> -- Original --
>>>>>> *From:* "Hyukjin Kwon" ;
>>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>>> *To:* "Xinrong Meng";
>>>>>> *Cc:* "dev";
>>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>>
>>>>>> SGTM +1
>>>>>>
>>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng 
>>>>>> wrote:
>>>>>>
>>>>>>> Hi All,
>>>>>>>
>>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed
>>>>>>> January 15th per
>>>>>>> https://spark.apache.org/versioning-policy.html, but I would
>>>>>>> suggest we postpone one day since January 15th is a Sunday.
>>>>>>>
>>>>>>> I would like to volunteer as the release manager for *Apache Spark
>>>>>>> 3.4.0*.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> Xinrong Meng
>>>>>>>
>>>>>>>


Re: Time for Spark 3.4.0 release?

2023-01-04 Thread Chao Sun
+1, thanks!

Chao

On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan  wrote:

>
> +1, Thanks !
>
> Regards,
> Mridul
>
> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang  wrote:
>
>> +1, thanks for driving the release!
>>
>>
>> Gengliang
>>
>> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun 
>> wrote:
>>
>>> +1
>>>
>>> Thank you!
>>>
>>> Dongjoon
>>>
>>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang  wrote:
>>>
>>>> +1 to cut the branch starting from a workday!
>>>>
>>>> Great to see this is happening!
>>>>
>>>> Thanks Xinrong!
>>>>
>>>> -Rui
>>>>
>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com 
>>>> wrote:
>>>>
>>>>> +1, thank you Xinrong for driving this release!
>>>>>
>>>>> --
>>>>> Ruifeng Zheng
>>>>> ruife...@foxmail.com
>>>>>
>>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>>
>>>>>
>>>>>
>>>>> -- Original --
>>>>> *From:* "Hyukjin Kwon" ;
>>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>>> *To:* "Xinrong Meng";
>>>>> *Cc:* "dev";
>>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>>
>>>>> SGTM +1
>>>>>
>>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng 
>>>>> wrote:
>>>>>
>>>>>> Hi All,
>>>>>>
>>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed
>>>>>> January 15th per
>>>>>> https://spark.apache.org/versioning-policy.html, but I would suggest
>>>>>> we postpone one day since January 15th is a Sunday.
>>>>>>
>>>>>> I would like to volunteer as the release manager for *Apache Spark
>>>>>> 3.4.0*.
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Xinrong Meng
>>>>>>
>>>>>>


Re: Time for Spark 3.4.0 release?

2023-01-04 Thread Enrico Minack

Hi All,

can we get these correctness issues fixed with the 3.4 release, please?

SPARK-41162 incorrect query plan for anti-join and semi-join of 
self-joined aggregations (since 3.1), fix in 
https://github.com/apache/spark/pull/39131
SPARK-40885 loosing in-partition order for string type partition columns 
when partitioned-writing (introduced in Spark 3.4)


Cheers,
Enrico


Am 04.01.23 um 06:12 schrieb Xinrong Meng:

Hi All,

Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed January 
15th per
https://spark.apache.org/versioning-policy.html, but I would suggest 
we postpone one day since January 15th is a Sunday.


I would like to volunteer as the release manager for *Apache Spark 3.4.0*.

Thanks,

Xinrong Meng



Re: Time for Spark 3.4.0 release?

2023-01-04 Thread Mridul Muralidharan
+1, Thanks !

Regards,
Mridul

On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang  wrote:

> +1, thanks for driving the release!
>
>
> Gengliang
>
> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun 
> wrote:
>
>> +1
>>
>> Thank you!
>>
>> Dongjoon
>>
>> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang  wrote:
>>
>>> +1 to cut the branch starting from a workday!
>>>
>>> Great to see this is happening!
>>>
>>> Thanks Xinrong!
>>>
>>> -Rui
>>>
>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com 
>>> wrote:
>>>
>>>> +1, thank you Xinrong for driving this release!
>>>>
>>>> --
>>>> Ruifeng Zheng
>>>> ruife...@foxmail.com
>>>>
>>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>>
>>>>
>>>>
>>>> -- Original --
>>>> *From:* "Hyukjin Kwon" ;
>>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>>> *To:* "Xinrong Meng";
>>>> *Cc:* "dev";
>>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>>
>>>> SGTM +1
>>>>
>>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng 
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed
>>>>> January 15th per
>>>>> https://spark.apache.org/versioning-policy.html, but I would suggest
>>>>> we postpone one day since January 15th is a Sunday.
>>>>>
>>>>> I would like to volunteer as the release manager for *Apache Spark
>>>>> 3.4.0*.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Xinrong Meng
>>>>>
>>>>>


Re: Time for Spark 3.4.0 release?

2023-01-04 Thread Gengliang Wang
+1, thanks for driving the release!

Gengliang

On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun 
wrote:

> +1
>
> Thank you!
>
> Dongjoon
>
> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang  wrote:
>
>> +1 to cut the branch starting from a workday!
>>
>> Great to see this is happening!
>>
>> Thanks Xinrong!
>>
>> -Rui
>>
>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com 
>> wrote:
>>
>>> +1, thank you Xinrong for driving this release!
>>>
>>> --
>>> Ruifeng Zheng
>>> ruife...@foxmail.com
>>>
>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>>
>>>
>>>
>>> -- Original --
>>> *From:* "Hyukjin Kwon" ;
>>> *Date:* Wed, Jan 4, 2023 01:15 PM
>>> *To:* "Xinrong Meng";
>>> *Cc:* "dev";
>>> *Subject:* Re: Time for Spark 3.4.0 release?
>>>
>>> SGTM +1
>>>
>>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng 
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed January
>>>> 15th per
>>>> https://spark.apache.org/versioning-policy.html, but I would suggest
>>>> we postpone one day since January 15th is a Sunday.
>>>>
>>>> I would like to volunteer as the release manager for *Apache Spark
>>>> 3.4.0*.
>>>>
>>>> Thanks,
>>>>
>>>> Xinrong Meng
>>>>
>>>>


Re: Time for Spark 3.4.0 release?

2023-01-03 Thread Dongjoon Hyun
+1

Thank you!

Dongjoon

On Tue, Jan 3, 2023 at 9:44 PM Rui Wang  wrote:

> +1 to cut the branch starting from a workday!
>
> Great to see this is happening!
>
> Thanks Xinrong!
>
> -Rui
>
> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com 
> wrote:
>
>> +1, thank you Xinrong for driving this release!
>>
>> --
>> Ruifeng Zheng
>> ruife...@foxmail.com
>>
>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>>
>>
>>
>> -- Original --
>> *From:* "Hyukjin Kwon" ;
>> *Date:* Wed, Jan 4, 2023 01:15 PM
>> *To:* "Xinrong Meng";
>> *Cc:* "dev";
>> *Subject:* Re: Time for Spark 3.4.0 release?
>>
>> SGTM +1
>>
>> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng 
>> wrote:
>>
>>> Hi All,
>>>
>>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed January
>>> 15th per
>>> https://spark.apache.org/versioning-policy.html, but I would suggest we
>>> postpone one day since January 15th is a Sunday.
>>>
>>> I would like to volunteer as the release manager for *Apache Spark
>>> 3.4.0*.
>>>
>>> Thanks,
>>>
>>> Xinrong Meng
>>>
>>>


Re: Time for Spark 3.4.0 release?

2023-01-03 Thread Rui Wang
+1 to cut the branch starting from a workday!

Great to see this is happening!

Thanks Xinrong!

-Rui

On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com 
wrote:

> +1, thank you Xinrong for driving this release!
>
> --
> Ruifeng Zheng
> ruife...@foxmail.com
>
> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=>
>
>
>
> -- Original --
> *From:* "Hyukjin Kwon" ;
> *Date:* Wed, Jan 4, 2023 01:15 PM
> *To:* "Xinrong Meng";
> *Cc:* "dev";
> *Subject:* Re: Time for Spark 3.4.0 release?
>
> SGTM +1
>
> On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng 
> wrote:
>
>> Hi All,
>>
>> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed January
>> 15th per
>> https://spark.apache.org/versioning-policy.html, but I would suggest we
>> postpone one day since January 15th is a Sunday.
>>
>> I would like to volunteer as the release manager for *Apache Spark 3.4.0*
>> .
>>
>> Thanks,
>>
>> Xinrong Meng
>>
>>


Re: Time for Spark 3.4.0 release?

2023-01-03 Thread 416161...@qq.com
+1, thank you Xinrong for driving this release!




Ruifeng Zheng
ruife...@foxmail.com



 




-- Original --
From:   
 "Hyukjin Kwon" 
   
https://spark.apache.org/versioning-policy.html, but I would suggest we 
postpone one day since January 15th is a Sunday.


I would like to volunteer as the release manager for Apache Spark 3.4.0.


Thanks,


Xinrong Meng

Re: Time for Spark 3.4.0 release?

2023-01-03 Thread Yang,Jie(INF)
+1 for me

YangJie

发件人: Hyukjin Kwon 
日期: 2023年1月4日 星期三 13:16
收件人: Xinrong Meng 
抄送: dev 
主题: Re: Time for Spark 3.4.0 release?

SGTM +1

On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng 
mailto:xinrong.apa...@gmail.com>> wrote:
Hi All,

Shall we cut branch-3.4 on January 16th, 2023? We proposed January 15th per
https://spark.apache.org/versioning-policy.html<https://mailshield.baidu.com/check?q=vctdW221Qpw1RkBH%2baEmJJYTNfyfKdQth%2bXybE4CmiqqiIKDFEKSh0Cm4i6jy9T6ROH2vg%3d%3d>,
 but I would suggest we postpone one day since January 15th is a Sunday.

I would like to volunteer as the release manager for Apache Spark 3.4.0.

Thanks,

Xinrong Meng



Re: Time for Spark 3.4.0 release?

2023-01-03 Thread Hyukjin Kwon
SGTM +1

On Wed, Jan 4, 2023 at 2:13 PM Xinrong Meng 
wrote:

> Hi All,
>
> Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed January
> 15th per
> https://spark.apache.org/versioning-policy.html, but I would suggest we
> postpone one day since January 15th is a Sunday.
>
> I would like to volunteer as the release manager for *Apache Spark 3.4.0*.
>
> Thanks,
>
> Xinrong Meng
>
>


Time for Spark 3.4.0 release?

2023-01-03 Thread Xinrong Meng
Hi All,

Shall we cut *branch-3.4* on *January 16th, 2023*? We proposed January 15th
per
https://spark.apache.org/versioning-policy.html, but I would suggest we
postpone one day since January 15th is a Sunday.

I would like to volunteer as the release manager for *Apache Spark 3.4.0*.

Thanks,

Xinrong Meng