Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread Hyukjin Kwon
+1

On Tue, 11 Apr 2023 at 11:04, Ruifeng Zheng  wrote:

> +1 (non-binding)
>
> Thank you for driving this release!
>
> --
> Ruifeng  Zheng
> ruife...@foxmail.com
>
> 
>
>
>
> -- Original --
> *From:* "Yuming Wang" ;
> *Date:* Tue, Apr 11, 2023 09:56 AM
> *To:* "Mridul Muralidharan";
> *Cc:* "huaxin gao";"Chao Sun" >;"yangjie01";"Dongjoon Hyun";"Sean
> Owen";"dev@spark.apache.org";
> *Subject:* Re: [VOTE] Release Apache Spark 3.2.4 (RC1)
>
> +1.
>
> On Tue, Apr 11, 2023 at 12:17 AM Mridul Muralidharan 
> wrote:
>
>> +1
>>
>> Signatures, digests, etc check out fine.
>> Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes
>>
>> Regards,
>> Mridul
>>
>>
>> On Mon, Apr 10, 2023 at 10:34 AM huaxin gao 
>> wrote:
>>
>>> +1
>>>
>>> On Mon, Apr 10, 2023 at 8:17 AM Chao Sun  wrote:
>>>
 +1 (non-binding)

 On Mon, Apr 10, 2023 at 7:07 AM yangjie01  wrote:

> +1 (non-binding)
>
>
>
> *发件人**: *Sean Owen 
> *日期**: *2023年4月10日 星期一 21:19
> *收件人**: *Dongjoon Hyun 
> *抄送**: *"dev@spark.apache.org" 
> *主题**: *Re: [VOTE] Release Apache Spark 3.2.4 (RC1)
>
>
>
> +1 from me
>
>
>
> On Sun, Apr 9, 2023 at 7:19 PM Dongjoon Hyun 
> wrote:
>
> I'll start with my +1.
>
> I verified the checksum, signatures of the artifacts, and
> documentations.
> Also, ran the tests with YARN and K8s modules.
>
> Dongjoon.
>
> On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
> > Please vote on releasing the following candidate as Apache Spark
> version
> > 3.2.4.
> >
> > The vote is open until April 13th 1AM (PST) and passes if a majority
> +1 PMC
> > votes are cast, with a minimum of 3 +1 votes.
> >
> > [ ] +1 Release this package as Apache Spark 3.2.4
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see
> https://spark.apache.org/
> 
> >
> > The tag to be voted on is v3.2.4-rc1 (commit
> > 0ae10ac18298d1792828f1d59b652ef17462d76e)
> > https://github.com/apache/spark/tree/v3.2.4-rc1
> 
> >
> > The release files, including signatures, digests, etc. can be found
> at:
> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
> 
> >
> > Signatures used for Spark RCs can be found in this file:
> > https://dist.apache.org/repos/dist/dev/spark/KEYS
> 
> >
> > The staging repository for this release can be found at:
> >
> https://repository.apache.org/content/repositories/orgapachespark-1442/
> 
> >
> > The documentation corresponding to this release can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
> 
> >
> > The list of bug fixes going into 3.2.4 can be found at the following
> URL:
> > https://issues.apache.org/jira/projects/SPARK/versions/12352607
> 
> >
> > This release is using the release script of the tag v3.2.4-rc1.
> >
> > FAQ
> >
> > =
> > How can I help test this release?
> > =
> >
> > If you are a Spark user, you can help us test this release by taking
> > an existing Spark workload and running on this release candidate,
> then
> > reporting any regressions.
> >
> > If you're working in PySpark you can set up a virtual env and install
> > the current RC and see if anything important breaks, in the
> Java/Scala
> > you can add the staging repository to your projects resolvers and
> test
> > with the RC (make sure to clean up the artifact cache before/after so
> > you don't end up 

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread Ruifeng Zheng
+1 (non-binding)


Thank you for driving this release!





RuifengZheng
ruife...@foxmail.com








--Original--
From:   
 "Yuming Wang"  
  
https://spark.apache.org/
  
  The tag to be voted on is v3.2.4-rc1 (commit
  0ae10ac18298d1792828f1d59b652ef17462d76e)
   https://github.com/apache/spark/tree/v3.2.4-rc1
  
  The release files, including signatures, digests, etc. can be found at:
   https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
  
  Signatures used for Spark RCs can be found in this file:
   https://dist.apache.org/repos/dist/dev/spark/KEYS
  
  The staging repository for this release can be found at:
   https://repository.apache.org/content/repositories/orgapachespark-1442/
  
  The documentation corresponding to this release can be found at:
   https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
  
  The list of bug fixes going into 3.2.4 can be found at the following URL:
   https://issues.apache.org/jira/projects/SPARK/versions/12352607
  
  This release is using the release script of the tag v3.2.4-rc1.
  
  FAQ
  
  =
  How can I help test this release?
  =
  
  If you are a Spark user, you can help us test this release by taking
  an existing Spark workload and running on this release candidate, then
  reporting any regressions.
  
  If you're working in PySpark you can set up a virtual env and install
  the current RC and see if anything important breaks, in the Java/Scala
  you can add the staging repository to your projects resolvers and test
  with the RC (make sure to clean up the artifact cache before/after so
  you don't end up building with a out of date RC going forward).
  
  ===
  What should happen to JIRA tickets still targeting 3.2.4?
  ===
  
  The current list of open tickets targeted at 3.2.4 can be found at:
   https://issues.apache.org/jira/projects/SPARK and search for "Target
  Version/s" = 3.2.4
  
  Committers should look at those and triage. Extremely important bug
  fixes, documentation, and API tweaks that impact compatibility should
  be worked on immediately. Everything else please retarget to an
  appropriate release.
  
  ==
  But my bug isn't fixed?
  ==
  
  In order to make timely releases, we will typically not hold the
  release unless the bug in question is a regression from the previous
  release. That being said, if there is something which is a regression
  that has not been correctly targeted please ping me or a committer to
  help target the issue.
  
 
 -
 To unsubscribe e-mail:  dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread Yuming Wang
+1.

On Tue, Apr 11, 2023 at 12:17 AM Mridul Muralidharan 
wrote:

> +1
>
> Signatures, digests, etc check out fine.
> Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes
>
> Regards,
> Mridul
>
>
> On Mon, Apr 10, 2023 at 10:34 AM huaxin gao 
> wrote:
>
>> +1
>>
>> On Mon, Apr 10, 2023 at 8:17 AM Chao Sun  wrote:
>>
>>> +1 (non-binding)
>>>
>>> On Mon, Apr 10, 2023 at 7:07 AM yangjie01  wrote:
>>>
 +1 (non-binding)



 *发件人**: *Sean Owen 
 *日期**: *2023年4月10日 星期一 21:19
 *收件人**: *Dongjoon Hyun 
 *抄送**: *"dev@spark.apache.org" 
 *主题**: *Re: [VOTE] Release Apache Spark 3.2.4 (RC1)



 +1 from me



 On Sun, Apr 9, 2023 at 7:19 PM Dongjoon Hyun 
 wrote:

 I'll start with my +1.

 I verified the checksum, signatures of the artifacts, and
 documentations.
 Also, ran the tests with YARN and K8s modules.

 Dongjoon.

 On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
 > Please vote on releasing the following candidate as Apache Spark
 version
 > 3.2.4.
 >
 > The vote is open until April 13th 1AM (PST) and passes if a majority
 +1 PMC
 > votes are cast, with a minimum of 3 +1 votes.
 >
 > [ ] +1 Release this package as Apache Spark 3.2.4
 > [ ] -1 Do not release this package because ...
 >
 > To learn more about Apache Spark, please see
 https://spark.apache.org/
 
 >
 > The tag to be voted on is v3.2.4-rc1 (commit
 > 0ae10ac18298d1792828f1d59b652ef17462d76e)
 > https://github.com/apache/spark/tree/v3.2.4-rc1
 
 >
 > The release files, including signatures, digests, etc. can be found
 at:
 > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
 
 >
 > Signatures used for Spark RCs can be found in this file:
 > https://dist.apache.org/repos/dist/dev/spark/KEYS
 
 >
 > The staging repository for this release can be found at:
 >
 https://repository.apache.org/content/repositories/orgapachespark-1442/
 
 >
 > The documentation corresponding to this release can be found at:
 > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
 
 >
 > The list of bug fixes going into 3.2.4 can be found at the following
 URL:
 > https://issues.apache.org/jira/projects/SPARK/versions/12352607
 
 >
 > This release is using the release script of the tag v3.2.4-rc1.
 >
 > FAQ
 >
 > =
 > How can I help test this release?
 > =
 >
 > If you are a Spark user, you can help us test this release by taking
 > an existing Spark workload and running on this release candidate, then
 > reporting any regressions.
 >
 > If you're working in PySpark you can set up a virtual env and install
 > the current RC and see if anything important breaks, in the Java/Scala
 > you can add the staging repository to your projects resolvers and test
 > with the RC (make sure to clean up the artifact cache before/after so
 > you don't end up building with a out of date RC going forward).
 >
 > ===
 > What should happen to JIRA tickets still targeting 3.2.4?
 > ===
 >
 > The current list of open tickets targeted at 3.2.4 can be found at:
 > https://issues.apache.org/jira/projects/SPARK
 
 and search for "Target
 > Version/s" = 3.2.4
 >
 > Committers should look at those and triage. Extremely important bug
 > fixes, documentation, and API tweaks that impact compatibility should
 > be worked on immediately. Everything else please retarget to an
 > appropriate release.
 >
 > ==
 > But my bug isn't fixed?
 > ==
 >
 > In order to make timely releases, we will 

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-10 Thread Yuming Wang
+1.

On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang  wrote:

> +1 (non-binding)
>
> Also ran the docker image related test (signatures/standalone/k8s) with
> rc7: https://github.com/apache/spark-docker/pull/32
>
> Regards,
> Yikun
>
>
> On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski  wrote:
>
>> +1
>>
>> * Built fine with Scala 2.13
>> and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
>> * Ran some demos on Java 17
>> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>>
>> Pozdrawiam,
>> Jacek Laskowski
>> 
>> "The Internals Of" Online Books 
>> Follow me on https://twitter.com/jaceklaskowski
>>
>> 
>>
>>
>> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng 
>> wrote:
>>
>>> Please vote on releasing the following candidate(RC7) as Apache Spark
>>> version 3.4.0.
>>>
>>> The vote is open until 11:59pm Pacific time *April 12th* and passes if
>>> a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>
>>> [ ] +1 Release this package as Apache Spark 3.4.0
>>> [ ] -1 Do not release this package because ...
>>>
>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>
>>> The tag to be voted on is v3.4.0-rc7 (commit
>>> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>>> https://github.com/apache/spark/tree/v3.4.0-rc7
>>>
>>> The release files, including signatures, digests, etc. can be found at:
>>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>>>
>>> Signatures used for Spark RCs can be found in this file:
>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>
>>> The staging repository for this release can be found at:
>>> https://repository.apache.org/content/repositories/orgapachespark-1441
>>>
>>> The documentation corresponding to this release can be found at:
>>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>>>
>>> The list of bug fixes going into 3.4.0 can be found at the following URL:
>>> https://issues.apache.org/jira/projects/SPARK/versions/12351465
>>>
>>> This release is using the release script of the tag v3.4.0-rc7.
>>>
>>>
>>> FAQ
>>>
>>> =
>>> How can I help test this release?
>>> =
>>> If you are a Spark user, you can help us test this release by taking
>>> an existing Spark workload and running on this release candidate, then
>>> reporting any regressions.
>>>
>>> If you're working in PySpark you can set up a virtual env and install
>>> the current RC and see if anything important breaks, in the Java/Scala
>>> you can add the staging repository to your projects resolvers and test
>>> with the RC (make sure to clean up the artifact cache before/after so
>>> you don't end up building with an out of date RC going forward).
>>>
>>> ===
>>> What should happen to JIRA tickets still targeting 3.4.0?
>>> ===
>>> The current list of open tickets targeted at 3.4.0 can be found at:
>>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>>> Version/s" = 3.4.0
>>>
>>> Committers should look at those and triage. Extremely important bug
>>> fixes, documentation, and API tweaks that impact compatibility should
>>> be worked on immediately. Everything else please retarget to an
>>> appropriate release.
>>>
>>> ==
>>> But my bug isn't fixed?
>>> ==
>>> In order to make timely releases, we will typically not hold the
>>> release unless the bug in question is a regression from the previous
>>> release. That being said, if there is something which is a regression
>>> that has not been correctly targeted please ping me or a committer to
>>> help target the issue.
>>>
>>> Thanks,
>>> Xinrong Meng
>>>
>>


Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-10 Thread Yikun Jiang
+1 (non-binding)

Also ran the docker image related test (signatures/standalone/k8s) with
rc7: https://github.com/apache/spark-docker/pull/32

Regards,
Yikun


On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski  wrote:

> +1
>
> * Built fine with Scala 2.13
> and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
> * Ran some demos on Java 17
> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>
> Pozdrawiam,
> Jacek Laskowski
> 
> "The Internals Of" Online Books 
> Follow me on https://twitter.com/jaceklaskowski
>
> 
>
>
> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng 
> wrote:
>
>> Please vote on releasing the following candidate(RC7) as Apache Spark
>> version 3.4.0.
>>
>> The vote is open until 11:59pm Pacific time *April 12th* and passes if a
>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>
>> [ ] +1 Release this package as Apache Spark 3.4.0
>> [ ] -1 Do not release this package because ...
>>
>> To learn more about Apache Spark, please see http://spark.apache.org/
>>
>> The tag to be voted on is v3.4.0-rc7 (commit
>> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>> https://github.com/apache/spark/tree/v3.4.0-rc7
>>
>> The release files, including signatures, digests, etc. can be found at:
>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>>
>> Signatures used for Spark RCs can be found in this file:
>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>
>> The staging repository for this release can be found at:
>> https://repository.apache.org/content/repositories/orgapachespark-1441
>>
>> The documentation corresponding to this release can be found at:
>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>>
>> The list of bug fixes going into 3.4.0 can be found at the following URL:
>> https://issues.apache.org/jira/projects/SPARK/versions/12351465
>>
>> This release is using the release script of the tag v3.4.0-rc7.
>>
>>
>> FAQ
>>
>> =
>> How can I help test this release?
>> =
>> If you are a Spark user, you can help us test this release by taking
>> an existing Spark workload and running on this release candidate, then
>> reporting any regressions.
>>
>> If you're working in PySpark you can set up a virtual env and install
>> the current RC and see if anything important breaks, in the Java/Scala
>> you can add the staging repository to your projects resolvers and test
>> with the RC (make sure to clean up the artifact cache before/after so
>> you don't end up building with an out of date RC going forward).
>>
>> ===
>> What should happen to JIRA tickets still targeting 3.4.0?
>> ===
>> The current list of open tickets targeted at 3.4.0 can be found at:
>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>> Version/s" = 3.4.0
>>
>> Committers should look at those and triage. Extremely important bug
>> fixes, documentation, and API tweaks that impact compatibility should
>> be worked on immediately. Everything else please retarget to an
>> appropriate release.
>>
>> ==
>> But my bug isn't fixed?
>> ==
>> In order to make timely releases, we will typically not hold the
>> release unless the bug in question is a regression from the previous
>> release. That being said, if there is something which is a regression
>> that has not been correctly targeted please ping me or a committer to
>> help target the issue.
>>
>> Thanks,
>> Xinrong Meng
>>
>


Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-10 Thread Jacek Laskowski
+1

* Built fine with Scala 2.13
and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
* Ran some demos on Java 17
* Mac mini / Apple M2 Pro / Ventura 13.3.1

Pozdrawiam,
Jacek Laskowski

"The Internals Of" Online Books 
Follow me on https://twitter.com/jaceklaskowski




On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng 
wrote:

> Please vote on releasing the following candidate(RC7) as Apache Spark
> version 3.4.0.
>
> The vote is open until 11:59pm Pacific time *April 12th* and passes if a
> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 3.4.0
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see http://spark.apache.org/
>
> The tag to be voted on is v3.4.0-rc7 (commit
> 87a5442f7ed96b11051d8a9333476d080054e5a0):
> https://github.com/apache/spark/tree/v3.4.0-rc7
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1441
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>
> The list of bug fixes going into 3.4.0 can be found at the following URL:
> https://issues.apache.org/jira/projects/SPARK/versions/12351465
>
> This release is using the release script of the tag v3.4.0-rc7.
>
>
> FAQ
>
> =
> How can I help test this release?
> =
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with an out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 3.4.0?
> ===
> The current list of open tickets targeted at 3.4.0 can be found at:
> https://issues.apache.org/jira/projects/SPARK and search for "Target
> Version/s" = 3.4.0
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.
>
> Thanks,
> Xinrong Meng
>


Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread Mridul Muralidharan
+1

Signatures, digests, etc check out fine.
Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes

Regards,
Mridul


On Mon, Apr 10, 2023 at 10:34 AM huaxin gao  wrote:

> +1
>
> On Mon, Apr 10, 2023 at 8:17 AM Chao Sun  wrote:
>
>> +1 (non-binding)
>>
>> On Mon, Apr 10, 2023 at 7:07 AM yangjie01  wrote:
>>
>>> +1 (non-binding)
>>>
>>>
>>>
>>> *发件人**: *Sean Owen 
>>> *日期**: *2023年4月10日 星期一 21:19
>>> *收件人**: *Dongjoon Hyun 
>>> *抄送**: *"dev@spark.apache.org" 
>>> *主题**: *Re: [VOTE] Release Apache Spark 3.2.4 (RC1)
>>>
>>>
>>>
>>> +1 from me
>>>
>>>
>>>
>>> On Sun, Apr 9, 2023 at 7:19 PM Dongjoon Hyun 
>>> wrote:
>>>
>>> I'll start with my +1.
>>>
>>> I verified the checksum, signatures of the artifacts, and documentations.
>>> Also, ran the tests with YARN and K8s modules.
>>>
>>> Dongjoon.
>>>
>>> On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
>>> > Please vote on releasing the following candidate as Apache Spark
>>> version
>>> > 3.2.4.
>>> >
>>> > The vote is open until April 13th 1AM (PST) and passes if a majority
>>> +1 PMC
>>> > votes are cast, with a minimum of 3 +1 votes.
>>> >
>>> > [ ] +1 Release this package as Apache Spark 3.2.4
>>> > [ ] -1 Do not release this package because ...
>>> >
>>> > To learn more about Apache Spark, please see https://spark.apache.org/
>>> 
>>> >
>>> > The tag to be voted on is v3.2.4-rc1 (commit
>>> > 0ae10ac18298d1792828f1d59b652ef17462d76e)
>>> > https://github.com/apache/spark/tree/v3.2.4-rc1
>>> 
>>> >
>>> > The release files, including signatures, digests, etc. can be found at:
>>> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
>>> 
>>> >
>>> > Signatures used for Spark RCs can be found in this file:
>>> > https://dist.apache.org/repos/dist/dev/spark/KEYS
>>> 
>>> >
>>> > The staging repository for this release can be found at:
>>> >
>>> https://repository.apache.org/content/repositories/orgapachespark-1442/
>>> 
>>> >
>>> > The documentation corresponding to this release can be found at:
>>> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
>>> 
>>> >
>>> > The list of bug fixes going into 3.2.4 can be found at the following
>>> URL:
>>> > https://issues.apache.org/jira/projects/SPARK/versions/12352607
>>> 
>>> >
>>> > This release is using the release script of the tag v3.2.4-rc1.
>>> >
>>> > FAQ
>>> >
>>> > =
>>> > How can I help test this release?
>>> > =
>>> >
>>> > If you are a Spark user, you can help us test this release by taking
>>> > an existing Spark workload and running on this release candidate, then
>>> > reporting any regressions.
>>> >
>>> > If you're working in PySpark you can set up a virtual env and install
>>> > the current RC and see if anything important breaks, in the Java/Scala
>>> > you can add the staging repository to your projects resolvers and test
>>> > with the RC (make sure to clean up the artifact cache before/after so
>>> > you don't end up building with a out of date RC going forward).
>>> >
>>> > ===
>>> > What should happen to JIRA tickets still targeting 3.2.4?
>>> > ===
>>> >
>>> > The current list of open tickets targeted at 3.2.4 can be found at:
>>> > https://issues.apache.org/jira/projects/SPARK
>>> 
>>> and search for "Target
>>> > Version/s" = 3.2.4
>>> >
>>> > Committers should look at those and triage. Extremely important bug
>>> > fixes, documentation, and API tweaks that impact compatibility should
>>> > be worked on immediately. Everything else please retarget to an
>>> > appropriate release.
>>> >
>>> > ==
>>> > But my bug isn't fixed?
>>> > ==
>>> >
>>> > In order to make timely releases, we will typically not hold the
>>> > release unless the bug in question is a regression from the previous
>>> > release. That being said, if there is something which is a regression
>>> > that has not been correctly targeted 

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-10 Thread huaxin gao
+1

On Mon, Apr 10, 2023 at 8:18 AM Chao Sun  wrote:

> +1 (non-binding)
>
> On Mon, Apr 10, 2023 at 12:41 AM Ruifeng Zheng 
> wrote:
>
>> +1 (non-binding)
>>
>> --
>> Ruifeng  Zheng
>> ruife...@foxmail.com
>>
>> 
>>
>>
>>
>> -- Original --
>> *From:* "Kent Yao" ;
>> *Date:* Mon, Apr 10, 2023 03:33 PM
>> *To:* "Gengliang Wang";
>> *Cc:* "Dongjoon Hyun";"Mridul Muralidharan"<
>> mri...@gmail.com>;"L. C. Hsieh";"yangjie01"<
>> yangji...@baidu.com>;"Sean Owen";"Xinrong Meng"<
>> xinrong.apa...@gmail.com>;"dev";
>> *Subject:* Re: [VOTE] Release Apache Spark 3.4.0 (RC7)
>>
>> +1(non-binding)
>>
>> Gengliang Wang  于2023年4月10日周一 15:27写道:
>> >
>> > +1
>> >
>> > On Sun, Apr 9, 2023 at 3:17 PM Dongjoon Hyun 
>> wrote:
>> >>
>> >> +1
>> >>
>> >> I verified the same steps like previous RCs.
>> >>
>> >> Dongjoon.
>> >>
>> >>
>> >> On Sat, Apr 8, 2023 at 7:47 PM Mridul Muralidharan 
>> wrote:
>> >>>
>> >>>
>> >>> +1
>> >>>
>> >>> Signatures, digests, etc check out fine.
>> >>> Checked out tag and build/tested with -Phive -Pyarn -Pmesos
>> -Pkubernetes
>> >>>
>> >>> Regards,
>> >>> Mridul
>> >>>
>> >>>
>> >>> On Sat, Apr 8, 2023 at 12:13 PM L. C. Hsieh  wrote:
>> 
>>  +1
>> 
>>  Thanks Xinrong.
>> 
>>  On Sat, Apr 8, 2023 at 8:23 AM yangjie01 
>> wrote:
>>  >
>>  > +1
>>  >
>>  >
>>  >
>>  > 发件人: Sean Owen 
>>  > 日期: 2023年4月8日 星期六 20:27
>>  > 收件人: Xinrong Meng 
>>  > 抄送: dev 
>>  > 主题: Re: [VOTE] Release Apache Spark 3.4.0 (RC7)
>>  >
>>  >
>>  >
>>  > +1 form me, same result as last time.
>>  >
>>  >
>>  >
>>  > On Fri, Apr 7, 2023 at 6:30 PM Xinrong Meng <
>> xinrong.apa...@gmail.com> wrote:
>>  >
>>  > Please vote on releasing the following candidate(RC7) as Apache
>> Spark version 3.4.0.
>>  >
>>  > The vote is open until 11:59pm Pacific time April 12th and passes
>> if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>  >
>>  > [ ] +1 Release this package as Apache Spark 3.4.0
>>  > [ ] -1 Do not release this package because ...
>>  >
>>  > To learn more about Apache Spark, please see
>> http://spark.apache.org/
>>  >
>>  > The tag to be voted on is v3.4.0-rc7 (commit
>> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>>  > https://github.com/apache/spark/tree/v3.4.0-rc7
>>  >
>>  > The release files, including signatures, digests, etc. can be
>> found at:
>>  > https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>>  >
>>  > Signatures used for Spark RCs can be found in this file:
>>  > https://dist.apache.org/repos/dist/dev/spark/KEYS
>>  >
>>  > The staging repository for this release can be found at:
>>  >
>> https://repository.apache.org/content/repositories/orgapachespark-1441
>>  >
>>  > The documentation corresponding to this release can be found at:
>>  > https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>>  >
>>  > The list of bug fixes going into 3.4.0 can be found at the
>> following URL:
>>  > https://issues.apache.org/jira/projects/SPARK/versions/12351465
>>  >
>>  > This release is using the release script of the tag v3.4.0-rc7.
>>  >
>>  >
>>  > FAQ
>>  >
>>  > =
>>  > How can I help test this release?
>>  > =
>>  > If you are a Spark user, you can help us test this release by
>> taking
>>  > an existing Spark workload and running on this release candidate,
>> then
>>  > reporting any regressions.
>>  >
>>  > If you're working in PySpark you can set up a virtual env and
>> install
>>  > the current RC and see if anything important breaks, in the
>> Java/Scala
>>  > you can add the staging repository to your projects resolvers and
>> test
>>  > with the RC (make sure to clean up the artifact cache before/after
>> so
>>  > you don't end up building with an out of date RC going forward).
>>  >
>>  > ===
>>  > What should happen to JIRA tickets still targeting 3.4.0?
>>  > ===
>>  > The current list of open tickets targeted at 3.4.0 can be found at:
>>  > https://issues.apache.org/jira/projects/SPARK and search for
>> "Target Version/s" = 3.4.0
>>  >
>>  > Committers should look at those and triage. Extremely important bug
>>  > fixes, documentation, and API tweaks that impact compatibility
>> should
>>  > be worked on immediately. Everything else please retarget to an
>>  > 

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread huaxin gao
+1

On Mon, Apr 10, 2023 at 8:17 AM Chao Sun  wrote:

> +1 (non-binding)
>
> On Mon, Apr 10, 2023 at 7:07 AM yangjie01  wrote:
>
>> +1 (non-binding)
>>
>>
>>
>> *发件人**: *Sean Owen 
>> *日期**: *2023年4月10日 星期一 21:19
>> *收件人**: *Dongjoon Hyun 
>> *抄送**: *"dev@spark.apache.org" 
>> *主题**: *Re: [VOTE] Release Apache Spark 3.2.4 (RC1)
>>
>>
>>
>> +1 from me
>>
>>
>>
>> On Sun, Apr 9, 2023 at 7:19 PM Dongjoon Hyun  wrote:
>>
>> I'll start with my +1.
>>
>> I verified the checksum, signatures of the artifacts, and documentations.
>> Also, ran the tests with YARN and K8s modules.
>>
>> Dongjoon.
>>
>> On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
>> > Please vote on releasing the following candidate as Apache Spark version
>> > 3.2.4.
>> >
>> > The vote is open until April 13th 1AM (PST) and passes if a majority +1
>> PMC
>> > votes are cast, with a minimum of 3 +1 votes.
>> >
>> > [ ] +1 Release this package as Apache Spark 3.2.4
>> > [ ] -1 Do not release this package because ...
>> >
>> > To learn more about Apache Spark, please see https://spark.apache.org/
>> 
>> >
>> > The tag to be voted on is v3.2.4-rc1 (commit
>> > 0ae10ac18298d1792828f1d59b652ef17462d76e)
>> > https://github.com/apache/spark/tree/v3.2.4-rc1
>> 
>> >
>> > The release files, including signatures, digests, etc. can be found at:
>> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
>> 
>> >
>> > Signatures used for Spark RCs can be found in this file:
>> > https://dist.apache.org/repos/dist/dev/spark/KEYS
>> 
>> >
>> > The staging repository for this release can be found at:
>> > https://repository.apache.org/content/repositories/orgapachespark-1442/
>> 
>> >
>> > The documentation corresponding to this release can be found at:
>> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
>> 
>> >
>> > The list of bug fixes going into 3.2.4 can be found at the following
>> URL:
>> > https://issues.apache.org/jira/projects/SPARK/versions/12352607
>> 
>> >
>> > This release is using the release script of the tag v3.2.4-rc1.
>> >
>> > FAQ
>> >
>> > =
>> > How can I help test this release?
>> > =
>> >
>> > If you are a Spark user, you can help us test this release by taking
>> > an existing Spark workload and running on this release candidate, then
>> > reporting any regressions.
>> >
>> > If you're working in PySpark you can set up a virtual env and install
>> > the current RC and see if anything important breaks, in the Java/Scala
>> > you can add the staging repository to your projects resolvers and test
>> > with the RC (make sure to clean up the artifact cache before/after so
>> > you don't end up building with a out of date RC going forward).
>> >
>> > ===
>> > What should happen to JIRA tickets still targeting 3.2.4?
>> > ===
>> >
>> > The current list of open tickets targeted at 3.2.4 can be found at:
>> > https://issues.apache.org/jira/projects/SPARK
>> 
>> and search for "Target
>> > Version/s" = 3.2.4
>> >
>> > Committers should look at those and triage. Extremely important bug
>> > fixes, documentation, and API tweaks that impact compatibility should
>> > be worked on immediately. Everything else please retarget to an
>> > appropriate release.
>> >
>> > ==
>> > But my bug isn't fixed?
>> > ==
>> >
>> > In order to make timely releases, we will typically not hold the
>> > release unless the bug in question is a regression from the previous
>> > release. That being said, if there is something which is a regression
>> > that has not been correctly targeted please ping me or a committer to
>> > help target the issue.
>> >
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>>


Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-10 Thread Chao Sun
+1 (non-binding)

On Mon, Apr 10, 2023 at 12:41 AM Ruifeng Zheng  wrote:

> +1 (non-binding)
>
> --
> Ruifeng  Zheng
> ruife...@foxmail.com
>
> 
>
>
>
> -- Original --
> *From:* "Kent Yao" ;
> *Date:* Mon, Apr 10, 2023 03:33 PM
> *To:* "Gengliang Wang";
> *Cc:* "Dongjoon Hyun";"Mridul Muralidharan"<
> mri...@gmail.com>;"L. C. Hsieh";"yangjie01"<
> yangji...@baidu.com>;"Sean Owen";"Xinrong Meng"<
> xinrong.apa...@gmail.com>;"dev";
> *Subject:* Re: [VOTE] Release Apache Spark 3.4.0 (RC7)
>
> +1(non-binding)
>
> Gengliang Wang  于2023年4月10日周一 15:27写道:
> >
> > +1
> >
> > On Sun, Apr 9, 2023 at 3:17 PM Dongjoon Hyun 
> wrote:
> >>
> >> +1
> >>
> >> I verified the same steps like previous RCs.
> >>
> >> Dongjoon.
> >>
> >>
> >> On Sat, Apr 8, 2023 at 7:47 PM Mridul Muralidharan 
> wrote:
> >>>
> >>>
> >>> +1
> >>>
> >>> Signatures, digests, etc check out fine.
> >>> Checked out tag and build/tested with -Phive -Pyarn -Pmesos
> -Pkubernetes
> >>>
> >>> Regards,
> >>> Mridul
> >>>
> >>>
> >>> On Sat, Apr 8, 2023 at 12:13 PM L. C. Hsieh  wrote:
> 
>  +1
> 
>  Thanks Xinrong.
> 
>  On Sat, Apr 8, 2023 at 8:23 AM yangjie01  wrote:
>  >
>  > +1
>  >
>  >
>  >
>  > 发件人: Sean Owen 
>  > 日期: 2023年4月8日 星期六 20:27
>  > 收件人: Xinrong Meng 
>  > 抄送: dev 
>  > 主题: Re: [VOTE] Release Apache Spark 3.4.0 (RC7)
>  >
>  >
>  >
>  > +1 form me, same result as last time.
>  >
>  >
>  >
>  > On Fri, Apr 7, 2023 at 6:30 PM Xinrong Meng <
> xinrong.apa...@gmail.com> wrote:
>  >
>  > Please vote on releasing the following candidate(RC7) as Apache
> Spark version 3.4.0.
>  >
>  > The vote is open until 11:59pm Pacific time April 12th and passes
> if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>  >
>  > [ ] +1 Release this package as Apache Spark 3.4.0
>  > [ ] -1 Do not release this package because ...
>  >
>  > To learn more about Apache Spark, please see
> http://spark.apache.org/
>  >
>  > The tag to be voted on is v3.4.0-rc7 (commit
> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>  > https://github.com/apache/spark/tree/v3.4.0-rc7
>  >
>  > The release files, including signatures, digests, etc. can be found
> at:
>  > https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>  >
>  > Signatures used for Spark RCs can be found in this file:
>  > https://dist.apache.org/repos/dist/dev/spark/KEYS
>  >
>  > The staging repository for this release can be found at:
>  >
> https://repository.apache.org/content/repositories/orgapachespark-1441
>  >
>  > The documentation corresponding to this release can be found at:
>  > https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>  >
>  > The list of bug fixes going into 3.4.0 can be found at the
> following URL:
>  > https://issues.apache.org/jira/projects/SPARK/versions/12351465
>  >
>  > This release is using the release script of the tag v3.4.0-rc7.
>  >
>  >
>  > FAQ
>  >
>  > =
>  > How can I help test this release?
>  > =
>  > If you are a Spark user, you can help us test this release by taking
>  > an existing Spark workload and running on this release candidate,
> then
>  > reporting any regressions.
>  >
>  > If you're working in PySpark you can set up a virtual env and
> install
>  > the current RC and see if anything important breaks, in the
> Java/Scala
>  > you can add the staging repository to your projects resolvers and
> test
>  > with the RC (make sure to clean up the artifact cache before/after
> so
>  > you don't end up building with an out of date RC going forward).
>  >
>  > ===
>  > What should happen to JIRA tickets still targeting 3.4.0?
>  > ===
>  > The current list of open tickets targeted at 3.4.0 can be found at:
>  > https://issues.apache.org/jira/projects/SPARK and search for
> "Target Version/s" = 3.4.0
>  >
>  > Committers should look at those and triage. Extremely important bug
>  > fixes, documentation, and API tweaks that impact compatibility
> should
>  > be worked on immediately. Everything else please retarget to an
>  > appropriate release.
>  >
>  > ==
>  > But my bug isn't fixed?
>  > ==
>  > In order to make timely releases, we will typically not hold the
>  > release unless 

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread Chao Sun
+1 (non-binding)

On Mon, Apr 10, 2023 at 7:07 AM yangjie01  wrote:

> +1 (non-binding)
>
>
>
> *发件人**: *Sean Owen 
> *日期**: *2023年4月10日 星期一 21:19
> *收件人**: *Dongjoon Hyun 
> *抄送**: *"dev@spark.apache.org" 
> *主题**: *Re: [VOTE] Release Apache Spark 3.2.4 (RC1)
>
>
>
> +1 from me
>
>
>
> On Sun, Apr 9, 2023 at 7:19 PM Dongjoon Hyun  wrote:
>
> I'll start with my +1.
>
> I verified the checksum, signatures of the artifacts, and documentations.
> Also, ran the tests with YARN and K8s modules.
>
> Dongjoon.
>
> On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
> > Please vote on releasing the following candidate as Apache Spark version
> > 3.2.4.
> >
> > The vote is open until April 13th 1AM (PST) and passes if a majority +1
> PMC
> > votes are cast, with a minimum of 3 +1 votes.
> >
> > [ ] +1 Release this package as Apache Spark 3.2.4
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see https://spark.apache.org/
> 
> >
> > The tag to be voted on is v3.2.4-rc1 (commit
> > 0ae10ac18298d1792828f1d59b652ef17462d76e)
> > https://github.com/apache/spark/tree/v3.2.4-rc1
> 
> >
> > The release files, including signatures, digests, etc. can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
> 
> >
> > Signatures used for Spark RCs can be found in this file:
> > https://dist.apache.org/repos/dist/dev/spark/KEYS
> 
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1442/
> 
> >
> > The documentation corresponding to this release can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
> 
> >
> > The list of bug fixes going into 3.2.4 can be found at the following URL:
> > https://issues.apache.org/jira/projects/SPARK/versions/12352607
> 
> >
> > This release is using the release script of the tag v3.2.4-rc1.
> >
> > FAQ
> >
> > =
> > How can I help test this release?
> > =
> >
> > If you are a Spark user, you can help us test this release by taking
> > an existing Spark workload and running on this release candidate, then
> > reporting any regressions.
> >
> > If you're working in PySpark you can set up a virtual env and install
> > the current RC and see if anything important breaks, in the Java/Scala
> > you can add the staging repository to your projects resolvers and test
> > with the RC (make sure to clean up the artifact cache before/after so
> > you don't end up building with a out of date RC going forward).
> >
> > ===
> > What should happen to JIRA tickets still targeting 3.2.4?
> > ===
> >
> > The current list of open tickets targeted at 3.2.4 can be found at:
> > https://issues.apache.org/jira/projects/SPARK
> 
> and search for "Target
> > Version/s" = 3.2.4
> >
> > Committers should look at those and triage. Extremely important bug
> > fixes, documentation, and API tweaks that impact compatibility should
> > be worked on immediately. Everything else please retarget to an
> > appropriate release.
> >
> > ==
> > But my bug isn't fixed?
> > ==
> >
> > In order to make timely releases, we will typically not hold the
> > release unless the bug in question is a regression from the previous
> > release. That being said, if there is something which is a regression
> > that has not been correctly targeted please ping me or a committer to
> > help target the issue.
> >
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread yangjie01
+1 (non-binding)

发件人: Sean Owen 
日期: 2023年4月10日 星期一 21:19
收件人: Dongjoon Hyun 
抄送: "dev@spark.apache.org" 
主题: Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

+1 from me

On Sun, Apr 9, 2023 at 7:19 PM Dongjoon Hyun 
mailto:dongj...@apache.org>> wrote:
I'll start with my +1.

I verified the checksum, signatures of the artifacts, and documentations.
Also, ran the tests with YARN and K8s modules.

Dongjoon.

On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
> Please vote on releasing the following candidate as Apache Spark version
> 3.2.4.
>
> The vote is open until April 13th 1AM (PST) and passes if a majority +1 PMC
> votes are cast, with a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 3.2.4
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see 
> https://spark.apache.org/
>
> The tag to be voted on is v3.2.4-rc1 (commit
> 0ae10ac18298d1792828f1d59b652ef17462d76e)
> https://github.com/apache/spark/tree/v3.2.4-rc1
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1442/
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
>
> The list of bug fixes going into 3.2.4 can be found at the following URL:
> https://issues.apache.org/jira/projects/SPARK/versions/12352607
>
> This release is using the release script of the tag v3.2.4-rc1.
>
> FAQ
>
> =
> How can I help test this release?
> =
>
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with a out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 3.2.4?
> ===
>
> The current list of open tickets targeted at 3.2.4 can be found at:
> https://issues.apache.org/jira/projects/SPARK
>  and search for "Target
> Version/s" = 3.2.4
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
>
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.
>

-
To unsubscribe e-mail: 
dev-unsubscr...@spark.apache.org


Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread Sean Owen
+1 from me

On Sun, Apr 9, 2023 at 7:19 PM Dongjoon Hyun  wrote:

> I'll start with my +1.
>
> I verified the checksum, signatures of the artifacts, and documentations.
> Also, ran the tests with YARN and K8s modules.
>
> Dongjoon.
>
> On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
> > Please vote on releasing the following candidate as Apache Spark version
> > 3.2.4.
> >
> > The vote is open until April 13th 1AM (PST) and passes if a majority +1
> PMC
> > votes are cast, with a minimum of 3 +1 votes.
> >
> > [ ] +1 Release this package as Apache Spark 3.2.4
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see https://spark.apache.org/
> >
> > The tag to be voted on is v3.2.4-rc1 (commit
> > 0ae10ac18298d1792828f1d59b652ef17462d76e)
> > https://github.com/apache/spark/tree/v3.2.4-rc1
> >
> > The release files, including signatures, digests, etc. can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
> >
> > Signatures used for Spark RCs can be found in this file:
> > https://dist.apache.org/repos/dist/dev/spark/KEYS
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1442/
> >
> > The documentation corresponding to this release can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
> >
> > The list of bug fixes going into 3.2.4 can be found at the following URL:
> > https://issues.apache.org/jira/projects/SPARK/versions/12352607
> >
> > This release is using the release script of the tag v3.2.4-rc1.
> >
> > FAQ
> >
> > =
> > How can I help test this release?
> > =
> >
> > If you are a Spark user, you can help us test this release by taking
> > an existing Spark workload and running on this release candidate, then
> > reporting any regressions.
> >
> > If you're working in PySpark you can set up a virtual env and install
> > the current RC and see if anything important breaks, in the Java/Scala
> > you can add the staging repository to your projects resolvers and test
> > with the RC (make sure to clean up the artifact cache before/after so
> > you don't end up building with a out of date RC going forward).
> >
> > ===
> > What should happen to JIRA tickets still targeting 3.2.4?
> > ===
> >
> > The current list of open tickets targeted at 3.2.4 can be found at:
> > https://issues.apache.org/jira/projects/SPARK and search for "Target
> > Version/s" = 3.2.4
> >
> > Committers should look at those and triage. Extremely important bug
> > fixes, documentation, and API tweaks that impact compatibility should
> > be worked on immediately. Everything else please retarget to an
> > appropriate release.
> >
> > ==
> > But my bug isn't fixed?
> > ==
> >
> > In order to make timely releases, we will typically not hold the
> > release unless the bug in question is a regression from the previous
> > release. That being said, if there is something which is a regression
> > that has not been correctly targeted please ping me or a committer to
> > help target the issue.
> >
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-10 Thread Ruifeng Zheng
+1 (non-binding)




RuifengZheng
ruife...@foxmail.com








--Original--
From:   
 "Kent Yao" 
   http://spark.apache.org/
 
  The tag to be voted on is v3.4.0-rc7 (commit 
87a5442f7ed96b11051d8a9333476d080054e5a0):
  https://github.com/apache/spark/tree/v3.4.0-rc7
 
  The release files, including signatures, digests, etc. 
can be found at:
  
https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
 
  Signatures used for Spark RCs can be found in this file:
  https://dist.apache.org/repos/dist/dev/spark/KEYS
 
  The staging repository for this release can be found at:
  
https://repository.apache.org/content/repositories/orgapachespark-1441
 
  The documentation corresponding to this release can be 
found at:
  
https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
 
  The list of bug fixes going into 3.4.0 can be found at 
the following URL:
  
https://issues.apache.org/jira/projects/SPARK/versions/12351465
 
  This release is using the release script of the tag 
v3.4.0-rc7.
 
 
  FAQ
 
  =
  How can I help test this release?
  =
  If you are a Spark user, you can help us test this 
release by taking
  an existing Spark workload and running on this release 
candidate, then
  reporting any regressions.
 
  If you're working in PySpark you can set up a virtual env 
and install
  the current RC and see if anything important breaks, in 
the Java/Scala
  you can add the staging repository to your projects 
resolvers and test
  with the RC (make sure to clean up the artifact cache 
before/after so
  you don't end up building with an out of date RC going 
forward).
 
  ===
  What should happen to JIRA tickets still targeting 3.4.0?
  ===
  The current list of open tickets targeted at 3.4.0 can be 
found at:
  https://issues.apache.org/jira/projects/SPARK and search 
for "Target Version/s" = 3.4.0
 
  Committers should look at those and triage. Extremely 
important bug
  fixes, documentation, and API tweaks that impact 
compatibility should
  be worked on immediately. Everything else please retarget 
to an
  appropriate release.
 
  ==
  But my bug isn't fixed?
  ==
  In order to make timely releases, we will typically not 
hold the
  release unless the bug in question is a regression from 
the previous
  release. That being said, if there is something which is 
a regression
  that has not been correctly targeted please ping me or a 
committer to
  help target the issue.
 
  Thanks,
  Xinrong Meng

 
-
 To unsubscribe e-mail: dev-unsubscr...@spark.apache.org


-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread Kent Yao
+1 (non-binding)

L. C. Hsieh  于2023年4月10日周一 15:02写道:
>
> +1
>
> Thanks Dongjoon
>
> On Sun, Apr 9, 2023 at 5:20 PM Dongjoon Hyun  wrote:
> >
> > I'll start with my +1.
> >
> > I verified the checksum, signatures of the artifacts, and documentations.
> > Also, ran the tests with YARN and K8s modules.
> >
> > Dongjoon.
> >
> > On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
> > > Please vote on releasing the following candidate as Apache Spark version
> > > 3.2.4.
> > >
> > > The vote is open until April 13th 1AM (PST) and passes if a majority +1 
> > > PMC
> > > votes are cast, with a minimum of 3 +1 votes.
> > >
> > > [ ] +1 Release this package as Apache Spark 3.2.4
> > > [ ] -1 Do not release this package because ...
> > >
> > > To learn more about Apache Spark, please see https://spark.apache.org/
> > >
> > > The tag to be voted on is v3.2.4-rc1 (commit
> > > 0ae10ac18298d1792828f1d59b652ef17462d76e)
> > > https://github.com/apache/spark/tree/v3.2.4-rc1
> > >
> > > The release files, including signatures, digests, etc. can be found at:
> > > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
> > >
> > > Signatures used for Spark RCs can be found in this file:
> > > https://dist.apache.org/repos/dist/dev/spark/KEYS
> > >
> > > The staging repository for this release can be found at:
> > > https://repository.apache.org/content/repositories/orgapachespark-1442/
> > >
> > > The documentation corresponding to this release can be found at:
> > > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
> > >
> > > The list of bug fixes going into 3.2.4 can be found at the following URL:
> > > https://issues.apache.org/jira/projects/SPARK/versions/12352607
> > >
> > > This release is using the release script of the tag v3.2.4-rc1.
> > >
> > > FAQ
> > >
> > > =
> > > How can I help test this release?
> > > =
> > >
> > > If you are a Spark user, you can help us test this release by taking
> > > an existing Spark workload and running on this release candidate, then
> > > reporting any regressions.
> > >
> > > If you're working in PySpark you can set up a virtual env and install
> > > the current RC and see if anything important breaks, in the Java/Scala
> > > you can add the staging repository to your projects resolvers and test
> > > with the RC (make sure to clean up the artifact cache before/after so
> > > you don't end up building with a out of date RC going forward).
> > >
> > > ===
> > > What should happen to JIRA tickets still targeting 3.2.4?
> > > ===
> > >
> > > The current list of open tickets targeted at 3.2.4 can be found at:
> > > https://issues.apache.org/jira/projects/SPARK and search for "Target
> > > Version/s" = 3.2.4
> > >
> > > Committers should look at those and triage. Extremely important bug
> > > fixes, documentation, and API tweaks that impact compatibility should
> > > be worked on immediately. Everything else please retarget to an
> > > appropriate release.
> > >
> > > ==
> > > But my bug isn't fixed?
> > > ==
> > >
> > > In order to make timely releases, we will typically not hold the
> > > release unless the bug in question is a regression from the previous
> > > release. That being said, if there is something which is a regression
> > > that has not been correctly targeted please ping me or a committer to
> > > help target the issue.
> > >
> >
> > -
> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
> >
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-10 Thread Kent Yao
+1(non-binding)

Gengliang Wang  于2023年4月10日周一 15:27写道:
>
> +1
>
> On Sun, Apr 9, 2023 at 3:17 PM Dongjoon Hyun  wrote:
>>
>> +1
>>
>> I verified the same steps like previous RCs.
>>
>> Dongjoon.
>>
>>
>> On Sat, Apr 8, 2023 at 7:47 PM Mridul Muralidharan  wrote:
>>>
>>>
>>> +1
>>>
>>> Signatures, digests, etc check out fine.
>>> Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes
>>>
>>> Regards,
>>> Mridul
>>>
>>>
>>> On Sat, Apr 8, 2023 at 12:13 PM L. C. Hsieh  wrote:

 +1

 Thanks Xinrong.

 On Sat, Apr 8, 2023 at 8:23 AM yangjie01  wrote:
 >
 > +1
 >
 >
 >
 > 发件人: Sean Owen 
 > 日期: 2023年4月8日 星期六 20:27
 > 收件人: Xinrong Meng 
 > 抄送: dev 
 > 主题: Re: [VOTE] Release Apache Spark 3.4.0 (RC7)
 >
 >
 >
 > +1 form me, same result as last time.
 >
 >
 >
 > On Fri, Apr 7, 2023 at 6:30 PM Xinrong Meng  
 > wrote:
 >
 > Please vote on releasing the following candidate(RC7) as Apache Spark 
 > version 3.4.0.
 >
 > The vote is open until 11:59pm Pacific time April 12th and passes if a 
 > majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
 >
 > [ ] +1 Release this package as Apache Spark 3.4.0
 > [ ] -1 Do not release this package because ...
 >
 > To learn more about Apache Spark, please see http://spark.apache.org/
 >
 > The tag to be voted on is v3.4.0-rc7 (commit 
 > 87a5442f7ed96b11051d8a9333476d080054e5a0):
 > https://github.com/apache/spark/tree/v3.4.0-rc7
 >
 > The release files, including signatures, digests, etc. can be found at:
 > https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
 >
 > Signatures used for Spark RCs can be found in this file:
 > https://dist.apache.org/repos/dist/dev/spark/KEYS
 >
 > The staging repository for this release can be found at:
 > https://repository.apache.org/content/repositories/orgapachespark-1441
 >
 > The documentation corresponding to this release can be found at:
 > https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
 >
 > The list of bug fixes going into 3.4.0 can be found at the following URL:
 > https://issues.apache.org/jira/projects/SPARK/versions/12351465
 >
 > This release is using the release script of the tag v3.4.0-rc7.
 >
 >
 > FAQ
 >
 > =
 > How can I help test this release?
 > =
 > If you are a Spark user, you can help us test this release by taking
 > an existing Spark workload and running on this release candidate, then
 > reporting any regressions.
 >
 > If you're working in PySpark you can set up a virtual env and install
 > the current RC and see if anything important breaks, in the Java/Scala
 > you can add the staging repository to your projects resolvers and test
 > with the RC (make sure to clean up the artifact cache before/after so
 > you don't end up building with an out of date RC going forward).
 >
 > ===
 > What should happen to JIRA tickets still targeting 3.4.0?
 > ===
 > The current list of open tickets targeted at 3.4.0 can be found at:
 > https://issues.apache.org/jira/projects/SPARK and search for "Target 
 > Version/s" = 3.4.0
 >
 > Committers should look at those and triage. Extremely important bug
 > fixes, documentation, and API tweaks that impact compatibility should
 > be worked on immediately. Everything else please retarget to an
 > appropriate release.
 >
 > ==
 > But my bug isn't fixed?
 > ==
 > In order to make timely releases, we will typically not hold the
 > release unless the bug in question is a regression from the previous
 > release. That being said, if there is something which is a regression
 > that has not been correctly targeted please ping me or a committer to
 > help target the issue.
 >
 > Thanks,
 > Xinrong Meng

 -
 To unsubscribe e-mail: dev-unsubscr...@spark.apache.org


-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

2023-04-10 Thread Gengliang Wang
+1

On Sun, Apr 9, 2023 at 3:17 PM Dongjoon Hyun 
wrote:

> +1
>
> I verified the same steps like previous RCs.
>
> Dongjoon.
>
>
> On Sat, Apr 8, 2023 at 7:47 PM Mridul Muralidharan 
> wrote:
>
>>
>> +1
>>
>> Signatures, digests, etc check out fine.
>> Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes
>>
>> Regards,
>> Mridul
>>
>>
>> On Sat, Apr 8, 2023 at 12:13 PM L. C. Hsieh  wrote:
>>
>>> +1
>>>
>>> Thanks Xinrong.
>>>
>>> On Sat, Apr 8, 2023 at 8:23 AM yangjie01  wrote:
>>> >
>>> > +1
>>> >
>>> >
>>> >
>>> > 发件人: Sean Owen 
>>> > 日期: 2023年4月8日 星期六 20:27
>>> > 收件人: Xinrong Meng 
>>> > 抄送: dev 
>>> > 主题: Re: [VOTE] Release Apache Spark 3.4.0 (RC7)
>>> >
>>> >
>>> >
>>> > +1 form me, same result as last time.
>>> >
>>> >
>>> >
>>> > On Fri, Apr 7, 2023 at 6:30 PM Xinrong Meng 
>>> wrote:
>>> >
>>> > Please vote on releasing the following candidate(RC7) as Apache Spark
>>> version 3.4.0.
>>> >
>>> > The vote is open until 11:59pm Pacific time April 12th and passes if a
>>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>> >
>>> > [ ] +1 Release this package as Apache Spark 3.4.0
>>> > [ ] -1 Do not release this package because ...
>>> >
>>> > To learn more about Apache Spark, please see http://spark.apache.org/
>>> >
>>> > The tag to be voted on is v3.4.0-rc7 (commit
>>> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>>> > https://github.com/apache/spark/tree/v3.4.0-rc7
>>> >
>>> > The release files, including signatures, digests, etc. can be found at:
>>> > https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>>> >
>>> > Signatures used for Spark RCs can be found in this file:
>>> > https://dist.apache.org/repos/dist/dev/spark/KEYS
>>> >
>>> > The staging repository for this release can be found at:
>>> > https://repository.apache.org/content/repositories/orgapachespark-1441
>>> >
>>> > The documentation corresponding to this release can be found at:
>>> > https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>>> >
>>> > The list of bug fixes going into 3.4.0 can be found at the following
>>> URL:
>>> > https://issues.apache.org/jira/projects/SPARK/versions/12351465
>>> >
>>> > This release is using the release script of the tag v3.4.0-rc7.
>>> >
>>> >
>>> > FAQ
>>> >
>>> > =
>>> > How can I help test this release?
>>> > =
>>> > If you are a Spark user, you can help us test this release by taking
>>> > an existing Spark workload and running on this release candidate, then
>>> > reporting any regressions.
>>> >
>>> > If you're working in PySpark you can set up a virtual env and install
>>> > the current RC and see if anything important breaks, in the Java/Scala
>>> > you can add the staging repository to your projects resolvers and test
>>> > with the RC (make sure to clean up the artifact cache before/after so
>>> > you don't end up building with an out of date RC going forward).
>>> >
>>> > ===
>>> > What should happen to JIRA tickets still targeting 3.4.0?
>>> > ===
>>> > The current list of open tickets targeted at 3.4.0 can be found at:
>>> > https://issues.apache.org/jira/projects/SPARK and search for "Target
>>> Version/s" = 3.4.0
>>> >
>>> > Committers should look at those and triage. Extremely important bug
>>> > fixes, documentation, and API tweaks that impact compatibility should
>>> > be worked on immediately. Everything else please retarget to an
>>> > appropriate release.
>>> >
>>> > ==
>>> > But my bug isn't fixed?
>>> > ==
>>> > In order to make timely releases, we will typically not hold the
>>> > release unless the bug in question is a regression from the previous
>>> > release. That being said, if there is something which is a regression
>>> > that has not been correctly targeted please ping me or a committer to
>>> > help target the issue.
>>> >
>>> > Thanks,
>>> > Xinrong Meng
>>>
>>> -
>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>
>>>


Re: Slack for Spark Community: Merging various threads

2023-04-10 Thread Chitral Verma
Hi all,
Thanks for starting a discussion on this super-important topic.

I'm not sure if this is already considered, but Discord is also a viable
option and many many open-source projects and communities are using it.

   - It's *mostly* free with no online user limitations like slack.
   - Has a big feature overlap with Slack.
   - Sign up process is simple and straightforward. Clients for web/
   desktop/ mobile are available.
   - Policies and controlling can be possibly done via bots + designated
   channel managers.
   - allows channels like Slack for the organisation of messages.


On Mon, 10 Apr 2023 at 08:09, Dongjoon Hyun  wrote:

> Thank you, Holden, Bjorn, Maciej.
>
> Yes, those are also valid.
>
> Dongjoon.
>
> On Sat, Apr 8, 2023 at 4:20 AM Maciej  wrote:
>
>> @Bjørn Matrix (represented by element in the linked summary. Also, since
>> the last year, Rocket Chat uses Matrix under the hood) is already used for
>> user support and related discussions for a number of large projects, since
>> gitter migrated there. And it is not like we need Slack or its replacement
>> in the first place. Some of the Slack features are useful for us, but its
>> not exactly the best tool for user support IMHO.
>>
>> @Dongjoon There are probably two more things we should discuss:
>>
>>- What are data privacy obligations while keeping a communication
>>channel, advertised as official, outside the ASF?  Does it put it out of
>>scope for the ASF legal and data privacy teams?
>>
>>If I recall correctly, Slack requires at least some of the
>>formalities to be handled by the primary owner and as far as I am aware 
>> the
>>project is not a legal person. Not sure how linen.dev or another
>>retention tool fits into all of that, but it's unrealistic to expect it
>>makes things easier.
>>
>>This might sound hypothetical, but we've already seen users leaking
>>sensitive information on the mail list and requesting erasure (which,
>>luckily for us, is not technically possible).
>>
>>- How are we going to handle moderation, if we assume number of users
>>comparable to Delta Lake Slack and open registration? At minimum we have 
>> to
>>ensure that the ASF Code of Conduct is respected. An official channel or
>>not, failure to do that reflects badly on the project, the ASF and all of
>>us.
>>
>> --
>> Maciej
>>
>>
>>
>> On 4/7/23 21:02, Bjørn Jørgensen wrote:
>>
>> Yes, I have done some search for slack alternatives
>> 
>> I feel that we should do some search, to find if there can be a
>> better solution than slack.
>> For what I have found, there are two that can be an alternative for
>> slack.
>>
>> Rocket.Chat  
>>
>> and
>>
>> Zulip Chat 
>> Zulip Cloud Standard is free for open-source projects
>> 
>> Witch means we get
>>
>>- Unlimited search history
>>- File storage up to 10 GB per user
>>- Message retention policies
>>
>>- Brand Zulip with your logo
>>- Priority commercial support
>>- Funds the Zulip open source project
>>
>>
>> Rust is using zulip  
>>
>> We can import chats from slack
>> 
>> We can use zulip for events   With multi-use
>> invite links , there’s no need
>> to create individual Zulip invitations.  This means that PMC doesn't have
>> to send a link to every user.
>> CODE BLOCKS
>>
>> Discuss code with ease using Markdown code blocks, syntax highlighting,
>> and code playgrounds
>> .
>>
>>
>>
>>
>>
>>
>> fre. 7. apr. 2023 kl. 18:54 skrev Holden Karau :
>>
>>> I think there was some concern around how to make any sync channel show
>>> up in logs / index / search results?
>>>
>>> On Fri, Apr 7, 2023 at 9:41 AM Dongjoon Hyun 
>>> wrote:
>>>
 Thank you, All.

 I'm very satisfied with the focused and right questions for the real
 issues by removing irrelevant claims. :)

 Let me collect your relevant comments simply.


 # Category 1: Invitation Hurdle

 > The key question here is that do PMC members have the bandwidth of
 inviting everyone in user@ and dev@?

 > Extending this to inviting everyone on @user (over >4k  subscribers
 according to the previous thread) might be a stretch,

 > we should have an official project Slack with an easy invitation
 process.


 # Category 2: Controllability

 > Additionally. there is no indication that the-asf.slack.com is
 intended for general support.

 > I would also lean towards a standalone workspace, where we have more
 control over organizing the channels,

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

2023-04-10 Thread L. C. Hsieh
+1

Thanks Dongjoon

On Sun, Apr 9, 2023 at 5:20 PM Dongjoon Hyun  wrote:
>
> I'll start with my +1.
>
> I verified the checksum, signatures of the artifacts, and documentations.
> Also, ran the tests with YARN and K8s modules.
>
> Dongjoon.
>
> On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
> > Please vote on releasing the following candidate as Apache Spark version
> > 3.2.4.
> >
> > The vote is open until April 13th 1AM (PST) and passes if a majority +1 PMC
> > votes are cast, with a minimum of 3 +1 votes.
> >
> > [ ] +1 Release this package as Apache Spark 3.2.4
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see https://spark.apache.org/
> >
> > The tag to be voted on is v3.2.4-rc1 (commit
> > 0ae10ac18298d1792828f1d59b652ef17462d76e)
> > https://github.com/apache/spark/tree/v3.2.4-rc1
> >
> > The release files, including signatures, digests, etc. can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
> >
> > Signatures used for Spark RCs can be found in this file:
> > https://dist.apache.org/repos/dist/dev/spark/KEYS
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1442/
> >
> > The documentation corresponding to this release can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
> >
> > The list of bug fixes going into 3.2.4 can be found at the following URL:
> > https://issues.apache.org/jira/projects/SPARK/versions/12352607
> >
> > This release is using the release script of the tag v3.2.4-rc1.
> >
> > FAQ
> >
> > =
> > How can I help test this release?
> > =
> >
> > If you are a Spark user, you can help us test this release by taking
> > an existing Spark workload and running on this release candidate, then
> > reporting any regressions.
> >
> > If you're working in PySpark you can set up a virtual env and install
> > the current RC and see if anything important breaks, in the Java/Scala
> > you can add the staging repository to your projects resolvers and test
> > with the RC (make sure to clean up the artifact cache before/after so
> > you don't end up building with a out of date RC going forward).
> >
> > ===
> > What should happen to JIRA tickets still targeting 3.2.4?
> > ===
> >
> > The current list of open tickets targeted at 3.2.4 can be found at:
> > https://issues.apache.org/jira/projects/SPARK and search for "Target
> > Version/s" = 3.2.4
> >
> > Committers should look at those and triage. Extremely important bug
> > fixes, documentation, and API tweaks that impact compatibility should
> > be worked on immediately. Everything else please retarget to an
> > appropriate release.
> >
> > ==
> > But my bug isn't fixed?
> > ==
> >
> > In order to make timely releases, we will typically not hold the
> > release unless the bug in question is a regression from the previous
> > release. That being said, if there is something which is a regression
> > that has not been correctly targeted please ping me or a committer to
> > help target the issue.
> >
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org