Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-22 Thread Yuming Wang
+1 for me. Passed Delta unit tests
, Iceberg unit tests
 and Hudi unit tests
.

On Sat, Oct 22, 2022 at 8:30 PM Yuming Wang  wrote:

>
> @Mridul Muralidharan  I can't reproduce this issue.
> This is my github action
> 
> job.
>
> On Sat, Oct 22, 2022 at 9:00 AM Mridul Muralidharan 
> wrote:
>
>>
>> My desktop is running Ubuntu 22.04.1 LTS, with JAVA_HOME pointing to
>> jdk1.8.0_341
>> I ran build with '-Pyarn -Pmesos -Pkubernetes' profiles [1] and with
>> $HOME/.m2 cleaned up.
>>
>> Regards,
>> Mridul
>>
>> [1] ARGS="-Pyarn -Pmesos -Pkubernetes"; ./build/mvn $ARGS clean &&
>> ./build/mvn -DskipTests $ARGS package 2>&1 | tee build_output.txt  &&
>> ./build/mvn  $ARGS package 2>&1 | tee test_output.txt
>>
>> On Fri, Oct 21, 2022 at 11:17 AM Dongjoon Hyun 
>> wrote:
>>
>>> Could you provide your environment and test profile? Both community CIs
>>> look fine to me.
>>>
>>> GitHub Action:
>>> https://github.com/apache/spark/actions?query=branch%3Abranch-3.3
>>> Apple Silicon Jenkins Farm:
>>> https://apache-spark.s3.fr-par.scw.cloud/BRANCH-3.3.html
>>>
>>> Dongjoon.
>>>
>>>
>>> On Fri, Oct 21, 2022 at 8:48 AM Mridul Muralidharan 
>>> wrote:
>>>
 Hi,

   I saw a couple of test failures I have not observed before:

 a) FsHistoryProviderSuite -  "SPARK-33146: don't let one bad rolling
 log folder prevent loading other applications"
 b) MesosClusterSchedulerSuite - "accept/decline offers with driver
 constraints"

 I ended up 'ignore''ing them to make the build pass, but did anything
 change to cause them to fail/be flakey ?

 Rest of the validation and build went fine.

 Regards,
 Mridul





 On Tue, Oct 18, 2022 at 10:28 PM Cheng Pan  wrote:

> +1 (non-binding)
>
> - Passed Apache Kyuubi (Incubating) integration tests[1]
> - Run some jobs on our internal K8s cluster
>
> [1] https://github.com/apache/incubator-kyuubi/pull/3507
>
> Thanks,
> Cheng Pan
>
> On Wed, Oct 19, 2022 at 9:13 AM Yikun Jiang 
> wrote:
> >
> > +1, also test passed with spark-docker workflow (downloading rc4
> tgz, extract, build image, run K8s IT)
> >
> > [1] https://github.com/Yikun/spark-docker/pull/9
> >
> > Regards,
> > Yikun
> >
> > On Wed, Oct 19, 2022 at 8:59 AM Wenchen Fan 
> wrote:
> >>
> >> +1
> >>
> >> On Wed, Oct 19, 2022 at 4:59 AM Chao Sun 
> wrote:
> >>>
> >>> +1. Thanks Yuming!
> >>>
> >>> Chao
> >>>
> >>> On Tue, Oct 18, 2022 at 1:18 PM Thomas graves 
> wrote:
> >>> >
> >>> > +1. Ran internal test suite.
> >>> >
> >>> > Tom
> >>> >
> >>> > On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang 
> wrote:
> >>> > >
> >>> > > Please vote on releasing the following candidate as Apache
> Spark version 3.3.1.
> >>> > >
> >>> > > The vote is open until 11:59pm Pacific time October 21th and
> passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
> >>> > >
> >>> > > [ ] +1 Release this package as Apache Spark 3.3.1
> >>> > > [ ] -1 Do not release this package because ...
> >>> > >
> >>> > > To learn more about Apache Spark, please see
> https://spark.apache.org
> >>> > >
> >>> > > The tag to be voted on is v3.3.1-rc4 (commit
> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
> >>> > > https://github.com/apache/spark/tree/v3.3.1-rc4
> >>> > >
> >>> > > The release files, including signatures, digests, etc. can be
> found at:
> >>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
> >>> > >
> >>> > > Signatures used for Spark RCs can be found in this file:
> >>> > > https://dist.apache.org/repos/dist/dev/spark/KEYS
> >>> > >
> >>> > > The staging repository for this release can be found at:
> >>> > >
> https://repository.apache.org/content/repositories/orgapachespark-1430
> >>> > >
> >>> > > The documentation corresponding to this release can be found
> at:
> >>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
> >>> > >
> >>> > > The list of bug fixes going into 3.3.1 can be found at the
> following URL:
> >>> > > https://s.apache.org/ttgz6
> >>> > >
> >>> > > This release is using the release script of the tag v3.3.1-rc4.
> >>> > >
> >>> > >
> >>> > > FAQ
> >>> > >
> >>> > > ==
> >>> > > What happened to v3.3.1-rc3?
> >>> > > ==
> >>> > > A performance regression(SPARK-40703) was found after tagging
> v3.3.1-rc3, which the Iceberg community hopes Spark 3.3.1 could fix.
> >>> > > So we skipped the vote on v3.3.1-rc3.
>>>

Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-22 Thread Yuming Wang
@Mridul Muralidharan  I can't reproduce this issue. This
is my github action

job.

On Sat, Oct 22, 2022 at 9:00 AM Mridul Muralidharan 
wrote:

>
> My desktop is running Ubuntu 22.04.1 LTS, with JAVA_HOME pointing to
> jdk1.8.0_341
> I ran build with '-Pyarn -Pmesos -Pkubernetes' profiles [1] and with
> $HOME/.m2 cleaned up.
>
> Regards,
> Mridul
>
> [1] ARGS="-Pyarn -Pmesos -Pkubernetes"; ./build/mvn $ARGS clean &&
> ./build/mvn -DskipTests $ARGS package 2>&1 | tee build_output.txt  &&
> ./build/mvn  $ARGS package 2>&1 | tee test_output.txt
>
> On Fri, Oct 21, 2022 at 11:17 AM Dongjoon Hyun 
> wrote:
>
>> Could you provide your environment and test profile? Both community CIs
>> look fine to me.
>>
>> GitHub Action:
>> https://github.com/apache/spark/actions?query=branch%3Abranch-3.3
>> Apple Silicon Jenkins Farm:
>> https://apache-spark.s3.fr-par.scw.cloud/BRANCH-3.3.html
>>
>> Dongjoon.
>>
>>
>> On Fri, Oct 21, 2022 at 8:48 AM Mridul Muralidharan 
>> wrote:
>>
>>> Hi,
>>>
>>>   I saw a couple of test failures I have not observed before:
>>>
>>> a) FsHistoryProviderSuite -  "SPARK-33146: don't let one bad rolling log
>>> folder prevent loading other applications"
>>> b) MesosClusterSchedulerSuite - "accept/decline offers with driver
>>> constraints"
>>>
>>> I ended up 'ignore''ing them to make the build pass, but did anything
>>> change to cause them to fail/be flakey ?
>>>
>>> Rest of the validation and build went fine.
>>>
>>> Regards,
>>> Mridul
>>>
>>>
>>>
>>>
>>>
>>> On Tue, Oct 18, 2022 at 10:28 PM Cheng Pan  wrote:
>>>
 +1 (non-binding)

 - Passed Apache Kyuubi (Incubating) integration tests[1]
 - Run some jobs on our internal K8s cluster

 [1] https://github.com/apache/incubator-kyuubi/pull/3507

 Thanks,
 Cheng Pan

 On Wed, Oct 19, 2022 at 9:13 AM Yikun Jiang 
 wrote:
 >
 > +1, also test passed with spark-docker workflow (downloading rc4 tgz,
 extract, build image, run K8s IT)
 >
 > [1] https://github.com/Yikun/spark-docker/pull/9
 >
 > Regards,
 > Yikun
 >
 > On Wed, Oct 19, 2022 at 8:59 AM Wenchen Fan 
 wrote:
 >>
 >> +1
 >>
 >> On Wed, Oct 19, 2022 at 4:59 AM Chao Sun  wrote:
 >>>
 >>> +1. Thanks Yuming!
 >>>
 >>> Chao
 >>>
 >>> On Tue, Oct 18, 2022 at 1:18 PM Thomas graves 
 wrote:
 >>> >
 >>> > +1. Ran internal test suite.
 >>> >
 >>> > Tom
 >>> >
 >>> > On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang 
 wrote:
 >>> > >
 >>> > > Please vote on releasing the following candidate as Apache
 Spark version 3.3.1.
 >>> > >
 >>> > > The vote is open until 11:59pm Pacific time October 21th and
 passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
 >>> > >
 >>> > > [ ] +1 Release this package as Apache Spark 3.3.1
 >>> > > [ ] -1 Do not release this package because ...
 >>> > >
 >>> > > To learn more about Apache Spark, please see
 https://spark.apache.org
 >>> > >
 >>> > > The tag to be voted on is v3.3.1-rc4 (commit
 fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
 >>> > > https://github.com/apache/spark/tree/v3.3.1-rc4
 >>> > >
 >>> > > The release files, including signatures, digests, etc. can be
 found at:
 >>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
 >>> > >
 >>> > > Signatures used for Spark RCs can be found in this file:
 >>> > > https://dist.apache.org/repos/dist/dev/spark/KEYS
 >>> > >
 >>> > > The staging repository for this release can be found at:
 >>> > >
 https://repository.apache.org/content/repositories/orgapachespark-1430
 >>> > >
 >>> > > The documentation corresponding to this release can be found at:
 >>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
 >>> > >
 >>> > > The list of bug fixes going into 3.3.1 can be found at the
 following URL:
 >>> > > https://s.apache.org/ttgz6
 >>> > >
 >>> > > This release is using the release script of the tag v3.3.1-rc4.
 >>> > >
 >>> > >
 >>> > > FAQ
 >>> > >
 >>> > > ==
 >>> > > What happened to v3.3.1-rc3?
 >>> > > ==
 >>> > > A performance regression(SPARK-40703) was found after tagging
 v3.3.1-rc3, which the Iceberg community hopes Spark 3.3.1 could fix.
 >>> > > So we skipped the vote on v3.3.1-rc3.
 >>> > >
 >>> > > =
 >>> > > How can I help test this release?
 >>> > > =
 >>> > > If you are a Spark user, you can help us test this release by
 taking
 >>> > > an existing Spark workload and running on this release
 candidate, then
 >>> > > reporting any regressions.
 >>> > >
 >>> > > If you're working in PySpark you can set up a virtual en

Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-21 Thread Mridul Muralidharan
My desktop is running Ubuntu 22.04.1 LTS, with JAVA_HOME pointing to
jdk1.8.0_341
I ran build with '-Pyarn -Pmesos -Pkubernetes' profiles [1] and with
$HOME/.m2 cleaned up.

Regards,
Mridul

[1] ARGS="-Pyarn -Pmesos -Pkubernetes"; ./build/mvn $ARGS clean &&
./build/mvn -DskipTests $ARGS package 2>&1 | tee build_output.txt  &&
./build/mvn  $ARGS package 2>&1 | tee test_output.txt

On Fri, Oct 21, 2022 at 11:17 AM Dongjoon Hyun 
wrote:

> Could you provide your environment and test profile? Both community CIs
> look fine to me.
>
> GitHub Action:
> https://github.com/apache/spark/actions?query=branch%3Abranch-3.3
> Apple Silicon Jenkins Farm:
> https://apache-spark.s3.fr-par.scw.cloud/BRANCH-3.3.html
>
> Dongjoon.
>
>
> On Fri, Oct 21, 2022 at 8:48 AM Mridul Muralidharan 
> wrote:
>
>> Hi,
>>
>>   I saw a couple of test failures I have not observed before:
>>
>> a) FsHistoryProviderSuite -  "SPARK-33146: don't let one bad rolling log
>> folder prevent loading other applications"
>> b) MesosClusterSchedulerSuite - "accept/decline offers with driver
>> constraints"
>>
>> I ended up 'ignore''ing them to make the build pass, but did anything
>> change to cause them to fail/be flakey ?
>>
>> Rest of the validation and build went fine.
>>
>> Regards,
>> Mridul
>>
>>
>>
>>
>>
>> On Tue, Oct 18, 2022 at 10:28 PM Cheng Pan  wrote:
>>
>>> +1 (non-binding)
>>>
>>> - Passed Apache Kyuubi (Incubating) integration tests[1]
>>> - Run some jobs on our internal K8s cluster
>>>
>>> [1] https://github.com/apache/incubator-kyuubi/pull/3507
>>>
>>> Thanks,
>>> Cheng Pan
>>>
>>> On Wed, Oct 19, 2022 at 9:13 AM Yikun Jiang  wrote:
>>> >
>>> > +1, also test passed with spark-docker workflow (downloading rc4 tgz,
>>> extract, build image, run K8s IT)
>>> >
>>> > [1] https://github.com/Yikun/spark-docker/pull/9
>>> >
>>> > Regards,
>>> > Yikun
>>> >
>>> > On Wed, Oct 19, 2022 at 8:59 AM Wenchen Fan 
>>> wrote:
>>> >>
>>> >> +1
>>> >>
>>> >> On Wed, Oct 19, 2022 at 4:59 AM Chao Sun  wrote:
>>> >>>
>>> >>> +1. Thanks Yuming!
>>> >>>
>>> >>> Chao
>>> >>>
>>> >>> On Tue, Oct 18, 2022 at 1:18 PM Thomas graves 
>>> wrote:
>>> >>> >
>>> >>> > +1. Ran internal test suite.
>>> >>> >
>>> >>> > Tom
>>> >>> >
>>> >>> > On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang 
>>> wrote:
>>> >>> > >
>>> >>> > > Please vote on releasing the following candidate as Apache Spark
>>> version 3.3.1.
>>> >>> > >
>>> >>> > > The vote is open until 11:59pm Pacific time October 21th and
>>> passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>> >>> > >
>>> >>> > > [ ] +1 Release this package as Apache Spark 3.3.1
>>> >>> > > [ ] -1 Do not release this package because ...
>>> >>> > >
>>> >>> > > To learn more about Apache Spark, please see
>>> https://spark.apache.org
>>> >>> > >
>>> >>> > > The tag to be voted on is v3.3.1-rc4 (commit
>>> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
>>> >>> > > https://github.com/apache/spark/tree/v3.3.1-rc4
>>> >>> > >
>>> >>> > > The release files, including signatures, digests, etc. can be
>>> found at:
>>> >>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
>>> >>> > >
>>> >>> > > Signatures used for Spark RCs can be found in this file:
>>> >>> > > https://dist.apache.org/repos/dist/dev/spark/KEYS
>>> >>> > >
>>> >>> > > The staging repository for this release can be found at:
>>> >>> > >
>>> https://repository.apache.org/content/repositories/orgapachespark-1430
>>> >>> > >
>>> >>> > > The documentation corresponding to this release can be found at:
>>> >>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
>>> >>> > >
>>> >>> > > The list of bug fixes going into 3.3.1 can be found at the
>>> following URL:
>>> >>> > > https://s.apache.org/ttgz6
>>> >>> > >
>>> >>> > > This release is using the release script of the tag v3.3.1-rc4.
>>> >>> > >
>>> >>> > >
>>> >>> > > FAQ
>>> >>> > >
>>> >>> > > ==
>>> >>> > > What happened to v3.3.1-rc3?
>>> >>> > > ==
>>> >>> > > A performance regression(SPARK-40703) was found after tagging
>>> v3.3.1-rc3, which the Iceberg community hopes Spark 3.3.1 could fix.
>>> >>> > > So we skipped the vote on v3.3.1-rc3.
>>> >>> > >
>>> >>> > > =
>>> >>> > > How can I help test this release?
>>> >>> > > =
>>> >>> > > If you are a Spark user, you can help us test this release by
>>> taking
>>> >>> > > an existing Spark workload and running on this release
>>> candidate, then
>>> >>> > > reporting any regressions.
>>> >>> > >
>>> >>> > > If you're working in PySpark you can set up a virtual env and
>>> install
>>> >>> > > the current RC and see if anything important breaks, in the
>>> Java/Scala
>>> >>> > > you can add the staging repository to your projects resolvers
>>> and test
>>> >>> > > with the RC (make sure to clean up the artifact cache
>>> before/after so
>>> >>> > > you don't end up building with a out of date RC going forward).
>>> >>> > >
>>> >>> > > =

Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-21 Thread Dongjoon Hyun
Could you provide your environment and test profile? Both community CIs
look fine to me.

GitHub Action:
https://github.com/apache/spark/actions?query=branch%3Abranch-3.3
Apple Silicon Jenkins Farm:
https://apache-spark.s3.fr-par.scw.cloud/BRANCH-3.3.html

Dongjoon.


On Fri, Oct 21, 2022 at 8:48 AM Mridul Muralidharan 
wrote:

> Hi,
>
>   I saw a couple of test failures I have not observed before:
>
> a) FsHistoryProviderSuite -  "SPARK-33146: don't let one bad rolling log
> folder prevent loading other applications"
> b) MesosClusterSchedulerSuite - "accept/decline offers with driver
> constraints"
>
> I ended up 'ignore''ing them to make the build pass, but did anything
> change to cause them to fail/be flakey ?
>
> Rest of the validation and build went fine.
>
> Regards,
> Mridul
>
>
>
>
>
> On Tue, Oct 18, 2022 at 10:28 PM Cheng Pan  wrote:
>
>> +1 (non-binding)
>>
>> - Passed Apache Kyuubi (Incubating) integration tests[1]
>> - Run some jobs on our internal K8s cluster
>>
>> [1] https://github.com/apache/incubator-kyuubi/pull/3507
>>
>> Thanks,
>> Cheng Pan
>>
>> On Wed, Oct 19, 2022 at 9:13 AM Yikun Jiang  wrote:
>> >
>> > +1, also test passed with spark-docker workflow (downloading rc4 tgz,
>> extract, build image, run K8s IT)
>> >
>> > [1] https://github.com/Yikun/spark-docker/pull/9
>> >
>> > Regards,
>> > Yikun
>> >
>> > On Wed, Oct 19, 2022 at 8:59 AM Wenchen Fan 
>> wrote:
>> >>
>> >> +1
>> >>
>> >> On Wed, Oct 19, 2022 at 4:59 AM Chao Sun  wrote:
>> >>>
>> >>> +1. Thanks Yuming!
>> >>>
>> >>> Chao
>> >>>
>> >>> On Tue, Oct 18, 2022 at 1:18 PM Thomas graves 
>> wrote:
>> >>> >
>> >>> > +1. Ran internal test suite.
>> >>> >
>> >>> > Tom
>> >>> >
>> >>> > On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang 
>> wrote:
>> >>> > >
>> >>> > > Please vote on releasing the following candidate as Apache Spark
>> version 3.3.1.
>> >>> > >
>> >>> > > The vote is open until 11:59pm Pacific time October 21th and
>> passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>> >>> > >
>> >>> > > [ ] +1 Release this package as Apache Spark 3.3.1
>> >>> > > [ ] -1 Do not release this package because ...
>> >>> > >
>> >>> > > To learn more about Apache Spark, please see
>> https://spark.apache.org
>> >>> > >
>> >>> > > The tag to be voted on is v3.3.1-rc4 (commit
>> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
>> >>> > > https://github.com/apache/spark/tree/v3.3.1-rc4
>> >>> > >
>> >>> > > The release files, including signatures, digests, etc. can be
>> found at:
>> >>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
>> >>> > >
>> >>> > > Signatures used for Spark RCs can be found in this file:
>> >>> > > https://dist.apache.org/repos/dist/dev/spark/KEYS
>> >>> > >
>> >>> > > The staging repository for this release can be found at:
>> >>> > >
>> https://repository.apache.org/content/repositories/orgapachespark-1430
>> >>> > >
>> >>> > > The documentation corresponding to this release can be found at:
>> >>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
>> >>> > >
>> >>> > > The list of bug fixes going into 3.3.1 can be found at the
>> following URL:
>> >>> > > https://s.apache.org/ttgz6
>> >>> > >
>> >>> > > This release is using the release script of the tag v3.3.1-rc4.
>> >>> > >
>> >>> > >
>> >>> > > FAQ
>> >>> > >
>> >>> > > ==
>> >>> > > What happened to v3.3.1-rc3?
>> >>> > > ==
>> >>> > > A performance regression(SPARK-40703) was found after tagging
>> v3.3.1-rc3, which the Iceberg community hopes Spark 3.3.1 could fix.
>> >>> > > So we skipped the vote on v3.3.1-rc3.
>> >>> > >
>> >>> > > =
>> >>> > > How can I help test this release?
>> >>> > > =
>> >>> > > If you are a Spark user, you can help us test this release by
>> taking
>> >>> > > an existing Spark workload and running on this release candidate,
>> then
>> >>> > > reporting any regressions.
>> >>> > >
>> >>> > > If you're working in PySpark you can set up a virtual env and
>> install
>> >>> > > the current RC and see if anything important breaks, in the
>> Java/Scala
>> >>> > > you can add the staging repository to your projects resolvers and
>> test
>> >>> > > with the RC (make sure to clean up the artifact cache
>> before/after so
>> >>> > > you don't end up building with a out of date RC going forward).
>> >>> > >
>> >>> > > ===
>> >>> > > What should happen to JIRA tickets still targeting 3.3.1?
>> >>> > > ===
>> >>> > > The current list of open tickets targeted at 3.3.1 can be found
>> at:
>> >>> > > https://issues.apache.org/jira/projects/SPARK and search for
>> "Target Version/s" = 3.3.1
>> >>> > >
>> >>> > > Committers should look at those and triage. Extremely important
>> bug
>> >>> > > fixes, documentation, and API tweaks that impact compatibility
>> should
>> >>> > > be worked on immediately. Everything else please retarget to an
>> >>

Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-21 Thread Mridul Muralidharan
Hi,

  I saw a couple of test failures I have not observed before:

a) FsHistoryProviderSuite -  "SPARK-33146: don't let one bad rolling log
folder prevent loading other applications"
b) MesosClusterSchedulerSuite - "accept/decline offers with driver
constraints"

I ended up 'ignore''ing them to make the build pass, but did anything
change to cause them to fail/be flakey ?

Rest of the validation and build went fine.

Regards,
Mridul





On Tue, Oct 18, 2022 at 10:28 PM Cheng Pan  wrote:

> +1 (non-binding)
>
> - Passed Apache Kyuubi (Incubating) integration tests[1]
> - Run some jobs on our internal K8s cluster
>
> [1] https://github.com/apache/incubator-kyuubi/pull/3507
>
> Thanks,
> Cheng Pan
>
> On Wed, Oct 19, 2022 at 9:13 AM Yikun Jiang  wrote:
> >
> > +1, also test passed with spark-docker workflow (downloading rc4 tgz,
> extract, build image, run K8s IT)
> >
> > [1] https://github.com/Yikun/spark-docker/pull/9
> >
> > Regards,
> > Yikun
> >
> > On Wed, Oct 19, 2022 at 8:59 AM Wenchen Fan  wrote:
> >>
> >> +1
> >>
> >> On Wed, Oct 19, 2022 at 4:59 AM Chao Sun  wrote:
> >>>
> >>> +1. Thanks Yuming!
> >>>
> >>> Chao
> >>>
> >>> On Tue, Oct 18, 2022 at 1:18 PM Thomas graves 
> wrote:
> >>> >
> >>> > +1. Ran internal test suite.
> >>> >
> >>> > Tom
> >>> >
> >>> > On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang 
> wrote:
> >>> > >
> >>> > > Please vote on releasing the following candidate as Apache Spark
> version 3.3.1.
> >>> > >
> >>> > > The vote is open until 11:59pm Pacific time October 21th and
> passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
> >>> > >
> >>> > > [ ] +1 Release this package as Apache Spark 3.3.1
> >>> > > [ ] -1 Do not release this package because ...
> >>> > >
> >>> > > To learn more about Apache Spark, please see
> https://spark.apache.org
> >>> > >
> >>> > > The tag to be voted on is v3.3.1-rc4 (commit
> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
> >>> > > https://github.com/apache/spark/tree/v3.3.1-rc4
> >>> > >
> >>> > > The release files, including signatures, digests, etc. can be
> found at:
> >>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
> >>> > >
> >>> > > Signatures used for Spark RCs can be found in this file:
> >>> > > https://dist.apache.org/repos/dist/dev/spark/KEYS
> >>> > >
> >>> > > The staging repository for this release can be found at:
> >>> > >
> https://repository.apache.org/content/repositories/orgapachespark-1430
> >>> > >
> >>> > > The documentation corresponding to this release can be found at:
> >>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
> >>> > >
> >>> > > The list of bug fixes going into 3.3.1 can be found at the
> following URL:
> >>> > > https://s.apache.org/ttgz6
> >>> > >
> >>> > > This release is using the release script of the tag v3.3.1-rc4.
> >>> > >
> >>> > >
> >>> > > FAQ
> >>> > >
> >>> > > ==
> >>> > > What happened to v3.3.1-rc3?
> >>> > > ==
> >>> > > A performance regression(SPARK-40703) was found after tagging
> v3.3.1-rc3, which the Iceberg community hopes Spark 3.3.1 could fix.
> >>> > > So we skipped the vote on v3.3.1-rc3.
> >>> > >
> >>> > > =
> >>> > > How can I help test this release?
> >>> > > =
> >>> > > If you are a Spark user, you can help us test this release by
> taking
> >>> > > an existing Spark workload and running on this release candidate,
> then
> >>> > > reporting any regressions.
> >>> > >
> >>> > > If you're working in PySpark you can set up a virtual env and
> install
> >>> > > the current RC and see if anything important breaks, in the
> Java/Scala
> >>> > > you can add the staging repository to your projects resolvers and
> test
> >>> > > with the RC (make sure to clean up the artifact cache before/after
> so
> >>> > > you don't end up building with a out of date RC going forward).
> >>> > >
> >>> > > ===
> >>> > > What should happen to JIRA tickets still targeting 3.3.1?
> >>> > > ===
> >>> > > The current list of open tickets targeted at 3.3.1 can be found at:
> >>> > > https://issues.apache.org/jira/projects/SPARK and search for
> "Target Version/s" = 3.3.1
> >>> > >
> >>> > > Committers should look at those and triage. Extremely important bug
> >>> > > fixes, documentation, and API tweaks that impact compatibility
> should
> >>> > > be worked on immediately. Everything else please retarget to an
> >>> > > appropriate release.
> >>> > >
> >>> > > ==
> >>> > > But my bug isn't fixed?
> >>> > > ==
> >>> > > In order to make timely releases, we will typically not hold the
> >>> > > release unless the bug in question is a regression from the
> previous
> >>> > > release. That being said, if there is something which is a
> regression
> >>> > > that has not been correctly targeted please ping me or a committer
> to
> >>> > > help target the issue.
> >>> > >

Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-18 Thread Cheng Pan
+1 (non-binding)

- Passed Apache Kyuubi (Incubating) integration tests[1]
- Run some jobs on our internal K8s cluster

[1] https://github.com/apache/incubator-kyuubi/pull/3507

Thanks,
Cheng Pan

On Wed, Oct 19, 2022 at 9:13 AM Yikun Jiang  wrote:
>
> +1, also test passed with spark-docker workflow (downloading rc4 tgz, 
> extract, build image, run K8s IT)
>
> [1] https://github.com/Yikun/spark-docker/pull/9
>
> Regards,
> Yikun
>
> On Wed, Oct 19, 2022 at 8:59 AM Wenchen Fan  wrote:
>>
>> +1
>>
>> On Wed, Oct 19, 2022 at 4:59 AM Chao Sun  wrote:
>>>
>>> +1. Thanks Yuming!
>>>
>>> Chao
>>>
>>> On Tue, Oct 18, 2022 at 1:18 PM Thomas graves  wrote:
>>> >
>>> > +1. Ran internal test suite.
>>> >
>>> > Tom
>>> >
>>> > On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang  wrote:
>>> > >
>>> > > Please vote on releasing the following candidate as Apache Spark 
>>> > > version 3.3.1.
>>> > >
>>> > > The vote is open until 11:59pm Pacific time October 21th and passes if 
>>> > > a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>> > >
>>> > > [ ] +1 Release this package as Apache Spark 3.3.1
>>> > > [ ] -1 Do not release this package because ...
>>> > >
>>> > > To learn more about Apache Spark, please see https://spark.apache.org
>>> > >
>>> > > The tag to be voted on is v3.3.1-rc4 (commit 
>>> > > fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
>>> > > https://github.com/apache/spark/tree/v3.3.1-rc4
>>> > >
>>> > > The release files, including signatures, digests, etc. can be found at:
>>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
>>> > >
>>> > > Signatures used for Spark RCs can be found in this file:
>>> > > https://dist.apache.org/repos/dist/dev/spark/KEYS
>>> > >
>>> > > The staging repository for this release can be found at:
>>> > > https://repository.apache.org/content/repositories/orgapachespark-1430
>>> > >
>>> > > The documentation corresponding to this release can be found at:
>>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
>>> > >
>>> > > The list of bug fixes going into 3.3.1 can be found at the following 
>>> > > URL:
>>> > > https://s.apache.org/ttgz6
>>> > >
>>> > > This release is using the release script of the tag v3.3.1-rc4.
>>> > >
>>> > >
>>> > > FAQ
>>> > >
>>> > > ==
>>> > > What happened to v3.3.1-rc3?
>>> > > ==
>>> > > A performance regression(SPARK-40703) was found after tagging 
>>> > > v3.3.1-rc3, which the Iceberg community hopes Spark 3.3.1 could fix.
>>> > > So we skipped the vote on v3.3.1-rc3.
>>> > >
>>> > > =
>>> > > How can I help test this release?
>>> > > =
>>> > > If you are a Spark user, you can help us test this release by taking
>>> > > an existing Spark workload and running on this release candidate, then
>>> > > reporting any regressions.
>>> > >
>>> > > If you're working in PySpark you can set up a virtual env and install
>>> > > the current RC and see if anything important breaks, in the Java/Scala
>>> > > you can add the staging repository to your projects resolvers and test
>>> > > with the RC (make sure to clean up the artifact cache before/after so
>>> > > you don't end up building with a out of date RC going forward).
>>> > >
>>> > > ===
>>> > > What should happen to JIRA tickets still targeting 3.3.1?
>>> > > ===
>>> > > The current list of open tickets targeted at 3.3.1 can be found at:
>>> > > https://issues.apache.org/jira/projects/SPARK and search for "Target 
>>> > > Version/s" = 3.3.1
>>> > >
>>> > > Committers should look at those and triage. Extremely important bug
>>> > > fixes, documentation, and API tweaks that impact compatibility should
>>> > > be worked on immediately. Everything else please retarget to an
>>> > > appropriate release.
>>> > >
>>> > > ==
>>> > > But my bug isn't fixed?
>>> > > ==
>>> > > In order to make timely releases, we will typically not hold the
>>> > > release unless the bug in question is a regression from the previous
>>> > > release. That being said, if there is something which is a regression
>>> > > that has not been correctly targeted please ping me or a committer to
>>> > > help target the issue.
>>> > >
>>> > >
>>> >
>>> > -
>>> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>> >
>>>
>>> -
>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-18 Thread Yikun Jiang
+1, also test passed with spark-docker workflow (downloading rc4 tgz,
extract, build image, run K8s IT)

[1] https://github.com/Yikun/spark-docker/pull/9

Regards,
Yikun

On Wed, Oct 19, 2022 at 8:59 AM Wenchen Fan  wrote:

> +1
>
> On Wed, Oct 19, 2022 at 4:59 AM Chao Sun  wrote:
>
>> +1. Thanks Yuming!
>>
>> Chao
>>
>> On Tue, Oct 18, 2022 at 1:18 PM Thomas graves  wrote:
>> >
>> > +1. Ran internal test suite.
>> >
>> > Tom
>> >
>> > On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang  wrote:
>> > >
>> > > Please vote on releasing the following candidate as Apache Spark
>> version 3.3.1.
>> > >
>> > > The vote is open until 11:59pm Pacific time October 21th and passes
>> if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>> > >
>> > > [ ] +1 Release this package as Apache Spark 3.3.1
>> > > [ ] -1 Do not release this package because ...
>> > >
>> > > To learn more about Apache Spark, please see https://spark.apache.org
>> > >
>> > > The tag to be voted on is v3.3.1-rc4 (commit
>> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
>> > > https://github.com/apache/spark/tree/v3.3.1-rc4
>> > >
>> > > The release files, including signatures, digests, etc. can be found
>> at:
>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
>> > >
>> > > Signatures used for Spark RCs can be found in this file:
>> > > https://dist.apache.org/repos/dist/dev/spark/KEYS
>> > >
>> > > The staging repository for this release can be found at:
>> > >
>> https://repository.apache.org/content/repositories/orgapachespark-1430
>> > >
>> > > The documentation corresponding to this release can be found at:
>> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
>> > >
>> > > The list of bug fixes going into 3.3.1 can be found at the following
>> URL:
>> > > https://s.apache.org/ttgz6
>> > >
>> > > This release is using the release script of the tag v3.3.1-rc4.
>> > >
>> > >
>> > > FAQ
>> > >
>> > > ==
>> > > What happened to v3.3.1-rc3?
>> > > ==
>> > > A performance regression(SPARK-40703) was found after tagging
>> v3.3.1-rc3, which the Iceberg community hopes Spark 3.3.1 could fix.
>> > > So we skipped the vote on v3.3.1-rc3.
>> > >
>> > > =
>> > > How can I help test this release?
>> > > =
>> > > If you are a Spark user, you can help us test this release by taking
>> > > an existing Spark workload and running on this release candidate, then
>> > > reporting any regressions.
>> > >
>> > > If you're working in PySpark you can set up a virtual env and install
>> > > the current RC and see if anything important breaks, in the Java/Scala
>> > > you can add the staging repository to your projects resolvers and test
>> > > with the RC (make sure to clean up the artifact cache before/after so
>> > > you don't end up building with a out of date RC going forward).
>> > >
>> > > ===
>> > > What should happen to JIRA tickets still targeting 3.3.1?
>> > > ===
>> > > The current list of open tickets targeted at 3.3.1 can be found at:
>> > > https://issues.apache.org/jira/projects/SPARK and search for "Target
>> Version/s" = 3.3.1
>> > >
>> > > Committers should look at those and triage. Extremely important bug
>> > > fixes, documentation, and API tweaks that impact compatibility should
>> > > be worked on immediately. Everything else please retarget to an
>> > > appropriate release.
>> > >
>> > > ==
>> > > But my bug isn't fixed?
>> > > ==
>> > > In order to make timely releases, we will typically not hold the
>> > > release unless the bug in question is a regression from the previous
>> > > release. That being said, if there is something which is a regression
>> > > that has not been correctly targeted please ping me or a committer to
>> > > help target the issue.
>> > >
>> > >
>> >
>> > -
>> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>> >
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>>


Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-18 Thread Wenchen Fan
+1

On Wed, Oct 19, 2022 at 4:59 AM Chao Sun  wrote:

> +1. Thanks Yuming!
>
> Chao
>
> On Tue, Oct 18, 2022 at 1:18 PM Thomas graves  wrote:
> >
> > +1. Ran internal test suite.
> >
> > Tom
> >
> > On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang  wrote:
> > >
> > > Please vote on releasing the following candidate as Apache Spark
> version 3.3.1.
> > >
> > > The vote is open until 11:59pm Pacific time October 21th and passes if
> a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
> > >
> > > [ ] +1 Release this package as Apache Spark 3.3.1
> > > [ ] -1 Do not release this package because ...
> > >
> > > To learn more about Apache Spark, please see https://spark.apache.org
> > >
> > > The tag to be voted on is v3.3.1-rc4 (commit
> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
> > > https://github.com/apache/spark/tree/v3.3.1-rc4
> > >
> > > The release files, including signatures, digests, etc. can be found at:
> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
> > >
> > > Signatures used for Spark RCs can be found in this file:
> > > https://dist.apache.org/repos/dist/dev/spark/KEYS
> > >
> > > The staging repository for this release can be found at:
> > > https://repository.apache.org/content/repositories/orgapachespark-1430
> > >
> > > The documentation corresponding to this release can be found at:
> > > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
> > >
> > > The list of bug fixes going into 3.3.1 can be found at the following
> URL:
> > > https://s.apache.org/ttgz6
> > >
> > > This release is using the release script of the tag v3.3.1-rc4.
> > >
> > >
> > > FAQ
> > >
> > > ==
> > > What happened to v3.3.1-rc3?
> > > ==
> > > A performance regression(SPARK-40703) was found after tagging
> v3.3.1-rc3, which the Iceberg community hopes Spark 3.3.1 could fix.
> > > So we skipped the vote on v3.3.1-rc3.
> > >
> > > =
> > > How can I help test this release?
> > > =
> > > If you are a Spark user, you can help us test this release by taking
> > > an existing Spark workload and running on this release candidate, then
> > > reporting any regressions.
> > >
> > > If you're working in PySpark you can set up a virtual env and install
> > > the current RC and see if anything important breaks, in the Java/Scala
> > > you can add the staging repository to your projects resolvers and test
> > > with the RC (make sure to clean up the artifact cache before/after so
> > > you don't end up building with a out of date RC going forward).
> > >
> > > ===
> > > What should happen to JIRA tickets still targeting 3.3.1?
> > > ===
> > > The current list of open tickets targeted at 3.3.1 can be found at:
> > > https://issues.apache.org/jira/projects/SPARK and search for "Target
> Version/s" = 3.3.1
> > >
> > > Committers should look at those and triage. Extremely important bug
> > > fixes, documentation, and API tweaks that impact compatibility should
> > > be worked on immediately. Everything else please retarget to an
> > > appropriate release.
> > >
> > > ==
> > > But my bug isn't fixed?
> > > ==
> > > In order to make timely releases, we will typically not hold the
> > > release unless the bug in question is a regression from the previous
> > > release. That being said, if there is something which is a regression
> > > that has not been correctly targeted please ping me or a committer to
> > > help target the issue.
> > >
> > >
> >
> > -
> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
> >
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-18 Thread Chao Sun
+1. Thanks Yuming!

Chao

On Tue, Oct 18, 2022 at 1:18 PM Thomas graves  wrote:
>
> +1. Ran internal test suite.
>
> Tom
>
> On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang  wrote:
> >
> > Please vote on releasing the following candidate as Apache Spark version 
> > 3.3.1.
> >
> > The vote is open until 11:59pm Pacific time October 21th and passes if a 
> > majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
> >
> > [ ] +1 Release this package as Apache Spark 3.3.1
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see https://spark.apache.org
> >
> > The tag to be voted on is v3.3.1-rc4 (commit 
> > fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
> > https://github.com/apache/spark/tree/v3.3.1-rc4
> >
> > The release files, including signatures, digests, etc. can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
> >
> > Signatures used for Spark RCs can be found in this file:
> > https://dist.apache.org/repos/dist/dev/spark/KEYS
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1430
> >
> > The documentation corresponding to this release can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
> >
> > The list of bug fixes going into 3.3.1 can be found at the following URL:
> > https://s.apache.org/ttgz6
> >
> > This release is using the release script of the tag v3.3.1-rc4.
> >
> >
> > FAQ
> >
> > ==
> > What happened to v3.3.1-rc3?
> > ==
> > A performance regression(SPARK-40703) was found after tagging v3.3.1-rc3, 
> > which the Iceberg community hopes Spark 3.3.1 could fix.
> > So we skipped the vote on v3.3.1-rc3.
> >
> > =
> > How can I help test this release?
> > =
> > If you are a Spark user, you can help us test this release by taking
> > an existing Spark workload and running on this release candidate, then
> > reporting any regressions.
> >
> > If you're working in PySpark you can set up a virtual env and install
> > the current RC and see if anything important breaks, in the Java/Scala
> > you can add the staging repository to your projects resolvers and test
> > with the RC (make sure to clean up the artifact cache before/after so
> > you don't end up building with a out of date RC going forward).
> >
> > ===
> > What should happen to JIRA tickets still targeting 3.3.1?
> > ===
> > The current list of open tickets targeted at 3.3.1 can be found at:
> > https://issues.apache.org/jira/projects/SPARK and search for "Target 
> > Version/s" = 3.3.1
> >
> > Committers should look at those and triage. Extremely important bug
> > fixes, documentation, and API tweaks that impact compatibility should
> > be worked on immediately. Everything else please retarget to an
> > appropriate release.
> >
> > ==
> > But my bug isn't fixed?
> > ==
> > In order to make timely releases, we will typically not hold the
> > release unless the bug in question is a regression from the previous
> > release. That being said, if there is something which is a regression
> > that has not been correctly targeted please ping me or a committer to
> > help target the issue.
> >
> >
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-18 Thread Thomas graves
+1. Ran internal test suite.

Tom

On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang  wrote:
>
> Please vote on releasing the following candidate as Apache Spark version 
> 3.3.1.
>
> The vote is open until 11:59pm Pacific time October 21th and passes if a 
> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 3.3.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see https://spark.apache.org
>
> The tag to be voted on is v3.3.1-rc4 (commit 
> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
> https://github.com/apache/spark/tree/v3.3.1-rc4
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1430
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
>
> The list of bug fixes going into 3.3.1 can be found at the following URL:
> https://s.apache.org/ttgz6
>
> This release is using the release script of the tag v3.3.1-rc4.
>
>
> FAQ
>
> ==
> What happened to v3.3.1-rc3?
> ==
> A performance regression(SPARK-40703) was found after tagging v3.3.1-rc3, 
> which the Iceberg community hopes Spark 3.3.1 could fix.
> So we skipped the vote on v3.3.1-rc3.
>
> =
> How can I help test this release?
> =
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with a out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 3.3.1?
> ===
> The current list of open tickets targeted at 3.3.1 can be found at:
> https://issues.apache.org/jira/projects/SPARK and search for "Target 
> Version/s" = 3.3.1
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.
>
>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-18 Thread Gengliang Wang
+1 from me, same as last time.

On Tue, Oct 18, 2022 at 11:45 AM L. C. Hsieh  wrote:

> +1
>
> Thanks Yuming!
>
> On Tue, Oct 18, 2022 at 11:28 AM Dongjoon Hyun 
> wrote:
> >
> > +1
> >
> > Thank you, Yuming and all!
> >
> > Dongjoon.
> >
> >
> > On Tue, Oct 18, 2022 at 9:22 AM Yang,Jie(INF) 
> wrote:
> >>
> >> Use maven to test Java 17 + Scala 2.13 and test passed, +1 for me
> >>
> >>
> >>
> >> 发件人: Sean Owen 
> >> 日期: 2022年10月17日 星期一 21:34
> >> 收件人: Yuming Wang 
> >> 抄送: dev 
> >> 主题: Re: [VOTE] Release Spark 3.3.1 (RC4)
> >>
> >>
> >>
> >> +1 from me, same as last time
> >>
> >>
> >>
> >> On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang  wrote:
> >>
> >> Please vote on releasing the following candidate as Apache Spark
> version 3.3.1.
> >>
> >> The vote is open until 11:59pm Pacific time October 21th and passes if
> a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
> >>
> >> [ ] +1 Release this package as Apache Spark 3.3.1
> >> [ ] -1 Do not release this package because ...
> >>
> >> To learn more about Apache Spark, please see https://spark.apache.org
> >>
> >> The tag to be voted on is v3.3.1-rc4 (commit
> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
> >> https://github.com/apache/spark/tree/v3.3.1-rc4
> >>
> >> The release files, including signatures, digests, etc. can be found at:
> >> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
> >>
> >> Signatures used for Spark RCs can be found in this file:
> >> https://dist.apache.org/repos/dist/dev/spark/KEYS
> >>
> >> The staging repository for this release can be found at:
> >> https://repository.apache.org/content/repositories/orgapachespark-1430
> >>
> >> The documentation corresponding to this release can be found at:
> >> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
> >>
> >> The list of bug fixes going into 3.3.1 can be found at the following
> URL:
> >> https://s.apache.org/ttgz6
> >>
> >> This release is using the release script of the tag v3.3.1-rc4.
> >>
> >>
> >> FAQ
> >>
> >> ==
> >> What happened to v3.3.1-rc3?
> >> ==
> >> A performance regression(SPARK-40703) was found after tagging
> v3.3.1-rc3, which the Iceberg community hopes Spark 3.3.1 could fix.
> >> So we skipped the vote on v3.3.1-rc3.
> >>
> >> =
> >> How can I help test this release?
> >> =
> >> If you are a Spark user, you can help us test this release by taking
> >> an existing Spark workload and running on this release candidate, then
> >> reporting any regressions.
> >>
> >> If you're working in PySpark you can set up a virtual env and install
> >> the current RC and see if anything important breaks, in the Java/Scala
> >> you can add the staging repository to your projects resolvers and test
> >> with the RC (make sure to clean up the artifact cache before/after so
> >> you don't end up building with a out of date RC going forward).
> >>
> >> ===
> >> What should happen to JIRA tickets still targeting 3.3.1?
> >> ===
> >> The current list of open tickets targeted at 3.3.1 can be found at:
> >> https://issues.apache.org/jira/projects/SPARK and search for "Target
> Version/s" = 3.3.1
> >>
> >> Committers should look at those and triage. Extremely important bug
> >> fixes, documentation, and API tweaks that impact compatibility should
> >> be worked on immediately. Everything else please retarget to an
> >> appropriate release.
> >>
> >> ==
> >> But my bug isn't fixed?
> >> ==
> >> In order to make timely releases, we will typically not hold the
> >> release unless the bug in question is a regression from the previous
> >> release. That being said, if there is something which is a regression
> >> that has not been correctly targeted please ping me or a committer to
> >> help target the issue.
> >>
> >>
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-18 Thread L. C. Hsieh
+1

Thanks Yuming!

On Tue, Oct 18, 2022 at 11:28 AM Dongjoon Hyun  wrote:
>
> +1
>
> Thank you, Yuming and all!
>
> Dongjoon.
>
>
> On Tue, Oct 18, 2022 at 9:22 AM Yang,Jie(INF)  wrote:
>>
>> Use maven to test Java 17 + Scala 2.13 and test passed, +1 for me
>>
>>
>>
>> 发件人: Sean Owen 
>> 日期: 2022年10月17日 星期一 21:34
>> 收件人: Yuming Wang 
>> 抄送: dev 
>> 主题: Re: [VOTE] Release Spark 3.3.1 (RC4)
>>
>>
>>
>> +1 from me, same as last time
>>
>>
>>
>> On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang  wrote:
>>
>> Please vote on releasing the following candidate as Apache Spark version 
>> 3.3.1.
>>
>> The vote is open until 11:59pm Pacific time October 21th and passes if a 
>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>
>> [ ] +1 Release this package as Apache Spark 3.3.1
>> [ ] -1 Do not release this package because ...
>>
>> To learn more about Apache Spark, please see https://spark.apache.org
>>
>> The tag to be voted on is v3.3.1-rc4 (commit 
>> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
>> https://github.com/apache/spark/tree/v3.3.1-rc4
>>
>> The release files, including signatures, digests, etc. can be found at:
>> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
>>
>> Signatures used for Spark RCs can be found in this file:
>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>
>> The staging repository for this release can be found at:
>> https://repository.apache.org/content/repositories/orgapachespark-1430
>>
>> The documentation corresponding to this release can be found at:
>> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
>>
>> The list of bug fixes going into 3.3.1 can be found at the following URL:
>> https://s.apache.org/ttgz6
>>
>> This release is using the release script of the tag v3.3.1-rc4.
>>
>>
>> FAQ
>>
>> ==
>> What happened to v3.3.1-rc3?
>> ==
>> A performance regression(SPARK-40703) was found after tagging v3.3.1-rc3, 
>> which the Iceberg community hopes Spark 3.3.1 could fix.
>> So we skipped the vote on v3.3.1-rc3.
>>
>> =
>> How can I help test this release?
>> =
>> If you are a Spark user, you can help us test this release by taking
>> an existing Spark workload and running on this release candidate, then
>> reporting any regressions.
>>
>> If you're working in PySpark you can set up a virtual env and install
>> the current RC and see if anything important breaks, in the Java/Scala
>> you can add the staging repository to your projects resolvers and test
>> with the RC (make sure to clean up the artifact cache before/after so
>> you don't end up building with a out of date RC going forward).
>>
>> ===
>> What should happen to JIRA tickets still targeting 3.3.1?
>> ===
>> The current list of open tickets targeted at 3.3.1 can be found at:
>> https://issues.apache.org/jira/projects/SPARK and search for "Target 
>> Version/s" = 3.3.1
>>
>> Committers should look at those and triage. Extremely important bug
>> fixes, documentation, and API tweaks that impact compatibility should
>> be worked on immediately. Everything else please retarget to an
>> appropriate release.
>>
>> ==
>> But my bug isn't fixed?
>> ==
>> In order to make timely releases, we will typically not hold the
>> release unless the bug in question is a regression from the previous
>> release. That being said, if there is something which is a regression
>> that has not been correctly targeted please ping me or a committer to
>> help target the issue.
>>
>>

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org



Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-18 Thread Dongjoon Hyun
+1

Thank you, Yuming and all!

Dongjoon.


On Tue, Oct 18, 2022 at 9:22 AM Yang,Jie(INF)  wrote:

> Use maven to test Java 17 + Scala 2.13 and test passed, +1 for me
>
>
>
> *发件人**: *Sean Owen 
> *日期**: *2022年10月17日 星期一 21:34
> *收件人**: *Yuming Wang 
> *抄送**: *dev 
> *主题**: *Re: [VOTE] Release Spark 3.3.1 (RC4)
>
>
>
> +1 from me, same as last time
>
>
>
> On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang  wrote:
>
> Please vote on releasing the following candidate as Apache Spark version 
> 3.3.1.
>
> The vote is open until 11:59pm Pacific time October 21th and passes if a 
> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 3.3.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see https://spark.apache.org 
> <https://mailshield.baidu.com/check?q=cUpKoLnajWahunV4UDIAXHiHyx%2f5wSVGtwwdag%3d%3d>
>
> The tag to be voted on is v3.3.1-rc4 (commit 
> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
> https://github.com/apache/spark/tree/v3.3.1-rc4 
> <https://mailshield.baidu.com/check?q=XrzoU0PRX3VCWRsrQ7zr%2ffHC8QYq%2bI2HoXgaZyhWm78HUoefji%2bZjP2IDyia%2fZb2Qmg3kw%3d%3d>
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin 
> <https://mailshield.baidu.com/check?q=TXDzpB5XE%2bdN0fxBjFmmpZq5md0dg3F6AtUcMjLQ7op0HnCtXZd8pWuQYEXVJed7812ausF2gG9OWFFRb3Vogg%3d%3d>
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS 
> <https://mailshield.baidu.com/check?q=E6fHbSXEWw02TTJBpc3bfA9mi7ea0YiWcNHkm%2fDJxwlaWinGnMdaoO1PahHhgj00vKwcbElpuHA%3d>
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1430 
> <https://mailshield.baidu.com/check?q=qD4wXqor8EodCtQ8mIYf1PQgqEVvkgN%2fCyR2K%2f8HtW4jgb7mMBEikG5PmW3TsVOavjgb9W25JZHJkJM2zag0RyUNxpDid92U1epD8w%3d%3d>
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs 
> <https://mailshield.baidu.com/check?q=EL83a3B23V9gFarJ%2bWMuLqcnDVOGec%2fVVZcOCHvZrTthEKjnKuYC2oR48Vp%2f7cHKd%2fwnCnYqADNUZ%2bMYoVcM7g%3d%3d>
>
> The list of bug fixes going into 3.3.1 can be found at the following URL:
> https://s.apache.org/ttgz6 
> <https://mailshield.baidu.com/check?q=3SNemXHKYCDJkpqihvlJogPI0bOmgX04yyi1Q9G15Yc%3d>
>
> This release is using the release script of the tag v3.3.1-rc4.
>
>
> FAQ
>
> ==
> What happened to v3.3.1-rc3?
> ==
> A performance regression(SPARK-40703) was found after tagging v3.3.1-rc3, 
> which the Iceberg community hopes Spark 3.3.1 could fix.
> So we skipped the vote on v3.3.1-rc3.
>
> =
> How can I help test this release?
> =
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with a out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 3.3.1?
> ===
> The current list of open tickets targeted at 3.3.1 can be found at:
> https://issues.apache.org/jira/projects/SPARK 
> <https://mailshield.baidu.com/check?q=4UUpJqq41y71Gnuj0qTUYo6hTjqzT7oytN6x%2fvgC5XUtQUC8MfJ77tj7K70O%2f1QMmNoa1A%3d%3d>
>  and search for "Target Version/s" = 3.3.1
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.
>
>
>
>


Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-18 Thread Yang,Jie(INF)
Use maven to test Java 17 + Scala 2.13 and test passed, +1 for me

发件人: Sean Owen 
日期: 2022年10月17日 星期一 21:34
收件人: Yuming Wang 
抄送: dev 
主题: Re: [VOTE] Release Spark 3.3.1 (RC4)

+1 from me, same as last time

On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang 
mailto:wgy...@gmail.com>> wrote:

Please vote on releasing the following candidate as Apache Spark version 3.3.1.

The vote is open until 11:59pm Pacific time October 21th and passes if a 
majority +1 PMC votes are cast, with a minimum of 3 +1 votes.

[ ] +1 Release this package as Apache Spark 3.3.1
[ ] -1 Do not release this package because ...

To learn more about Apache Spark, please see 
https://spark.apache.org<https://mailshield.baidu.com/check?q=cUpKoLnajWahunV4UDIAXHiHyx%2f5wSVGtwwdag%3d%3d>

The tag to be voted on is v3.3.1-rc4 (commit 
fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
https://github.com/apache/spark/tree/v3.3.1-rc4<https://mailshield.baidu.com/check?q=XrzoU0PRX3VCWRsrQ7zr%2ffHC8QYq%2bI2HoXgaZyhWm78HUoefji%2bZjP2IDyia%2fZb2Qmg3kw%3d%3d>

The release files, including signatures, digests, etc. can be found at:
https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin<https://mailshield.baidu.com/check?q=TXDzpB5XE%2bdN0fxBjFmmpZq5md0dg3F6AtUcMjLQ7op0HnCtXZd8pWuQYEXVJed7812ausF2gG9OWFFRb3Vogg%3d%3d>

Signatures used for Spark RCs can be found in this file:
https://dist.apache.org/repos/dist/dev/spark/KEYS<https://mailshield.baidu.com/check?q=E6fHbSXEWw02TTJBpc3bfA9mi7ea0YiWcNHkm%2fDJxwlaWinGnMdaoO1PahHhgj00vKwcbElpuHA%3d>

The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1430<https://mailshield.baidu.com/check?q=qD4wXqor8EodCtQ8mIYf1PQgqEVvkgN%2fCyR2K%2f8HtW4jgb7mMBEikG5PmW3TsVOavjgb9W25JZHJkJM2zag0RyUNxpDid92U1epD8w%3d%3d>

The documentation corresponding to this release can be found at:
https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs<https://mailshield.baidu.com/check?q=EL83a3B23V9gFarJ%2bWMuLqcnDVOGec%2fVVZcOCHvZrTthEKjnKuYC2oR48Vp%2f7cHKd%2fwnCnYqADNUZ%2bMYoVcM7g%3d%3d>

The list of bug fixes going into 3.3.1 can be found at the following URL:
https://s.apache.org/ttgz6<https://mailshield.baidu.com/check?q=3SNemXHKYCDJkpqihvlJogPI0bOmgX04yyi1Q9G15Yc%3d>

This release is using the release script of the tag v3.3.1-rc4.


FAQ

==
What happened to v3.3.1-rc3?
==
A performance regression(SPARK-40703) was found after tagging v3.3.1-rc3, which 
the Iceberg community hopes Spark 3.3.1 could fix.
So we skipped the vote on v3.3.1-rc3.

=
How can I help test this release?
=
If you are a Spark user, you can help us test this release by taking
an existing Spark workload and running on this release candidate, then
reporting any regressions.

If you're working in PySpark you can set up a virtual env and install
the current RC and see if anything important breaks, in the Java/Scala
you can add the staging repository to your projects resolvers and test
with the RC (make sure to clean up the artifact cache before/after so
you don't end up building with a out of date RC going forward).

===
What should happen to JIRA tickets still targeting 3.3.1?
===
The current list of open tickets targeted at 3.3.1 can be found at:
https://issues.apache.org/jira/projects/SPARK<https://mailshield.baidu.com/check?q=4UUpJqq41y71Gnuj0qTUYo6hTjqzT7oytN6x%2fvgC5XUtQUC8MfJ77tj7K70O%2f1QMmNoa1A%3d%3d>
 and search for "Target Version/s" = 3.3.1

Committers should look at those and triage. Extremely important bug
fixes, documentation, and API tweaks that impact compatibility should
be worked on immediately. Everything else please retarget to an
appropriate release.

==
But my bug isn't fixed?
==
In order to make timely releases, we will typically not hold the
release unless the bug in question is a regression from the previous
release. That being said, if there is something which is a regression
that has not been correctly targeted please ping me or a committer to
help target the issue.




Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-17 Thread Sean Owen
+1 from me, same as last time

On Sun, Oct 16, 2022 at 9:14 PM Yuming Wang  wrote:

> Please vote on releasing the following candidate as Apache Spark version 
> 3.3.1.
>
> The vote is open until 11:59pm Pacific time October 21th and passes if a 
> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 3.3.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see https://spark.apache.org
>
> The tag to be voted on is v3.3.1-rc4 (commit 
> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
> https://github.com/apache/spark/tree/v3.3.1-rc4
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1430
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
>
> The list of bug fixes going into 3.3.1 can be found at the following URL:
> https://s.apache.org/ttgz6
>
> This release is using the release script of the tag v3.3.1-rc4.
>
>
> FAQ
>
> ==
> What happened to v3.3.1-rc3?
> ==
> A performance regression(SPARK-40703) was found after tagging v3.3.1-rc3, 
> which the Iceberg community hopes Spark 3.3.1 could fix.
> So we skipped the vote on v3.3.1-rc3.
>
> =
> How can I help test this release?
> =
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with a out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 3.3.1?
> ===
> The current list of open tickets targeted at 3.3.1 can be found at:
> https://issues.apache.org/jira/projects/SPARK and search for "Target 
> Version/s" = 3.3.1
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.
>
>
>


Re: [VOTE] Release Spark 3.3.1 (RC4)

2022-10-17 Thread Mallanagouda Patil
Please unsubscribe me.. thanks!

On Mon, Oct 17, 2022 at 7:44 AM Yuming Wang  wrote:

> Please vote on releasing the following candidate as Apache Spark version 
> 3.3.1.
>
> The vote is open until 11:59pm Pacific time October 21th and passes if a 
> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 3.3.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see https://spark.apache.org
>
> The tag to be voted on is v3.3.1-rc4 (commit 
> fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
> https://github.com/apache/spark/tree/v3.3.1-rc4
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1430
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs
>
> The list of bug fixes going into 3.3.1 can be found at the following URL:
> https://s.apache.org/ttgz6
>
> This release is using the release script of the tag v3.3.1-rc4.
>
>
> FAQ
>
> ==
> What happened to v3.3.1-rc3?
> ==
> A performance regression(SPARK-40703) was found after tagging v3.3.1-rc3, 
> which the Iceberg community hopes Spark 3.3.1 could fix.
> So we skipped the vote on v3.3.1-rc3.
>
> =
> How can I help test this release?
> =
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with a out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 3.3.1?
> ===
> The current list of open tickets targeted at 3.3.1 can be found at:
> https://issues.apache.org/jira/projects/SPARK and search for "Target 
> Version/s" = 3.3.1
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.
>
>
>


[VOTE] Release Spark 3.3.1 (RC4)

2022-10-16 Thread Yuming Wang
Please vote on releasing the following candidate as Apache Spark version 3.3.1.

The vote is open until 11:59pm Pacific time October 21th and passes if
a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.

[ ] +1 Release this package as Apache Spark 3.3.1
[ ] -1 Do not release this package because ...

To learn more about Apache Spark, please see https://spark.apache.org

The tag to be voted on is v3.3.1-rc4 (commit
fbbcf9434ac070dd4ced4fb9efe32899c6db12a9):
https://github.com/apache/spark/tree/v3.3.1-rc4

The release files, including signatures, digests, etc. can be found at:
https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-bin

Signatures used for Spark RCs can be found in this file:
https://dist.apache.org/repos/dist/dev/spark/KEYS

The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1430

The documentation corresponding to this release can be found at:
https://dist.apache.org/repos/dist/dev/spark/v3.3.1-rc4-docs

The list of bug fixes going into 3.3.1 can be found at the following URL:
https://s.apache.org/ttgz6

This release is using the release script of the tag v3.3.1-rc4.


FAQ

==
What happened to v3.3.1-rc3?
==
A performance regression(SPARK-40703) was found after tagging
v3.3.1-rc3, which the Iceberg community hopes Spark 3.3.1 could fix.
So we skipped the vote on v3.3.1-rc3.

=
How can I help test this release?
=
If you are a Spark user, you can help us test this release by taking
an existing Spark workload and running on this release candidate, then
reporting any regressions.

If you're working in PySpark you can set up a virtual env and install
the current RC and see if anything important breaks, in the Java/Scala
you can add the staging repository to your projects resolvers and test
with the RC (make sure to clean up the artifact cache before/after so
you don't end up building with a out of date RC going forward).

===
What should happen to JIRA tickets still targeting 3.3.1?
===
The current list of open tickets targeted at 3.3.1 can be found at:
https://issues.apache.org/jira/projects/SPARK and search for "Target
Version/s" = 3.3.1

Committers should look at those and triage. Extremely important bug
fixes, documentation, and API tweaks that impact compatibility should
be worked on immediately. Everything else please retarget to an
appropriate release.

==
But my bug isn't fixed?
==
In order to make timely releases, we will typically not hold the
release unless the bug in question is a regression from the previous
release. That being said, if there is something which is a regression
that has not been correctly targeted please ping me or a committer to
help target the issue.