Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

[Marco Gaido]

+1

Il giorno mer 28 ago 2019 alle ore 06:31 Wenchen Fan 
ha scritto:

> +1
>
> On Wed, Aug 28, 2019 at 2:43 AM DB Tsai  wrote:
>
>> +1
>>
>> Sincerely,
>>
>> DB Tsai
>> --
>> Web: https://www.dbtsai.com
>> PGP Key ID: 42E5B25A8F7A82C1
>>
>> On Tue, Aug 27, 2019 at 11:31 AM Dongjoon Hyun 
>> wrote:
>> >
>> > +1.
>> >
>> > I also verified SHA/GPG and tested UTs on AdoptOpenJDKu8_222/CentOS6.9
>> with profile
>> > "-Pyarn -Phadoop-2.7 -Pkubernetes -Pkinesis-asl -Phive
>> -Phive-thriftserver"
>> >
>> > Additionally, JDBC IT also is tested.
>> >
>> > Thank you, Kazuaki!
>> >
>> > Bests,
>> > Dongjoon.
>> >
>> >
>> > On Tue, Aug 27, 2019 at 11:20 AM Sean Owen  wrote:
>> >>
>> >> +1 - license and signature looks OK, the docs look OK, the artifacts
>> >> seem to be in order. Tests passed for me when building from source
>> >> with most common profiles set.
>> >>
>> >> On Mon, Aug 26, 2019 at 3:28 PM Kazuaki Ishizaki 
>> wrote:
>> >> >
>> >> > Please vote on releasing the following candidate as Apache Spark
>> version 2.3.4.
>> >> >
>> >> > The vote is open until August 29th 2PM PST and passes if a majority
>> +1 PMC votes are cast, with
>> >> > a minimum of 3 +1 votes.
>> >> >
>> >> > [ ] +1 Release this package as Apache Spark 2.3.4
>> >> > [ ] -1 Do not release this package because ...
>> >> >
>> >> > To learn more about Apache Spark, please see
>> https://spark.apache.org/
>> >> >
>> >> > The tag to be voted on is v2.3.4-rc1 (commit
>> 8c6f8150f3c6298ff4e1c7e06028f12d7eaf0210):
>> >> > https://github.com/apache/spark/tree/v2.3.4-rc1
>> >> >
>> >> > The release files, including signatures, digests, etc. can be found
>> at:
>> >> > https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-bin/
>> >> >
>> >> > Signatures used for Spark RCs can be found in this file:
>> >> > https://dist.apache.org/repos/dist/dev/spark/KEYS
>> >> >
>> >> > The staging repository for this release can be found at:
>> >> >
>> https://repository.apache.org/content/repositories/orgapachespark-1331/
>> >> >
>> >> > The documentation corresponding to this release can be found at:
>> >> > https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-docs/
>> >> >
>> >> > The list of bug fixes going into 2.3.4 can be found at the following
>> URL:
>> >> > https://issues.apache.org/jira/projects/SPARK/versions/12344844
>> >> >
>> >> > FAQ
>> >> >
>> >> > =
>> >> > How can I help test this release?
>> >> > =
>> >> >
>> >> > If you are a Spark user, you can help us test this release by taking
>> >> > an existing Spark workload and running on this release candidate,
>> then
>> >> > reporting any regressions.
>> >> >
>> >> > If you're working in PySpark you can set up a virtual env and install
>> >> > the current RC and see if anything important breaks, in the
>> Java/Scala
>> >> > you can add the staging repository to your projects resolvers and
>> test
>> >> > with the RC (make sure to clean up the artifact cache before/after so
>> >> > you don't end up building with a out of date RC going forward).
>> >> >
>> >> > ===
>> >> > What should happen to JIRA tickets still targeting 2.3.4?
>> >> > ===
>> >> >
>> >> > The current list of open tickets targeted at 2.3.4 can be found at:
>> >> > https://issues.apache.org/jira/projects/SPARKand search for "Target
>> Version/s" = 2.3.4
>> >> >
>> >> > Committers should look at those and triage. Extremely important bug
>> >> > fixes, documentation, and API tweaks that impact compatibility should
>> >> > be worked on immediately. Everything else please retarget to an
>> >> > appropriate release.
>> >> >
>> >> > ==
>> >> > But my bug isn't fixed?
>> >> > ==
>> >> >
>> >> > In order to make timely releases, we will typically not hold the
>> >> > release unless the bug in question is a regression from the previous
>> >> > release. That being said, if there is something which is a regression
>> >> > that has not been correctly targeted please ping me or a committer to
>> >> > help target the issue.
>> >> >
>> >>
>> >> -
>> >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>> >>
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>>

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

[Shrinidhi Kanchi]

+1
Tests are running fine, docs look good. Should be good to go.

Thanks and Regards,
Shrinidhi kanchi
+4915218336840

On Wed, 28 Aug 2019, 10:17 Marco Gaido,  wrote:

> +1
>
> Il giorno mer 28 ago 2019 alle ore 06:31 Wenchen Fan 
> ha scritto:
>
>> +1
>>
>> On Wed, Aug 28, 2019 at 2:43 AM DB Tsai 
>> wrote:
>>
>>> +1
>>>
>>> Sincerely,
>>>
>>> DB Tsai
>>> --
>>> Web: https://www.dbtsai.com
>>> PGP Key ID: 42E5B25A8F7A82C1
>>>
>>> On Tue, Aug 27, 2019 at 11:31 AM Dongjoon Hyun 
>>> wrote:
>>> >
>>> > +1.
>>> >
>>> > I also verified SHA/GPG and tested UTs on AdoptOpenJDKu8_222/CentOS6.9
>>> with profile
>>> > "-Pyarn -Phadoop-2.7 -Pkubernetes -Pkinesis-asl -Phive
>>> -Phive-thriftserver"
>>> >
>>> > Additionally, JDBC IT also is tested.
>>> >
>>> > Thank you, Kazuaki!
>>> >
>>> > Bests,
>>> > Dongjoon.
>>> >
>>> >
>>> > On Tue, Aug 27, 2019 at 11:20 AM Sean Owen  wrote:
>>> >>
>>> >> +1 - license and signature looks OK, the docs look OK, the artifacts
>>> >> seem to be in order. Tests passed for me when building from source
>>> >> with most common profiles set.
>>> >>
>>> >> On Mon, Aug 26, 2019 at 3:28 PM Kazuaki Ishizaki 
>>> wrote:
>>> >> >
>>> >> > Please vote on releasing the following candidate as Apache Spark
>>> version 2.3.4.
>>> >> >
>>> >> > The vote is open until August 29th 2PM PST and passes if a majority
>>> +1 PMC votes are cast, with
>>> >> > a minimum of 3 +1 votes.
>>> >> >
>>> >> > [ ] +1 Release this package as Apache Spark 2.3.4
>>> >> > [ ] -1 Do not release this package because ...
>>> >> >
>>> >> > To learn more about Apache Spark, please see
>>> https://spark.apache.org/
>>> >> >
>>> >> > The tag to be voted on is v2.3.4-rc1 (commit
>>> 8c6f8150f3c6298ff4e1c7e06028f12d7eaf0210):
>>> >> > https://github.com/apache/spark/tree/v2.3.4-rc1
>>> >> >
>>> >> > The release files, including signatures, digests, etc. can be found
>>> at:
>>> >> > https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-bin/
>>> >> >
>>> >> > Signatures used for Spark RCs can be found in this file:
>>> >> > https://dist.apache.org/repos/dist/dev/spark/KEYS
>>> >> >
>>> >> > The staging repository for this release can be found at:
>>> >> >
>>> https://repository.apache.org/content/repositories/orgapachespark-1331/
>>> >> >
>>> >> > The documentation corresponding to this release can be found at:
>>> >> > https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-docs/
>>> >> >
>>> >> > The list of bug fixes going into 2.3.4 can be found at the
>>> following URL:
>>> >> > https://issues.apache.org/jira/projects/SPARK/versions/12344844
>>> >> >
>>> >> > FAQ
>>> >> >
>>> >> > =
>>> >> > How can I help test this release?
>>> >> > =
>>> >> >
>>> >> > If you are a Spark user, you can help us test this release by taking
>>> >> > an existing Spark workload and running on this release candidate,
>>> then
>>> >> > reporting any regressions.
>>> >> >
>>> >> > If you're working in PySpark you can set up a virtual env and
>>> install
>>> >> > the current RC and see if anything important breaks, in the
>>> Java/Scala
>>> >> > you can add the staging repository to your projects resolvers and
>>> test
>>> >> > with the RC (make sure to clean up the artifact cache before/after
>>> so
>>> >> > you don't end up building with a out of date RC going forward).
>>> >> >
>>> >> > ===
>>> >> > What should happen to JIRA tickets still targeting 2.3.4?
>>> >> > ===
>>> >> >
>>> >> > The current list of open tickets targeted at 2.3.4 can be found at:
>>> >> > https://issues.apache.org/jira/projects/SPARKand search for
>>> "Target Version/s" = 2.3.4
>>> >> >
>>> >> > Committers should look at those and triage. Extremely important bug
>>> >> > fixes, documentation, and API tweaks that impact compatibility
>>> should
>>> >> > be worked on immediately. Everything else please retarget to an
>>> >> > appropriate release.
>>> >> >
>>> >> > ==
>>> >> > But my bug isn't fixed?
>>> >> > ==
>>> >> >
>>> >> > In order to make timely releases, we will typically not hold the
>>> >> > release unless the bug in question is a regression from the previous
>>> >> > release. That being said, if there is something which is a
>>> regression
>>> >> > that has not been correctly targeted please ping me or a committer
>>> to
>>> >> > help target the issue.
>>> >> >
>>> >>
>>> >> -
>>> >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>> >>
>>>
>>> -
>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>
>>>

RE: [VOTE] Release Apache Spark 2.4.4 (RC3)

[Kazuaki Ishizaki]

+1
Built and tested with `mvn -Pyarn -Phadoop-2.7 -Pkubernetes -Pkinesis-asl 
-Phive -Phive-thriftserver test` on OpenJDK 1.8.0_211 on Ubuntu 16.04 
x86_64

Regards,
Kazuaki Ishizaki



From:   Dongjoon Hyun 
To: dev 
Date:   2019/08/28 12:14
Subject:[EXTERNAL] Re: [VOTE] Release Apache Spark 2.4.4 (RC3)



+1.

- Checked checksums and signatures of artifacts.
- Checked to have all binaries and maven repo.
- Checked document generation (including a new change after RC2)
- Build with `-Pyarn -Pmesos -Pkubernetes -Phive -Phive-thriftserver 
-Phadoop-2.6` on AdoptOpenJDK8_202.
- Tested with both Scala-2.11/Scala-2.12 and both Python2/3.
   Python 2.7.15 with numpy 1.16.4, scipy 1.2.2, pandas 0.19.2, pyarrow 
0.8.0
   Python 3.6.4 with numpy 1.16.4, scipy 1.2.2, pandas 0.23.2, pyarrow 
0.11.0
- Tested JDBC IT.

Bests,
Dongjoon.


On Tue, Aug 27, 2019 at 4:05 PM Dongjoon Hyun  
wrote:
Please vote on releasing the following candidate as Apache Spark version 
2.4.4.

The vote is open until August 30th 5PM PST and passes if a majority +1 PMC 
votes are cast, with a minimum of 3 +1 votes.

[ ] +1 Release this package as Apache Spark 2.4.4
[ ] -1 Do not release this package because ...

To learn more about Apache Spark, please see http://spark.apache.org/

The tag to be voted on is v2.4.4-rc3 (commit 
7955b3962ac46b89564e0613db7bea98a1478bf2):
https://github.com/apache/spark/tree/v2.4.4-rc3

The release files, including signatures, digests, etc. can be found at:
https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-bin/

Signatures used for Spark RCs can be found in this file:
https://dist.apache.org/repos/dist/dev/spark/KEYS

The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1332/

The documentation corresponding to this release can be found at:
https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-docs/

The list of bug fixes going into 2.4.4 can be found at the following URL:
https://issues.apache.org/jira/projects/SPARK/versions/12345466

This release is using the release script of the tag v2.4.4-rc3.

FAQ

=
How can I help test this release?
=

If you are a Spark user, you can help us test this release by taking
an existing Spark workload and running on this release candidate, then
reporting any regressions.

If you're working in PySpark you can set up a virtual env and install
the current RC and see if anything important breaks, in the Java/Scala
you can add the staging repository to your projects resolvers and test
with the RC (make sure to clean up the artifact cache before/after so
you don't end up building with a out of date RC going forward).

===
What should happen to JIRA tickets still targeting 2.4.4?
===

The current list of open tickets targeted at 2.4.4 can be found at:
https://issues.apache.org/jira/projects/SPARK and search for "Target 
Version/s" = 2.4.4

Committers should look at those and triage. Extremely important bug
fixes, documentation, and API tweaks that impact compatibility should
be worked on immediately. Everything else please retarget to an
appropriate release.

==
But my bug isn't fixed?
==

In order to make timely releases, we will typically not hold the
release unless the bug in question is a regression from the previous
release. That being said, if there is something which is a regression
that has not been correctly targeted please ping me or a committer to
help target the issue.

Re: [VOTE] Release Apache Spark 2.4.4 (RC3)

[Sean Owen]

+1 from me again.

On Tue, Aug 27, 2019 at 6:06 PM Dongjoon Hyun  wrote:
>
> Please vote on releasing the following candidate as Apache Spark version 
> 2.4.4.
>
> The vote is open until August 30th 5PM PST and passes if a majority +1 PMC 
> votes are cast, with a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 2.4.4
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see http://spark.apache.org/
>
> The tag to be voted on is v2.4.4-rc3 (commit 
> 7955b3962ac46b89564e0613db7bea98a1478bf2):
> https://github.com/apache/spark/tree/v2.4.4-rc3
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-bin/
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1332/
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-docs/
>
> The list of bug fixes going into 2.4.4 can be found at the following URL:
> https://issues.apache.org/jira/projects/SPARK/versions/12345466
>
> This release is using the release script of the tag v2.4.4-rc3.
>
> FAQ
>
> =
> How can I help test this release?
> =
>
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with a out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 2.4.4?
> ===
>
> The current list of open tickets targeted at 2.4.4 can be found at:
> https://issues.apache.org/jira/projects/SPARK and search for "Target 
> Version/s" = 2.4.4
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
>
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Standardizing test build config

[Sean Owen]

I'm surfacing this to dev@ as the right answers may depend on a lot of
historical decisions that I don't know about.

See https://issues.apache.org/jira/browse/SPARK-28900 for a summary of
how the different build configs are set up, and why we might need to
standardize them to fully test with JDK 11 at least, and why we could
probably collapse some too.

Comments welcome on the JIRA, as I'm sure I'm missing a thing or two.

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Apache Spark 2.4.4 (RC3)

[Wenchen Fan]

+1, no more blocking issues that I'm aware of.

On Wed, Aug 28, 2019 at 8:33 PM Sean Owen  wrote:

> +1 from me again.
>
> On Tue, Aug 27, 2019 at 6:06 PM Dongjoon Hyun 
> wrote:
> >
> > Please vote on releasing the following candidate as Apache Spark version
> 2.4.4.
> >
> > The vote is open until August 30th 5PM PST and passes if a majority +1
> PMC votes are cast, with a minimum of 3 +1 votes.
> >
> > [ ] +1 Release this package as Apache Spark 2.4.4
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see http://spark.apache.org/
> >
> > The tag to be voted on is v2.4.4-rc3 (commit
> 7955b3962ac46b89564e0613db7bea98a1478bf2):
> > https://github.com/apache/spark/tree/v2.4.4-rc3
> >
> > The release files, including signatures, digests, etc. can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-bin/
> >
> > Signatures used for Spark RCs can be found in this file:
> > https://dist.apache.org/repos/dist/dev/spark/KEYS
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1332/
> >
> > The documentation corresponding to this release can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-docs/
> >
> > The list of bug fixes going into 2.4.4 can be found at the following URL:
> > https://issues.apache.org/jira/projects/SPARK/versions/12345466
> >
> > This release is using the release script of the tag v2.4.4-rc3.
> >
> > FAQ
> >
> > =
> > How can I help test this release?
> > =
> >
> > If you are a Spark user, you can help us test this release by taking
> > an existing Spark workload and running on this release candidate, then
> > reporting any regressions.
> >
> > If you're working in PySpark you can set up a virtual env and install
> > the current RC and see if anything important breaks, in the Java/Scala
> > you can add the staging repository to your projects resolvers and test
> > with the RC (make sure to clean up the artifact cache before/after so
> > you don't end up building with a out of date RC going forward).
> >
> > ===
> > What should happen to JIRA tickets still targeting 2.4.4?
> > ===
> >
> > The current list of open tickets targeted at 2.4.4 can be found at:
> > https://issues.apache.org/jira/projects/SPARK and search for "Target
> Version/s" = 2.4.4
> >
> > Committers should look at those and triage. Extremely important bug
> > fixes, documentation, and API tweaks that impact compatibility should
> > be worked on immediately. Everything else please retarget to an
> > appropriate release.
> >
> > ==
> > But my bug isn't fixed?
> > ==
> >
> > In order to make timely releases, we will typically not hold the
> > release unless the bug in question is a regression from the previous
> > release. That being said, if there is something which is a regression
> > that has not been correctly targeted please ping me or a committer to
> > help target the issue.
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

[John Zhuge]

+1

On Wed, Aug 28, 2019 at 1:29 AM Shrinidhi Kanchi 
wrote:

> +1
> Tests are running fine, docs look good. Should be good to go.
>
> Thanks and Regards,
> Shrinidhi kanchi
> +4915218336840
>
> On Wed, 28 Aug 2019, 10:17 Marco Gaido,  wrote:
>
>> +1
>>
>> Il giorno mer 28 ago 2019 alle ore 06:31 Wenchen Fan 
>> ha scritto:
>>
>>> +1
>>>
>>> On Wed, Aug 28, 2019 at 2:43 AM DB Tsai 
>>> wrote:
>>>
 +1

 Sincerely,

 DB Tsai
 --
 Web: https://www.dbtsai.com
 PGP Key ID: 42E5B25A8F7A82C1

 On Tue, Aug 27, 2019 at 11:31 AM Dongjoon Hyun 
 wrote:
 >
 > +1.
 >
 > I also verified SHA/GPG and tested UTs on
 AdoptOpenJDKu8_222/CentOS6.9 with profile
 > "-Pyarn -Phadoop-2.7 -Pkubernetes -Pkinesis-asl -Phive
 -Phive-thriftserver"
 >
 > Additionally, JDBC IT also is tested.
 >
 > Thank you, Kazuaki!
 >
 > Bests,
 > Dongjoon.
 >
 >
 > On Tue, Aug 27, 2019 at 11:20 AM Sean Owen  wrote:
 >>
 >> +1 - license and signature looks OK, the docs look OK, the artifacts
 >> seem to be in order. Tests passed for me when building from source
 >> with most common profiles set.
 >>
 >> On Mon, Aug 26, 2019 at 3:28 PM Kazuaki Ishizaki <
 ishiz...@jp.ibm.com> wrote:
 >> >
 >> > Please vote on releasing the following candidate as Apache Spark
 version 2.3.4.
 >> >
 >> > The vote is open until August 29th 2PM PST and passes if a
 majority +1 PMC votes are cast, with
 >> > a minimum of 3 +1 votes.
 >> >
 >> > [ ] +1 Release this package as Apache Spark 2.3.4
 >> > [ ] -1 Do not release this package because ...
 >> >
 >> > To learn more about Apache Spark, please see
 https://spark.apache.org/
 >> >
 >> > The tag to be voted on is v2.3.4-rc1 (commit
 8c6f8150f3c6298ff4e1c7e06028f12d7eaf0210):
 >> > https://github.com/apache/spark/tree/v2.3.4-rc1
 >> >
 >> > The release files, including signatures, digests, etc. can be
 found at:
 >> > https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-bin/
 >> >
 >> > Signatures used for Spark RCs can be found in this file:
 >> > https://dist.apache.org/repos/dist/dev/spark/KEYS
 >> >
 >> > The staging repository for this release can be found at:
 >> >
 https://repository.apache.org/content/repositories/orgapachespark-1331/
 >> >
 >> > The documentation corresponding to this release can be found at:
 >> > https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-docs/
 >> >
 >> > The list of bug fixes going into 2.3.4 can be found at the
 following URL:
 >> > https://issues.apache.org/jira/projects/SPARK/versions/12344844
 >> >
 >> > FAQ
 >> >
 >> > =
 >> > How can I help test this release?
 >> > =
 >> >
 >> > If you are a Spark user, you can help us test this release by
 taking
 >> > an existing Spark workload and running on this release candidate,
 then
 >> > reporting any regressions.
 >> >
 >> > If you're working in PySpark you can set up a virtual env and
 install
 >> > the current RC and see if anything important breaks, in the
 Java/Scala
 >> > you can add the staging repository to your projects resolvers and
 test
 >> > with the RC (make sure to clean up the artifact cache before/after
 so
 >> > you don't end up building with a out of date RC going forward).
 >> >
 >> > ===
 >> > What should happen to JIRA tickets still targeting 2.3.4?
 >> > ===
 >> >
 >> > The current list of open tickets targeted at 2.3.4 can be found at:
 >> > https://issues.apache.org/jira/projects/SPARKand search for
 "Target Version/s" = 2.3.4
 >> >
 >> > Committers should look at those and triage. Extremely important bug
 >> > fixes, documentation, and API tweaks that impact compatibility
 should
 >> > be worked on immediately. Everything else please retarget to an
 >> > appropriate release.
 >> >
 >> > ==
 >> > But my bug isn't fixed?
 >> > ==
 >> >
 >> > In order to make timely releases, we will typically not hold the
 >> > release unless the bug in question is a regression from the
 previous
 >> > release. That being said, if there is something which is a
 regression
 >> > that has not been correctly targeted please ping me or a committer
 to
 >> > help target the issue.
 >> >
 >>
 >> -
 >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
 >>

 -
 To unsubscribe e-ma

Re: Standardizing test build config

[Shane Knapp]

> I'm surfacing this to dev@ as the right answers may depend on a lot of
> historical decisions that I don't know about.
>
yeah, it's been time to clean up the build configs for quite a while...

also, the vast majority of these build configs predate even my joining
the amplab.  josh rosen and patrick wendell would have a LOT more
context about some of the decisions made.

> See https://issues.apache.org/jira/browse/SPARK-28900 for a summary of
> how the different build configs are set up, and why we might need to
> standardize them to fully test with JDK 11 at least, and why we could
> probably collapse some too.
>
> Comments welcome on the JIRA, as I'm sure I'm missing a thing or two.

i will definitely be adding my thoughts, but i most likely won't be
able to get to this until after the labor day holiday (i'm busy
writing performance reviews).

shane
-- 
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Apache Spark 2.4.4 (RC3)

[DB Tsai]

+1

Thanks!

On Wed, Aug 28, 2019 at 7:14 AM Wenchen Fan  wrote:

> +1, no more blocking issues that I'm aware of.
>
> On Wed, Aug 28, 2019 at 8:33 PM Sean Owen  wrote:
>
>> +1 from me again.
>>
>> On Tue, Aug 27, 2019 at 6:06 PM Dongjoon Hyun 
>> wrote:
>> >
>> > Please vote on releasing the following candidate as Apache Spark
>> version 2.4.4.
>> >
>> > The vote is open until August 30th 5PM PST and passes if a majority +1
>> PMC votes are cast, with a minimum of 3 +1 votes.
>> >
>> > [ ] +1 Release this package as Apache Spark 2.4.4
>> > [ ] -1 Do not release this package because ...
>> >
>> > To learn more about Apache Spark, please see http://spark.apache.org/
>> >
>> > The tag to be voted on is v2.4.4-rc3 (commit
>> 7955b3962ac46b89564e0613db7bea98a1478bf2):
>> > https://github.com/apache/spark/tree/v2.4.4-rc3
>> >
>> > The release files, including signatures, digests, etc. can be found at:
>> > https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-bin/
>> >
>> > Signatures used for Spark RCs can be found in this file:
>> > https://dist.apache.org/repos/dist/dev/spark/KEYS
>> >
>> > The staging repository for this release can be found at:
>> > https://repository.apache.org/content/repositories/orgapachespark-1332/
>> >
>> > The documentation corresponding to this release can be found at:
>> > https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-docs/
>> >
>> > The list of bug fixes going into 2.4.4 can be found at the following
>> URL:
>> > https://issues.apache.org/jira/projects/SPARK/versions/12345466
>> >
>> > This release is using the release script of the tag v2.4.4-rc3.
>> >
>> > FAQ
>> >
>> > =
>> > How can I help test this release?
>> > =
>> >
>> > If you are a Spark user, you can help us test this release by taking
>> > an existing Spark workload and running on this release candidate, then
>> > reporting any regressions.
>> >
>> > If you're working in PySpark you can set up a virtual env and install
>> > the current RC and see if anything important breaks, in the Java/Scala
>> > you can add the staging repository to your projects resolvers and test
>> > with the RC (make sure to clean up the artifact cache before/after so
>> > you don't end up building with a out of date RC going forward).
>> >
>> > ===
>> > What should happen to JIRA tickets still targeting 2.4.4?
>> > ===
>> >
>> > The current list of open tickets targeted at 2.4.4 can be found at:
>> > https://issues.apache.org/jira/projects/SPARK and search for "Target
>> Version/s" = 2.4.4
>> >
>> > Committers should look at those and triage. Extremely important bug
>> > fixes, documentation, and API tweaks that impact compatibility should
>> > be worked on immediately. Everything else please retarget to an
>> > appropriate release.
>> >
>> > ==
>> > But my bug isn't fixed?
>> > ==
>> >
>> > In order to make timely releases, we will typically not hold the
>> > release unless the bug in question is a regression from the previous
>> > release. That being said, if there is something which is a regression
>> > that has not been correctly targeted please ping me or a committer to
>> > help target the issue.
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>> --
- DB Sent from my iPhone

Re: [VOTE] Release Apache Spark 2.4.4 (RC3)

[Holden Karau]

+1
Installed PySpark in a py3 virtual env & checked the PKG-INFO which we've
had difficulty with previously and looked good.

On Wed, Aug 28, 2019 at 10:17 AM DB Tsai  wrote:

> +1
>
> Thanks!
>
> On Wed, Aug 28, 2019 at 7:14 AM Wenchen Fan  wrote:
>
>> +1, no more blocking issues that I'm aware of.
>>
>> On Wed, Aug 28, 2019 at 8:33 PM Sean Owen  wrote:
>>
>>> +1 from me again.
>>>
>>> On Tue, Aug 27, 2019 at 6:06 PM Dongjoon Hyun 
>>> wrote:
>>> >
>>> > Please vote on releasing the following candidate as Apache Spark
>>> version 2.4.4.
>>> >
>>> > The vote is open until August 30th 5PM PST and passes if a majority +1
>>> PMC votes are cast, with a minimum of 3 +1 votes.
>>> >
>>> > [ ] +1 Release this package as Apache Spark 2.4.4
>>> > [ ] -1 Do not release this package because ...
>>> >
>>> > To learn more about Apache Spark, please see http://spark.apache.org/
>>> >
>>> > The tag to be voted on is v2.4.4-rc3 (commit
>>> 7955b3962ac46b89564e0613db7bea98a1478bf2):
>>> > https://github.com/apache/spark/tree/v2.4.4-rc3
>>> >
>>> > The release files, including signatures, digests, etc. can be found at:
>>> > https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-bin/
>>> >
>>> > Signatures used for Spark RCs can be found in this file:
>>> > https://dist.apache.org/repos/dist/dev/spark/KEYS
>>> >
>>> > The staging repository for this release can be found at:
>>> >
>>> https://repository.apache.org/content/repositories/orgapachespark-1332/
>>> >
>>> > The documentation corresponding to this release can be found at:
>>> > https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-docs/
>>> >
>>> > The list of bug fixes going into 2.4.4 can be found at the following
>>> URL:
>>> > https://issues.apache.org/jira/projects/SPARK/versions/12345466
>>> >
>>> > This release is using the release script of the tag v2.4.4-rc3.
>>> >
>>> > FAQ
>>> >
>>> > =
>>> > How can I help test this release?
>>> > =
>>> >
>>> > If you are a Spark user, you can help us test this release by taking
>>> > an existing Spark workload and running on this release candidate, then
>>> > reporting any regressions.
>>> >
>>> > If you're working in PySpark you can set up a virtual env and install
>>> > the current RC and see if anything important breaks, in the Java/Scala
>>> > you can add the staging repository to your projects resolvers and test
>>> > with the RC (make sure to clean up the artifact cache before/after so
>>> > you don't end up building with a out of date RC going forward).
>>> >
>>> > ===
>>> > What should happen to JIRA tickets still targeting 2.4.4?
>>> > ===
>>> >
>>> > The current list of open tickets targeted at 2.4.4 can be found at:
>>> > https://issues.apache.org/jira/projects/SPARK and search for "Target
>>> Version/s" = 2.4.4
>>> >
>>> > Committers should look at those and triage. Extremely important bug
>>> > fixes, documentation, and API tweaks that impact compatibility should
>>> > be worked on immediately. Everything else please retarget to an
>>> > appropriate release.
>>> >
>>> > ==
>>> > But my bug isn't fixed?
>>> > ==
>>> >
>>> > In order to make timely releases, we will typically not hold the
>>> > release unless the bug in question is a regression from the previous
>>> > release. That being said, if there is something which is a regression
>>> > that has not been correctly targeted please ping me or a committer to
>>> > help target the issue.
>>>
>>> -
>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>>
>>> --
> - DB Sent from my iPhone
>


-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

Re: [VOTE] Release Apache Spark 2.4.4 (RC3)

[Marcelo Vanzin]

+1

On Tue, Aug 27, 2019 at 4:06 PM Dongjoon Hyun  wrote:
>
> Please vote on releasing the following candidate as Apache Spark version 
> 2.4.4.
>
> The vote is open until August 30th 5PM PST and passes if a majority +1 PMC 
> votes are cast, with a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 2.4.4
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see http://spark.apache.org/
>
> The tag to be voted on is v2.4.4-rc3 (commit 
> 7955b3962ac46b89564e0613db7bea98a1478bf2):
> https://github.com/apache/spark/tree/v2.4.4-rc3
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-bin/
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1332/
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-docs/
>
> The list of bug fixes going into 2.4.4 can be found at the following URL:
> https://issues.apache.org/jira/projects/SPARK/versions/12345466
>
> This release is using the release script of the tag v2.4.4-rc3.
>
> FAQ
>
> =
> How can I help test this release?
> =
>
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with a out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 2.4.4?
> ===
>
> The current list of open tickets targeted at 2.4.4 can be found at:
> https://issues.apache.org/jira/projects/SPARK and search for "Target 
> Version/s" = 2.4.4
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
>
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.



-- 
Marcelo

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

[Marcelo Vanzin]

Just noticed something before I started to run some tests. The output
of "spark-submit --version" is a little weird, in that it's missing
information (see end of e-mail).

Personally I don't think a lot of that output is super useful (like
"Compiled by" or the repo URL), but the branch and revision are.

Could be an artifact of the docker-based build scripts. I don't think
it should block the release, but we should fix that.


$ spark2-submit --version
Welcome to
    __
 / __/__  ___ _/ /__
_\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.3.4
  /_/

Using Scala version 2.11.8, Java HotSpot(TM) 64-Bit Server VM, 1.8.0_111
Branch
Compiled by user  on 2019-08-26T08:09:33Z
Revision
Url
Type --help for more information.

On Mon, Aug 26, 2019 at 1:28 PM Kazuaki Ishizaki  wrote:
>
> Please vote on releasing the following candidate as Apache Spark version 
> 2.3.4.
>
> The vote is open until August 29th 2PM PST and passes if a majority +1 PMC 
> votes are cast, with
> a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 2.3.4
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see https://spark.apache.org/
>
> The tag to be voted on is v2.3.4-rc1 (commit 
> 8c6f8150f3c6298ff4e1c7e06028f12d7eaf0210):
> https://github.com/apache/spark/tree/v2.3.4-rc1
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-bin/
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1331/
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-docs/
>
> The list of bug fixes going into 2.3.4 can be found at the following URL:
> https://issues.apache.org/jira/projects/SPARK/versions/12344844
>
> FAQ
>
> =
> How can I help test this release?
> =
>
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with a out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 2.3.4?
> ===
>
> The current list of open tickets targeted at 2.3.4 can be found at:
> https://issues.apache.org/jira/projects/SPARKand search for "Target 
> Version/s" = 2.3.4
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
>
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.
>


-- 
Marcelo

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

[Marcelo Vanzin]

(Ah, and the 2.4 RC has the same issue.)

On Wed, Aug 28, 2019 at 2:23 PM Marcelo Vanzin  wrote:
>
> Just noticed something before I started to run some tests. The output
> of "spark-submit --version" is a little weird, in that it's missing
> information (see end of e-mail).
>
> Personally I don't think a lot of that output is super useful (like
> "Compiled by" or the repo URL), but the branch and revision are.
>
> Could be an artifact of the docker-based build scripts. I don't think
> it should block the release, but we should fix that.
>
>
> $ spark2-submit --version
> Welcome to
>     __
>  / __/__  ___ _/ /__
> _\ \/ _ \/ _ `/ __/  '_/
>/___/ .__/\_,_/_/ /_/\_\   version 2.3.4
>   /_/
>
> Using Scala version 2.11.8, Java HotSpot(TM) 64-Bit Server VM, 1.8.0_111
> Branch
> Compiled by user  on 2019-08-26T08:09:33Z
> Revision
> Url
> Type --help for more information.
>
> On Mon, Aug 26, 2019 at 1:28 PM Kazuaki Ishizaki  wrote:
> >
> > Please vote on releasing the following candidate as Apache Spark version 
> > 2.3.4.
> >
> > The vote is open until August 29th 2PM PST and passes if a majority +1 PMC 
> > votes are cast, with
> > a minimum of 3 +1 votes.
> >
> > [ ] +1 Release this package as Apache Spark 2.3.4
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see https://spark.apache.org/
> >
> > The tag to be voted on is v2.3.4-rc1 (commit 
> > 8c6f8150f3c6298ff4e1c7e06028f12d7eaf0210):
> > https://github.com/apache/spark/tree/v2.3.4-rc1
> >
> > The release files, including signatures, digests, etc. can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-bin/
> >
> > Signatures used for Spark RCs can be found in this file:
> > https://dist.apache.org/repos/dist/dev/spark/KEYS
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1331/
> >
> > The documentation corresponding to this release can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-docs/
> >
> > The list of bug fixes going into 2.3.4 can be found at the following URL:
> > https://issues.apache.org/jira/projects/SPARK/versions/12344844
> >
> > FAQ
> >
> > =
> > How can I help test this release?
> > =
> >
> > If you are a Spark user, you can help us test this release by taking
> > an existing Spark workload and running on this release candidate, then
> > reporting any regressions.
> >
> > If you're working in PySpark you can set up a virtual env and install
> > the current RC and see if anything important breaks, in the Java/Scala
> > you can add the staging repository to your projects resolvers and test
> > with the RC (make sure to clean up the artifact cache before/after so
> > you don't end up building with a out of date RC going forward).
> >
> > ===
> > What should happen to JIRA tickets still targeting 2.3.4?
> > ===
> >
> > The current list of open tickets targeted at 2.3.4 can be found at:
> > https://issues.apache.org/jira/projects/SPARKand search for "Target 
> > Version/s" = 2.3.4
> >
> > Committers should look at those and triage. Extremely important bug
> > fixes, documentation, and API tweaks that impact compatibility should
> > be worked on immediately. Everything else please retarget to an
> > appropriate release.
> >
> > ==
> > But my bug isn't fixed?
> > ==
> >
> > In order to make timely releases, we will typically not hold the
> > release unless the bug in question is a regression from the previous
> > release. That being said, if there is something which is a regression
> > that has not been correctly targeted please ping me or a committer to
> > help target the issue.
> >
>
>
> --
> Marcelo



-- 
Marcelo

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

[Dongjoon Hyun]

Ya. It looks like that, but it seems to be a long standing issue. (2.3.3 /
2.4.0 / 2.4.1 / 2.4.2 / 2.4.3 are the same).

$ bin/spark-submit --version
Welcome to
    __
 / __/__  ___ _/ /__
_\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.3.3
  /_/

Using Scala version 2.11.8, OpenJDK 64-Bit Server VM, 1.8.0_222
Branch
Compiled by user  on 2019-02-04T13:00:46Z
Revision
Url
Type --help for more information.


$ bin/spark-submit --version
Welcome to
    __
 / __/__  ___ _/ /__
_\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.4.0
  /_/

Using Scala version 2.11.12, OpenJDK 64-Bit Server VM, 1.8.0_222
Branch
Compiled by user  on 2018-10-29T06:22:05Z
Revision
Url
Type --help for more information.




On Wed, Aug 28, 2019 at 2:24 PM Marcelo Vanzin 
wrote:

> (Ah, and the 2.4 RC has the same issue.)
>
> On Wed, Aug 28, 2019 at 2:23 PM Marcelo Vanzin 
> wrote:
> >
> > Just noticed something before I started to run some tests. The output
> > of "spark-submit --version" is a little weird, in that it's missing
> > information (see end of e-mail).
> >
> > Personally I don't think a lot of that output is super useful (like
> > "Compiled by" or the repo URL), but the branch and revision are.
> >
> > Could be an artifact of the docker-based build scripts. I don't think
> > it should block the release, but we should fix that.
> >
> >
> > $ spark2-submit --version
> > Welcome to
> >     __
> >  / __/__  ___ _/ /__
> > _\ \/ _ \/ _ `/ __/  '_/
> >/___/ .__/\_,_/_/ /_/\_\   version 2.3.4
> >   /_/
> >
> > Using Scala version 2.11.8, Java HotSpot(TM) 64-Bit Server VM, 1.8.0_111
> > Branch
> > Compiled by user  on 2019-08-26T08:09:33Z
> > Revision
> > Url
> > Type --help for more information.
> >
> > On Mon, Aug 26, 2019 at 1:28 PM Kazuaki Ishizaki 
> wrote:
> > >
> > > Please vote on releasing the following candidate as Apache Spark
> version 2.3.4.
> > >
> > > The vote is open until August 29th 2PM PST and passes if a majority +1
> PMC votes are cast, with
> > > a minimum of 3 +1 votes.
> > >
> > > [ ] +1 Release this package as Apache Spark 2.3.4
> > > [ ] -1 Do not release this package because ...
> > >
> > > To learn more about Apache Spark, please see https://spark.apache.org/
> > >
> > > The tag to be voted on is v2.3.4-rc1 (commit
> 8c6f8150f3c6298ff4e1c7e06028f12d7eaf0210):
> > > https://github.com/apache/spark/tree/v2.3.4-rc1
> > >
> > > The release files, including signatures, digests, etc. can be found at:
> > > https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-bin/
> > >
> > > Signatures used for Spark RCs can be found in this file:
> > > https://dist.apache.org/repos/dist/dev/spark/KEYS
> > >
> > > The staging repository for this release can be found at:
> > >
> https://repository.apache.org/content/repositories/orgapachespark-1331/
> > >
> > > The documentation corresponding to this release can be found at:
> > > https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-docs/
> > >
> > > The list of bug fixes going into 2.3.4 can be found at the following
> URL:
> > > https://issues.apache.org/jira/projects/SPARK/versions/12344844
> > >
> > > FAQ
> > >
> > > =
> > > How can I help test this release?
> > > =
> > >
> > > If you are a Spark user, you can help us test this release by taking
> > > an existing Spark workload and running on this release candidate, then
> > > reporting any regressions.
> > >
> > > If you're working in PySpark you can set up a virtual env and install
> > > the current RC and see if anything important breaks, in the Java/Scala
> > > you can add the staging repository to your projects resolvers and test
> > > with the RC (make sure to clean up the artifact cache before/after so
> > > you don't end up building with a out of date RC going forward).
> > >
> > > ===
> > > What should happen to JIRA tickets still targeting 2.3.4?
> > > ===
> > >
> > > The current list of open tickets targeted at 2.3.4 can be found at:
> > > https://issues.apache.org/jira/projects/SPARKand search for "Target
> Version/s" = 2.3.4
> > >
> > > Committers should look at those and triage. Extremely important bug
> > > fixes, documentation, and API tweaks that impact compatibility should
> > > be worked on immediately. Everything else please retarget to an
> > > appropriate release.
> > >
> > > ==
> > > But my bug isn't fixed?
> > > ==
> > >
> > > In order to make timely releases, we will typically not hold the
> > > release unless the bug in question is a regression from the previous
> > > release. That being said, if there is something which is a regression
> > > that has not been correctly targeted please ping me or a committer to
> > > help target the issue.
> > >
> >
> >
> > --
> > Marcelo
>
>
>
> --
> Marcelo
>

Re: [VOTE] Release Apache Spark 2.4.4 (RC3)

[Takeshi Yamamuro]

I checked the tests passed again on the same env.
It looks ok.


On Thu, Aug 29, 2019 at 6:15 AM Marcelo Vanzin 
wrote:

> +1
>
> On Tue, Aug 27, 2019 at 4:06 PM Dongjoon Hyun 
> wrote:
> >
> > Please vote on releasing the following candidate as Apache Spark version
> 2.4.4.
> >
> > The vote is open until August 30th 5PM PST and passes if a majority +1
> PMC votes are cast, with a minimum of 3 +1 votes.
> >
> > [ ] +1 Release this package as Apache Spark 2.4.4
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see http://spark.apache.org/
> >
> > The tag to be voted on is v2.4.4-rc3 (commit
> 7955b3962ac46b89564e0613db7bea98a1478bf2):
> > https://github.com/apache/spark/tree/v2.4.4-rc3
> >
> > The release files, including signatures, digests, etc. can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-bin/
> >
> > Signatures used for Spark RCs can be found in this file:
> > https://dist.apache.org/repos/dist/dev/spark/KEYS
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1332/
> >
> > The documentation corresponding to this release can be found at:
> > https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-docs/
> >
> > The list of bug fixes going into 2.4.4 can be found at the following URL:
> > https://issues.apache.org/jira/projects/SPARK/versions/12345466
> >
> > This release is using the release script of the tag v2.4.4-rc3.
> >
> > FAQ
> >
> > =
> > How can I help test this release?
> > =
> >
> > If you are a Spark user, you can help us test this release by taking
> > an existing Spark workload and running on this release candidate, then
> > reporting any regressions.
> >
> > If you're working in PySpark you can set up a virtual env and install
> > the current RC and see if anything important breaks, in the Java/Scala
> > you can add the staging repository to your projects resolvers and test
> > with the RC (make sure to clean up the artifact cache before/after so
> > you don't end up building with a out of date RC going forward).
> >
> > ===
> > What should happen to JIRA tickets still targeting 2.4.4?
> > ===
> >
> > The current list of open tickets targeted at 2.4.4 can be found at:
> > https://issues.apache.org/jira/projects/SPARK and search for "Target
> Version/s" = 2.4.4
> >
> > Committers should look at those and triage. Extremely important bug
> > fixes, documentation, and API tweaks that impact compatibility should
> > be worked on immediately. Everything else please retarget to an
> > appropriate release.
> >
> > ==
> > But my bug isn't fixed?
> > ==
> >
> > In order to make timely releases, we will typically not hold the
> > release unless the bug in question is a regression from the previous
> > release. That being said, if there is something which is a regression
> > that has not been correctly targeted please ping me or a committer to
> > help target the issue.
>
>
>
> --
> Marcelo
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>

-- 
---
Takeshi Yamamuro

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

[Dongjoon Hyun]

https://issues.apache.org/jira/browse/SPARK-28906 is filed for 2.3.2 ~
2.4.4.

Bests,
Dongjoon.

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

[Marcelo Vanzin]

+1

On Mon, Aug 26, 2019 at 1:28 PM Kazuaki Ishizaki  wrote:
>
> Please vote on releasing the following candidate as Apache Spark version 
> 2.3.4.
>
> The vote is open until August 29th 2PM PST and passes if a majority +1 PMC 
> votes are cast, with
> a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 2.3.4
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see https://spark.apache.org/
>
> The tag to be voted on is v2.3.4-rc1 (commit 
> 8c6f8150f3c6298ff4e1c7e06028f12d7eaf0210):
> https://github.com/apache/spark/tree/v2.3.4-rc1
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-bin/
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1331/
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v2.3.4-rc1-docs/
>
> The list of bug fixes going into 2.3.4 can be found at the following URL:
> https://issues.apache.org/jira/projects/SPARK/versions/12344844
>
> FAQ
>
> =
> How can I help test this release?
> =
>
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with a out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 2.3.4?
> ===
>
> The current list of open tickets targeted at 2.3.4 can be found at:
> https://issues.apache.org/jira/projects/SPARKand search for "Target 
> Version/s" = 2.3.4
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
>
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.
>


-- 
Marcelo

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Apache Spark 2.4.4 (RC3)

[Hyukjin Kwon]

+1 (from the last blocker PR)

2019년 8월 29일 (목) 오전 8:20, Takeshi Yamamuro 님이 작성:

> I checked the tests passed again on the same env.
> It looks ok.
>
>
> On Thu, Aug 29, 2019 at 6:15 AM Marcelo Vanzin 
> wrote:
>
>> +1
>>
>> On Tue, Aug 27, 2019 at 4:06 PM Dongjoon Hyun 
>> wrote:
>> >
>> > Please vote on releasing the following candidate as Apache Spark
>> version 2.4.4.
>> >
>> > The vote is open until August 30th 5PM PST and passes if a majority +1
>> PMC votes are cast, with a minimum of 3 +1 votes.
>> >
>> > [ ] +1 Release this package as Apache Spark 2.4.4
>> > [ ] -1 Do not release this package because ...
>> >
>> > To learn more about Apache Spark, please see http://spark.apache.org/
>> >
>> > The tag to be voted on is v2.4.4-rc3 (commit
>> 7955b3962ac46b89564e0613db7bea98a1478bf2):
>> > https://github.com/apache/spark/tree/v2.4.4-rc3
>> >
>> > The release files, including signatures, digests, etc. can be found at:
>> > https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-bin/
>> >
>> > Signatures used for Spark RCs can be found in this file:
>> > https://dist.apache.org/repos/dist/dev/spark/KEYS
>> >
>> > The staging repository for this release can be found at:
>> > https://repository.apache.org/content/repositories/orgapachespark-1332/
>> >
>> > The documentation corresponding to this release can be found at:
>> > https://dist.apache.org/repos/dist/dev/spark/v2.4.4-rc3-docs/
>> >
>> > The list of bug fixes going into 2.4.4 can be found at the following
>> URL:
>> > https://issues.apache.org/jira/projects/SPARK/versions/12345466
>> >
>> > This release is using the release script of the tag v2.4.4-rc3.
>> >
>> > FAQ
>> >
>> > =
>> > How can I help test this release?
>> > =
>> >
>> > If you are a Spark user, you can help us test this release by taking
>> > an existing Spark workload and running on this release candidate, then
>> > reporting any regressions.
>> >
>> > If you're working in PySpark you can set up a virtual env and install
>> > the current RC and see if anything important breaks, in the Java/Scala
>> > you can add the staging repository to your projects resolvers and test
>> > with the RC (make sure to clean up the artifact cache before/after so
>> > you don't end up building with a out of date RC going forward).
>> >
>> > ===
>> > What should happen to JIRA tickets still targeting 2.4.4?
>> > ===
>> >
>> > The current list of open tickets targeted at 2.4.4 can be found at:
>> > https://issues.apache.org/jira/projects/SPARK and search for "Target
>> Version/s" = 2.4.4
>> >
>> > Committers should look at those and triage. Extremely important bug
>> > fixes, documentation, and API tweaks that impact compatibility should
>> > be worked on immediately. Everything else please retarget to an
>> > appropriate release.
>> >
>> > ==
>> > But my bug isn't fixed?
>> > ==
>> >
>> > In order to make timely releases, we will typically not hold the
>> > release unless the bug in question is a regression from the previous
>> > release. That being said, if there is something which is a regression
>> > that has not been correctly targeted please ping me or a committer to
>> > help target the issue.
>>
>>
>>
>> --
>> Marcelo
>>
>> -
>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>>
>>
>
> --
> ---
> Takeshi Yamamuro
>

please care and vote for Chinese people under cruel autocracy of CCP, great thanks!

[ant_fighter]

Hi all,
Sorry for disturbing you guys. Though I don't think here as a proper place to 
do this, I need your help, your vote, your holy vote, for us Chinese, for 
conscience and justice, for better world.

In the over 70 years of ruling over China, the Chinese Communist Party has done 
many horrible things humans can think of. These malicious and evil deeds 
include but are not limited to: falsifying national history, suppression of 
freedom of speech and press, money laundering in the scale of trillions, live 
organ harvesting, sexual harassment and assault to underaged females, 
slaughtering innocent citizens with counter-revolutionary excuses, etc.

In light of the recent violent actions to Hong Kongers by the People's 
Liberation Army (PLA) disguised as Hong Kong Police Force, we the people 
petition to officially recognize the Chinese Communist Party as a terrorist 
organization.

PLEASE SIGNUP and VOTE for us：
https://petitions.whitehouse.gov/petition/call-official-recognition-chinese-communist-party-terrorist-organization

Thanks again for all!

nameless, an ant fighter
2019.8.29