回复： [DISCUSS] Apache Spark 3.0.1 Release
I volunteer to be a release manager of 3.0.1, if nobody is working on this. -- 原始邮件 -- 发件人: "Gengliang Wang"https://issues.apache.org/jira/browse/SPARK-32051 and include the fix into 3.0.1 if possible. Looks like APIs designed to work with Scala 2.11 & Java bring ambiguity in Scala 2.12 & Java. On Wed, Jun 24, 2020 at 4:52 AM Jules Damji https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 ; YouTube Live Streams: https://www.youtube.com/user/holdenkarau
回复： [DISCUSS] Apache Spark 3.0.1 Release
Hi all, I am going to prepare the realease of 3.0.1 RC1, with the help of Wenchen. -- 原始邮件 -- 发件人: "Jason Moore" https://issues.apache.org/jira/browse/SPARK-32307 On Tue, Jul 14, 2020 at 11:13 PM Sean Owen https://issues.apache.org/jira/browse/SPARK-32234 ? On Tue, Jul 14, 2020 at 9:57 AM Shivaram Venkataraman
[VOTE] Release Spark 3.0.1 (RC3)
Please vote on releasing the following candidate as Apache Spark version 3.0.1. The vote is open until Sep 2nd at 9AM PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 3.0.1 [ ] -1 Do not release this package because ... To learn more about Apache Spark, please see http://spark.apache.org/ There are currently no issues targeting 3.0.1 (try project = SPARK AND "Target Version/s" = "3.0.1" AND status in (Open, Reopened, "In Progress")) The tag to be voted on is v3.0.1-rc3 (commit dc04bf53fe821b7a07f817966c6c173f3b3788c6): https://github.com/apache/spark/tree/v3.0.1-rc3 The release files, including signatures, digests, etc. can be found at: https://dist.apache.org/repos/dist/dev/spark/v3.0.1-rc3-bin/ Signatures used for Spark RCs can be found in this file: https://dist.apache.org/repos/dist/dev/spark/KEYS The staging repository for this release can be found at: https://repository.apache.org/content/repositories/orgapachespark-1357/ The documentation corresponding to this release can be found at: https://dist.apache.org/repos/dist/dev/spark/v3.0.1-rc3-docs/ The list of bug fixes going into 3.0.1 can be found at the following URL: https://s.apache.org/q9g2d This release is using the release script of the tag v3.0.1-rc3. FAQ = How can I help test this release? = If you are a Spark user, you can help us test this release by taking an existing Spark workload and running on this release candidate, then reporting any regressions. If you're working in PySpark you can set up a virtual env and install the current RC and see if anything important breaks, in the Java/Scala you can add the staging repository to your projects resolvers and test with the RC (make sure to clean up the artifact cache before/after so you don't end up building with an out of date RC going forward). === What should happen to JIRA tickets still targeting 3.0.1? === The current list of open tickets targeted at 3.0.1 can be found at: https://issues.apache.org/jira/projects/SPARK and search for "Target Version/s" = 3.0.1 Committers should look at those and triage. Extremely important bug fixes, documentation, and API tweaks that impact compatibility should be worked on immediately. Everything else please retarget to an appropriate release. == But my bug isn't fixed? == In order to make timely releases, we will typically not hold the release unless the bug in question is a regression from the previous release. That being said, if there is something which is a regression that has not been correctly targeted please ping me or a committer to help target the issue.
[VOTE][RESULT] Release Spark 3.0.1 (RC3)
The vote passes. Thanks to all who helped with the release! (* = binding) +1: - Sean Owen * - Jungtaek Lim - Tom Graves * - Dongjoon Hyun * +0: - Xiao Li * -1: None
[ANNOUNCE] Announcing Apache Spark 3.0.1
Hi all, We are happy to announce the availability of Spark 3.0.1! Spark 3.0.1 is a maintenance release containing stability fixes. This release is based on the branch-3.0 maintenance branch of Spark. We strongly recommend all 3.0 users to upgrade to this stable release. To download Spark 3.0.1, head over to the download page: http://spark.apache.org/downloads.html Note that you might need to clear your browser cache or to use `Private`/`Incognito` mode according to your browsers. To view the release notes: https://spark.apache.org/releases/spark-release-3-0-1.html We would like to acknowledge all community members for contributing to this release. This release would not have been possible without you. Thanks, Ruifeng Zheng
回复： [VOTE][SPARK-30602] SPIP: Support push-based shuffle to improve shuffle efficiency
+1 -- 原始邮件 -- 发件人: "叶先进" https://issues.apache.org/jira/browse/SPARK-30602 SPIP doc: https://docs.google.com/document/d/1mYzKVZllA5Flw8AtoX7JUcXBOnNIDADWRbJ7GI6Y71Q/edit POC against master and results summary : https://docs.google.com/document/d/1Q5m7YAp0HyG_TNFL4p_bjQgzzw33ik5i49Vr86UNZgg/edit Active discussions on the jira and SPIP document have settled. I will leave the vote open until Friday (the 18th September 2020), 5pm CST. [ ] +1: Accept the proposal as an official SPIP [ ] +0 [ ] -1: I don't think this is a good idea because ... Thanks, Mridul -- Sincerely, DB Tsai -- Web: https://www.dbtsai.com PGP Key ID: 42E5B25A8F7A82C1
回复： I'm going to be out starting Nov 5th
Take care, Holden! Best wishes! -- 原始邮件 -- 发件人: "Hyukjin Kwon" http://blog.holdenkarau.com/2020/10/taking-break-surgery.html Happy Sparking Everyone, Holden :) -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 ; YouTube Live Streams: https://www.youtube.com/user/holdenkarau
回复： [VOTE] Release Spark 3.1.1 (RC1)
+1 (non-binding) Thank you, Hyukjin Bests, Ruifeng -- 原始邮件 -- 发件人: "Dongjoon Hyun" http://spark.apache.org/ The tag to be voted on is v3.1.1-rc1 (commit 53fe365edb948d0e05a5ccb62f349cd9fcb4bb5d): https://github.com/apache/spark/tree/v3.1.1-rc1 The release files, including signatures, digests, etc. can be found at: https://dist.apache.org/repos/dist/dev/spark/v3.1.1-rc1-bin/ Signatures used for Spark RCs can be found in this file: https://dist.apache.org/repos/dist/dev/spark/KEYS The staging repository for this release can be found at: https://repository.apache.org/content/repositories/orgapachespark-1364 The documentation corresponding to this release can be found at: https://dist.apache.org/repos/dist/dev/spark/v3.1.1-rc1-docs/ The list of bug fixes going into 3.1.1 can be found at the following URL: https://s.apache.org/41kf2 This release is using the release script of the tag v3.1.1-rc1. FAQ === What happened to 3.1.0? === There was a technical issue during Apache Spark 3.1.0 preparation, and it was discussed and decided to skip 3.1.0. Please see https://spark.apache.org/news/next-official-release-spark-3.1.1.html for more details. = How can I help test this release? = If you are a Spark user, you can help us test this release by taking an existing Spark workload and running on this release candidate, then reporting any regressions. If you're working in PySpark you can set up a virtual env and install the current RC via "pip install https://dist.apache.org/repos/dist/dev/spark/v3.1.1-rc1-bin/pyspark-3.1.1.tar.gz"; and see if anything important breaks. In the Java/Scala, you can add the staging repository to your projects resolvers and test with the RC (make sure to clean up the artifact cache before/after so you don't end up building with an out of date RC going forward). === What should happen to JIRA tickets still targeting 3.1.1? === The current list of open tickets targeted at 3.1.1 can be found at: https://issues.apache.org/jira/projects/SPARK and search for "Target Version/s" = 3.1.1 Committers should look at those and triage. Extremely important bug fixes, documentation, and API tweaks that impact compatibility should be worked on immediately. Everything else please retarget to an appropriate release. == But my bug isn't fixed? == In order to make timely releases, we will typically not hold the release unless the bug in question is a regression from the previous release. That being said, if there is something which is a regression that has not been correctly targeted please ping me or a committer to help target the issue. -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 ; YouTube Live Streams: https://www.youtube.com/user/holdenkarau
回复： [VOTE] Release Spark 3.1.1 (RC2)
+1 (non-binding) Thank you, Hyukjin -- 原始邮件 -- 发件人: "Gengliang Wang" https://issues.apache.org/jira/issues/?jql=project%20%3D%20SPARK%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20in%20(3.1.0%2C%203.1.1)%20AND%20(assignee%20is%20EMPTY%20or%20assignee%20%3D%20apachespark) On Tue, Feb 9, 2021 at 9:05 AM Hyukjin Kwon http://spark.apache.org/ The tag to be voted on is v3.1.1-rc2 (commit cf0115ac2d60070399af481b14566f33d22ec45e): https://github.com/apache/spark/tree/v3.1.1-rc2 The release files, including signatures, digests, etc. can be found at: https://dist.apache.org/repos/dist/dev/spark/v3.1.1-rc2-bin/ Signatures used for Spark RCs can be found in this file: https://dist.apache.org/repos/dist/dev/spark/KEYS The staging repository for this release can be found at: https://repository.apache.org/content/repositories/orgapachespark-1365 The documentation corresponding to this release can be found at: https://dist.apache.org/repos/dist/dev/spark/v3.1.1-rc2-docs/ The list of bug fixes going into 3.1.1 can be found at the following URL: https://s.apache.org/41kf2 This release is using the release script of the tag v3.1.1-rc2. FAQ === What happened to 3.1.0? === There was a technical issue during Apache Spark 3.1.0 preparation, and it was discussed and decided to skip 3.1.0. Please see https://spark.apache.org/news/next-official-release-spark-3.1.1.html for more details. = How can I help test this release? = If you are a Spark user, you can help us test this release by taking an existing Spark workload and running on this release candidate, then reporting any regressions. If you're working in PySpark you can set up a virtual env and install the current RC via "pip install https://dist.apache.org/repos/dist/dev/spark/v3.1.1-rc2-bin/pyspark-3.1.1.tar.gz"; and see if anything important breaks. In the Java/Scala, you can add the staging repository to your projects resolvers and test with the RC (make sure to clean up the artifact cache before/after so you don't end up building with an out of date RC going forward). === What should happen to JIRA tickets still targeting 3.1.1? === The current list of open tickets targeted at 3.1.1 can be found at: https://issues.apache.org/jira/projects/SPARK and search for "Target Version/s" = 3.1.1 Committers should look at those and triage. Extremely important bug fixes, documentation, and API tweaks that impact compatibility should be worked on immediately. Everything else please retarget to an appropriate release. == But my bug isn't fixed? == In order to make timely releases, we will typically not hold the release unless the bug in question is a regression from the previous release. That being said, if there is something which is a regression that has not been correctly targeted please ping me or a committer to help target the issue.
回复： Welcoming six new Apache Spark committers
Congratulations to all! -- 原始邮件 -- 发件人: "Yuanjian Li" http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org -- --- Takeshi Yamamuro
回复： [VOTE] SPIP: Support pandas API layer on PySpark
+1 (non-binding) -- 原始邮件 -- 发件人: "Maxim Gekk" http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org -- --- Takeshi Yamamuro
回复： [VOTE] Release Spark 2.4.8 (RC3)
+1 (non-binding) Thanks, ruifengz -- 原始邮件 -- 发件人: "Hyukjin Kwon" http://spark.apache.org/ There are currently no issues targeting 2.4.8 (try project = SPARK AND "Target Version/s" = "2.4.8" AND status in (Open, Reopened, "In Progress")) The tag to be voted on is v2.4.8-rc3 (commit e89526d2401b3a04719721c923a6f630e555e286): https://github.com/apache/spark/tree/v2.4.8-rc3 The release files, including signatures, digests, etc. can be found at: https://dist.apache.org/repos/dist/dev/spark/v2.4.8-rc3-bin/ Signatures used for Spark RCs can be found in this file: https://dist.apache.org/repos/dist/dev/spark/KEYS The staging repository for this release can be found at: https://repository.apache.org/content/repositories/orgapachespark-1377/ The documentation corresponding to this release can be found at: https://dist.apache.org/repos/dist/dev/spark/v2.4.8-rc3-docs/ The list of bug fixes going into 2.4.8 can be found at the following URL: https://s.apache.org/spark-v2.4.8-rc3 This release is using the release script of the tag v2.4.8-rc3. FAQ = How can I help test this release? = If you are a Spark user, you can help us test this release by taking an existing Spark workload and running on this release candidate, then reporting any regressions. If you're working in PySpark you can set up a virtual env and install the current RC and see if anything important breaks, in the Java/Scala you can add the staging repository to your projects resolvers and test with the RC (make sure to clean up the artifact cache before/after so you don't end up building with an out of date RC going forward). === What should happen to JIRA tickets still targeting 2.4.8? === The current list of open tickets targeted at 2.4.8 can be found at: https://issues.apache.org/jira/projects/SPARK and search for "Target Version/s" = 2.4.8 Committers should look at those and triage. Extremely important bug fixes, documentation, and API tweaks that impact compatibility should be worked on immediately. Everything else please retarget to an appropriate release. == But my bug isn't fixed? == In order to make timely releases, we will typically not hold the release unless the bug in question is a regression from the previous release. That being said, if there is something which is a regression that has not been correctly targeted please ping me or a committer to help target the issue. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
回复： [ANNOUNCE] Apache Spark 2.4.8 released
Thank you for the great work, Liang-Chi! -- 原始邮件 -- 发件人: "Chao Sun" http://spark.apache.org/downloads.html Note that you might need to clear your browser cache or to use `Private`/`Incognito` mode according to your browsers. To view the release notes: https://spark.apache.org/releases/spark-release-2-4-8.html We would like to acknowledge all community members for contributing to this release. This release would not have been possible without you. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org -- --- Takeshi Yamamuro
回复： Apache Spark 3.1.2 Release?
late +1. thanks Dongjoon! -- 原始邮件 -- 发件人: "Dongjoon Hyun" http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org -- --- Takeshi Yamamuro -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 ; YouTube Live Streams: https://www.youtube.com/user/holdenkarau -- John Zhuge --
回复：[ANNOUNCE] Apache Spark 3.1.2 released
Great work! Dongjoon! -- 原始邮件 -- 发件人: "Dongjoon Hyun" https://spark.apache.org/downloads.html To view the release notes: https://spark.apache.org/releases/spark-release-3-1-2.html We would like to acknowledge all community members for contributing to this release. This release would not have been possible without you. Dongjoon Hyun
回复： Apache Spark 3.0.3 Release?
+1, thanks Yi -- 原始邮件 -- 发件人: "Mridul Muralidharan"
回复： [VOTE] Release Spark 3.2.0 (RC6)
+1 (non-bindng) -- 原始邮件 -- 发件人: "Yuming Wang" http://spark.apache.org/ The tag to be voted on is v3.2.0-rc6 (commit dde73e2e1c7e55c8e740cb159872e081ddfa7ed6): https://github.com/apache/spark/tree/v3.2.0-rc6 The release files, including signatures, digests, etc. can be found at: https://dist.apache.org/repos/dist/dev/spark/v3.2.0-rc6-bin/ Signatures used for Spark RCs can be found in this file: https://dist.apache.org/repos/dist/dev/spark/KEYS The staging repository for this release can be found at: https://repository.apache.org/content/repositories/orgapachespark-1393 The documentation corresponding to this release can be found at: https://dist.apache.org/repos/dist/dev/spark/v3.2.0-rc6-docs/ The list of bug fixes going into 3.2.0 can be found at the following URL: https://issues.apache.org/jira/projects/SPARK/versions/12349407 This release is using the release script of the tag v3.2.0-rc6. FAQ = How can I help test this release? = If you are a Spark user, you can help us test this release by taking an existing Spark workload and running on this release candidate, then reporting any regressions. If you're working in PySpark you can set up a virtual env and install the current RC and see if anything important breaks, in the Java/Scala you can add the staging repository to your projects resolvers and test with the RC (make sure to clean up the artifact cache before/after so you don't end up building with a out of date RC going forward). === What should happen to JIRA tickets still targeting 3.2.0? === The current list of open tickets targeted at 3.2.0 can be found at: https://issues.apache.org/jira/projects/SPARK and search for "Target Version/s" = 3.2.0 Committers should look at those and triage. Extremely important bug fixes, documentation, and API tweaks that impact compatibility should be worked on immediately. Everything else please retarget to an appropriate release. == But my bug isn't fixed? == In order to make timely releases, we will typically not hold the release unless the bug in question is a regression from the previous release. That being said, if there is something which is a regression that has not been correctly targeted please ping me or a committer to help target the issue.
回复： [VOTE] Release Spark 3.2.0 (RC7)
+1 (non-binding) -- 原始邮件 -- 发件人: "Sean Owen" http://spark.apache.org/ The tag to be voted on is v3.2.0-rc7 (commit 5d45a415f3a29898d92380380cfd82bfc7f579ea): https://github.com/apache/spark/tree/v3.2.0-rc7 The release files, including signatures, digests, etc. can be found at: https://dist.apache.org/repos/dist/dev/spark/v3.2.0-rc7-bin/ Signatures used for Spark RCs can be found in this file: https://dist.apache.org/repos/dist/dev/spark/KEYS The staging repository for this release can be found at: https://repository.apache.org/content/repositories/orgapachespark-1394 The documentation corresponding to this release can be found at: https://dist.apache.org/repos/dist/dev/spark/v3.2.0-rc7-docs/ The list of bug fixes going into 3.2.0 can be found at the following URL: https://issues.apache.org/jira/projects/SPARK/versions/12349407 This release is using the release script of the tag v3.2.0-rc7. FAQ = How can I help test this release? = If you are a Spark user, you can help us test this release by taking an existing Spark workload and running on this release candidate, then reporting any regressions. If you're working in PySpark you can set up a virtual env and install the current RC and see if anything important breaks, in the Java/Scala you can add the staging repository to your projects resolvers and test with the RC (make sure to clean up the artifact cache before/after so you don't end up building with a out of date RC going forward). === What should happen to JIRA tickets still targeting 3.2.0? === The current list of open tickets targeted at 3.2.0 can be found at: https://issues.apache.org/jira/projects/SPARK and search for "Target Version/s" = 3.2.0 Committers should look at those and triage. Extremely important bug fixes, documentation, and API tweaks that impact compatibility should be worked on immediately. Everything else please retarget to an appropriate release. == But my bug isn't fixed? == In order to make timely releases, we will typically not hold the release unless the bug in question is a regression from the previous release. That being said, if there is something which is a regression that has not been correctly targeted please ping me or a committer to help target the issue.
