Re: [VOTE] Release Apache Spark 3.3.3 (RC1)

[Yuming Wang]

+1 myself.

On Tue, Aug 8, 2023 at 12:41 AM Dongjoon Hyun 
wrote:

> Thank you, Yuming.
>
> Dongjoon.
>
> On Mon, Aug 7, 2023 at 9:30 AM yangjie01  wrote:
>
>> HI，Dongjoon and Yuming
>>
>>
>>
>> I submitted a PR a few days ago to try to fix this issue:
>> https://github.com/apache/spark/pull/42167. The reason for the failure
>> is that the branch daily test and the master use the same yml file.
>>
>>
>>
>> Jie Yang
>>
>>
>>
>> *发件人**: *Dongjoon Hyun 
>> *日期**: *2023年8月8日 星期二 00:18
>> *收件人**: *Yuming Wang 
>> *抄送**: *dev 
>> *主题**: *Re: [VOTE] Release Apache Spark 3.3.3 (RC1)
>>
>>
>>
>> Hi, Yuming.
>>
>>
>>
>> One of the community GitHub Action test pipelines is unhealthy
>> consistently due to Python mypy linter.
>>
>>
>>
>> https://github.com/apache/spark/actions/workflows/build_branch33.yml
>> 
>>
>>
>>
>> It seems due to the pipeline difference between the same Python mypy
>> linter already pass in commit build,
>>
>>
>>
>> Dongjoon.
>>
>>
>>
>>
>>
>> On Fri, Aug 4, 2023 at 8:09 PM Yuming Wang  wrote:
>>
>> Please vote on releasing the following candidate as Apache Spark version
>> 3.3.3.
>>
>> The vote is open until 11:59pm Pacific time August 10th and passes if a
>> majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>
>> [ ] +1 Release this package as Apache Spark 3.3.3
>> [ ] -1 Do not release this package because ...
>>
>> To learn more about Apache Spark, please see https://spark.apache.org
>> 
>>
>> The tag to be voted on is v3.3.3-rc1 (commit
>> 8c2b3319c6734250ff9d72f3d7e5cab56b142195):
>> https://github.com/apache/spark/tree/v3.3.3-rc1
>> 
>>
>> The release files, including signatures, digests, etc. can be found at:
>> https://dist.apache.org/repos/dist/dev/spark/v3.3.3-rc1-bin
>> 
>>
>> Signatures used for Spark RCs can be found in this file:
>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>> 
>>
>> The staging repository for this release can be found at:
>> https://repository.apache.org/content/repositories/orgapachespark-1445
>> 
>>
>> The documentation corresponding to this release can be found at:
>> https://dist.apache.org/repos/dist/dev/spark/v3.3.3-rc1-docs
>> 
>>
>> The list of bug fixes going into 3.3.3 can be found at the following URL:
>> https://s.apache.org/rjci4
>> 
>>
>> This release is using the release script of the tag v3.3.3-rc1.
>>
>>
>> FAQ
>>
>> =
>> How can I help test this release?
>> =
>> If you are a Spark user, you can help us test this release by taking
>> an existing Spark workload and running on this release candidate, then
>> reporting any regressions.
>>
>> If you're working in PySpark you can set up a virtual env and install
>> the current RC and see if anything important breaks, in the Java/Scala
>> you can add the staging repository to your projects resolvers and test
>> with the RC (make sure to clean up the artifact cache before/after so
>> you don't end up building with an out of date RC going forward).
>>
>> ===
>> What should happen to JIRA tickets still targeting 3.3.3?
>> ===
>> The current list of open tickets targeted at 3.3.3 can be found at:
>> https://issues.apache.org/jira/projects/SPARK
>> 
>> and search for "Target Version/s" = 3.3.3
>>
>> Committers should look at those and triage. Extremely important bug
>> fixes, documentation, and API tweaks that impact compatibility should
>> be worked on immediately. Everything else please retarget to an
>> appropriate release.
>>
>> ==
>> But my bug isn't fixed?
>> ==
>> In order to make timely releases, we will typically not hold the
>> release unless the bug in question is a regression from the previous
>> release. That being said, if there is something which is a regression
>> that has not been correctly targeted please ping me or a committer to
>> help 

Re: ASF board report draft for August 2023

[Matei Zaharia]

Sounds good, I’ll add that.

> On Aug 8, 2023, at 9:34 AM, Holden Karau  wrote:
> 
> Maybe add a link to the 4.0 JIRA where we are tracking the current plans for 
> 4.0?
> 
> On Tue, Aug 8, 2023 at 9:33 AM Dongjoon Hyun  > wrote:
>> Thank you, Matei.
>> 
>> It looks good to me.
>> 
>> Dongjoon
>> 
>> On Mon, Aug 7, 2023 at 22:54 Matei Zaharia > > wrote:
>>> It’s time to send our quarterly report to the ASF board on August 9th. 
>>> Here’s what I wrote as a draft — feel free to suggest changes.
>>> 
>>> =
>>> 
>>> Issues for the board:
>>> 
>>> - None
>>> 
>>> Project status:
>>> 
>>> - We cut the branch Spark 3.5.0 on July 17th 2023. The community is working 
>>> on bug fixes, tests, stability and documentation.
>>> - We made a patch release, Spark 3.4.1, on June 23, 2023.
>>> - We are preparing a Spark 3.3.3 release for later this month 
>>> (https://lists.apache.org/thread/0kgnw8njjnfgc5nghx60mn7oojvrqwj7).
>>> - Votes on three Spark Project Improvement Proposals (SPIP) passed: "XML 
>>> data source support", "Python Data Source API", and "PySpark Test 
>>> Framework".
>>> - A vote for "Apache Spark PMC asks Databricks to differentiate its Spark 
>>> version string" did not pass. This was asking a company to change the 
>>> string returned by Spark APIs in a product that packages a modified version 
>>> of Apache Spark.
>>> - The community decided to release Apache Spark 4.0.0 after the 3.5.0 
>>> version.
>>> - An official Apache Spark Docker image is now available at 
>>> https://hub.docker.com/_/spark
>>> - A new repository, https://github.com/apache/spark-connect-go, was created 
>>> for the Go client of Spark Connect.
>>> - The PMC voted to add two new committers to the project, XiDuo You and 
>>> Peter Toth
>>> 
>>> Trademarks:
>>> 
>>> - No changes since the last report.
>>> 
>>> Latest releases:
>>> 
>>> - We released Apache Spark 3.4.1 on June 23, 2023
>>> - We released Apache Spark 3.2.4 on April 13, 2023
>>> - We released Spark 3.3.2 on February 17, 2023
>>> 
>>> Committers and PMC:
>>> 
>>> - The latest committers were added on July 11th, 2023 (XiDuo You and Peter 
>>> Toth).
>>> - The latest PMC members were added on May 10th, 2023 (Chao Sun, Xinrong 
>>> Meng and Ruifeng Zheng).
>>> 
>>> =
> -- 
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 
>  
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau