@ian.a.mann...@gmail.com <ian.a.mann...@gmail.com> Thank you for your question. Because the voting period hasn't ended yet and this fix has just been merged, we don't want to release version 3.5.0 with a known correctness bug.
We've quickly cut RC5, and we welcome you to continue assisting with the testing. Ian Manning <ian.a.mann...@gmail.com> 于2023年9月9日周六 02:27写道： > This issue is not a regression and yet we fail the vote? Couldn't this > issue have been fixed in 3.5.1? > > Sorry I am new, so maybe this is how it works? > > On Sat, 9 Sep 2023, 02:29 Dongjoon Hyun, <dongjoon.h...@gmail.com> wrote: > >> Sorry but I'm -1 because there exists a late-arrival correctness patch >> although it's not a regression. >> >> - https://issues.apache.org/jira/browse/SPARK-44805 >> "Data lost after union using >> spark.sql.parquet.enableNestedColumnVectorizedReader=true" >> >> - https://github.com/apache/spark/pull/42850 >> - >> https://github.com/apache/spark/commit/b2b2ba97d3003d25d159943ab8a4bf50e421fdab >> (branch-3.5) >> >> Dongjoon. >> >> >>>>>> >>>>>> On Wed, Sep 6, 2023 at 8:11 AM Yuanjian Li <xyliyuanj...@gmail.com> >>>>>> wrote: >>>>>> >>>>>> Please vote on releasing the following candidate(RC4) as Apache Spark >>>>>> version 3.5.0. >>>>>> >>>>>> >>>>>> >>>>>> The vote is open until 11:59pm Pacific time *Sep 8th* and passes if >>>>>> a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. >>>>>> >>>>>> >>>>>> >>>>>> [ ] +1 Release this package as Apache Spark 3.5.0 >>>>>> >>>>>> [ ] -1 Do not release this package because ... >>>>>> >>>>>> >>>>>> >>>>>> To learn more about Apache Spark, please see http://spark.apache.org/ >>>>>> >>>>>> >>>>>> >>>>>> The tag to be voted on is v3.5.0-rc4 (commit >>>>>> c2939589a29dd0d6a2d3d31a8d833877a37ee02a): >>>>>> >>>>>> https://github.com/apache/spark/tree/v3.5.0-rc4 >>>>>> >>>>>> >>>>>> >>>>>> The release files, including signatures, digests, etc. can be found >>>>>> at: >>>>>> >>>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-bin/ >>>>>> >>>>>> >>>>>> >>>>>> Signatures used for Spark RCs can be found in this file: >>>>>> >>>>>> https://dist.apache.org/repos/dist/dev/spark/KEYS >>>>>> >>>>>> >>>>>> >>>>>> The staging repository for this release can be found at: >>>>>> >>>>>> https://repository.apache.org/content/repositories/orgapachespark-1448 >>>>>> >>>>>> >>>>>> >>>>>> The documentation corresponding to this release can be found at: >>>>>> >>>>>> https://dist.apache.org/repos/dist/dev/spark/v3.5.0-rc4-docs/ >>>>>> >>>>>> >>>>>> >>>>>> The list of bug fixes going into 3.5.0 can be found at the following >>>>>> URL: >>>>>> >>>>>> https://issues.apache.org/jira/projects/SPARK/versions/12352848 >>>>>> >>>>>> >>>>>> >>>>>> This release is using the release script of the tag v3.5.0-rc4. >>>>>> >>>>>> >>>>>> >>>>>> FAQ >>>>>> >>>>>> >>>>>> >>>>>> ========================= >>>>>> >>>>>> How can I help test this release? >>>>>> >>>>>> ========================= >>>>>> >>>>>> If you are a Spark user, you can help us test this release by taking >>>>>> >>>>>> an existing Spark workload and running on this release candidate, then >>>>>> >>>>>> reporting any regressions. >>>>>> >>>>>> >>>>>> >>>>>> If you're working in PySpark you can set up a virtual env and install >>>>>> >>>>>> the current RC and see if anything important breaks, in the Java/Scala >>>>>> >>>>>> you can add the staging repository to your projects resolvers and test >>>>>> >>>>>> with the RC (make sure to clean up the artifact cache before/after so >>>>>> >>>>>> you don't end up building with an out of date RC going forward). >>>>>> >>>>>> >>>>>> >>>>>> =========================================== >>>>>> >>>>>> What should happen to JIRA tickets still targeting 3.5.0? >>>>>> >>>>>> =========================================== >>>>>> >>>>>> The current list of open tickets targeted at 3.5.0 can be found at: >>>>>> >>>>>> https://issues.apache.org/jira/projects/SPARK and search for "Target >>>>>> Version/s" = 3.5.0 >>>>>> >>>>>> >>>>>> >>>>>> Committers should look at those and triage. Extremely important bug >>>>>> >>>>>> fixes, documentation, and API tweaks that impact compatibility should >>>>>> >>>>>> be worked on immediately. Everything else please retarget to an >>>>>> >>>>>> appropriate release. >>>>>> >>>>>> >>>>>> >>>>>> ================== >>>>>> >>>>>> But my bug isn't fixed? >>>>>> >>>>>> ================== >>>>>> >>>>>> In order to make timely releases, we will typically not hold the >>>>>> >>>>>> release unless the bug in question is a regression from the previous >>>>>> >>>>>> release. That being said, if there is something which is a regression >>>>>> >>>>>> that has not been correctly targeted please ping me or a committer to >>>>>> >>>>>> help target the issue. >>>>>> >>>>>> >>>>>> >>>>>> Thanks, >>>>>> >>>>>> Yuanjian Li >>>>>> >>>>>> >>>> >>>> -- >>>> Twitter: https://twitter.com/holdenkarau >>>> Books (Learning Spark, High Performance Spark, etc.): >>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>> >>>
