Re: [ANNOUNCE] New Apache Hudi Committer - Zhaojing Yu
Thank you all, especially Danny！ sagar sumit 于2022年4月1日周五 14:41写道： > Congrats Zhaojing! > > On Fri, Apr 1, 2022 at 12:03 PM Pratyaksh Sharma > wrote: > > > Congratulations Zhaojing! > > > > On Thu, Mar 31, 2022 at 8:27 PM Vinoth Chandar > wrote: > > > > > Congrats! > > > > > > On Thu, Mar 31, 2022 at 4:06 AM leesf wrote: > > > > > > > Congrats! > > > > > > > > Vino Yang 于2022年3月31日周四 17:03写道： > > > > > > > > > Congrats! > > > > > > > > > > Best, > > > > > Vino > > > > > > > > > > Gary Li 于2022年3月25日周五 19:11写道： > > > > > > > > > > > > Congrats! > > > > > > > > > > > > Best, > > > > > > Gary > > > > > > > > > > > > On Fri, Mar 25, 2022 at 4:07 PM Shiyan Xu < > > > xu.shiyan.raym...@gmail.com > > > > > > > > > > > wrote: > > > > > > > > > > > > > Congrats! > > > > > > > > > > > > > > On Fri, Mar 25, 2022 at 1:40 PM Danny Chan < > danny0...@apache.org > > > > > > > > wrote: > > > > > > > > > > > > > > > Hi everyone, > > > > > > > > > > > > > > > > On behalf of the PMC, I'm very happy to announce Zhaojing Yu > > as a > > > > new > > > > > > > > Hudi committer. > > > > > > > > > > > > > > > > Zhaojing is very active in Flink Hudi contributions, many > cool > > > > > > > > features such as the flink streaming bootstrap, compaction > > > service > > > > > and > > > > > > > > all kinds of writing modes are contributed by him. He also > > fixed > > > > many > > > > > > > > critical bugs from the Flink side. > > > > > > > > > > > > > > > > Besides that, Zhaojing is also active in use case publicity > of > > > Hudi > > > > > in > > > > > > > > China, he is very active in answering user questions in our > > > > Dingtalk > > > > > > > > group. Now he is working in Bytedance for pushing forward the > > > > > Volcanic > > > > > > > > cloud service Hudi products ! > > > > > > > > > > > > > > > > Please join me in congratulating Zhaojing for becoming a Hudi > > > > > committer! > > > > > > > > > > > > > > > > Cheers, > > > > > > > > Danny > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > -- > > > > > > > Best, > > > > > > > Shiyan > > > > > > > > > > > > > > > > > > > > > >
Re: 0.12.0 Release Timeline
+1 agree it. sagar sumit 于2022年7月11日周一 12:59写道： > Hi Folks, > > Some excellent features from the community are in review and near-landing > (could take up to a week). > The release blockers are tracked here > < > https://github.com/apache/hudi/pulls?q=is%3Apr+is%3Aopen+label%3Apriority%3Ablocker > > > . > So, I'd like to propose an updated release timeline. > - *July 20, 11:59 PM PST*: Code freeze - new features/functionalities > won't be merged to master. > - *July 22, 11:59 PM PST*: Cut release branch and start RC voting/testing. > > Regards, > Sagar > > On Wed, Jun 29, 2022 at 2:54 PM sagar sumit wrote: > > > Hi Folks, > > > > I am the RM for the upcoming release 0.12.0. > > In line with our roadmap, I'd like to propose the following timeline: > > > > - *July 15, 11:59 PM PST*: Code freeze - new features/functionalities > > won't be merged to master. > > - *July 18, 11:59 PM PST*: Cut release branch and start RC > voting/testing. > > > > Please highlight any concerns with the timeline. > > If it works, please +1 on this thread. > > > > Also, if you have not done already, please tag any JIRAs that you have > > planned for the release by setting its "Fix Version/s" to "0.12.0" > > > > Regards, > > Sagar > > >
Re: Release managers for 0.12.1 and 0.13.0
I'd like to be the release manager of the next minor release. Best, - Zhaojing Shiyan Xu 于2022年8月26日周五 07:02写道： > Hi everyone, > > As we finished 0.12.0, we're planning for next major and minor releases. > So I would like to call for volunteers to be the release managers. > > RM plays a very important role in ensuring the release schedule is followed > through, the targeting features/tickets are properly closed, and the > release notes are well-prepared. If you haven't done RM before, a PMC > member will help you along the way. Please respond to this thread to claim > the role. > > -- > Best, > Shiyan >
0.12.1 release timeline
Hi folks, As the RM for the 0.12.1 release, I'd like to propose the code freeze on Sep 21 (Wed) for any bug fixes that are going to be included in the minor release, about a month after the 0.12.0 release. Let me know if you need more time for fixing any issues. Please tag any fix that you think we should include in 0.12.1, by setting the "Fix Version/s" to "0.12.1" in the corresponding Jira ticket. As the RM, I will make the final decision. I have started cherry-picking the commits from the master. I will watch out for ongoing critical fixes and remind authors and reviewers in the PRs along the way so they can land in time. cherry-picking link： https://docs.google.com/document/d/1G4eeZkSUqMgONRI2YE0o_XBxy9kBaq_Cznolfp2VhS8/edit#heading=h.3fl3egu0kv0z Thanks, - Zhaojing
Re: 0.12.1 release timeline
To clarify, 09/21 is to cut RC1 and it will be released if all testing/checks pass. zhaojing yu 于2022年9月16日周五 16:45写道： > Hi folks, > > As the RM for the 0.12.1 release, I'd like to propose the code freeze on > Sep 21 (Wed) for any bug fixes that are going to be included in the minor > release, about a month after the 0.12.0 release. Let me know if you need > more time for fixing any issues. > > Please tag any fix that you think we should include in 0.12.1, by setting > the "Fix Version/s" to "0.12.1" in the corresponding Jira ticket. As the > RM, I will make the final decision. I have started cherry-picking the > commits from the master. I will watch out for ongoing critical fixes and > remind authors and reviewers in the PRs along the way so they can land in > time. > > cherry-picking link： > https://docs.google.com/document/d/1G4eeZkSUqMgONRI2YE0o_XBxy9kBaq_Cznolfp2VhS8/edit#heading=h.3fl3egu0kv0z > > Thanks, > - Zhaojing >
Re: 0.12.1 release timeline
Do anyone else have any suggestions? We will determine the time of the code freeze tomorrow. Sivabalan 于2022年9月19日周一 14:05写道： > Hey hi Zhaojing, > Announcing a code freeze just 1 week ahead might be too aggressive. > Do you think, we can make it sometime next week(week of 26th) to give some > buffer for folks to push any critical fixes in. Open to hear what others > have to say. > > > > On Fri, 16 Sept 2022 at 01:47, zhaojing yu wrote: > > > To clarify, 09/21 is to cut RC1 and it will be released if all > > testing/checks pass. > > > > zhaojing yu 于2022年9月16日周五 16:45写道： > > > > > Hi folks, > > > > > > As the RM for the 0.12.1 release, I'd like to propose the code freeze > on > > > Sep 21 (Wed) for any bug fixes that are going to be included in the > minor > > > release, about a month after the 0.12.0 release. Let me know if you > need > > > more time for fixing any issues. > > > > > > Please tag any fix that you think we should include in 0.12.1, by > setting > > > the "Fix Version/s" to "0.12.1" in the corresponding Jira ticket. As > the > > > RM, I will make the final decision. I have started cherry-picking the > > > commits from the master. I will watch out for ongoing critical fixes > and > > > remind authors and reviewers in the PRs along the way so they can land > in > > > time. > > > > > > cherry-picking link： > > > > > > https://docs.google.com/document/d/1G4eeZkSUqMgONRI2YE0o_XBxy9kBaq_Cznolfp2VhS8/edit#heading=h.3fl3egu0kv0z > > > > > > Thanks, > > > - Zhaojing > > > > > > > > -- > Regards, > -Sivabalan >
Re: 0.12.1 release timeline
After discussion our goal will be to freeze the code on 28th Sep. Until then I will follow the progress of the above blocker pr. Sivabalan 于2022年9月21日周三 11:02写道： > We are targeting to land all of these by 28th Sep. We will try our best to > land them before starting of next week, but 28th would be more practical. > > On Tue, 20 Sept 2022 at 18:21, Vinoth Chandar wrote: > > > Thanks for sharing. Do we have an ETA for these? > > > > Zhaojing - please chime with your thoughts as well > > > > On Wed, Sep 21, 2022 at 06:34 Y Ethan Guo wrote: > > > > > Hi Zhaojing, > > > > > > It would be good if we can land the following bootstrap fixes for > 0.12.1 > > > release. I'm working on getting them merged. > > > > > > HUDI-4855: https://github.com/apache/hudi/pull/6694 > > > HUDI-4453: https://github.com/apache/hudi/pull/6676 > > > > > > Thanks, > > > - Ethan > > > > > > On Tue, Sep 20, 2022 at 12:03 PM Alexey Kudinkin > > > wrote: > > > > > > > There are also a few critical issues we want to address before > cutting > > > the > > > > 0.12.1 release: > > > > > > > > HUDI-4760 <https://issues.apache.org/jira/browse/HUDI-4760> > > > > HUDI-3636 <https://issues.apache.org/jira/browse/HUDI-3636> > > > > HUDI-4885 <https://issues.apache.org/jira/browse/HUDI-4885> > > > > HUDI-2780 <https://issues.apache.org/jira/browse/HUDI-2780> > > > > > > > > On Tue, Sep 20, 2022 at 10:14 AM Sivabalan > wrote: > > > > > > > > > sure. We have few critical PRs that we are looking to land. Few > > notable > > > > > ones are > > > > > > > > > > ClassNotFoundException when using hudi-spark-bundle to write table > > with > > > > > hbase index <https://github.com/apache/hudi/pull/6715> > > > > > Fix fq can not be queried in pending compaction when query ro table > > > with > > > > > spark <https://github.com/apache/hudi/pull/6516> > > > > > Syncing non-partitioned table has bugs around partition parameters > > > > > <https://github.com/apache/hudi/pull/6525> > > > > > bootstrap bug fixes: https://github.com/apache/hudi/pull/6694 and > > > > > https://github.com/apache/hudi/pull/6676 > > > > > > > > > > > > > > > On Mon, 19 Sept 2022 at 20:24, Vinoth Chandar > > > wrote: > > > > > > > > > > > tbh the RM can make this call. Whether or not 1 week is > aggressive, > > > > > really > > > > > > depends on the scope of release, whats left to land/test. > > > > > > > > > > > > Would it be useful to frame the discussion in that way? > > > > > > > > > > > > On Mon, Sep 19, 2022 at 1:25 PM zhaojing yu > > > > > wrote: > > > > > > > > > > > > > Do anyone else have any suggestions? > > > > > > > We will determine the time of the code freeze tomorrow. > > > > > > > > > > > > > > Sivabalan 于2022年9月19日周一 14:05写道： > > > > > > > > > > > > > > > Hey hi Zhaojing, > > > > > > > > Announcing a code freeze just 1 week ahead might be too > > > > > > aggressive. > > > > > > > > Do you think, we can make it sometime next week(week of 26th) > > to > > > > give > > > > > > > some > > > > > > > > buffer for folks to push any critical fixes in. Open to hear > > what > > > > > > others > > > > > > > > have to say. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, 16 Sept 2022 at 01:47, zhaojing yu < > > maidou...@gmail.com> > > > > > > wrote: > > > > > > > > > > > > > > > > > To clarify, 09/21 is to cut RC1 and it will be released if > > all > > > > > > > > > testing/checks pass. > > > > > > > > > > > > > > > > > > zhaojing yu 于2022年9月16日周五 16:45写道： > > > > > > > > > > > > > > > > > > > Hi folks, > > > &g
Re: 0.12.1 release timeline
Hi folks, There are still a few critical PRs are pending, e.g., HUDI-2780 <https://github.com/apache/hudi/pull/4015>, HUDI-3636 <https://github.com/apache/hudi/pull/5269>, HUDI-4453 <https://github.com/apache/hudi/pull/6676>, HUDI-4687 <https://github.com/apache/hudi/pull/6657>, HUDI-4855 <https://github.com/apache/hudi/pull/6694>, etc. We should get those landed for 0.12.1. In mind, I'm proposing a new date for code freeze *Oct 2nd, 11:59 PM PST*. Kindlky let me know if you hava any concerns. Thanks, - Zhaojing zhaojing yu 于2022年9月23日周五 15:10写道： > After discussion our goal will be to freeze the code on 28th Sep. > Until then I will follow the progress of the above blocker pr. > > Sivabalan 于2022年9月21日周三 11:02写道： > >> We are targeting to land all of these by 28th Sep. We will try our best to >> land them before starting of next week, but 28th would be more practical. >> >> On Tue, 20 Sept 2022 at 18:21, Vinoth Chandar wrote: >> >> > Thanks for sharing. Do we have an ETA for these? >> > >> > Zhaojing - please chime with your thoughts as well >> > >> > On Wed, Sep 21, 2022 at 06:34 Y Ethan Guo wrote: >> > >> > > Hi Zhaojing, >> > > >> > > It would be good if we can land the following bootstrap fixes for >> 0.12.1 >> > > release. I'm working on getting them merged. >> > > >> > > HUDI-4855: https://github.com/apache/hudi/pull/6694 >> > > HUDI-4453: https://github.com/apache/hudi/pull/6676 >> > > >> > > Thanks, >> > > - Ethan >> > > >> > > On Tue, Sep 20, 2022 at 12:03 PM Alexey Kudinkin >> > > wrote: >> > > >> > > > There are also a few critical issues we want to address before >> cutting >> > > the >> > > > 0.12.1 release: >> > > > >> > > > HUDI-4760 <https://issues.apache.org/jira/browse/HUDI-4760> >> > > > HUDI-3636 <https://issues.apache.org/jira/browse/HUDI-3636> >> > > > HUDI-4885 <https://issues.apache.org/jira/browse/HUDI-4885> >> > > > HUDI-2780 <https://issues.apache.org/jira/browse/HUDI-2780> >> > > > >> > > > On Tue, Sep 20, 2022 at 10:14 AM Sivabalan >> wrote: >> > > > >> > > > > sure. We have few critical PRs that we are looking to land. Few >> > notable >> > > > > ones are >> > > > > >> > > > > ClassNotFoundException when using hudi-spark-bundle to write table >> > with >> > > > > hbase index <https://github.com/apache/hudi/pull/6715> >> > > > > Fix fq can not be queried in pending compaction when query ro >> table >> > > with >> > > > > spark <https://github.com/apache/hudi/pull/6516> >> > > > > Syncing non-partitioned table has bugs around partition parameters >> > > > > <https://github.com/apache/hudi/pull/6525> >> > > > > bootstrap bug fixes: https://github.com/apache/hudi/pull/6694 and >> > > > > https://github.com/apache/hudi/pull/6676 >> > > > > >> > > > > >> > > > > On Mon, 19 Sept 2022 at 20:24, Vinoth Chandar >> > > wrote: >> > > > > >> > > > > > tbh the RM can make this call. Whether or not 1 week is >> aggressive, >> > > > > really >> > > > > > depends on the scope of release, whats left to land/test. >> > > > > > >> > > > > > Would it be useful to frame the discussion in that way? >> > > > > > >> > > > > > On Mon, Sep 19, 2022 at 1:25 PM zhaojing yu < >> maidou...@gmail.com> >> > > > wrote: >> > > > > > >> > > > > > > Do anyone else have any suggestions? >> > > > > > > We will determine the time of the code freeze tomorrow. >> > > > > > > >> > > > > > > Sivabalan 于2022年9月19日周一 14:05写道： >> > > > > > > >> > > > > > > > Hey hi Zhaojing, >> > > > > > > > Announcing a code freeze just 1 week ahead might be >> too >> > > > > > aggressive. >> > > > > > > > Do you think, we can make it sometime next week(week of >> 26th) >> > to >> > > > give >> > > > > > > some >&
Re: 0.12.1 release timeline
Thanks for Alexey and Ethan's replies, we will continue to freeze the code according to the estimated 09/28 11:59 PST. Thanks, - Zhaojing Y Ethan Guo 于2022年9月28日周三 00:47写道： > Hi Zhaojing, > > Thanks for raising this. As Alexey mentioned, the authors feel > comfortable landing the PRs by the current code freeze time. Maybe you can > re-evaluate the situation Wednesday morning PT? > > Thanks, > - Ethan > > On Tue, Sep 27, 2022 at 9:11 AM Alexey Kudinkin > wrote: > > > Zhaojing, we synced up with the authors of the aforementioned PRs, and > > everyone feels comfortable that we should be able to land these w/in the > > currently set deadline of 09/28 11:59 PST. > > > > As such, i'd suggest we keep the existing deadline intact to avoid > delaying > > the release. What do you think? > > > > On Tue, Sep 27, 2022 at 3:37 AM zhaojing yu wrote: > > > > > Hi folks, > > > > > > There are still a few critical PRs are pending, e.g., > > > HUDI-2780 <https://github.com/apache/hudi/pull/4015>, > > > HUDI-3636 <https://github.com/apache/hudi/pull/5269>, > > > HUDI-4453 <https://github.com/apache/hudi/pull/6676>, > > > HUDI-4687 <https://github.com/apache/hudi/pull/6657>, > > > HUDI-4855 <https://github.com/apache/hudi/pull/6694>, etc. > > > > > > We should get those landed for 0.12.1. > > > In mind, I'm proposing a new date for code freeze *Oct 2nd, 11:59 PM > > PST*. > > > Kindlky let me know if you hava any concerns. > > > > > > > > > Thanks, > > > - Zhaojing > > > > > > zhaojing yu 于2022年9月23日周五 15:10写道： > > > > > > > After discussion our goal will be to freeze the code on 28th Sep. > > > > Until then I will follow the progress of the above blocker pr. > > > > > > > > Sivabalan 于2022年9月21日周三 11:02写道： > > > > > > > >> We are targeting to land all of these by 28th Sep. We will try our > > best > > > to > > > >> land them before starting of next week, but 28th would be more > > > practical. > > > >> > > > >> On Tue, 20 Sept 2022 at 18:21, Vinoth Chandar > > > wrote: > > > >> > > > >> > Thanks for sharing. Do we have an ETA for these? > > > >> > > > > >> > Zhaojing - please chime with your thoughts as well > > > >> > > > > >> > On Wed, Sep 21, 2022 at 06:34 Y Ethan Guo > wrote: > > > >> > > > > >> > > Hi Zhaojing, > > > >> > > > > > >> > > It would be good if we can land the following bootstrap fixes > for > > > >> 0.12.1 > > > >> > > release. I'm working on getting them merged. > > > >> > > > > > >> > > HUDI-4855: https://github.com/apache/hudi/pull/6694 > > > >> > > HUDI-4453: https://github.com/apache/hudi/pull/6676 > > > >> > > > > > >> > > Thanks, > > > >> > > - Ethan > > > >> > > > > > >> > > On Tue, Sep 20, 2022 at 12:03 PM Alexey Kudinkin < > > > ale...@onehouse.ai> > > > >> > > wrote: > > > >> > > > > > >> > > > There are also a few critical issues we want to address before > > > >> cutting > > > >> > > the > > > >> > > > 0.12.1 release: > > > >> > > > > > > >> > > > HUDI-4760 <https://issues.apache.org/jira/browse/HUDI-4760> > > > >> > > > HUDI-3636 <https://issues.apache.org/jira/browse/HUDI-3636> > > > >> > > > HUDI-4885 <https://issues.apache.org/jira/browse/HUDI-4885> > > > >> > > > HUDI-2780 <https://issues.apache.org/jira/browse/HUDI-2780> > > > >> > > > > > > >> > > > On Tue, Sep 20, 2022 at 10:14 AM Sivabalan < > n.siv...@gmail.com> > > > >> wrote: > > > >> > > > > > > >> > > > > sure. We have few critical PRs that we are looking to land. > > Few > > > >> > notable > > > >> > > > > ones are > > > >> > > > > > > > >> > > > > ClassNotFoundException when using hudi-spark-bundle to write > > >
[VOTE] Release 0.12.1, release candidate #1
Hi everyone, Please review and vote on the release candidate #1 for the version 0.12.1, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], * the official Apache source release and binary convenience releases to be deployed to dist.apache.org [2], which are signed with the key with fingerprint B4305519F36DD7E8B7E6A68458B85B8147783CE2 [3], * all artifacts to be deployed to the Maven Central Repository [4], * source code tag "release-0.12.1-rc1" [5], The vote will be open for at least 72 hours. It is adopted by majority approval, with at least 3 PMC affirmative votes. Thanks, Release Manager [1] https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12352182 [2] https://dist.apache.org/repos/dist/dev/hudi/hudi-0.12.1-rc1/ [3] https://dist.apache.org/repos/dist/dev/hudi/KEYS [4] https://repository.apache.org/content/repositories/orgapachehudi-1093/ [5] https://github.com/apache/hudi/releases/tag/release-0.12.1-rc1
Re: [VOTE] Release 0.12.1, release candidate #1
Confirm in https://www.apache.org/legal/src-headers.html#faq-exceptions that such files do not require LICENSE HEADER, have been modified validate_staged_release.sh skip the corresponding checks. Sivabalan 于2022年10月4日周二 12:01写道： > -1 Looks like we missed to add license header to a text file. > > ./release/validate_staged_release.sh --release=0.12.1 --rc_num=1 > /tmp/validation_scratch_dir_001 > ~/Documents/personal/projects/nov26/hudi/scripts > Downloading from svn co https://dist.apache.org/repos/dist/dev/hudi > Validating hudi-0.12.1-rc1 with release type "dev" > Checking Checksum of Source Release > Checksum Check of Source Release - [OK] > > % Total% Received % Xferd Average Speed TimeTime Time > Current > Dload Upload Total SpentLeft > Speed > 100 65803 100 658030 0 116k 0 --:--:-- --:--:-- --:--:-- > 116k > Checking Signature > Signature Check - [OK] > > Checking for binary files in source release > No Binary Files in Source Release? - [OK] > > Checking for DISCLAIMER > DISCLAIMER file exists ? [OK] > > Checking for LICENSE and NOTICE > License file exists ? [OK] > Notice file exists ? [OK] > > Performing custom Licensing Check > There were some source files that did not have Apache > License*./hudi-cli/src/main/resources/banner.txt* > > > On Sat, 1 Oct 2022 at 05:56, zhaojing yu wrote: > > > Hi everyone, > > > > Please review and vote on the release candidate #1 for the version > 0.12.1, > > as follows: > > > > [ ] +1, Approve the release > > [ ] -1, Do not approve the release (please provide specific comments) > > > > The complete staging area is available for your review, which includes: > > > > * JIRA release notes [1], > > * the official Apache source release and binary convenience releases to > be > > deployed to dist.apache.org [2], which are signed with the key with > > fingerprint B4305519F36DD7E8B7E6A68458B85B8147783CE2 [3], > > * all artifacts to be deployed to the Maven Central Repository [4], > > * source code tag "release-0.12.1-rc1" [5], > > > > The vote will be open for at least 72 hours. It is adopted by majority > > approval, with at least 3 PMC affirmative votes. > > > > Thanks, > > Release Manager > > > > [1] > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12352182 > > [2] https://dist.apache.org/repos/dist/dev/hudi/hudi-0.12.1-rc1/ > > [3] https://dist.apache.org/repos/dist/dev/hudi/KEYS > > [4] > https://repository.apache.org/content/repositories/orgapachehudi-1093/ > > [5] https://github.com/apache/hudi/releases/tag/release-0.12.1-rc1 > > > > > -- > Regards, > -Sivabalan >
Re: [VOTE] Release 0.12.1, release candidate #1
This commit has been reverted in version 0.12.1. Alexey Kudinkin 于2022年10月5日周三 03:45写道： > -1 > > Unfortunately, we will have to revert > commit 830e35c3f1d5663c9e96d36da4af67928e9d598b, as it plants a performance > regression that the author is currently working on to address. > > > On Tue, Oct 4, 2022 at 10:08 AM Sivabalan wrote: > > > Sorry about that. Raymond referred me to apache policy around license > > headers <https://www.apache.org/legal/src-headers.html#faq-exceptions>. > > So, > > reverting my vote to +1. > > > > Ran Deltastreamer tests, lock provider tests, structured spark streaming > > tests. > > > > On Tue, 4 Oct 2022 at 08:48, zhaojing yu wrote: > > > > > Confirm in > https://www.apache.org/legal/src-headers.html#faq-exceptions > > > that such files do not require LICENSE HEADER, have been modified > > > validate_staged_release.sh skip the corresponding checks. > > > > > > Sivabalan 于2022年10月4日周二 12:01写道： > > > > > > > -1 Looks like we missed to add license header to a text file. > > > > > > > > ./release/validate_staged_release.sh --release=0.12.1 --rc_num=1 > > > > /tmp/validation_scratch_dir_001 > > > > ~/Documents/personal/projects/nov26/hudi/scripts > > > > Downloading from svn co https://dist.apache.org/repos/dist/dev/hudi > > > > Validating hudi-0.12.1-rc1 with release type "dev" > > > > Checking Checksum of Source Release > > > > Checksum Check of Source Release - [OK] > > > > > > > > % Total% Received % Xferd Average Speed TimeTime > Time > > > > Current > > > > Dload Upload Total Spent > Left > > > > Speed > > > > 100 65803 100 658030 0 116k 0 --:--:-- --:--:-- > > --:--:-- > > > > 116k > > > > Checking Signature > > > > Signature Check - [OK] > > > > > > > > Checking for binary files in source release > > > > No Binary Files in Source Release? - [OK] > > > > > > > > Checking for DISCLAIMER > > > > DISCLAIMER file exists ? [OK] > > > > > > > > Checking for LICENSE and NOTICE > > > > License file exists ? [OK] > > > > Notice file exists ? [OK] > > > > > > > > Performing custom Licensing Check > > > > There were some source files that did not have Apache > > > > License*./hudi-cli/src/main/resources/banner.txt* > > > > > > > > > > > > On Sat, 1 Oct 2022 at 05:56, zhaojing yu > wrote: > > > > > > > > > Hi everyone, > > > > > > > > > > Please review and vote on the release candidate #1 for the version > > > > 0.12.1, > > > > > as follows: > > > > > > > > > > [ ] +1, Approve the release > > > > > [ ] -1, Do not approve the release (please provide specific > comments) > > > > > > > > > > The complete staging area is available for your review, which > > includes: > > > > > > > > > > * JIRA release notes [1], > > > > > * the official Apache source release and binary convenience > releases > > to > > > > be > > > > > deployed to dist.apache.org [2], which are signed with the key > with > > > > > fingerprint B4305519F36DD7E8B7E6A68458B85B8147783CE2 [3], > > > > > * all artifacts to be deployed to the Maven Central Repository [4], > > > > > * source code tag "release-0.12.1-rc1" [5], > > > > > > > > > > The vote will be open for at least 72 hours. It is adopted by > > majority > > > > > approval, with at least 3 PMC affirmative votes. > > > > > > > > > > Thanks, > > > > > Release Manager > > > > > > > > > > [1] > > > > > > > > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12352182 > > > > > [2] https://dist.apache.org/repos/dist/dev/hudi/hudi-0.12.1-rc1/ > > > > > [3] https://dist.apache.org/repos/dist/dev/hudi/KEYS > > > > > [4] > > > > > https://repository.apache.org/content/repositories/orgapachehudi-1093/ > > > > > [5] https://github.com/apache/hudi/releases/tag/release-0.12.1-rc1 > > > > > > > > > > > > > > > > > -- > > > > Regards, > > > > -Sivabalan > > > > > > > > > > > > > -- > > Regards, > > -Sivabalan > > >
Re: [VOTE] Release 0.12.1, release candidate #1
Since the temporary library has been closed, the code was redeployed https://repository.apache.org/content/repositories/orgapachehudi-1095, please review it again.
[RESULT] [VOTE] Release 0.12.1, release candidate #1
Hi everyone, I'm happy to announce that we have unanimously approved this release. There are 9 approving votes, 3 of which are binding. Here is the breakdown: +1 (binding) : 3 * Bhavani Sudha Saktheeswaran * Sivabalan Narayanan * Raymond Xu -1 (binding) : 0 +1 (non-binding) : 5 * Ethan Guo * Rahil C * Alexey Kudinkin * Sagar Sumit * Prasanna Rajaperumal -1 (non-binding) : 0 Thanks, everyone!
[REVERT] [VOTE] Release 0.12.0, release candidate #1
After careful consideration, we decided to restore the voting results due to the serious issue found with bulkinsert/row-writing path (affecting persisted data and resulting in duplicates). fix is here releasing 0.12.1 without the fix would make 0.12.0 and 0.12.1 basically crippled (have to ask users to avoid bulkinsert with row-writing) Therefore RC1 will be canceled and I'll start preparing for RC2.
Re: [REVERT] [VOTE] Release 0.12.0, release candidate #1
Update 0.12.0 to 0.12.1, sorry about that. zhaojing yu 于2022年10月7日周五 16:55写道： > After careful consideration, we decided to restore the voting results due > to the serious issue found with bulkinsert/row-writing path (affecting > persisted data and resulting in duplicates). fix is here > releasing 0.12.1 without the fix would make 0.12.0 and 0.12.1 basically > crippled (have to ask users to avoid bulkinsert with row-writing) > Therefore RC1 will be canceled and I'll start preparing for RC2. >
Re: [REVERT] [VOTE] Release 0.12.0, release candidate #1
Agreed w/ Raymond. For stability, we should put it in the next release. Best, Zhaojing Sivabalan 于2022年10月10日周一 22:43写道： > agreed w/ Raymond. But let's wait to hear from RM who can take the final > decision. > > On Sun, 9 Oct 2022 at 22:27, Shiyan Xu > wrote: > > > Thanks Nicolas, for filing the patch. I've left a comment on the PR. In > > short, I think there are some side effects. I also think given the > release > > decision was reverted mainly due to another serious issue, we should aim > to > > keep the change limited to that. We could still plan a 0.12.2 to make > > 0.12.x longer supported. > > > > On Sat, Oct 8, 2022 at 12:20 AM Nicolas Paris > > wrote: > > > > > Hi dev team, > > > > > > I take this opportunity to also propose to land this tiny fix which > > > lead us not to use the spark-bundle due to conflicts with other libs. > > > https://github.com/apache/hudi/pull/6874 > > > > > > In any case, thanks ! > > > > > > > > > On Fri, 2022-10-07 at 18:43 +0800, Shiyan Xu wrote: > > > > Thank you, Zhaojing, for handling this. Agree on the decision. the > > > > fix > > > > < > > > > > https://github.com/apache/hudi/commit/a51181726ce6efb57459285a66868e9d > > > > 3687bd60> > > > > was landed > > > > > > > > On Fri, Oct 7, 2022 at 4:56 PM zhaojing yu > > > > wrote: > > > > > > > > > Update 0.12.0 to 0.12.1, sorry about that. > > > > > > > > > > zhaojing yu 于2022年10月7日周五 16:55写道： > > > > > > > > > > > After careful consideration, we decided to restore the voting > > > > > > results due > > > > > > to the serious issue found with bulkinsert/row-writing path > > > > > > (affecting > > > > > > persisted data and resulting in duplicates). fix is here > > > > > > releasing 0.12.1 without the fix would make 0.12.0 and 0.12.1 > > > > > > basically > > > > > > crippled (have to ask users to avoid bulkinsert with row-writing) > > > > > > Therefore RC1 will be canceled and I'll start preparing for RC2. > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > Best, > > Shiyan > > > > > -- > Regards, > -Sivabalan >
[VOTE] Release 0.12.1, release candidate #2
Hi everyone, Please review and vote on the release candidate #2 for the version 0.12.1, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], * the official Apache source release and binary convenience releases to be deployed to dist.apache.org [2], which are signed with the key with fingerprint B4305519F36DD7E8B7E6A68458B85B8147783CE2 [3], * all artifacts to be deployed to the Maven Central Repository [4], * source code tag "release-0.12.1-rc2" [5], The vote will be open for at least 72 hours. It is adopted by majority approval, with at least 3 PMC affirmative votes. Thanks, Release Manager [1] https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12352182 [2] https://dist.apache.org/repos/dist/dev/hudi/hudi-0.12.1-rc2/ [3] https://dist.apache.org/repos/dist/dev/hudi/KEYS [4] https://repository.apache.org/content/repositories/orgapachehudi-1101/ [5] https://github.com/apache/hudi/releases/tag/release-0.12.1-rc2
[RESULT] [VOTE] Release 0.12.1, release candidate #2
Hi everyone, I'm happy to announce that we have unanimously approved this release. There are 8 approving votes, 5 of which are binding. Here is the breakdown: +1 (binding) : 5 * Bhavani Sudha Saktheeswaran * Sivabalan Narayanan * Danny Chan * Raymond Xu * Udit Mehrotra -1 (binding) : 0 +1 (non-binding) : 3 * Ethan Guo * Rahil C * Sagar Sumit -1 (non-binding) : 0 Thanks, everyone!
Re: [DISCUSS] Build tool upgrade
I have experienced some gradle development projects and want to share some thoughts. The flexibility and faster speed of gradle itself can certainly bring some advantages, but it will also greatly increase the troubleshooting time due to the bugs of gradle itself, and gradle DSL is very different from that of maven. There are also many learning costs for developers in the community. I think it does consume too much time on code release, but users or developers usually only compile part of the module. So I think, a certain advantage in build time alone is not enough to cover so much cost. Best, Zhaojing Gary Li 于2022年10月17日周一 19:22写道： > Hi folks, > > I'd share my thoughts as well. I personally won't build the whole project > too often, only before push to the remote branch or make big changes in > different modules. If I just make some changes and run a test, the IDE will > only build the necessary modules I believe. In addition, each time I deal > with dependency issues, the years of maven experience does help me locate > the issue quickly, especially when the dependency tree is pretty > complicated. The learning effort and the new environment setup effort are > considerable as well. > > Happy to learn if there are other benefits gradle or bazel could bring to > us, but if the only benefit is the xx% faster build time, I am a bit > unconvinced to make this change. > > Best, > Gary > > On Mon, Oct 17, 2022 at 2:58 PM Danny Chan wrote: > > > I have a full experience with how Apache Calcite switches from Maven > > to Gradle, and I want to share some thoughts. > > > > The gradle build is fast, but it relies heavily on its local cache, > > usually it needs too much time to download these cache jars because > > gradle upgrade itself very frequently. > > > > The gradle is very flexive for building, but it also has many bugs, > > you may need more time to debug its bug compared with building with > > maven. > > > > The gradle DSL for building is a must to learn for all the developers. > > > > For all above cases, I don't think switching to gradle is a right > > decision for Apache Calcite. Julian Hyde which is the creator of > > Calcite may have more words to say here. > > > > So I would not suggest we do that for Hudi. > > > > > > Best, > > Danny Chan > > > > Shiyan Xu 于2022年10月1日周六 13:48写道： > > > > > > Hi all, > > > > > > I'd like to raise a discussion around the build tool for Hudi. > > > > > > Maven has been a mature yet slow (10min to build on 2021 macbook pro) > > build > > > tool compared to modern ones like gradle or bazel. We all want faster > > > builds, however, we also need to consider the efforts and risks to > > upgrade, > > > and the developers' feedback on usability. > > > > > > What do you all think about upgrading to gradle or bazel? Please share > > your > > > thoughts. Thanks. > > > > > > -- > > > Best, > > > Shiyan > > >
[ANNOUNCE] Apache Hudi 0.12.1 released
The Apache Hudi team is pleased to announce the release of Apache Hudi 0.12.1. Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes and Incrementals. Apache Hudi manages storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage) and provides the ability to query them. This release comes 2 months after 0.12.0. It includes more than 150 resolved issues, comprising of a few new features as well as general improvements and bug fixes. You can read the release highlights at https://hudi.apache.org/releases/release-0.12.1. For details on how to use Hudi, please look at the quick start page located at https://hudi.apache.org/docs/quick-start-guide.html If you'd like to download the source release, you can find it here: https://github.com/apache/hudi/releases/tag/release-0.12.1 Release notes including the resolved issues can be found here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12352182 We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://hudi.apache.org Thanks to everyone involved! Release Manager
