Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

Hi Konstantin and Steve, HDFS-15751 has committed to related branches including 3.2.2. I will prepare 3.2.2-RC shortly. Please let me know if any other issues for doc or deployment do you meet. Thanks. - He Xiaoqiao On Wed, Dec 30, 2020 at 6:40 PM Xiaoqiao He wrote: > Hi Steve and C

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

Hi Steve and Chao, Konstatin has updated HDFS-15751 and attached patch for documentation msync API, Would you mind to TAL. I want to involve this update to 3.2.2 release, but for now it seems there are not enough committers to review. Please check when you have bandwidth. Thanks all. - He Xiaoqia

[jira] [Created] (HADOOP-17445) Update the year to 2021 for 3.2.2-RC

Xiaoqiao He created HADOOP-17445: Summary: Update the year to 2021 for 3.2.2-RC Key: HADOOP-17445 URL: https://issues.apache.org/jira/browse/HADOOP-17445 Project: Hadoop Common Issue Type

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

I feel that we can call a new RC as YARN-10540 is backported already. > > Thanks > Sunil > > On Wed, Dec 23, 2020 at 3:54 PM Xiaoqiao He wrote: > > > Thanks Jim, Eric and Sunil, > > > > I tried to backport YARN-10540 to branch-3.2.2 at local and check yarn >

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

; > > >> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10450&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&a

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

browse/HADOOP-15930>. >> >> Thanks >> Sunil >> >> On Sat, Dec 19, 2020 at 10:16 AM Sunil Govindan >> wrote: >> >>> Hi Xiaoqiao and Wei-chiu >>> >>> I am a bit confused after seeing both *.sha512 and *.md5 files in the >

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

ot;use with caution". And if we can get what the API does >> > defined in a way which works, it shouldn't need changing. >> > >> > (which reminds me, I do need to check that RC out, don't I?) >> > >> > On Sun, 13 Dec 2020 at 09:00, Xiao

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

Thanks Steve very much for your discussion here. Leave some comments inline. Will focus on this thread to wait for the final conclusion to decide if we should prepare another release candidate of 3.2.2. Thanks Steve and Chao again for your warm discussions. On Sat, Dec 12, 2020 at 7:18 PM Steve L

[VOTE] Release Apache Hadoop 3.2.2 - RC4

Hi folks, The release candidate (RC4) for Hadoop-3.2.2 is available now. There are 10 commits[1] differences between RC4 and RC3[2]. The RC4 is available at: http://people.apache.org/~hexiaoqiao/hadoop-3.2.2-RC4 The RC4 tag in github is here: https://github.com/apache/hadoop/tree/release-3.2.2-RC

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

, 2020 at 9:09 AM Chao Sun wrote: > > > > > > Thanks Xiaoqiao. I just committed the fix to branch-3.2 (and will port > it > > > to other branches as well later). Could you cherry-pick it to > branch-3.2.2 > > > and start another RC? really

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

e late notice. > > Best, > Chao > > On Mon, Nov 30, 2020 at 7:37 AM Xiaoqiao He wrote: > >> Hi folks, >> >> The release candidate (RC3) for Hadoop-3.2.2 is available now. >> There are 22 commits[1] differences between RC3 and RC2[2]. >> >> The

[VOTE] Release Apache Hadoop 3.2.2 - RC3

Hi folks, The release candidate (RC3) for Hadoop-3.2.2 is available now. There are 22 commits[1] differences between RC3 and RC2[2]. The RC3 is available at: http://people.apache.org/~hexiaoqiao/hadoop-3.2.2-RC3 The RC3 tag in github is here: https://github.com/apache/hadoop/tree/release-3.2.2-RC

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC2

es, looked around the webUI etc. Everything >>> looks fine. The only strange thing, was on the Namenode webUI under the >>> overview section - the "unknown" is a little strange, but I am not sure >>> what is usually in there: >>> >>> Version: 3.

[VOTE] Release Apache Hadoop 3.2.2 - RC2

Hi folks, The release candidate (RC2) for Hadoop-3.2.2 is available now. There are two commits[1] differences between RC2 and RC1[2](Thanks Akira Ajisaka for the report.): * revert HADOOP-17306. * include HDFS-15643. The RC2 is available at: http://people.apache.org/~hexiaoqiao/hadoop-3.2.2-RC2 T

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC1

hat the revert of HADOOP-17306 is now pushed to > the 3.2.2 branch as well. > > Let's do one more RC. Thanks @Xiaoqiao He for > helping. > > Thanks > Sunil > > On Fri, Nov 6, 2020 at 6:58 AM Akira Ajisaka wrote: > >> -1 >> >> - YARN resourc

[VOTE] Release Apache Hadoop 3.2.2 - RC1

Hi folks, I have put together a release candidate (RC1) for Hadoop-3.2.2. It contains *473[1]* fixed jira issues since 3.2.1 release which also include many features and improvements(Please reference the full set of release notes). The RC is available at: http://people.apache.org/~hexiaoqiao/had

[jira] [Created] (HADOOP-17329) mvn site fails due to MetricsSystemImpl class

Xiaoqiao He created HADOOP-17329: Summary: mvn site fails due to MetricsSystemImpl class Key: HADOOP-17329 URL: https://issues.apache.org/jira/browse/HADOOP-17329 Project: Hadoop Common

Re: [E] Re: Hadoop 3.2.2 Release Code Freeze Plan

> don't include it in 3.2.2. It's a blocking issue though, so I think it'd be > unfortunate if we missed this chance to include it in a 3.2.x maintenance > release. (Same for YARN-8992, which is a related JIRA.) > > Best, > Steve > > On Sat, Oct 17, 2020 at

Re: [E] Re: Hadoop 3.2.2 Release Code Freeze Plan

gt; On Fri, Oct 16, 2020 at 6:43 AM Sunil Govindan wrote: >> >>> Looks good to me. >>> >>> Thanks Xiaoquio. >>> >>> + Sunil >>> >>> On Fri, Oct 16, 2020 at 12:36 PM Xiaoqiao He >>> wrote: >>> >>> >

Re: Hadoop 3.2.2 Release Code Freeze Plan

op/commits/branch-3.2 On Fri, Oct 16, 2020 at 12:03 PM Sunil Govindan wrote: > Thank you > > Did we also cut the branch already ? > > Sunil > > On Fri, 16 Oct 2020 at 9:14 AM, Xiaoqiao He wrote: > >> Hi All, >> >> All issues targeted to 3.2.2 have been resolv

Re: Hadoop 3.2.2 Release Code Freeze Plan

Xiaoqiao He wrote: > Thanks to Wei-Chiu for your reminder, the dashboard and filters have been > updated. It is visible to the public now. > > Thanks, Regards. > > [1] > https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12335948 > > > On Fri, Oct 2, 2

Re: Hadoop 3.2.2 Release Code Freeze Plan

; Glad to see this is moving along. I noticed your dashboard has private > filters and therefore the results are not visible publicly. > > On Tue, Sep 29, 2020 at 10:02 PM Xiaoqiao He > wrote: > > > Hi All, > > > > Plan to code frozen for Hadoop-3.2.2 release at 2

Hadoop 3.2.2 Release Code Freeze Plan

Hi All, Plan to code frozen for Hadoop-3.2.2 release at 2020/10/15. From now on, most of the issues have been resolved. And there are two JIRA still open which target to 3.2.2 traced by [1]. * https://issues.apache.org/jira/browse/YARN-10244 * https://issues.apache.org/jira/browse/HADOOP-17287 P

Re: Skipping this week’s APAC Hadoop storage online meetup

Thanks Wei-Chiu for your reminder. Considering there is about 10 days vacation next month. We will plan to host the next APAC Hadoop storage online meetup at 2020/10/15 13:00. If any changes will inform in time. Thanks - He Xiaoqiao On Thu, Sep 24, 2020 at 1:10 AM Wei-Chiu Chuang wrote: > The

Re: [ANNOUNCE] Hui Fei is a new Apache Hadoop Committer

Congrats! Best Regards, He Xiaoqiao On Thu, Sep 24, 2020 at 10:03 AM Sammi Chen wrote: > Congratulations to Hui ! > > On Thu, Sep 24, 2020 at 2:07 AM Wei-Chiu Chuang > wrote: > > > I am pleased to announce that Hui Fei has accepted the invitation to > become > > a Hadoop committer. > > > > He

Re: [ANNOUNCE] Lisheng Sun is a new Apache Hadoop Committer

Congrats! Best Regards, He Xiaoqiao On Thu, Sep 24, 2020 at 9:08 AM Guanghao Zhang wrote: > Congratulations, Lisheng! >

Re: [DISCUSS] Hadoop 3.2.2 release

iao, > > Thanks for volunteering. > I could help to guide you through the process. > > Thanks, > Sunil > > On Thu, Sep 3, 2020 at 9:09 AM Xiaoqiao He wrote: > >> Thanks Wei-Chiu for initiating this. >> >> It's been nearly a year since Hadoop-3.2.1 release

Re: [DISCUSS] Hadoop 3.2.2 release

Thanks Wei-Chiu for initiating this. It's been nearly a year since Hadoop-3.2.1 released(2019 Sep 22). We have several important fixes landed in branch-3.2 (around 37 blockers/critical issues)[1]. There are also 3 blockers/critical pending issues and 3 other pending issues on 3.2.2[2]. I am will

Re: [VOTE] End of Life Hadoop 2.9

+1 On Tue, Sep 1, 2020 at 10:14 AM Ayush Saxena wrote: > +1 > > -Ayush > > > On 01-Sep-2020, at 7:23 AM, Akira Ajisaka wrote: > > > > +1 > > > > -Akira > > > >> On Tue, Sep 1, 2020 at 4:09 AM Wei-Chiu Chuang > wrote: > >> > >> Dear fellow Hadoop developers, > >> > >> Given the overwhelming fe

Re: [DISCUSS] fate of branch-2.9

+1 for putting 2.9 release lines to EOL. Thanks, Hexiaoqiao On Thu, Aug 27, 2020 at 3:14 PM Mingliang Liu wrote: > +1 for putting 2.9 lines to EOL. > > Let's focus on 2.10 releases for Hadoop 2. Also is there any plan for > 2.10.1? It has been 11 months since 2.10 first release. > > Thanks, > >

Re: Jenkins does not work for long time for HDFS sub-project

uple of weeks > back. > > This is the new link : > https://ci-hadoop.apache.org/job/PreCommit-HDFS-Build/ > > Give a check, if there is any problem there as well. > > -Ayush > > > On Fri, 21 Aug 2020 at 12:36, Xiaoqiao He wrote: > >> Hi all, >> >>

Jenkins does not work for long time for HDFS sub-project

Hi all, It seems that Jenkins does not work for over 20 days for the HDFS sub-project. And there is no entrance to start testing a patch manually[1]. Not sure If I missed something. Anyone who know if there are any issues? Thanks. Best Regards, He Xiaoqiao [1] https://builds.apache.org/job/PreCo

Re: [ANNOUNCE] New Apache Hadoop PMC member : Ayush Saxena

Congratulations Ayush! Regards, He Xiaoqiao On Thu, Jul 23, 2020 at 9:18 AM Sheng Liu wrote: > Congrats, and thanks for your help. > > Sree Vaddi 于2020年7月23日周四 上午3:59写道： > > > Congratulations, Ayush.Keep up the good work. > > > > > > Thank you./Sree > > > > > > > > On Wednesday, July 22, 2

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

hanks for bringing this to my attention. > > It's too rare to occur this scenario and a couple of releases went after > HDFS-4882(broken jira). > > So,You think it's fine to include in the next release? Or if you still > insist we can go for another RC... > > >

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

Thanks Brahma Reddy Battula for your great work here. Stephen fixed lease leak in namenode, and it is ready now: https://issues.apache.org/jira/browse/HDFS-14498. I think this affects 3.3.0-RC0. Would you check this? Sorry for reporting it so late. On Mon, Jul 13, 2020 at 2:53 PM Takanobu Asanuma

Re: [ANNOUNCE] New Apache Hadoop Committer - He Xiaoqiao

Thanks all! So glad to join the Hadoop committer family. Will continue to make contributions to the projects. Best Regards, He Xiaoqiao On Fri, Jun 12, 2020 at 3:04 PM Wangda Tan wrote: > Congrats! > > Best, > Wangda Tan > > On Thu, Jun 11, 2020 at 5:55 PM Tao Yang > wrote: > > > Congratulatio

Re: Client Caller Context Through Router(RBF)

Hi Ayush, Thank you for summary and re-launching this discussion. Both of JIRA's links are very helpful for pushing it forward. I would like to underline that this is a serious issue and very hope that we could get the solution here. As far as know, there are many users who deploy RBF meet this is

Re: [Hadoop-3.3 Release update]- branch-3.3 has created

Hi Brahma, Thanks for your great works here. About HDFS-12862 , I try to raise another JIRA (HDFS-15272) to track backport branch-3.1, close this one to decouple release progress. Thanks, Hexiaoqiao On Sun, Apr 12, 2020 at 2:49 AM Brahma Reddy Ba

Re: [ANNOUNCE] New Apache Hadoop Committer - Stephen O'Donnell

Congratulations Stephen! - Hexiaoqiao On Thu, Mar 5, 2020 at 11:08 AM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > Congratulations! > > Masatake Iwasaki > > > On 2020/03/04 5:11, Wei-Chiu Chuang wrote: > > In bcc: general@ > > > > It's my pleasure to announce that Stephen O'Donnell h

Re: [DISCUSS] Prefer Github PR Integration over patch in JIRA

Thanks Wei-Chiu for starting this discussion. +1 (non-binding) for turning code review to GitHub PR and keep other comments/discussions on JIRA. 1. In my experience, JIRA is better at tracking and recording information. 2. It is confused that no guide (`How to contribute`) about submit PR to JIRA

Re: Aug Hadoop Community Meetup in China

Thanks Junping for organizing the event. Looking forward to the coming meetup. BTW, It is hoped to keep running regular Hadoop Contributors Meetups in China. On Fri, Jul 19, 2019 at 12:35 AM Wanqiang Ji wrote: > Thanks for organize this event! > I always looking forward to meet folks in the com

Re: [ANNOUNCE] New Apache Hadoop Committer - Ayush Saxena

Congratulations, Ayush! - He Xiaoqiao On Mon, Jul 15, 2019 at 1:23 PM Vinayakumar B wrote: > In bcc: general@, please bcc: (and not cc:) general@ if you want to > include > > It's my pleasure to announce that Ayush Saxena has been elected as > committer > on the Apache Hadoop project recognisin

Re: [VOTE] Merge HDFS-13891(RBF) to trunk

> 1). > > https://lists.apache.org/thread.html/cdc2e084874b30bf6af2dd827bcbdba4ab8d3d983a8b9796e61608e6@%3Ccommon-dev.hadoop.apache.org%3E > > > On Wed, Jun 5, 2019 at 3:44 PM Xiaoqiao He wrote: > > > Thanks Brahma for starting the thread. > > +1 for merging. >

Re: [DISCUSS] Merge HDFS-13891(RBF) to trunk

Thanks Brahma for starting the thread. +1 for merging. He Xiaoqiao On Tue, Jun 4, 2019 at 1:53 PM Chittaranjan Hota wrote: > Thanks Brahma initiating this. > +1(non-binding) for merge. > > @Uber we have almost all changes specially rbf security in production for a > while now without issues. >

Re: [VOTE]: Support for RBF data locality Solution

; > On Thu, 11 Apr 2019, 12:23 pm Akira Ajisaka, wrote: > >> The Approach A looks good to me. >> >> Thanks, >> Akira >> >> On Thu, Apr 11, 2019 at 2:30 PM Xiaoqiao He wrote: >> > >> > Hi forks, >> > >> > The current imple

[VOTE]: Support for RBF data locality Solution

Hi forks, The current implementation of RBF is not sensitive about data locality, since NameNode could not get real client hostname by invoke Server#getRemoteAddress when RPC request forward by Router to NameNode. Therefore, it will lead to several challenges, for instance, - a. Client could h

<    1   2