Re: [Discuss] RBF: Aynchronous router RPC.

2024-06-05 Thread Xiaoqiao He
Hi @zhangjian <1361320...@qq.com> , the dev branch HDFS-17531 is ready now. FYI. Best Regards, - He Xiaoqiao On Tue, Jun 4, 2024 at 10:08 PM zhangjian <1361320...@qq.com> wrote: > Hi, Xiaoqiao He: > Can you help create a dev branch? I don't have the permission to create &

Re: [Discuss] RBF: Aynchronous router RPC.

2024-05-29 Thread Xiaoqiao He
> On Fri, May 24, 2024 at 1:57 AM zhangjian <1361320...@qq.com> wrote: > >>>>> Hello everyone, currently, I have tested the performance of async > and sync router for a downstream ns: > >>>>> 1. The throughput, CPU, and thread performance of the a

Re: [DISCUSS] pruning surplus branches/tags from the main hadoop repo

2024-05-29 Thread Xiaoqiao He
Strong +1. One concerns, how we define 'unnecessary branches', which mean how to distinguish the branches someone accidentally created, I try to traverse some of them but didn't get one obvious rule. Thanks. Best Regards, - He Xiaoqiao On Wed, May 29, 2024 at 10:11 PM Ayush Saxena wrote: >

[jira] [Resolved] (HADOOP-19156) ZooKeeper based state stores use different ZK address configs

2024-05-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19156. -- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > ZooKeeper ba

Re: [Discuss] RBF: Aynchronous router RPC.

2024-05-23 Thread Xiaoqiao He
gjin > > > > On Tue, May 21, 2024 at 5:13 AM zhangjian <1361320...@qq.com.invalid> > wrote: > > > >> Hi, xiaoqiao he, thank you for your reply. > >> > >> 1.Currently, the server and client protocols within router can be >

Re: [Discuss] RBF: Aynchronous router RPC.

2024-05-20 Thread Xiaoqiao He
Thanks for this great proposal! Some questions after reviewing the design doc (sorry didn't review PR carefully which is too large.) 1. This solution will involve RPC framework update, will it affect other modules and how to keep other modules off these changes. 2. Some RPC requests should be

[ANNOUNCE] New Hadoop Committer - Haiyang Hu

2024-04-21 Thread Xiaoqiao He
I am pleased to announce that Haiyang Hu has been elected as a committer on the Apache Hadoop project. We appreciate all of Haiyang's work, and look forward to her/his continued contributions. Congratulations and Welcome, Haiyang! Best Regards, - He Xiaoqiao (On behalf of the Apache Hadoop PMC)

[jira] [Resolved] (HADOOP-19060) Support hadoop client authentication through keytab configuration.

2024-03-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19060. -- Resolution: Won't Fix > Support hadoop client authentication through keytab configurat

[jira] [Resolved] (HADOOP-19111) ipc client print client info message duplicate

2024-03-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19111. -- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > ipc client pr

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-14 Thread Xiaoqiao He
ot 2739952 Sep 19 13:09 >> /usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 >> -rw-r--r-- 1 root root 4466856 Oct 27 13:40 >> /usr/lib/aarch64-linux-gnu/libcrypto.so.3 >> >> Anyone got any insights on how I should set up this (debian-based) OS >> here? >> I

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-11 Thread Xiaoqiao He
ified they are good. > > > > Oh, and I've also got my raspberry p5 doing the download of the arm > > stuff for its checknative; not expecting problems. > > > > So: i've got some stuff still ongoing, but the core changes to packaging > > are in and the rest I'm

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-11 Thread Xiaoqiao He
fixed in HADOOP-19057 > <https://issues.apache.org/jira/browse/HADOOP-19057>. > > -- > *From:* slfan1989 > *Sent:* Monday, March 4, 2024 10:07:05 PM > *To:* Hadoop Common; Hdfs-dev; yarn-dev; mapreduce-dev; < > priv...@hadoop.apache.org>

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-06 Thread Xiaoqiao He
cc @Chao Sun @zhang...@apache.org @Ayush Saxena Would you mind helping to check the upstream systems(Spark, HBase, Hive) dependency with the new hadoop release version if necessary? Thanks. Best Regards, - He Xiaoqiao On Thu, Mar 7, 2024 at 10:23 AM Xiaoqiao He wrote: > Shilun, Tha

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

2024-03-06 Thread Xiaoqiao He
Shilun, Thanks for your great work. I am checking but not finished yet. Will confirm once done. Best Regards, - He Xiaoqiao On Thu, Mar 7, 2024 at 7:23 AM slfan1989 wrote: > @Xiaoqiao He @Ayush Saxena > @Steve > Loughran @Mukund Madhav Thakur > @Takanobu > Asanuma @M

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC2)

2024-02-29 Thread Xiaoqiao He
with it; this caught some >>> problems >>> > >> with exported slf4j and log4j2 artifacts getting into the >>> classpath. That >>> > >> is: hadoop-common pulling in log4j 1.2 and 2.x bindings. >>> > >> >>> > >>

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

2024-02-05 Thread Xiaoqiao He
cc @PJ Fanning @Ayush Saxena @Steve Loughran @Takanobu Asanuma @Shuyan Zhang @inigo...@apache.org On Mon, Feb 5, 2024 at 11:30 AM Xiaoqiao He wrote: > +1(binding). > > I checked the following items: > - [X] Download links are valid. > - [X] Checksums and PGP signatures ar

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

2024-02-04 Thread Xiaoqiao He
at 10:29 PM slfan1989 wrote: > Hi folks, > > Xiaoqiao He and I have put together a release candidate (RC1) for Hadoop > Thirdparty 1.2.0. > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.2.0-RC1 > > The RC tag is > ht

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

2024-02-01 Thread Xiaoqiao He
ds, > Shilun Fan. > > On Tue, Jan 30, 2024 at 6:20 PM Xiaoqiao He wrote: > > > Thanks Shilun for driving it and making it happen. > > > > +1(binding). > > > > [x] Checksums and PGP signatures are valid. > > [x] LICENSE files exist. > > [x] NOTICE

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

2024-01-31 Thread Xiaoqiao He
gt; > Best Regards, > > Shilun Fan. > > > > On Tue, Jan 30, 2024 at 6:20 PM Xiaoqiao He > wrote: > > > > > Thanks Shilun for driving it and making it happen. > > > > > > +1(binding). > > > > > > [x] Checksums and PGP sig

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

2024-01-30 Thread Xiaoqiao He
wrote: > Hi folks, > > Xiaoqiao He and I have put together a release candidate (RC0) for Hadoop > Thirdparty 1.2.0. > > The RC is available at: > https://dist.apache.org/repos/dist/dev/hadoop/hadoop-thirdparty-1.2.0-RC0 > > The RC tag is > https://github.com/apache/

Re: [INFO] Hadoop-3.4 Release Update

2024-01-24 Thread Xiaoqiao He
; On Mon, 22 Jan 2024 at 11:50 AM, slfan1989 wrote: > > > >> Thank you very much for specifying the frozen time for the > >> Branch-3.4.0. @Xiaoqiao > >> He > >> > >> If there is a need to backport any PRs to branch-3.4/branch-3.4.0, > please &

Re: [INFO] Hadoop-3.4 Release Update

2024-01-21 Thread Xiaoqiao He
gt; > Best > > On Mon, Jan 22, 2024 at 10:38 AM Xiaoqiao He > wrote: > >> Thanks all for your input. Connected to Shilun offline yesterday, and he >> will >> update or recover the fix version tag before 3.4.0-RC1. >> >> Best Regards, >> - He Xiao

Re: [INFO] Hadoop-3.4 Release Update

2024-01-21 Thread Xiaoqiao He
se versions have been released, > remove > > > the 3.4.0 entry from the fix version. > > > > > > 3. For JIRA issues with target version set to 3.4.0, fix version set to > > > 3.4.0, and status set to > > > RESOLVED, if Affects Ve

[INFO] Hadoop-3.4 Release Update

2024-01-18 Thread Xiaoqiao He
Hi All, Branch trunk has been set to 3.5.0-SNAPSHOT and branch-3.4 is created[1]. Please set the proper fix version while committing jira, 3.5.0 should be priority. If there is any blocker/critical please also backport to branch-3.4 or sync to me or RM Shilun Fan. Shilun will start 3.4.0 RC1

Re: [VOTE] Release Apache Hadoop 3.4.0 RC0

2024-01-16 Thread Xiaoqiao He
Hi Shilun, Thanks for your great work! Compare branch-3.4 and branch-3.4.0, I found that commit [1] is only checked in branch-3.4.0 but not branch-3.4. Please double check if we need to backport branch-3.4. Moreover, before 3.4.0 release we should cherry-pick from trunk to branch-3.4 first if

[jira] [Resolved] (HADOOP-19031) Enhance access control for RunJar

2024-01-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19031. -- Fix Version/s: 3.4.0 3.5.0 Hadoop Flags: Reviewed Resolution

[jira] [Resolved] (HADOOP-19034) Fix Download Maven Url Not Found

2024-01-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-19034. -- Fix Version/s: 3.4.0 3.5.0 Hadoop Flags: Reviewed Resolution

[jira] [Created] (HADOOP-19031) Enhance access control for RunJar

2024-01-09 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-19031: Summary: Enhance access control for RunJar Key: HADOOP-19031 URL: https://issues.apache.org/jira/browse/HADOOP-19031 Project: Hadoop Common Issue Type

Re: [DISCUSS] Release Hadoop 3.4.0

2024-01-03 Thread Xiaoqiao He
> > I think the release discussion can be in public ML? Good idea. cc common-dev/hdfs-dev/yarn-dev/mapreduce-dev ML. Best Regards, - He Xiaoqiao On Tue, Jan 2, 2024 at 6:18 AM Ayush Saxena wrote: > +1 from me as well. > > We should definitely attempt to upgrade the thirdparty version for >

Re: [VOTE] Hadoop 3.2.x EOL

2023-12-21 Thread Xiaoqiao He
Hi All, JIRA/WIKI/Website has been updated. Release line 3.2 is EOL now. Thanks all. Best Regards, - He Xiaoqiao On Tue, Dec 19, 2023 at 11:58 AM Xiaoqiao He wrote: > This vote passed with 10 +1. I'll update the JIRA, WIKI and website for a > while. > > Thanks all for your p

Re: [DISCUSS][HDFS] Add rust binding for libhdfs

2023-12-20 Thread Xiaoqiao He
Thanks Xuanwo for your work. I believe it is valuable to enlarge hadoop ecosystem. I am also concerned that it will involve more hard work to release and version match, especially for one who is not familiar with C or Rust. Moreover, I am not aware the difference between `accept hdfs-sys as part

Re: [VOTE] Hadoop 3.2.x EOL

2023-12-18 Thread Xiaoqiao He
t; On Wed, Dec 6, 2023 at 8:39 AM Akira Ajisaka wrote: >> > >> > +1 >> > >> > >> > >> > On Wed, Dec 6, 2023 at 1:10 PM Xiaoqiao He wrote: >> > >> > > Dear Hadoop devs, >> > > >> > > Given the feedb

[jira] [Resolved] (HADOOP-18982) Fix doc about loading native libraries

2023-12-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18982. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix doc ab

[VOTE] Hadoop 3.2.x EOL

2023-12-05 Thread Xiaoqiao He
Dear Hadoop devs, Given the feedback from the discussion thread [1], I'd like to start an official thread for the community to vote on release line 3.2 EOL. It will include, a. An official announcement informs no further regular Hadoop 3.2.x releases. b. Issues which target 3.2.5 will not be

Re: [DISCUSS] Make some release lines EOL

2023-12-05 Thread Xiaoqiao He
here's a clear story: we have a > > new 3.4.x line stabilising, if you want something already stable move > onto > > 3.3.x if you hadn't already > > > > > > > > > > > > On Mon, 4 Dec 2023 at 12:39, Xiaoqiao He wrote: > > > > > Hi folk

Re: [DISCUSS] Make some release lines EOL

2023-12-04 Thread Xiaoqiao He
> > -Ayush > > On Mon, 4 Dec 2023 at 18:09, Xiaoqiao He wrote: > > > > Hi folks, > > > > There are many discussions about which release lines should we still > > consider actively > > maintained in history. I want to launch this topic again, and

[DISCUSS] Make some release lines EOL

2023-12-04 Thread Xiaoqiao He
Hi folks, There are many discussions about which release lines should we still consider actively maintained in history. I want to launch this topic again, and try to get a consensus. >From download page[1] and active branches page[2], we have the following release lines: Hadoop 3.3 Release

Re: [DISCUSS] Hadoop 3.4.0 release

2023-12-03 Thread Xiaoqiao He
Thanks Ahmar for starting this thread. Strong +1 to have 3.4.0 from trunk rather than from 3.3.*. We should keep release line clear, and it's not standard operation to cut a branch from another line. Let's move the trunk to 3.5.0-SNAPSHOT when we come to an agreement at this thread. About this

[ANNOUNCE] New Hadoop PMC Member - Shilun Fan

2023-10-31 Thread Xiaoqiao He
On behalf of the Apache Hadoop PMC, I am pleased to announce that Shilun Fan(slfan1989) has accepted the PMC's invitation to become PMC member on the project. We appreciate all of Shilun's generous contributions thus far and look forward to his continued involvement. Congratulations and welcome,

[jira] [Resolved] (HADOOP-18943) Fix trademark description issue of Apache on website

2023-10-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18943. -- Hadoop Flags: Reviewed Resolution: Fixed > Fix trademark description issue of Apa

[jira] [Created] (HADOOP-18943) Fix trademark description issue of Apache on website

2023-10-18 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18943: Summary: Fix trademark description issue of Apache on website Key: HADOOP-18943 URL: https://issues.apache.org/jira/browse/HADOOP-18943 Project: Hadoop Common

[ANNOUNCE] New Hadoop Committer - Shuyan Zhang

2023-09-26 Thread Xiaoqiao He
I am pleased to announce that Shuyan Zhang has been elected as a committer on the Apache Hadoop project. We appreciate all of Shuyan's work, and look forward to her/his continued contributions. Congratulations and Welcome, Shuyan! Best Regards, - He Xiaoqiao (On behalf of the Apache Hadoop PMC)

[jira] [Resolved] (HADOOP-18906) Increase default batch size of ZKDTSM token seqnum to reduce overflow speed of zonde dataVersion.

2023-09-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18906. -- Fix Version/s: 3.4.0 3.3.9 Hadoop Flags: Reviewed Resolution

[jira] [Created] (HADOOP-18906) Increase default batch size of ZKDTSM token seqnum to reduce overflow speed of zonde dataVersion.

2023-09-17 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18906: Summary: Increase default batch size of ZKDTSM token seqnum to reduce overflow speed of zonde dataVersion. Key: HADOOP-18906 URL: https://issues.apache.org/jira/browse/HADOOP

[jira] [Resolved] (HADOOP-18851) Performance improvement for DelegationTokenSecretManager.

2023-09-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18851. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Performa

[jira] [Created] (HADOOP-18881) ZKDTSM could be stuck when meet znode version overflow

2023-09-03 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18881: Summary: ZKDTSM could be stuck when meet znode version overflow Key: HADOOP-18881 URL: https://issues.apache.org/jira/browse/HADOOP-18881 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18840) Add enQueue time to RpcMetrics

2023-08-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18840. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add enQueue t

[jira] [Resolved] (HADOOP-18801) Delete path directly when it can not be parsed in trash

2023-07-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18801. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Delete p

[jira] [Resolved] (HADOOP-18789) Remove ozone from hadoop dev support

2023-07-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18789. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Remove oz

[jira] [Created] (HADOOP-18789) Remove ozone from hadoop dev support

2023-06-30 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18789: Summary: Remove ozone from hadoop dev support Key: HADOOP-18789 URL: https://issues.apache.org/jira/browse/HADOOP-18789 Project: Hadoop Common Issue Type

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-23 Thread Xiaoqiao He
+1(binding) * Verified signature and checksum of all source tarballs. * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example mr

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-21 Thread Xiaoqiao He
Addendum: A. Build the release from sources using: `mvn clean install package -DskipTests=true -Dmaven.javadoc.skip=true` B. It works well when using the same command to build from the source branch trunk. On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He wrote: > Hi, > > I met a fatal e

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

2023-06-21 Thread Xiaoqiao He
Hi, I met a fatal error when building from source on local Mac OSX. It could reproduce stably. Not sure if it is related to my local environment. Try to dig it, but not any conclusion right now. Will feedback once find reasons. Appendix system environment, some more stack information refer to

[jira] [Resolved] (HADOOP-18774) Add .vscode to gitignore

2023-06-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18774. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add .vsc

[jira] [Created] (HADOOP-18774) Add .vscode to gitignore

2023-06-17 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18774: Summary: Add .vscode to gitignore Key: HADOOP-18774 URL: https://issues.apache.org/jira/browse/HADOOP-18774 Project: Hadoop Common Issue Type: Improvement

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

2023-06-17 Thread Xiaoqiao He
Thanks Wei-Chiu for driving this release. The next RC will be prepared, right? If true, I would like to try and vote on the next RC. Just notice that some JIRAs are not included and need to revert some PRs to pass HBase verification which are mentioned above. Best Regards, - He Xiaoqiao On Fri,

Re: [DISCUSS] Hadoop 3.3.6 release planning

2023-05-04 Thread Xiaoqiao He
Thanks Wei-Chiu for driving this release. Cherry-pick YARN-11482 to branch-3.3 and mark 3.3.6 as the fixed version. so far only 8 jiras were resolved in the branch-3.3 line. If we should consider both 3.3.6 and 3.3.9 (which is from release-3.3.5 discuss)[1] for this release line? I try to query

[jira] [Resolved] (HADOOP-18644) Add bswap support for LoongArch

2023-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18644. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add bs

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-20 Thread Xiaoqiao He
+1 * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm (include EC) and check the result. * Run

[jira] [Resolved] (HADOOP-18497) Upgrade commons-text version to fix CVE-2022-42889

2022-10-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18497. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Assignee: PJ Fanning

[jira] [Resolved] (HADOOP-18492) upgrade commons-text to 1.10.0

2022-10-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18492. -- Resolution: Duplicate > upgrade commons-text to 1.1

[jira] [Resolved] (HADOOP-18462) InstrumentedWriteLock should consider Reentrant case

2022-10-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18462. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Created] (HADOOP-18497) Upgrade commons-text version to fix CVE-2022-42889

2022-10-16 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18497: Summary: Upgrade commons-text version to fix CVE-2022-42889 Key: HADOOP-18497 URL: https://issues.apache.org/jira/browse/HADOOP-18497 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18426) Improve the accuracy of MutableStat mean

2022-09-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18426. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Impr

[jira] [Resolved] (HADOOP-18364) All method metrics related to the RPC protocol should be initialized

2022-08-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18364. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk

Hadoop community online meetup (Mandarin)

2022-06-20 Thread Xiaoqiao He
Hi Hadoop folks, We am happy to inform you that we will have Dongfa Huang from ByteDance who is going to talk about their experience of extending NameNode of HDFS at ByteDance. This will be a Mandarin talk. Time/Date: 2022/06/22 10PM (US West Coast PST) 2022/06/23 1PM (Beijing, China CST) Join

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

2022-05-15 Thread Xiaoqiao He
+1(binding) * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example

Re: [DISCUSS] Hadoop 2.10.2 release

2022-05-11 Thread Xiaoqiao He
Thanks Masatake and Akira for bringing this release up. +1 for 2.10.2 release. Sorry for the late response. Regards, - He Xiaoqiao On Mon, Mar 14, 2022 at 1:17 PM Akira Ajisaka wrote: > > Thank you Masatake. > > +1 to release 2.10.2. > > On Fri, Mar 4, 2022 at 6:52 PM Masatake Iwasaki >

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1

2022-03-20 Thread Xiaoqiao He
+1(binding) * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm and check the result. * Run example

Re: Hadoop-3.2.3 Release Update

2022-03-11 Thread Xiaoqiao He
just for reload4j migration if we > need. > https://issues.apache.org/jira/browse/HADOOP-18088 > > Thanks, > Masatake Iwasaki > > On 2022/03/10 12:23, Xiaoqiao He wrote: > > Thanks Masatake for reaching out. > > > > Not sure if Brahma has bandwidth to pu

Re: Hadoop-3.2.3 Release Update

2022-03-09 Thread Xiaoqiao He
t; > >>> I am evaluating the CVE’s which needs to go for this release.. > >>> > >>> Will update soon!! > >>> > >>> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka > >> wrote: > >>> > >>>> Hi Brahm

Re: [ANNOUNCE] New Hadoop PMC Sun Chao

2022-03-08 Thread Xiaoqiao He
Congratulations, Sun Chao! Best Regards, - He Xiaoqiao On Wed, Mar 9, 2022 at 1:06 PM tom lee wrote: > Congratulations, Sun! > > Wei-Chiu Chuang 于2022年3月9日周三 11:47写道: > > > On behalf of the Apache Hadoop PMC, I am pleased to announce that Sun > > Chao(sunchao) has accepted the PMC's

Re: [ANNOUNCE] Apache Hadoop 3.3.2 release

2022-03-06 Thread Xiaoqiao He
t and 3.3.2 showed up in the list under the > > "Documentation" tab. > > > > In https://hadoop.apache.org, under the "Documentation" tab, the > > "Latest" and "Stable" are already updated to 3.3.2, but somehow the > > announcement is not

Re: [ANNOUNCE] Apache Hadoop 3.3.2 release

2022-03-05 Thread Xiaoqiao He
release, and everyone in > the > > Apache Hadoop community! This release is a direct result of your great > > contributions. > > > > Many thanks to everyone who helped in this release process! > > > > Many thanks to Viraj Jasani, Michael Stack, Masatake Iwasaki, Xiaoqiao > He, > > Mukund Madhav Thakur, Wei-Chiu Chuang, Steve Loughran, Akira Ajisaka and > > other folks who helped for this release process. > > > > Best Regards, > > Chao > > >

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC5

2022-02-23 Thread Xiaoqiao He
+1(binding) * Built on CentOS 8 and OpenJDK 8 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar` from source. * Verified signature and checksums. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm. * Submit example mr applications and check the result - Pi

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4

2022-02-21 Thread Xiaoqiao He
Thanks Chao for your great work and thanks Viraj's careful checks here. After checking to build from source and setting up a pseudo cluster based on the RC4, it seems that it is almost ready for release-3.3.2 beside update changelog, right? Please feel free to share information if you meet any

Re: Hadoop-3.2.3 Release Update

2021-09-22 Thread Xiaoqiao He
fine. FYI. Regards, - He Xiaoqiao On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula wrote: > Please go ahead. Let me know any help required on review. > > On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He wrote: > >> Hi Brahma, >> >> I plan to involve HDFS-14997 an

Re: Hadoop-3.2.3 Release Update

2021-09-14 Thread Xiaoqiao He
. Best Regards, - He Xiaoqiao On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He wrote: > Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI. > > On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula > wrote: > >> Hi All, >> >> Waiting for the fol

Re: Hadoop-3.2.3 Release Update

2021-09-14 Thread Xiaoqiao He
>>> In these patches, how about backporting the following issues to > >> >>> branch-3.2 and branch-3.2.3? > >> >>> - HADOOP-14922 > >> >>> - HADOOP-15939 > >> >>> - HADOOP-17569 > >> >>> > >> &

Re: [DISCUSS] Hadoop 3.3.2 release?

2021-09-08 Thread Xiaoqiao He
+1, Thanks Chao for bringing this up. - He Xiaoqiao On Thu, Sep 9, 2021 at 8:32 AM tom lee wrote: > +1 (non-binding) > > Ayush Saxena 于2021年9月9日周四 上午1:12写道: > > > +1, > > Thanx Chao for volunteering!!! > > > > > On 07-Sep-2021, at 10:36 PM, Chao Sun wrote: > > > > > > Hi all, > > > > > > It

Re: Hadoop-3.2.3 Release Update

2021-08-10 Thread Xiaoqiao He
Thanks Brahma for initiating this and making hadoop-3.2.3 release happen. I would like to validate the HBase project (both the latest release and trunk branch). Chao Sun will validate the Spark Project (Got in touch with Chao already). once RC is out. Thanks and Regards, - He Xiaoqiao On Tue,

Re: [DISCUSS] Hadoop 3.2.3 release

2021-07-28 Thread Xiaoqiao He
cc @dev mail-list. On Wed, Jul 28, 2021 at 5:11 PM Xiaoqiao He wrote: > Hi Brahma, > > I just created version 3.2.4, and changed all unresolved issues (target > version/s: 3.2.3) to 3.2.4 after checking both of them are not blocker > issues. Dashboard[1] is clean now. >

Re: [DISCUSS] Hadoop 3.2.3 release

2021-07-25 Thread Xiaoqiao He
Thanks Brahma for volunteering and driving this release plan. I just created a dashboard for 3.2.3 release[1]. I would like to support for this release line if need. (cc Brahma) Thanks. Regards, - He Xiaoqiao [1] https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12336167 On

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-15 Thread Xiaoqiao He
+0. - Built successfully from tag release-3.3.1-RC3 on Ubuntu 20.04 - Verified signature and checksum - Deployed pseudo-distributed cluster with 3 nodes - Ran basic HDFS shell commands and sample MR Jobs, it worked well. - Browsed NN/DN/RM/NM UI. *YARN UI2 DOES NOT work from my side.* NOTE:

Re: [VOTE] Hadoop 3.1.x EOL

2021-06-03 Thread Xiaoqiao He
+1 On Thu, Jun 3, 2021 at 4:18 PM Bharat Viswanadham wrote: > +1 > > Thanks, > Bharat > > > On Thu, Jun 3, 2021 at 1:00 PM Viraj Jasani wrote: > > > +1 (non-binding) > > > > On Thu, 3 Jun 2021 at 12:21 PM, Wei-Chiu Chuang > > wrote: > > > > > +1 > > > > > > On Thu, Jun 3, 2021 at 2:14 PM

Re: [VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

2021-05-27 Thread Xiaoqiao He
p in > the thirdparty 1 1 1. > > On Fri, May 28, 2021 at 11:23 AM Xiaoqiao He > wrote: > >> +1 >> >> - Verified checksums and signatures. >> - Checked CHANGELOG / RELEASE NOTES. >> - Built from source with jdk1.8.0_202. >> - Built Hadoop trunk with

Re: [VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

2021-05-27 Thread Xiaoqiao He
+1 - Verified checksums and signatures. - Checked CHANGELOG / RELEASE NOTES. - Built from source with jdk1.8.0_202. - Built Hadoop trunk with hadoop-thirdparty 1.1.1 and checked with pseudo distribution hadoop cluster deployment. Thanks Wei-Chiu for your work on this. I am confused about the

Re: [DISCUSS] which release lines should we still consider actively maintained?

2021-05-23 Thread Xiaoqiao He
Thanks Sean and Akira for discussion here. > As you commented, the confluence wiki pages for Hadoop releases were out of date. Updated [1]. Just update Roadmap[1] for 3.2.2 and updated/added issues collections for 3.2.3[2] which will be useful if you are interested in becoming a release manager

Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-05-19 Thread Xiaoqiao He
+1 for <= 100 chars long per line length. On Thu, May 20, 2021 at 10:28 AM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > I'm +1 too. > I feel 80 characters limit tends to degrade readability by introducing > useless line breaks. > > > >

Re: [VOTE] hadoop-thirdparty 1.1.0-RC0

2021-05-16 Thread Xiaoqiao He
+1 - Verified checksums and signatures. - Checked CHANGELOG / RELEASE NOTES. - Built from source with jdk1.8.0_202. - Built Hadoop trunk with hadoop-thirdparty 1.1.0 and checked with pseudo distribution hadoop cluster deployment. Thanks, - He Xiaoqiao On Fri, May 14, 2021 at 6:16 PM Viraj

Re: Hadoop Jenkins account

2021-04-26 Thread Xiaoqiao He
Hi Wei-Chiu, Please add me as well, Thanks. - He Xiaoqiao On Mon, Apr 26, 2021 at 7:34 PM Ayush Saxena wrote: > Hey Wei-Chiu, > I would be interested > -Ayush > > > On 26-Apr-2021, at 4:56 PM, Wei-Chiu Chuang wrote: > > > > If you're a committer and you're interested in getting involved in

[jira] [Reopened] (HADOOP-16947) Stale record should be remove when MutableRollingAverages generating aggregate data.

2021-01-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reopened HADOOP-16947: -- > Stale record should be remove when MutableRollingAverages generating > aggregat

[ANNOUNCE] Apache Hadoop 3.2.2 release

2021-01-15 Thread Xiaoqiao He
Hi All, It gives me great pleasure to announce that the Apache Hadoop community has voted to release Apache Hadoop 3.2.2. Apache Hadoop 3.2.2 includes 516 fixes since the previous Hadoop 3.2.1 release. * For major changes included in Hadoop 3.2.2, please refer to Hadoop 3.2.2 main page [1]. *

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC5

2021-01-08 Thread Xiaoqiao He
Hi folks, The vote[1] passed with 4 binging +1's and 4 non-binding +1's.[2] Thanks all for pushing this. I'm going to publish the release. binding +1's: - Akira Ajisaka - Wei-Chiu Chuang - Masatake Iwasaki - Sunil Govindan non-binding +1's: - Xiaoqiao He - Hui Fei - Lisheng Sun - Chao Sun

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2021-01-03 Thread Xiaoqiao He
l, - He Xiaoqiao [1] https://lists.apache.org/thread.html/r6c2817770e99362da79ebfaa0b6a774c5fca0f31e0dcc24df398eda0%40%3Chdfs-dev.hadoop.apache.org%3E On Thu, Dec 24, 2020 at 11:30 AM Xiaoqiao He wrote: > Thanks Sunil, it makes sense to me. Will backport and prepare another RC > shortly. > > - He Xiaoqiao > &

[VOTE] Release Apache Hadoop 3.2.2 - RC5

2021-01-03 Thread Xiaoqiao He
Hi folks, The release candidate (RC5) for Hadoop-3.2.2 is available now. There are 4 commits[1] differences between RC5 and RC4[2]. The RC5 is available at: http://people.apache.org/~hexiaoqiao/hadoop-3.2.2-RC5 The RC5 tag in github is here:

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

2021-01-03 Thread Xiaoqiao He
Hi Konstantin and Steve, HDFS-15751 has committed to related branches including 3.2.2. I will prepare 3.2.2-RC shortly. Please let me know if any other issues for doc or deployment do you meet. Thanks. - He Xiaoqiao On Wed, Dec 30, 2020 at 6:40 PM Xiaoqiao He wrote: > Hi Steve and C

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

2020-12-30 Thread Xiaoqiao He
Hi Steve and Chao, Konstatin has updated HDFS-15751 and attached patch for documentation msync API, Would you mind to TAL. I want to involve this update to 3.2.2 release, but for now it seems there are not enough committers to review. Please check when you have bandwidth. Thanks all. - He

[jira] [Created] (HADOOP-17445) Update the year to 2021 for 3.2.2-RC

2020-12-23 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-17445: Summary: Update the year to 2021 for 3.2.2-RC Key: HADOOP-17445 URL: https://issues.apache.org/jira/browse/HADOOP-17445 Project: Hadoop Common Issue Type

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-23 Thread Xiaoqiao He
> I feel that we can call a new RC as YARN-10540 is backported already. > > Thanks > Sunil > > On Wed, Dec 23, 2020 at 3:54 PM Xiaoqiao He wrote: > > > Thanks Jim, Eric and Sunil, > > > > I tried to backport YARN-10540 to branch-3.2.2 at local and check yarn >

  1   2   >