Re: [DISCUSS] Migrate hadoop from log4j1 to log4j2

2022-01-20 Thread Duo Zhang
t; wrote: > > > > Reload4J has fixed all of those CVEs without requiring an upgrade. > > > >> On Jan 20, 2022, at 5:56 AM, Duo Zhang wrote: > >> > >> There are 3 new CVEs for log4j1 reported recently[1][2][3]. So I think > it > >> is time t

Re: [DISCUSS] Migrate hadoop from log4j1 to log4j2

2022-01-20 Thread Duo Zhang
trics come to mind. There may be others. > > Thanks, > Arpit > > > > On Jan 20, 2022, at 5:55 AM, Duo Zhang wrote: > > > > There are 3 new CVEs for log4j1 reported recently[1][2][3]. So I think it > > is time to speed up the migration to log4j2 work[4] now. >

[DISCUSS] Migrate hadoop from log4j1 to log4j2

2022-01-20 Thread Duo Zhang
There are 3 new CVEs for log4j1 reported recently[1][2][3]. So I think it is time to speed up the migration to log4j2 work[4] now. You can see the discussion on the jira issue[4], our goal is to fully migrate to log4j2 and the current most blocking issue is lack of the "log4j.rootLogger=INFO,Conso

Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-05-19 Thread Duo Zhang
+1 for 100 instead of 80. I can see that some projects have already changed to 120. Akira Ajisaka 于2021年5月20日周四 上午10:01写道: > I'm +1 to allow <= 100 chars. > > FYI: There were some discussions long before: > - > https://lists.apache.org/thread.html/7813c2f8a49b1d1e7655dad180f2d915a280b2f4d562cfe

Re: Status of Hadoop 2.9.x

2019-12-26 Thread Duo Zhang
Yes, HBase is proposing to bump hadoop versions for new release lines, so we want to know which release lines are still alive for hadoop. Thanks. Wei-Chiu Chuang 于2019年12月26日周四 下午6:59写道: > Hi! > > Duo found out that the last 2.9.x release, 2.9.2 was GA in Nov 2018, which > is a little more than

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Duo Zhang
+1 Akira Ajisaka 于2019年10月24日周四 下午3:21写道: > Hi folks, > > Both Ozone and Apache Submarine have separate repositories. > Can we remove these modules from hadoop-trunk? > > Regards, > Akira >

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

2019-09-27 Thread Duo Zhang
For HBase we have a separated repo for hbase-thirdparty https://github.com/apache/hbase-thirdparty We will publish the artifacts to nexus so we do not need to include binaries in our git repo, just add a dependency in the pom. https://mvnrepository.com/artifact/org.apache.hbase.thirdparty/hbase-

Re: [NOTICE] Building trunk needs protoc 3.7.1

2019-09-23 Thread Duo Zhang
The new protobuf plugin related issues have all been pushed to trunk(though I think we'd better port them to all active branches). So what's the next step? Shade and relocated protobuf? HBase has already done this before so I do not think it will take too much time. If we all agree on the solution

Re: [NOTICE] Building trunk needs protoc 3.7.1

2019-09-20 Thread Duo Zhang
I think this one is alread in place so we have to upgrade... https://issues.apache.org/jira/browse/HADOOP-16557 Wangda Tan 于2019年9月21日周六 上午7:19写道: > Hi Vinay, > > A bit confused, I saw the HADOOP-13363 is still pending. Do we need to > upgrade protobuf version to 3.7.1 NOW or once HADOOP-13363

Re: [NOTICE] Building trunk needs protoc 3.7.1

2019-09-20 Thread Duo Zhang
As suggested before, please consider switching to maven protobuf plugin first before upgrading the protobuf dependency. https://www.xolstice.org/protobuf-maven-plugin/examples/protoc-artifact.html This plugin will download the protoc binary automatically so we do not need to have developers inst

Re: [DISCUSS] GitHub PRs without JIRA number

2019-09-10 Thread Duo Zhang
OK, the indexing is finished [Tue Sep 10 14:25:07 UTC 2019] Finished branch indexing. Indexing took 15 min So maybe 30 minutes is better... And we really should cleanup the stale PRs and branches... 张铎(Duo Zhang) 于2019年9月10日周二 下午10:20写道: > Actually the job for testing PR is here... > &

Re: [DISCUSS] GitHub PRs without JIRA number

2019-09-10 Thread Duo Zhang
nterval, maybe 20 or 30 minutes? Thanks. Steve Loughran 于2019年9月10日周二 下午7:36写道: > > > On Tue, Sep 10, 2019 at 9:07 AM 张铎(Duo Zhang) > wrote: > >> Nits: You can change the jenkins job config to not trigger pre commit >> build >> for stale PRs if only the base branc

Re: [DISCUSS] GitHub PRs without JIRA number

2019-09-10 Thread Duo Zhang
Nits: You can change the jenkins job config to not trigger pre commit build for stale PRs if only the base branch is changed. By default, either the PR itself changed, or the base branch is changed, the branch sources plugin will both trigger a build. You can add a Change requests option, and selec

Re: [DISCUSS] ARM/aarch64 support for Hadoop

2019-09-04 Thread Duo Zhang
d, Sep 4, 2019 at 4:39 PM Ayush Saxena wrote: > >> Thanx Vinay for the initiative, Makes sense to add support for different >> architectures. >> >> +1, for the branch idea. >> Good Luck!!! >> >> -Ayush >> >> > On 03-Sep-2019, at 6:19 AM, 张铎(D

Re: [DISCUSS] ARM/aarch64 support for Hadoop

2019-09-02 Thread Duo Zhang
For HBase, we purged all the protobuf related things from the public API, and then upgraded to a shaded and relocated version of protobuf. We have created a repo for this: https://github.com/apache/hbase-thirdparty But since the hadoop dependencies still pull in the protobuf 2.5 jars, our coproce

Re: [DISCUSS] EOL 2.8 or another 2.8.x release?

2019-07-25 Thread Duo Zhang
IIRC we have a 2.8.5 release? On the download page: 2.8.5 2018 Sep 15 Wei-Chiu Chuang 于2019年7月25日周四 上午9:39写道: > The last 2.8 release (2.8.4) was made in the last May, more than a year > ago. https://hadoop.apache.org/old/releases.html > > How do folks feel about the fate of branch-2.8? During