I found that INFO level log message is emitted on every CLI invocation.
$ bin/hdfs dfs -mkdir /tmp
2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for
dfs.client.datanode-restart.timeout(30) assuming SECONDS
The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
There seems to be no quick fix though it is noisy.
HDFS-14630 is the fix for this.
I will backport this to branch-3.2.3 if I need to cut RC1.
On 2022/03/18 0:54, Masatake Iwasaki wrote:
+1 from myself.
* built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install
-DskipTests -Pnative -Pdist`.
* launched pseudo distributed cluster.
* ran some MR example jobs.
* launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop
and ran some tutorial code.
* launched pseudo distributed cluster with Kerberos security enabled.
* launched KMS and created encryption zone.
* ran sample MR wordcount job over encryption zone.
* launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
* built site documentation by `mvn site site:stage` and skimmed the contents.
* built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
https://issues.apache.org/jira/browse/BIGTOP-3606
I found that INFO level log message is emitted on every CLI invocation.
$ bin/hdfs dfs -mkdir /tmp
2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for
dfs.client.datanode-restart.timeout(30) assuming SECONDS
The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
There seems to be no quick fix though it is noisy.
Masatake Iwasaki
On 2022/03/16 18:36, Viraj Jasani wrote:
+1 (non-binding)
Using hadoop-vote.sh
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_301): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_301): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_301): ok
- mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed
cluster (1M rows ingested), all good.
Test PR to run full build and track UT failures
https://github.com/apache/hadoop/pull/4073
<https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are
passing locally.
On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasak...@oss.nttdata.co.jp
<mailto:iwasak...@oss.nttdata.co.jp>> wrote:
Hi all,
Here's Hadoop 3.2.3 release candidate #0:
The RC is available at:
https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
<https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
<https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
The Maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1339
<https://repository.apache.org/content/repositories/orgapachehadoop-1339>
You can find my public key at:
https://downloads.apache.org/hadoop/common/KEYS
<https://downloads.apache.org/hadoop/common/KEYS>
Please evaluate the RC and vote.
Thanks,
Masatake Iwasaki
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
<mailto:hdfs-dev-unsubscr...@hadoop.apache.org>
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
<mailto:hdfs-dev-h...@hadoop.apache.org>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
