Re: Discussion about NameNode Fine-grained locking

Thanks for driving this. It's very meaningful. The performance improvement looks very good. Many users are facing the write performance issue. As far as I know, some companies already implemented the similar idea on their internal branches. But the internal branch is very different from the commun

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

Thank you very much for the review! I will avoid the diff. Best Regards, Shilun Fan. On Fri, Feb 2, 2024 at 9:59 AM Takanobu Asanuma wrote: > It also looks good to me, except for the diff. > > * Verified signatures and hashes > * Reviewed the documents > * Successfully built from source with `m

Discussion about NameNode Fine-grained locking

Hi everyone I have started a discussion about NameNode Fine-grained Locking to improve performance of write operations in NameNode. I started this discussion again for serval main reasons: 1. We have implemented it and gained nearly 7x performance improvement in our prod environment 2. Many other

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

It also looks good to me, except for the diff. * Verified signatures and hashes * Reviewed the documents * Successfully built from source with `mvn clean install` * Successfully compiled Hadoop trunk and branch-3.4 using the Hadoop thirdparty 1.2.0 Anyway, since hadoop-thirdparty-1.1.1 has some h

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/623/ [Jan 31, 2024, 5:30:35 AM] (github) HADOOP-19056. Highlight RBF features and improvements targeting version 3.4. (#6512) Contributed by Takanobu Asanuma. -1 overall The following subsystems vot

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

Thank you for helping to review Hadoop-Thirdparty-1.2.0-RC0 and providing feedback! I followed the "how to release" documentation and tried to package it using create-release and Dockerfile, but I couldn't successfully package it directly. Some modifications are required before compilation. I shou

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

There is some diff b/w the git tag & the src tar, the Dockerfile & the create-release are different, Why? Files hadoop-thirdparty/dev-support/bin/create-release and hadoop-thirdparty-1.2.0-src/dev-support/bin/create-release differ Files hadoop-thirdparty/dev-support/docker/Dockerfile and hadoop-t

[jira] [Resolved] (HDFS-17359) EC: recheck failed streamers should only after flushing all packets.

[ https://issues.apache.org/jira/browse/HDFS-17359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17359. - Fix Version/s: 3.3.9 3.4.1 3.5.0 Resolution:

[jira] [Created] (HDFS-17368) HA: Standy should exit safemode when resources are from low available

Zilong Zhu created HDFS-17368: - Summary: HA: Standy should exit safemode when resources are from low available Key: HDFS-17368 URL: https://issues.apache.org/jira/browse/HDFS-17368 Project: Hadoop HDFS

[jira] [Created] (HDFS-17367) Add PercentUsed for Different StorageTypes in JMX

Hualong Zhang created HDFS-17367: Summary: Add PercentUsed for Different StorageTypes in JMX Key: HDFS-17367 URL: https://issues.apache.org/jira/browse/HDFS-17367 Project: Hadoop HDFS Issue T

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

Gentle ping. @Ayush Saxena @Steve Loughran @inigo...@apache.org @Masatake Iwasaki and some other folks. On Wed, Jan 31, 2024 at 10:17 AM slfan1989 wrote: > Thank you for the review and vote! Looking forward to other forks helping > with voting and verification. > > Best Regards, > Shilun Fan