Re: Alternative Decommission Monitor Implementation

2020-09-28 Thread Stephen O'Donnell
Akira, We would be very interested in any feedback on the new monitor implementation, as we have not yet been able to test it on a large production cluster. Particularly: 1. Does it work correctly at scale? 2. Does it appear to place less load on the NN (less locking, and it should do less check

Re: Alternative Decommission Monitor Implementation

2020-09-28 Thread Akira Ajisaka
Hi Wei-Chiu and Stephen, We have upgraded to HDFS 3.3.0 and experimenting the new decommission monitor. I'd like to feedback to the community in the near future. Thanks, Akira On Thu, Feb 6, 2020 at 2:45 PM Akira Ajisaka wrote: > > Yes, I'm interested in the new decommission monitor. > We're pl

Re: Alternative Decommission Monitor Implementation

2020-02-05 Thread Akira Ajisaka
Yes, I'm interested in the new decommission monitor. We're planning to adopt this after upgrading to HDFS 3.3.0. Thanks, Akira On Wed, Feb 5, 2020 at 3:57 AM Wei-Chiu Chuang wrote: > @Akira Ajisaka you said you'd be interested, right? > Are you planning to adopt this feature? > > On Tue, Feb 4

Re: Alternative Decommission Monitor Implementation

2020-02-04 Thread Wei-Chiu Chuang
@Akira Ajisaka you said you'd be interested, right? Are you planning to adopt this feature? On Tue, Feb 4, 2020 at 10:41 AM Stephen O'Donnell wrote: > Hi All, > > In https://issues.apache.org/jira/browse/HDFS-14854 we committed a new > decommission monitor to trunk, which is disabled by default

Alternative Decommission Monitor Implementation

2020-02-04 Thread Stephen O'Donnell
Hi All, In https://issues.apache.org/jira/browse/HDFS-14854 we committed a new decommission monitor to trunk, which is disabled by default. The new implementation hopes to be an improvement over the original monitor, but without running it on a real cluster it is hard to know for sure. I would li