Decommission command without stopping bookkeeper server

2021-09-07 Thread zhangao
Hello everyone,Now, decommission command need bookie stoped, and only support one bookie at same time. I plan to make decommission behave more like HDFS decommission commands: 1??support decommission two or more servers at same time. 2??decommission will make servers become read-only. (m

Re: Decommission command without stopping bookkeeper server

2021-09-07 Thread Ivan Kelly
This seems to be part of another thread "Improve the process of removing bookies from a cluster". Can you please respond there to keep the conversation in one place? -Ivan On Tue, Sep 7, 2021 at 12:57 PM zhangao wrote: > > Hello everyone,Now, decommission command need bookie stoped, and onl

Re: Improve the process of removing bookies from a cluster

2021-09-07 Thread Yang Yang
Hi Ivan, Thanks for sharing these insights! Autoscaling is exactly one motivation for me to bring this topic up. I understand that the auto-recovery is not perfect at the moment, but it's an important component that maintains the core invariants of a bookkeeper cluster, so I think we may keep imp

Re: Improve the process of removing bookies from a cluster

2021-09-07 Thread Ivan Kelly
Hi Yang, > Autoscaling is exactly one motivation for me to bring this topic up. I > understand that the auto-recovery is not perfect at the moment, but it's an > important component that maintains the core invariants of a bookkeeper > cluster, so I think we may keep improving it until we find a be

Re: Improve the process of removing bookies from a cluster

2021-09-07 Thread Jonathan Ellis
On Tue, Sep 7, 2021 at 8:05 AM Ivan Kelly wrote: > Hi Yang, > > > Autoscaling is exactly one motivation for me to bring this topic up. I > > understand that the auto-recovery is not perfect at the moment, but it's > an > > important component that maintains the core invariants of a bookkeeper > >

Re: Improve the process of removing bookies from a cluster

2021-09-07 Thread Venkateswara Rao Jujjuri
Glad to see this thread. This is one of the biggest limitations to autoscaling. On Tue, Sep 7, 2021 at 6:11 AM Jonathan Ellis wrote: > On Tue, Sep 7, 2021 at 8:05 AM Ivan Kelly wrote: > > > Hi Yang, > > > > > Autoscaling is exactly one motivation for me to bring this topic up. I > > > understan

Re: Improve the process of removing bookies from a cluster

2021-09-07 Thread Michael Marshall
Hi Ivan and Yang, ++1 I am very happy to see this initiative. It will be a fantastic improvement, and I am happy to help contribute, if help is needed. I agree that the first step is adding an endpoint to mark a bookie as read only in a persistent way, and that the "draining" state only really ne