Re: Split Meta Design Reset Status

2021-08-13 Thread Andrew Purtell
It should be possible to recreate all necessary state in ZK in the cold boot scenario and recover from a total loss of ZK state without trouble (except some process restarts). We’ve been moving replication state out of zookeeper for this reason, etc. We’ve taken shortcuts that still need to be

Re: Split Meta Design Reset Status

2021-08-13 Thread Duo Zhang
This is not moving state to zookeeper, we already have this state in zookeeper... The location of meta region is only stored in zookeeper, and if it is cleaned, we will be in trouble... And I filed HBASE-26193 to fix this problem. PTAL if you have interest. Thanks. Andrew Purtell 于2021年8月13日周五

Re: Split Meta Design Reset Status

2021-08-13 Thread Duo Zhang
I checked the google doc history, it can show the difference, so I do not think we need to move it to git. There are still lots of unresolved comments on the doc, moving to git will lose them. And I do not think the online meeting breaks the rule in ASF, we will send out the meeting notes here and

[DISCUSS] About using masters as ConnectionRegistry endpoint

2021-08-13 Thread Duo Zhang
In HBASE-18095, the community provided a new way to get the registry information of a cluster, without touching ZooKeeper. The decision at that time was to use masters(including active and backup masters) as the connection registry endpoint. Later, when discussing how to implement splittable meta,

Re: Split Meta Design Reset Status

2021-08-13 Thread Stack
On Fri, Aug 13, 2021 at 8:39 AM Andrew Purtell wrote: > Also let me say that your entreaty for more to join your calls is fine and > I hope that happens, but this is Apache, and discussions should take place > in suitably asynchronous fashion so all can participate - even those who > have competi

Re: Split Meta Design Reset Status

2021-08-13 Thread Andrew Purtell
Also let me say that your entreaty for more to join your calls is fine and I hope that happens, but this is Apache, and discussions should take place in suitably asynchronous fashion so all can participate - even those who have competing responsibilities and commitments and cannot attend the cal

Re: Split Meta Design Reset Status

2021-08-13 Thread Andrew Purtell
Moving state into zookeeper is the wrong direction. Absolutely not. No, no, no. We can discuss it but it is very unlikely I would even not veto such a change. It doesn’t seem like a problem because you have other MUCH better and more viable options. > On Aug 13, 2021, at 7:50 AM, Stack wrote:

Re: Split Meta Design Reset Status

2021-08-13 Thread Stack
Rough minutes from our meeting of Wed Aug 11 17:04:44 PDT 2021 Attendees: Francis, Duo, Francis. We moved to discuss the proposed agenda item, how to implement the "ROOT" Region. Duo had a new proposal that we host meta Regions in zookeeper (either all in a single znode or a znode per location)