+1 The load data don't need to be persistent to the storage layer, Using a non-persistent topic is more efficient.
Thanks, Penghui On Wed, Mar 16, 2022 at 2:14 PM Kai Wang <kw...@streamnative.io.invalid> wrote: > Hi Pulsar Community, > > Currently, Pulsar LoadManager is using Zookeeper to store the local broker > data, the LoadReportUpdaterTask will report the local load data to > Zookeeper, the leader broker will collect load data and store it to > Zookeeper. > > When we have a lot of brokers and bundles, this load datas will put some > pressure on Zookeeper. > > Since the load data are not strongly consistent, we can use the > non-persistent topics to sync the load data. And it will reduce our > dependence on Zookeeper. > > If this proposal is acceptable, I will draft a PIP. > > Any suggestions are appreciated. > > Thanks, > Kai >
