Hi Xiangying > Since we can add data to the topic attribute, > why not directly put the > snapshot or snapshot segment position into > the topic position?
Reason 1: - The rate of loading the topic is once many days - The rate of taking Transaction Buffer snapshot is per 5 seconds The changes you suggested are to use write ZK per 5 seconds instead of reading data from BK once many days, it is not better. Reason 2: Once you move snapshots from BK to ZK, we can difficultly guarantee the compatibility of upgrading and downgrading. Thanks Yubioa Feng On Thu, Aug 22, 2024 at 4:52 PM xiangying meng <xiangy...@apache.org> wrote: > Good idea. I still have some questions about this. > > Since we can add data to the topic attribute, why not directly put the > snapshot or snapshot segment position into the topic position? > This method has two advantages: > 1. System properties of topics that do not use transactions are not > added. It will not affect common topics. > 2. Topics using transactions can be recovered faster. > > Of course, the disadvantage is that topics using transactions will > need to update these properties frequently. > > Thanks, > > Xiangying > > On Thu, Aug 22, 2024 at 10:53 AM Ran Gao <r...@apache.org> wrote: > > > > LGTM > > > > Not all topics use the transaction feature, it can save a lot of > resources to help reduce broker recovery time, and it's convenient to > calculate topics count that use transactions. > > > > Thanks, > > Ran Gao > > > > On 2024/08/21 14:27:25 Yubiao Feng wrote: > > > Hi all > > > > > > I drafted a proposal to add a topic's system prop that indicates > whether > > > users have published TXN messages in before. > > > > > > https://github.com/apache/pulsar/pull/23210 > > > > > > I'm looking forward to hearing from you. > > > > > > Thanks > > > Yubiao Feng > > > >
