Re: [DISCUSS] Regarding DLQ/Retry Topic auto creation, do not create partitioned DLQ/Retry Topic

2024-05-15 Thread Yubiao Feng
Hi all The PR #22705 has been merged and I cherry-picked it into branch 3.0 Close this discussion. Thanks Yubiao Feng. On Tue, May 14, 2024 at 2:56 AM Yubiao Feng wrote: > Hi community > > I want to change the behavior of DLQ/Retry Topic auto creation. > > ### Motivation > After you set `defa

Re: [DISCUSS] Regarding DLQ/Retry Topic auto creation, do not create partitioned DLQ/Retry Topic

2024-05-14 Thread Yubiao Feng
Hi Jiuming > Is it better to create the same number of retry/dlq topic > partitions as the original topic? That is what I want to change, in other words, https://github.com/apache/pulsar/pull/22705 did this change. But the topic name is not the same as you mentioned, the behavior is like the belo

Re: [DISCUSS] Regarding DLQ/Retry Topic auto creation, do not create partitioned DLQ/Retry Topic

2024-05-14 Thread Tao Jiuming
Hi, Yubiao Is it better to create the same number of retry/dlq topic partitions as the original topic? I mean, if the original topic has 16 partitions, we also create 16(or some other numbers, can be configurable) partitions for the retry/dlq topic. If the topic/partition is a retry/dlq topic,

Re: [DISCUSS] Regarding DLQ/Retry Topic auto creation, do not create partitioned DLQ/Retry Topic

2024-05-13 Thread Yubiao Feng
> And I want to cherry-pick the improvement > PR into branch-3.0 The issue described above will generate much more dirty partitioned and non-partitioned topics, which should be fixed for the LTS version. Thanks Yubiao Feng On Tue, May 14, 2024 at 2:56 AM Yubiao Feng wrote: > Hi community > >

Re: [DISCUSS] Regarding DLQ/Retry Topic auto creation, do not create partitioned DLQ/Retry Topic

2024-05-13 Thread Yubiao Feng
Append a related Issue ### Issue both partitioned DLQ and non-partitioned DLQ were created automatically. - Background - Broker settings: `{allowAutoTopicCreation=true, defaultNumPartitions=1, allowAutoTopicCreationType=partitioned}` - client version `< 3.1` - broker version `>= 3.1` - Flow

Re: [DISCUSS] Regarding DLQ/Retry Topic auto creation, do not create partitioned DLQ/Retry Topic

2024-05-13 Thread Yubiao Feng
And I want to cherry-pick the improvement PR into branch-3.0 Thanks Yubiao Feng On Tue, May 14, 2024 at 2:56 AM Yubiao Feng wrote: > Hi community > > I want to change the behavior of DLQ/Retry Topic auto creation. > > ### Motivation > After you set `defaultNumPartitions` to `16`, you will get `

[DISCUSS] Regarding DLQ/Retry Topic auto creation, do not create partitioned DLQ/Retry Topic

2024-05-13 Thread Yubiao Feng
Hi community I want to change the behavior of DLQ/Retry Topic auto creation. ### Motivation After you set `defaultNumPartitions` to `16`, you will get `16` partitions per topic, and `16*16` DLQ partitions per subscription, you will get a huge number of DLQs if you have more than one subscription