Re: [VOTE] PIP-363: Add callback parameters to the method: org.apache.pulsar.client.impl.SendCallback.sendComplete.

2024-07-08 Thread
bump Jie crossover 于2024年6月24日周一 10:01写道: > Hi, Pulsar Community. > > I would like to start the voting thread for PIP-363: Add callback > parameters to the method: > org.apache.pulsar.client.impl.SendCallback.sendComplete. > > PIP: https://github.com/apache/pulsar/pull/22940 > Discussion

Re: [VOTE] PIP-363: Add callback parameters to the method: org.apache.pulsar.client.impl.SendCallback.sendComplete.

2024-06-23 Thread
+1 nonbinding Jie crossover 于2024年6月24日 周一10:01写道: > Hi, Pulsar Community. > > I would like to start the voting thread for PIP-363: Add callback > parameters to the method: > org.apache.pulsar.client.impl.SendCallback.sendComplete. > > PIP: https://github.com/apache/pulsar/pull/22940 >

Re: [DISCUSS] PIP-363: Add callback parameters to the method: org.apache.pulsar.client.impl.SendCallback.sendComplete.

2024-06-21 Thread
Hi Jie, Thanks, so we don't need to fix Skywalking, for OpenTelemetry-javaagent, I'll create a PR to fix this. Jie crossover 于2024年6月21日周五 17:52写道: > Hi Jiuming, > > Good suggestion, done. > -- > Best Regards! > crossoverJie > > > 太上玄元道君 于2024年6月21日周五 17:34写道: >

Re: [DISCUSS] PIP-363: Add callback parameters to the method: org.apache.pulsar.client.impl.SendCallback.sendComplete.

2024-06-21 Thread
ecause the data sent in batches cannot be obtained in the > current pulsar-client, so when this feature is released, we need to add an > agent based on the latest version in OTel and Skywalking. > > -- > Best Regards! > crossoverJie > > > 太上玄元道君 于2024年6月21日周五 13:30写道: > &

Re: [DISCUSS] PIP-363: Add callback parameters to the method: org.apache.pulsar.client.impl.SendCallback.sendComplete.

2024-06-20 Thread
Hi Jie, I support the PIP but there are something we need to consider: OpenTelemetry-javagent[1] and Apache Skywalking-javaagent[2] enhanced `SendCallback` to monitor sending messages, if we change the method sign, the java-agents can't work. It will be great that you can make it compatible, or,

Re: [VOTE] PIP-355: Enhancing Broker-Level Metrics for Pulsar

2024-05-31 Thread
+1 nonbinding Thanks, Tao Jiuming Hang Chen 于2024年5月31日 周五08:47写道: > Hi, all > > I would like to start the voting thread for PIP-355: Enhancing > Broker-Level Metrics for Pulsar > > PIP: https://github.com/apache/pulsar/pull/22778 > > Thanks > Hang >

Re: [DISCUSS] PIP-353: Improve transaction message visibility for peek-messages

2024-05-21 Thread
+1 Baodi Shi 于2024年5月20日 周一18:48写道: > Hi all, I push a pip to improve transaction message visibility for the > peek-messages command. > > https://github.com/apache/pulsar/pull/22746 > > Please feel free to leave your ideas. > > > Thanks, > Baodi Shi >

Re: [VOTE] PIP-347: add role field in consumer's stat

2024-05-14 Thread
+1 nonbinding Thanks, Tao Jiuming thetumbled 于2024年5月14日 周二17:26写道: > Hi, Pulsar Community. > I would like to start the voting thread for PIP-347: add role field in > consumer's stat. > Proposal PR: https://github.com/apache/pulsar/pull/22564 > Implementation PR:

Re: [VOTE] PIP-350: Allow to disable the managedLedgerOffloadDeletionLagInMillis

2024-05-12 Thread
+1 nonbinding Thanks, Tao Jiuming Yong Zhang 于2024年5月13日周一 10:57写道: > Hi, > > I would like to start voting thread for PIP-350. > https://github.com/apache/pulsar/pull/22688 > > The implementation PR is: > https://github.com/apache/pulsar/pull/22689 > > Discuss thread: >

Re: [DISCUSS] PIP-350: Allow to disable the managedLedgerOffloadDeletionLagInMillis

2024-05-09 Thread
looks good Yong Zhang 于2024年5月10日周五 11:31写道: > Hi all, > > I pushed a new proposal to allow to use -1 to disable > the managedLedgerOffloadDeletionLagInMillis to not delete the data from > bookkeeper. > > Please take a look and share your thoughts. Thanks! > > PIP:

Re: [VOTE] PIP-349: Add systemCursorNames ignore list for TTL check

2024-05-07 Thread
+1 nonbinding Thanks, Tao Jiuming Hang Chen 于2024年5月7日 周二11:25写道: > Hi guys, > I want to start voting for PIP-349. > > PIP: https://github.com/apache/pulsar/pull/22651 > PR: https://github.com/apache/pulsar/pull/22614 > > DISCUSSION Thread: >

Re: [VOTE] PIP-348: Trigger offload on topic load stage

2024-05-07 Thread
+1 nonbinding Thanks, Tao Jiuming Hang Chen 于2024年5月7日 周二11:27写道: > Hi guys, > I want to start voting for PIP-348. > > PIP: https://github.com/apache/pulsar/pull/22650 > PR: https://github.com/apache/pulsar/pull/22652 > > DISCUSSION Thread: >

Re: [DISCUSS] PIP-348: Trigger offload on topic load stage

2024-05-05 Thread
FLAGs Thanks, Tao Jiuming Enrico Olivelli 于2024年5月5日 周日13:44写道: > daojun, > > Il giorno sab 4 mag 2024 alle ore 22:06 太上玄元道君 ha > scritto: > > > it doesn't matter, we don't need to wait until offload finished when > > loading topic, since offloading may take a lon

Re: [DISCUSS] PIP-349: Add systemCursorNames ignore list for TTL check

2024-05-04 Thread
looks good Hang Chen 于2024年5月5日 周日00:02写道: > Hi guys, > I proposed a new proposal to improve the TTL impact on system > cursors. Please help take a look, thanks. > > PIP: https://github.com/apache/pulsar/pull/22651 > > Thanks, > Hang >

Re: [DISCUSS] PIP-348: Trigger offload on topic load stage

2024-05-04 Thread
it doesn't matter, we don't need to wait until offload finished when loading topic, since offloading may take a long time. it just trigger offloading, and we don't need to handle the result. Enrico Olivelli 于2024年5月5日 周日02:41写道: > Overall I think it is a good idea. > > What about adding a flag

Re: [DISCUSS] PIP-347: add role field in consumer's stat

2024-04-25 Thread
It looks like https://github.com/apache/pulsar/pull/22562 is the implementation PR and just introduces a `role` field in consumer stats. It is acceptable and I agree with it. Thanks, Tao Jiuming thetumbled 于2024年4月23日周二 16:23写道: > Hi, pulsar community. > I open a new PIP for finding out the

Re: [VOTE] PIP-327 Support force topic loading for unrecoverable errors

2024-04-25 Thread
+1 nonbinding Rajan Dhabalia 于2024年4月17日周三 01:08写道: > Hi, > > I would like to start voting thread for PIP-327 which also addresses issue > # https://github.com/apache/pulsar/issues/21751 > > PIP design PR: > https://github.com/apache/pulsar/pull/21752 >

Re: [Discuss] Pulsar retention policy

2024-04-24 Thread
bump 太上玄元道君 于2024年4月11日周四 18:20写道: > Hi, Pulsar community, > > I'm opening this thread to discuss the retention policy for managed > ledgers. > > Currently, the retention policy is defined as a time/size-based policy to > retain messages in the ledger, but there is

Re: [Discuss] Pulsar retention policy

2024-04-15 Thread
of a > large backlog quota (e.g., 100GB) to ensure they can revert to a position > 10GB earlier, even if there isn't backlog in subscription. > > Regards, > Yike > ____ > From: 太上玄元道君 > Sent: Thursday, April 11, 2024 18:20 > To: dev@pulsar.ap

[Discuss] Pulsar retention policy

2024-04-11 Thread
Hi, Pulsar community, I'm opening this thread to discuss the retention policy for managed ledgers. Currently, the retention policy is defined as a time/size-based policy to retain messages in the ledger, but there is a difference between the official documentation and the actual code

Re: [DISCUSS] Remove the limitation between backlog quota and retention policy

2024-04-10 Thread
the limitation seems make no sense, after http://github.com/apache/pulsar/pull/22472 merged, I'll try to fix it. Thanks, Tao Jiuming Yike Xiao 于2024年4月10日 周三16:58写道: > Here's a hint as to why this restriction was introduced. > After reviewing the current implementation of the retention policy,

Re: [VOTE] PIP-345: Optimize finding message by timestamp

2024-03-25 Thread
this case, if the broker tries to search the entry with a predicate and > index. The managed > ledger will search from the index first. Of course, if the relevant entry > cannot be found in the index, > just fall back to the "optimized full scan". > > Regards, > Penghui >

Re: [VOTE] PIP-345: Optimize finding message by timestamp

2024-03-24 Thread
bump 太上玄元道君 于2024年3月20日 周三16:23写道: > bump > > 太上玄元道君 于2024年3月19日 周二19:35写道: > >> Hi Pulsar community, >> >> This thread is to start a vote for PIP-345: Optimize finding message by >> timestamp >> >> PIP: https://github.com/apache/pulsar/pull/2223

Re: [VOTE] PIP-345: Optimize finding message by timestamp

2024-03-20 Thread
bump 太上玄元道君 于2024年3月19日 周二19:35写道: > Hi Pulsar community, > > This thread is to start a vote for PIP-345: Optimize finding message by > timestamp > > PIP: https://github.com/apache/pulsar/pull/22234 > Discuss thread: > https://lists.apache.org/thread/5owc9os6wmy52zxbv07

[VOTE] PIP-345: Optimize finding message by timestamp

2024-03-19 Thread
Hi Pulsar community, This thread is to start a vote for PIP-345: Optimize finding message by timestamp PIP: https://github.com/apache/pulsar/pull/22234 Discuss thread: https://lists.apache.org/thread/5owc9os6wmy52zxbv07qo2jrfjm17hd2 Thanks, Tao Jiuming

Re: [DISCUSS] PIP-345: Optimize finding message by timestamp

2024-03-17 Thread
p` > to > > make it clear. > > > > Thanks, > > Tao Jiuming > > > > Girish Sharma 于2024年3月15日周五 12:14写道: > > > > > One suggestion, I think you can make do with storing just begin > > timestamp. > > > Any search utilising th

Re: [DISCUSS] PIP-345: Optimize finding message by timestamp

2024-03-14 Thread
On Fri, Mar 15, 2024, 9:39 AM 太上玄元道君 wrote: > > > bump > > > > 太上玄元道君 于2024年3月10日 周日06:41写道: > > > > > Hi Pulsar community, > > > > > > A new PIP is opened, this thread is to discuss PIP-345: Optimize > finding > > > message by t

Re: [DISCUSS] PIP-345: Optimize finding message by timestamp

2024-03-14 Thread
bump 太上玄元道君 于2024年3月10日 周日06:41写道: > Hi Pulsar community, > > A new PIP is opened, this thread is to discuss PIP-345: Optimize finding > message by timestamp. > > Motivation: > Finding message by timestamp is widely used in Pulsar: > * It is used by the `pulsar-admin` to

Re: [VOTE] PIP-342: Support OpenTelemetry metrics in Pulsar client

2024-03-13 Thread
+1 nonbinding Matteo Merli 于2024年3月14日周四 09:45写道: > PIP: https://github.com/apache/pulsar/pull/22178 > > WIP PR: https://github.com/apache/pulsar/pull/22179 > > > > > -- > Matteo Merli > >

Re: [DISCUSS] PIP-345: Optimize finding message by timestamp

2024-03-11 Thread
ese new ledger fields? > I think you are asking to modify the main message logic which is highly > optimized., but I’m not sure. Have you tried your code on your own > hardware? Do you have performance comparisons of the normal flow? > > > On Mar 11, 2024, at 7:41 PM, 太上玄元道君 wrote:

Re: [DISCUSS] PIP-345: Optimize finding message by timestamp

2024-03-11 Thread
bump 太上玄元道君 于2024年3月11日 周一17:55写道: > bump > > 太上玄元道君 于2024年3月10日周日 06:41写道: > >> Hi Pulsar community, >> >> A new PIP is opened, this thread is to discuss PIP-345: Optimize finding >> message by timestamp. >> >> Motivation: >>

Re: [DISCUSS] PIP-345: Optimize finding message by timestamp

2024-03-11 Thread
bump 太上玄元道君 于2024年3月10日周日 06:41写道: > Hi Pulsar community, > > A new PIP is opened, this thread is to discuss PIP-345: Optimize finding > message by timestamp. > > Motivation: > Finding message by timestamp is widely used in Pulsar: > * It is used by the `pulsar-admin` to

[DISCUSS] PIP-345: Optimize finding message by timestamp

2024-03-09 Thread
Hi Pulsar community, A new PIP is opened, this thread is to discuss PIP-345: Optimize finding message by timestamp. Motivation: Finding message by timestamp is widely used in Pulsar: * It is used by the `pulsar-admin` tool to get the message id by timestamp, expire messages by timestamp, and

Re: [VOTE] PIP-343: Use picocli instead of jcommander

2024-03-06 Thread
+1 nonbinding Zixuan Liu 于2024年3月6日 周三23:04写道: > Hello, > > A new proposal to improve the CLI user experience. > > PIP: https://github.com/apache/pulsar/pull/22181 > Discussion thread: > https://lists.apache.org/thread/ydg1q064cd11pxwz693frtk4by74q32f > > PR:

Re: [DISCUSS] PIP-342: Support OpenTelemetry metrics in Pulsar client

2024-03-03 Thread
+1 Enrico Olivelli 于2024年3月3日 周日16:58写道: > I support the initiative > > Lgtm > > > Thanks > Enrico > > Enrico > > Il Dom 3 Mar 2024, 04:09 Matteo Merli ha scritto: > > > PIP PR: https://github.com/apache/pulsar/pull/22178 > > > > WIP of proposed implementation: > >

Re: Idea: Add a "From zero to hero" contributor roadmap article

2024-03-02 Thread
I support Pulsar is a very complex software, structuring this knowledge will be very helpful Kiryl Valkovich 于2024年3月2日 周六22:01写道: > Imagine that you are a Pulsar user or interested in data streaming in > general and would like to contribute to some related open-source project. > You have some

Re: [DISCUSS] Migrate CLI parser from jcommander to picocli

2024-02-20 Thread
sounds great! +1 nonbinding Zixuan Liu 于2024年2月21日 周三13:08写道: > Hi Pulsar Community, > > The pulsar CLI(pulsar-admin, pulsar-client, pulsar-shell, and so on) uses > the jcommander [1] as CLI parser, which is an awesome project, but the > maintainer is not active and cannot keep up with modern

Re: [ANNOUNCE] New Committer: Asaf Mesika

2024-02-20 Thread
congrats! Lari Hotari 于2024年2月21日 周三00:50写道: > The Apache Pulsar Project Management Committee (PMC) has invited > Asaf Mesika https://github.com/asafm to become a committer and we > are pleased to announce that he has accepted. > > Welcome and Congratulations, Asaf Mesika! > > Please join us in

Re: [VOTE] PIP-335: Oxia metadata support

2024-02-06 Thread
+1 nonbinding Matteo Merli 于2024年2月6日 周二04:40写道: > https://github.com/apache/pulsar/pull/22009 > > - > > # PIP-335: Support Oxia metadata store plugin > > # Motivation > > Oxia is a scalable metadata store and coordination system that can be used > as the core infrastructure > to

Re: [DISCUSS] PIP-335: Oxia metadata support

2024-01-31 Thread
+1 Matteo Merli 于2024年2月1日 周四07:58写道: > https://github.com/apache/pulsar/pull/22009 > > === > > # PIP-335: Supporty Oxia metadata store plugin > > # Motivation > > Oxia is a scalable metadata store and coordination system that can be used > as the core infrastructure > to build large

Re: Status of "Oxia" in Apache ecosystem?

2024-01-22 Thread
Oxia is a project of StreamNative inc, it's non public. From my understanding, it's a zookeeper proxy, like Apache ShardingSphere, for the purpose of zookeeper's horizontal expansion. Dave Fisher 于2024年1月23日 周二05:23写道: > Hi Paul, > > There is no such thing as Apache Oxia. It is from a vendor in

Re: [VOTE] PIP-330: getMessagesById gets all messages

2024-01-17 Thread
+1 nonbinding > 2024年1月17日 17:35,Asaf Mesika 写道: > > +1 (non-binding) > > On Tue, Jan 16, 2024 at 4:43 AM Dezhi Liu wrote: > >> +1 (non-binding) >> >> Thanks, >> Dezhi Liu >> >> On 2024/01/15 09:33:48 Zixuan Liu wrote: >>> Hi Pulsar Community, >>> >>> Voting for PIP-330: getMessagesById

Re: [VOTE] PIP-326: Create a BOM to ease dependency management

2023-12-22 Thread
+1 nonbinding Umut Bilal Okur 于2023年12月23日 周六00:13写道: > +1 (non-binding) > > Enrico Olivelli , 22 Ara 2023 Cum, 18:26 tarihinde > şunu yazdı: > > > +1 (binding) > > > > Enrico > > > > Il giorno ven 22 dic 2023 alle ore 02:46 Apurva Telang > > ha scritto: > > > > > > +1 (non-binding) > > > > > >

Re: [Vote] PIP-223: Add metrics for all Rest Endpoints

2023-12-20 Thread
Sorry, the PIP had approved, please ignore. Tao Jiuming 于2023年12月21日周四 04:25写道: > > bump > > On 2022/11/28 08:47:01 Jiuming Tao wrote: > > Dear Pulsar Community, > > > > Please review and vote on this PIP. > > > > PIP link: https://github.com/apache/pulsar/issues/18560 > > > > Discuss thread: >

Re: [DISCUSS] PIP-327 Support force topic loading for unrecoverable errors

2023-12-20 Thread
In my understanding, the PIP is for some certain `extreme` conditions. Some ledgers failing to recover is an event with a very low probability, and it should be hard to reproduce(unless we delete some ledgers manually). If we skip these failed-recover ledgers, message production should be able to

Re: [ANNOUNCE] Daniel Blankensteiner as new PMC member in Apache Pulsar

2023-11-27 Thread
congrats! Lari Hotari 于2023年11月27日 周一19:46写道: > Congratulations on becoming a PMC member, Daniel! Well deserved! > > -Lari > > On 2023/11/27 08:12:15 tison wrote: > > The Apache Pulsar Project Management Committee (PMC) has invited > > Daniel Blankensteiner https://github.com/blankensteiner to

Re: [VOTE] PIP-312 Use StateStoreProvider to manage state in Pulsar Functions endpoints

2023-11-17 Thread
+1 non binding Zili Chen 于2023年11月17日 周五17:56写道: > +1 binding > > Thanks for your proposal. > > On 2023/11/15 03:39:42 Pengcheng Jiang wrote: > > Hi Pulsar Community, > > > > This thread is to start a vote for PIP-312: Use StateStoreProvider to > > manage state in Pulsar Functions endpoints. > >

Re: [OT] Evaluate Virtual thread [WAS][DISCUSS] Moving to Java 21

2023-11-07 Thread
In the past, threads usually blocked on LockUtil.park(…), and AQS is depends on it to park threads. Virtual thread only solved thread blocking on JDK layer by rewriting LockUtik.park(…) In some conditions, the carrier thread will be blocked (I only remember the following points) 1. JNI calling

Re: [DISCUSS] PIP-310: Support custom publish rate limiters

2023-11-03 Thread
Hi Girish, There is also a discussion thread[1] about rate-limiting. I think there is some conflicts between some kind of rate-limiter and backpressure Take the fail-fast strategy as an example: Brokers have to reply to clients after receiving and decode the message, but the broker also has the

Re: [VOTE] PIP-271: Add broker health check status into prometheus metrics #20147

2023-10-26 Thread
+1 non binding Thanks, Tao Jiuming Rajan Dhabalia 于2023年10月27日 周五07:00写道: > Thanks for adding it. > +1 > > Thanks, > Rajan > > On Thu, Oct 26, 2023 at 3:52 PM vineeth p > wrote: > > > Broker metrics don't have anything to indicate the health of the broker > (to > > indicate if the broker is

Re: [VOTE] PIP-307: Support subscribing multi-topics for WebSocket

2023-10-24 Thread
+1(no-binding) Thanks, Tao Jiuming Cong Zhao 于2023年10月24日 周二16:03写道: > +1(no-binding) > > Thanks, > Cong Zhao > > On 2023/10/19 12:47:45 guo jiwei wrote: > > Hi dev, > >Currently WebSocket only supports the consumption of a single topic, > > which cannot satisfy users' consumption scenarios

Re: [VOTE] PIP-300: Add custom dynamic configuration for plugins

2023-10-08 Thread
+1 (no-binding) Zixuan Liu 于2023年9月26日 周二10:54写道: > Hi Pulsar Community, > > Voting for PIP-300: https://github.com/apache/pulsar/pull/21127 > Discussion thread: > https://lists.apache.org/thread/ysnsnollgy1b6w1dsvmx1t1y2rz1tyd6 > > Thanks, > Zixuan >

Re: [VOTE] PIP-302 Introduce refreshAsync API for TableView

2023-10-08 Thread
+1 (no-binding) Xiangying Meng 于2023年9月27日 周三15:05写道: > Hi dev, >This thread is to start a vote for PIP-302 Add new API > refreshAsync for TableView. > Discuss thread: > https://lists.apache.org/thread/o085y2314o0fymvx0x8pojmgjwcwn59q > PIP: https://github.com/apache/pulsar/pull/21166 > >

Re: [VOTE] Accept pulsar-admin-go as part of the Apache Pulsar project

2023-08-05 Thread
+1 non-binding Thanks, Tao Jiuming Zixuan Liu 于2023年8月5日 周六22:58写道: > +1 (non-binding) > > Thanks, > Zixuan > > 于2023年8月5日周六 21:11写道: > > > > +1 (binding) > > > > Best, > > Mattison > > On 5 Aug 2023 at 20:05 +0800, Yunze Xu , wrote: > > > +1 (binding) > > > > > > Thanks, > > > Yunze > > > > >

Re: [DISCUSS] Proposal for donating pulsar-admin-go to the Apache Pulsar project

2023-07-31 Thread
+1 Thanks, Tao Jiuming Yunze Xu 于2023年7月31日 周一16:26写道: > LGTM. > > Thanks, > Yunze > > On Wed, Jul 26, 2023 at 5:11 PM tison wrote: > > > > Hi, > > > > ## Motivation > > > > Pulsar brokers serve two kinds of client-side requests: data panel > requests > > (often known as client-api) and

Re: [ANNOUNCE] Qiang Zhao as new PMC member in Apache Pulsar

2023-03-29 Thread
Congrats!! Thanks, Tao Jiuming > 2023年3月29日 23:51,Devin Bost 写道: > > Congrats! > > Devin G. Bost > > > On Wed, Mar 29, 2023 at 6:38 AM ZhangJian He wrote: > >> Congratulations! >> >> Thanks >> ZhangJian He >> >> >> On Wed, 29 Mar 2023 at 19:33, Haiting Jiang >> wrote: >> >>>

Re: [Discuss] PIP-248: Add backlog eviction metric

2023-03-15 Thread
> Perhaps clarify, they can call: > getStats(subscriptionBacklogSize=true, getPreciseBacklog=false, > getEarliestTimeInBacklog=false) > Each subscription will contain backlogSize. > The subscription with max backlogSize will also be the one with oldest age. Yes, "The subscription with max

Re: [Discuss] PIP-248: Add backlog eviction metric

2023-03-14 Thread
he age. > > I would add before: > > > slowestReaderTimeBasedBacklogQuotaCheck > > < > https://github.com/apache/pulsar/blob/master/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/persistent/PersistentTopic.java#L2817> > is > > a totally in-memory method

[Vote] PIP-248: Add metrics for backlog eviction events

2023-03-13 Thread
Hi all, The thread is to start the vote for PIP-248 Discussion thread: https://lists.apache.org/thread/m7khb49pk7vdx5yxvhzhkbo7t48d0rzs PIP link: https://github.com/apache/pulsar/issues/19601 Thanks, Tao Jiuming

Re: [Discuss] PIP-248: Add backlog eviction metric

2023-03-09 Thread
I think yes, to avoid missing something, you can take a look if you have time. Thanks, Tao Jiuming Asaf Mesika 于2023年3月9日周四 17:40写道: > Is the PIP updated with all comments? > > On Thu, Mar 9, 2023 at 8:59 AM 太上玄元道君 wrote: > > > > backlogQuotaLimitSize > > > sh

Re: [Discuss] PIP-248: Add backlog eviction metric

2023-03-08 Thread
< > https://github.com/apache/pulsar/blob/master/pulsar-client-admin-api/src/main/java/org/apache/pulsar/client/admin/Topics.java#L1139> > to > >get the topic stats, and find which subscriptions are in backlog. > >Pulsar exposed backlogSize and earliestMsgPublishTi

Re: [Discuss] PIP-248: Add backlog eviction metric

2023-03-06 Thread
Hi Aasf, I've updated the PIP, PTAL Thanks, Tao Jiuming Asaf Mesika 于2023年3月5日周日 21:00写道: > On Thu, Mar 2, 2023 at 12:57 PM 太上玄元道君 wrote: > > > > I think you should fix this explanation: > > > > Thanks! I would like to copy the context you provide to the

Re: [Discuss] PIP-248: Add backlog eviction metric

2023-03-02 Thread
in terms of I/O is limited. > Now you are adding one additional I/O per collection, every 1 min by > default. That's a lot perhaps. How long is the check interval today? > > Perhaps in the backlog quota check, you can persist the check result, and > use it? Persist the age th

Re: [ANNOUNCE] New committer: Yuri Mizushima

2023-02-27 Thread
congrats! Thanks, Tao Jiuming Nozomi Kurihara 于2023年2月27日周一 15:47写道: > Hi everyone, > > The Project Management Committee (PMC) for Apache Pulsar > has invited Yuri Mizushima (https://github.com/equanz) to become a > committer and we are pleased > to announce that he has accepted. > > Yuri has

Re: [Vote] PIP-245: Make subscriptions of non-persistent topic non-durable

2023-02-23 Thread
Hi Rajan, Even we don't persistent NonPersistentSubscription's state, but it has a `isDurable` field ``` public NonPersistentSubscription(NonPersistentTopic topic, String subscriptionName, boolean isDurable, Map properties) { this.topic = topic;

[Discuss] PIP-248: Add backlog eviction metric

2023-02-22 Thread
Hi all, I've started a PIP to discuss: PIP-248 Add backlog eviction metric ### Motivation: Pulsar has 2 configurations for the backlog eviction: `backlogQuotaDefaultLimitBytes` and `backlogQuotaDefaultLimitSecond`, if topic backlog reaches the threshold of any item, backlog eviction will be