RE: Re:[DISCUSS] KIP-1009: Add Broker-level Throttle Configurations

2024-06-24 Thread Harry Fallows
Hi Ria,

I think this KIP will be a great addition! My current use case for replication 
throttling is during broker recovery after data loss; in this situation we 
would want to throttle the replication of all topics to avoid impacting 
producer/consumer traffic, which would be much easier with broker-level 
throttle toggling.

In case you haven't seen, I also raised a KIP (KIP-1051) to allow replication 
throttle rate to be applied statically. I'm not sure if that's also useful for 
you. Additionally, I have fixed the bug you mentioned in KIP-1009 
(https://issues.apache.org/jira/browse/KAFKA-10190), which allows the throttle 
rate to be applied across all brokers.

Kind regards,
Harry

On 2023/11/21 20:26:37 "Ria Pradeep (BLOOMBERG/ 919 3RD A)" wrote:
> Hi All,
> 
> (I sent the previous email prematurely, apologies)
> 
> I'd like to start a discussion on KIP-1009: Add Broker-level Throttle 
> Configurations - 
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-1009%3A+Add+Broker-level+Throttle+Configurations
> 
> At a high level, this KIP adds dynamic broker level configurations to 
> throttle out of sync replication. Currently, replication throttles can be 
> configured at a topic level, but not for the broker as a whole.
> 
> I’m looking forward to hearing any suggestions or thoughts on this KIP!
> 
> Thanks,
> Ria
> 
> 
> From: dev@kafka.apache.org At: 11/21/23 15:17:15 UTC-5:00To:  
> dev@kafka.apache.org
> Subject: [DISCUSS] KIP-1009: Add Broker-level Throttle Configurations
> 
> Hi All,
> 
> I'd like to start a discussion on KIP-1009: Add Broker-level Throttle 
> Configurations.
> 
>


Re:[DISCUSS] KIP-1009: Add Broker-level Throttle Configurations

2023-11-21 Thread Ria Pradeep (BLOOMBERG/ 919 3RD A)
Hi All,

(I sent the previous email prematurely, apologies)

I'd like to start a discussion on KIP-1009: Add Broker-level Throttle 
Configurations - 
https://cwiki.apache.org/confluence/display/KAFKA/KIP-1009%3A+Add+Broker-level+Throttle+Configurations

At a high level, this KIP adds dynamic broker level configurations to throttle 
out of sync replication. Currently, replication throttles can be configured at 
a topic level, but not for the broker as a whole.

I’m looking forward to hearing any suggestions or thoughts on this KIP!

Thanks,
Ria


From: dev@kafka.apache.org At: 11/21/23 15:17:15 UTC-5:00To:  
dev@kafka.apache.org
Subject: [DISCUSS] KIP-1009: Add Broker-level Throttle Configurations

Hi All,

I'd like to start a discussion on KIP-1009: Add Broker-level Throttle 
Configurations.