Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-05-13 Thread Greg Harris
cation on this topic. > Again, thank you for sharing your concerns about balancing this proposal > against the impact to the ecosystem. We think the additional performance that > this could provide along with the improved flexibility to add or accelerate > compression codecs outweighs the

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-05-13 Thread Diop, Assane
are looking at alternative approaches for brokers and clients to > coordinate the plugin. > > One way to do this coordination is each client should have a configuration > mapping of the plugin name to its implementation. > > Assane > > > > > > > -Original Mes

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-05-07 Thread Diop, Assane
the increased complexity for the operators. Assane -Original Message- From: Greg Harris Sent: Wednesday, May 1, 2024 12:09 PM To: dev@kafka.apache.org Subject: Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka Hi Assane, Thanks for the update. Unfortunately, I don't think

Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-05-01 Thread Greg Harris
s for brokers and clients to > coordinate the plugin. > > One way to do this coordination is each client should have a configuration > mapping of the plugin name to its implementation. > > Assane > > > > > > > -Original Message- > From: Luke Chen

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-04-29 Thread Diop, Assane
implementation. Assane -Original Message- From: Luke Chen Sent: Monday, February 26, 2024 7:50 PM To: dev@kafka.apache.org Subject: Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka Hi Assane, I also share the same concern as Greg has, which is that the KIP

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-03-01 Thread Diop, Assane
-Original Message- From: Luke Chen Sent: Monday, February 26, 2024 7:50 PM To: dev@kafka.apache.org Subject: Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka Hi Assane, I also share the same concern as Greg has, which is that the KIP is not kafka ecosystem friendly

Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-02-26 Thread Luke Chen
e interface, you should use topic level compression. > > I would like to have your valuable inputs on this!! > > Thanks before end, > Assane > > -Original Message----- > From: Greg Harris > Sent: Wednesday, February 14, 2024 2:36 PM > To: dev@kafka.apache.org

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-02-26 Thread Diop, Assane
far as Kafka. > I have added more information to the > https://cwiki.apache.org/confluence/display/KAFKA/KIP-984%3A+Add+plugg > able+compression+interface+to+Kafka I am ready for a PR if this KIP > gets accepted > > Assane > > -Original Message- > From: Diop, Assa

Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-02-14 Thread Greg Harris
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-984%3A+Add+pluggable+compression+interface+to+Kafka > I am ready for a PR if this KIP gets accepted > > Assane > > -Original Message- > From: Diop, Assane > Sent: Wednesday, January 31, 2024 10:24 AM

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-02-14 Thread Diop, Assane
if this KIP gets accepted Assane -Original Message- From: Diop, Assane Sent: Wednesday, January 31, 2024 10:24 AM To: dev@kafka.apache.org Subject: RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka Hi Divij, Thank you for your response! Although compression is not a new problem

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-01-31 Thread Diop, Assane
. Assane -Original Message- From: Divij Vaidya Sent: Friday, December 22, 2023 2:27 AM To: dev@kafka.apache.org Subject: Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka Thank you for writing the KIP Assane. In general, exposing a "pluggable" interface is not

Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2023-12-22 Thread Divij Vaidya
to this KIP. We have added an > interface to the compression code that allow anyone to build their own > compression plugin and integrate easily back to kafka. > > Assane > > -Original Message- > From: Diop, Assane > Sent: Monday, October 2, 2023 9:27 AM > To: dev@kafk

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2023-12-18 Thread Diop, Assane
To: dev@kafka.apache.org Subject: DISCUSS KIP-984 Add pluggable compression interface to Kafka https://cwiki.apache.org/confluence/display/KAFKA/KIP-984%3A+Add+pluggable+compression+interface+to+Kafka

DISCUSS KIP-984 Add pluggable compression interface to Kafka

2023-10-02 Thread Diop, Assane
https://cwiki.apache.org/confluence/display/KAFKA/KIP-984%3A+Add+pluggable+compression+interface+to+Kafka