RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

could implement this feature, and just leave the Kafka compression off? I think an "Add Brotli Compression" KIP is definitely worth pursuing, if that is the compression algorithm you have in mind currently. Thanks, Greg On Mon, Apr 29, 2024 at 3:10 PM Diop, Assane wrote: > > Hi Divij,

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

an "Add Brotli Compression" KIP is definitely worth pursuing, if that is the compression algorithm you have in mind currently. Thanks, Greg On Mon, Apr 29, 2024 at 3:10 PM Diop, Assane wrote: > > Hi Divij, Greg and Luke, > I have updated the KIP for Kafka pluggable compressi

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

have made significant changes to the design to accommodate the concerns and would like some feedback from the community and engage communication. Assane -Original Message- From: Diop, Assane Sent: Friday, March 1, 2024 4:45 PM To: dev@kafka.apache.org Subject: RE: DISCUSS KIP-984 Add

RE:DISCUSS KIP-984 Add pluggable compression interface to Kafka

communication. Assane -Original Message- From: Diop, Assane Sent: Friday, March 1, 2024 4:45 PM To: dev@kafka.apache.org Subject: RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka Hi Luke, The proposal doesn't preclude supporting multiple clients but each client would need

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

27, 2024 at 7:44 AM Diop, Assane wrote: > Hi Greg, > > Thanks for taking the time to give some feedback. It was very insightful. > > I have some answers: > > 1. The current proposal is Java centric. We want to figure out with > Java first and then later incorporate othe

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

leaving the namespace to be wrangled by operators and client libraries. Thanks, Greg [1] https://github.com/confluentinc/librdkafka [2] https://github.com/apache/kafka/blob/e8c70fce26626ed2ab90f2728a45f6e55e907ec1/clients/src/main/java/org/apache/kafka/common/record/DefaultRecordBatch.java#L130 On

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

if this KIP gets accepted Assane -Original Message- From: Diop, Assane Sent: Wednesday, January 31, 2024 10:24 AM To: dev@kafka.apache.org Subject: RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka Hi Divij, Thank you for your response! Although compression is not a new problem

RE: [VOTE] KIP-390: Support Compression Level (rebooted)

Hi Mickael I will take some time today to add some documentation to KIP-984. I actually have a working implementation of the plugin and I have been running test. I would be ready to do a PR anytime. As far as motivation, Divij did asked about that and I responded in an email to the mailing

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

sage with V1 and broker expects in V2, we convert the message and recompress it. -- Divij Vaidya On Mon, Dec 18, 2023 at 7:22 PM Diop, Assane wrote: > I would like to bring some attention to this KIP. We have added an > interface to the compression code that allow anyone to build th

RE: DISCUSS KIP-984 Add pluggable compression interface to Kafka

I would like to bring some attention to this KIP. We have added an interface to the compression code that allow anyone to build their own compression plugin and integrate easily back to kafka. Assane -Original Message- From: Diop, Assane Sent: Monday, October 2, 2023 9:27 AM

DISCUSS KIP-984 Add pluggable compression interface to Kafka

https://cwiki.apache.org/confluence/display/KAFKA/KIP-984%3A+Add+pluggable+compression+interface+to+Kafka

Permissions to contribute to Apache Kafka

Hi Team, Following are the details for Wiki id Email: assane.d...@intel.com Username: Assane.diop Jira id Email: assane.d...@gmail.com Username: adiop Thanks, Assane Diop

Can't creare a Jira

I am unable to complete my Jira account. The request seems to be pending. Can anyone help with this? Assane