Re: KRaft Migration Prod Ready?

2024-07-17 Thread Upesh Desai
4. Restart the controller(s) with the migration configuration removed 5. Remove ZK instances Please let me know if this understanding is correct and/or if there is any other documentation on how to properly migrate when running on Kubernetes! Thanks in advance, Upesh Upesh Desai| Senior

KRaft Migration Prod Ready?

2024-07-02 Thread Upesh Desai
://strimzi.io/blog/2024/03/21/kraft-migration/ - https://www.confluent.io/blog/introducing-apache-kafka-3-6/ Thanks in advance! Upesh Desai| Senior Software Developer ude...@itrsgroup.com ITRS Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility

Kafka Broker Backups

2023-11-14 Thread Upesh Desai
not always be exactly at the same time. Thanks in advance! Upesh Upesh Desai| Senior Software Developer ude...@itrsgroup.com ITRS Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility for the contents of this message. Any view or opinions

Kafka Consumer Health Check

2023-03-07 Thread Upesh Desai
. Thanks in advance! Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility for the contents of this message. Any view or opinions presented are solely those

Re: Custom Kafka Streams State Restore Logic

2023-01-23 Thread Upesh Desai
and is performant enough thus far! Thanks for your help. Cheers, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Matthias J. Sax Date: Monday, January 23, 2023 at 8:05 PM To: users@kafka.apache.org Subject: Re: Custom Kafka Streams State Restore Logic

Re: Custom Kafka Streams State Restore Logic

2023-01-18 Thread Upesh Desai
starting to process. Any advice on Kafka streams / state store logic would be appreciated! -Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Matthias J. Sax Date: Wednesday, January 18, 2023 at 12:50 AM To: users@kafka.apache.org Subject: Re: Custom

Custom Kafka Streams State Restore Logic

2023-01-13 Thread Upesh Desai
key()) ); ChangelogRecordDeserializationHelper.applyChecksAndUpdatePosition( record, consistencyEnabled, position ); } } ); Thanks in advance! Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.

Re: Kafka Streams possible partitioner bug

2022-11-20 Thread Upesh Desai
will help for now, and we will look out for the new config when it comes out. Thanks for the quick help, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Sophie Blee-Goldman Date: Friday, November 18, 2022 at 7:35 PM To: users@kafka.apache.org Subject: Re

Kafka Streams possible partitioner bug

2022-11-18 Thread Upesh Desai
? Thanks in advance! Upesh Desai Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility for the contents of this message. Any view or opinions presented are solely those of t

Kafka Streams Testing Suite Question

2021-10-08 Thread Upesh Desai
follow the life cycle of the production streams code, life cycle and logic? Thanks in advance, Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility

Re: [VOTE] 2.7.1 RC2

2021-05-19 Thread Upesh Desai
Excuse me if this is the wrong thread to ask, but I was curious as to if there was an updated timeline for the release of 2.7.1? Thanks in advance, Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS

Re: Kafka Connect Dist. Worker Does not join group

2021-05-04 Thread Upesh Desai
Hello, I wanted to follow up to see if anyone has ever experienced such behavior with Kafka Connect? Any guidance would be greatly appreciated! Thanks, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Upesh Desai Date: Thursday, April 22, 2021 at 4

Kafka Connect Dist. Worker Does not join group

2021-04-22 Thread Upesh Desai
configuration I am missing? Thanks in advance, Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility for the contents of this message. Any view or opinions presented

State Store Data Retention

2021-04-18 Thread Upesh Desai
to periodically remove old data from the stores? I’m using kafka 2.7.0 components across the board (broker, connect, etc.). Thanks in advance, Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-30 Thread Upesh Desai
Hi Guozhang, We can confirm the behavior with the 2.7.1 release. Appreciate all the help! Cheers, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Guozhang Wang Date: Tuesday, March 30, 2021 at 2:10 PM To: Users Cc: Bart Lilje Subject: Re: Kafka

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-30 Thread Upesh Desai
as part of a punctuation. So my next key question is: is this changelog record generated, i.e. its put call triggered, from processing an input record, or from a punctuation call? Guozhang On Mon, Mar 29, 2021 at 2:01 PM Upesh Desai wrote: > Hi Guozhang, > > > > When testing with

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-29 Thread Upesh Desai
? This was the first and only record written to the store/changelog. Is there anything else we can try to resolve this issue or give us more insight into where this issue could originate from? Thanks, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Upesh Desai

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-25 Thread Upesh Desai
instantly. Best, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Guozhang Wang Date: Thursday, March 25, 2021 at 6:31 PM To: Users Subject: Re: Kafka Streams Processor API state stores not restored via changelog topics BTW, yes that indicates

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-25 Thread Upesh Desai
is just set to compact. We also confirmed that this does not happen when we run everything on Kafka version 2.6. Thanks, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Guozhang Wang Date: Thursday, March 25, 2021 at 4:01 PM To: Users Cc: Bart Lilje

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-24 Thread Upesh Desai
to an empty byte array `new byte[0]`. A couple other variations I have tried are setting to a non-empty static byte array such as `new byte[1]` or `new byte[]{1}`. Hope this gives a little more clarity and hope to hear from you soon. Thanks, Upesh Upesh Desai | Senior Software Developer | ude

Kafka Streams Processor API state stores not restored via changelog topics

2021-03-23 Thread Upesh Desai
feredLimitIndex; Where ‘changelogMetadata.bufferedLimitIndex’ always == 0. My question to you all is, 1) Is this expected behavior? 2) If not, is it a bug? Hope to get some clarity, and thanks in advance! Best, Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com

Re: Kafka 2.7.0 processor API and streams-test-utils changes

2021-02-07 Thread Upesh Desai
Hi John, Guozhang, No problem, I’ll keep an eye out for the change! Thanks for letting me know, I will give my change a try with your example. Appreciate the quick reply! Best, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: John Roesler Date

Kafka 2.7.0 processor API and streams-test-utils changes

2021-02-04 Thread Upesh Desai
direction if this has indeed been changed/fixed or need to raise an issue to have this updated in the next release? Cheers! Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not accept legal