Re: [VOTE] KIP-862: Self-join optimization for stream-stream joins

2022-09-13 Thread Jim Hughes
Hi Vicky, I'm +1 (non-binding); thanks for the KIP (and PR)! Cheers, Jim On Tue, Sep 13, 2022 at 12:05 PM Guozhang Wang wrote: > Thank Vicky! I'm +1. > > Guozhang > > On Mon, Sep 12, 2022 at 7:02 PM John Roesler wrote: > > > Thanks for the updates, Vicky! > > > > I've reviewed the KIP and

[jira] [Created] (KAFKA-14076) Fix issues with KafkaStreams.CloseOptions

2022-07-14 Thread Jim Hughes (Jira)
Jim Hughes created KAFKA-14076: -- Summary: Fix issues with KafkaStreams.CloseOptions Key: KAFKA-14076 URL: https://issues.apache.org/jira/browse/KAFKA-14076 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-834: Pause / Resume KafkaStreams Topologies

2022-06-16 Thread Jim Hughes
1) may still use resources, and 2) may load in bad data. > > > > Guozhang > > > > > > > > > > > > > > > > On Wed, Jun 1, 2022 at 5:53 AM Jim Hughes > > wrote: > > > > > Hi all, > > > > >

[jira] [Created] (KAFKA-13998) JoinGroupRequestData 'reason' can be too large

2022-06-15 Thread Jim Hughes (Jira)
Jim Hughes created KAFKA-13998: -- Summary: JoinGroupRequestData 'reason' can be too large Key: KAFKA-13998 URL: https://issues.apache.org/jira/browse/KAFKA-13998 Project: Kafka Issue Type: Bug

Re: [DISCUSS] Apache Kafka 3.3.0 Release

2022-06-03 Thread Jim Hughes
Hi José, Can we add KIP-834 as well? The vote has passed and I have PR in progress. Cheers, Jim On Fri, Jun 3, 2022 at 1:05 PM Mickael Maison wrote: > Hi José, > > Can we also add KIP-827? The vote has passed and I opened a PR today. > > Thanks, > Mickael > > On Fri, Jun 3, 2022 at 5:43 PM

Re: [VOTE] KIP-834: Pause / Resume KafkaStreams Topologies

2022-06-01 Thread Jim Hughes
Mon, May 16, 2022 at 11:07 AM Jim Hughes wrote: > Hi all, > > > With 5 binding votes (John, Bruno, Sophie, Matthias, Bill) and 4 > non-binding votes (Guozhang, Luke, Leah, Walker), the vote for KIP-834 > passes! > > > Thanks all for the great discussion. > > I h

Re: [VOTE] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-16 Thread Jim Hughes
> > > > > > > > > > > > > > > > > -Matthias > > > > > > > > > > > > On 5/10/22 12:32 PM, Sophie Blee-Goldman wrote: > > > > > > > Thanks for the KIP! +1 (binding) > > > >

Re: [DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-11 Thread Jim Hughes
ause state? > > > I can imagine there's a use case that after pausing for a while, user > > just > > > want to continue with the latest offset, and skipping the intermediate > > > records. > > > > > > Thank you. > > > Luke > > > >

Re: [DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-10 Thread Jim Hughes
y document it. > > > -Matthias > > On 5/10/22 12:04 PM, Jim Hughes wrote: > > Hi Bill, all, > > > > Thank you. I've updated the KIP to reflect pausing standby tasks as > well. > > I think all the outstanding points have been addressed and I'm going to >

[VOTE] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-10 Thread Jim Hughes
Hi all, I'm asking for a vote on KIP-834: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=211882832 Thanks in advance! Jim

Re: [DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-10 Thread Jim Hughes
; since it may be surprising if we decide to only pause active processing > > > (another option > > > is to rename the method something like #pauseProcessing or > > > #pauseActiveProcessing > > > so that it's hard to miss). > > > > > &

Re: [DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-09 Thread Jim Hughes
to try and > > guess > > > what that proposal will look like. > > > > > > To be honest, you’re proposing a KafkaStreams runtime-level > pause/resume > > > function, not a topology-level one anyway, so it seems pretty clear > that >

Re: [DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-09 Thread Jim Hughes
s! Jim > Thanks, > -John > > On Sat, May 7, 2022, at 00:06, Guozhang Wang wrote: > > I'm in favor of the "just pausing the instance itself“ option as well. As > > for EOS, the point is that when the processing is paused, we would not > > trigger any `producer.send`

Re: [DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-06 Thread Jim Hughes
e/resume feature > (ie, APIs) accordingly. Of course, the code can (and should) already be > setup to support it to be future proof. > > Good call out about commit and EOS -- to simplify it, I think it might > be good to commit also for the at-least-once case? > > > -Matthias >

Re: [DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-06 Thread Jim Hughes
> the changelog topic? > Yes, standby tasks would continue reading from the changelog topic. All consumers would continue reading to avoid getting dropped from their consumer groups. Cheers, Jim > Thanks! > Bill > > > On Fri, May 6, 2022 at 2:44 PM Jim Hughes > wrote:

Re: [DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-06 Thread Jim Hughes
live across/outside of it? In the former case, I think there shouldn't be any issues with EOS. Otherwise, we may need to work through some details to get EOS right. Once we figure that out, I can update the KIP. Thanks, Jim > > > Guozhang > > > > On Wed, May 4, 2022 at

[DISCUSS] KIP-834: Pause / Resume KafkaStreams Topologies

2022-05-04 Thread Jim Hughes
Hi all, I have written up a KIP for adding the ability to pause and resume the processing of a topology in AK Streams. The KIP is here: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=211882832 Thanks in advance for your feedback! Cheers, Jim

[jira] [Created] (KAFKA-13873) Add ability to Pause / Resume KafkaStreams Topologies

2022-05-04 Thread Jim Hughes (Jira)
Jim Hughes created KAFKA-13873: -- Summary: Add ability to Pause / Resume KafkaStreams Topologies Key: KAFKA-13873 URL: https://issues.apache.org/jira/browse/KAFKA-13873 Project: Kafka Issue Type

Re: Developer access

2022-04-04 Thread Jim Hughes
Hi Bill, Thank you very much! Cheers, Jim On Mon, Apr 4, 2022 at 4:58 PM Bill Bejeck wrote: > Hey Jim, > > You're all set now on Jira and the Wiki. > > -Bill > > > > On Mon, Apr 4, 2022 at 4:52 PM Jim Hughes > wrote: > > > Hi all, > > > &

Developer access

2022-04-04 Thread Jim Hughes
Hi all, Could I get access to the Kafka project in JIRA and on the Wiki? My username for each is jhughes. Thanks in advance! Cheers, Jim