Re: Streams, Kafka windows

Good idea! I’ll make a note to do it when I’m at a computer. On Sat, Jan 18, 2020, at 21:51, Guozhang Wang wrote: > Hey John, > > Since this is a common question and I've seen many users asking about > window semantics like this, could you file a JIRA ticket for creating a > wiki page like Join

Re: Streams, Kafka windows

Hey John, Since this is a common question and I've seen many users asking about window semantics like this, could you file a JIRA ticket for creating a wiki page like Join Semantics ( https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Streams+Join+Semantics) to summarize the windowing

Re: KIP-560 Discuss

Thank you I understand you 1. admin client has topic list 2. applicationId can only have one stream, so It won't be a problem! 3. For example, --input-topic [reg] Allowing reg solves some inconvenience On 2020/01/18 18:15:23, Gwen Shapira wrote: > I am not sure I follow. Afaik: > > 1.

[jira] [Created] (KAFKA-9454) Relax transaction.id security requirement

Boyang Chen created KAFKA-9454: -- Summary: Relax transaction.id security requirement Key: KAFKA-9454 URL: https://issues.apache.org/jira/browse/KAFKA-9454 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-9453) Make transaction.id optional in group mode EOS

Boyang Chen created KAFKA-9453: -- Summary: Make transaction.id optional in group mode EOS Key: KAFKA-9453 URL: https://issues.apache.org/jira/browse/KAFKA-9453 Project: Kafka Issue Type:

Re: Streams, Kafka windows

Glad it helped! -John On Sat, Jan 18, 2020, at 12:27, Viktor Markvardt wrote: > Hi John, > > Thank you for your assistance! > Your example very help me and I understood kafka-streams more clearly now. > Have a nice weekend :) > > Best regards, > Viktor Markvardt > > чт, 16 янв. 2020 г. в

Re: Streams, Kafka windows

Hi John, Thank you for your assistance! Your example very help me and I understood kafka-streams more clearly now. Have a nice weekend :) Best regards, Viktor Markvardt чт, 16 янв. 2020 г. в 19:29, John Roesler : > Hi Viktor, > > I’m starting to wonder what exactly “duplicate” means in this

[DISCUSS] KIP-552: Add new cached authorizer:change the dim of cache

Hello all, I wrote a KIP about adding the new cached authorizer,this improvement can reduce greatly the CPU usage in the long run. Please take a look: https://cwiki.apache.org/confluence/display/KAFKA/KIP-553%3A+Using+AclCommand%2Cavoid+call+the+global+method+loadcache+in+SimpleAclAuthorizer

Re: [DISCUSS] : KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance

Sure John, I will update the StoreQueryParams with static factory methods. @Ted, we would need to create taskId only in case a user provides one single partition. In case user wants to query all partitions of an instance the current code is good enough where we iterate over all stream threads

Re: [DISCUSS] : KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance

Looking at the current KIP-562: bq. Create a taskId from the combination of store name and partition provided by the user I wonder if a single taskId would be used for the “all partitions” case. If so, we need to choose a numerical value for the partition portion of the taskId. On Sat, Jan 18,

Re: [DISCUSS] : KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance

Thanks, Ted! This makes sense, but it seems like we should lean towards explicit semantics in the public API. ‘-1’ meaning “all partitions” is reasonable, but not explicit. That’s why I suggested the Boolean for “all partitions”. I guess this also means getPartition() should either throw an

Re: KIP-560 Discuss

I am not sure I follow. Afaik: 1. Topics don't include client ID information 2. Even if you did, the same ID could be used for topics that are not Kafka Streams input The regex idea sounds doable, but I'm not sure it solves much? On Sat, Jan 18, 2020, 7:12 AM Sang wn Lee wrote: > Thank you >

Re: [DISCUSS] : KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance

Hi Navinder, Thanks for the explanation. Your thinking makes sense, but those classes are actually only constructed internally by Streams, never by users of the API. I believe all the public config objects are constructed with factory methods. What you say for the partition selection sounds

Re: KIP-560 Discuss

Thank you Gwen Shapira! We'll add a flag to clear all topics by clientId It is ‘reset-all-external-topics’ I also want to use regex on the input topic flag to clear all matching topics. On 2020/01/17 19:29:09, Gwen Shapira wrote: > Seem like a very nice improvement to me. But I have to admit

Re: [DISCUSS] : KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance

I wonder if the following two methods can be combined: Integer getPartition() // would be null if unset or if "all partitions" boolean getAllLocalPartitions() // true/false if "all partitions" requested into: Integer getPartition() // would be null if unset or -1 if "all partitions" Cheers On

Build failed in Jenkins: kafka-2.4-jdk8 #129

See Changes: [matthias] MINOR: move "Added/Removed sensor" log messages to TRACE (#7502) -- [...truncated 5.49 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Created] (KAFKA-9452) Add new cached authorizer:change the dim of cache

Steven Lu created KAFKA-9452: Summary: Add new cached authorizer:change the dim of cache Key: KAFKA-9452 URL: https://issues.apache.org/jira/browse/KAFKA-9452 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-559: Make the Kafka Protocol Friendlier with L7 Proxies

Hi all, FYI - I will start a vote on Monday if there no comments. Regards, David Le mer. 15 janv. 2020 à 13:48, David Jacot a écrit : > Hi all, > > I just posted KIP-559: Make the Kafka Protocol Friendlier with L7 Proxies: > >