Contributors list

2021-10-27 Thread Michael Negodaev
Hello! Please add me to the contributor list in JIRA with username "mnegodaev". Thank you.

Re: Kafka streams - message not materialized in intermediate topics

2021-10-27 Thread Matthias J. Sax
For this case, you can call `aggregate(...).suppress()`. -Matthias On 10/27/21 12:42 PM, Tomer Cohen wrote: Hi Bill, Thanks for the prompt reply. Setting to 0 forces a no collection window, so if I get 10 messages to aggregate for example, it will send 10 updates. But I only want to publish t

Re: Apache Kafka : start up scripts

2021-10-27 Thread Israel Ekpo
Start here https://github.com/apache/kafka/blob/trunk/bin/kafka-server-start.sh https://github.com/apache/kafka/tree/trunk/core/src/main/scala/kafka/server Also take a look at the logs when the server starts up. That should give you some insights. On Wed, Oct 27, 2021 at 5:03 PM Kafka Life wro

Apache Kafka : start up scripts

2021-10-27 Thread Kafka Life
Dear Kafka experts when an broker is started using start script , could any of you please let me know the sequence of steps that happens in the back ground when the node UP like : when the script is initiated to start , 1/ is it checking indexes .. ? 2/ is it checking isr ? 3/ is URP being made t

Re: Kafka streams - message not materialized in intermediate topics

2021-10-27 Thread Tomer Cohen
Hi Bill, Thanks for the prompt reply. Setting to 0 forces a no collection window, so if I get 10 messages to aggregate for example, it will send 10 updates. But I only want to publish the final state only. Thanks, Tomer On Wed, Oct 27, 2021 at 2:10 PM Bill Bejeck wrote: > Hi Tomer, > > From

Re: Kafka streams - message not materialized in intermediate topics

2021-10-27 Thread Bill Bejeck
Hi Tomer, >From the description you've provided, it sounds to me like you have a stateful operation. The thing to keep in mind with stateful operations in Kafka Streams is that every result is not written to the changelog and forwarded downstream. Kafka Streams uses a cache for stateful operation

multiple tenants accessing Confluent kafka on GCP

2021-10-27 Thread karan alang
Hello All - For multiple external tenants accessing Kafka, is there any issue with providing the same endpoint (ie. set of brokers, ports) to the multiple producers ? what are the best practices wrt multiple tenants producing data on (Confluent) Kafka topics, Kafka being installed on GCP. tia!

Kafka streams - message not materialized in intermediate topics

2021-10-27 Thread Tomer Cohen
Hello Kafka team, I am seeing an odd behavior when using kafka streams. During periods of heavier volumes, there are messages coming in. However, they do look like they are processed by the adder/subtractor and are not materialized in the intermediate topics which causes them not to be outputted

Replica leader election stops when zk connection is re-established

2021-10-27 Thread Olsson, Daniel
Hi all! We have a problem with 6 of our Kafka clusters since we upgraded to 2.8.0 from 2.3.1 a few months back. A seventh cluster is still on 2.3.1 and never had this problem. The cluster runs fine for a random period, days, or weeks. Suddenly when creating new topics, they never get assigned p