Re: Kafka Streams - issues with windowing and suppress

And the answer is to change .windowedBy(TimeWindows.of(Duration.ofMillis(5000))) and specify the grace period: windowedBy(TimeWindows.of(Duration.ofMillis(5000)).grace(Duration.ofMillis(100))) On Wed, Apr 15, 2020 at 4:34 PM Liam Clarke wrote: > Okay, doing some debugging it looks like I'm see

Re: Kafka Streams - issues with windowing and suppress

Okay, doing some debugging it looks like I'm seeing this behaviour because it's picking up a grace duration of 86,395,000 ms in KTableImpl.buildSuppress, which would happen to be 5000 millis (my window size) off 24 hours, so I've got some clues! On Wed, Apr 15, 2020 at 3:43 PM Liam Clarke wrote:

Kafka Streams - issues with windowing and suppress

Hi all, I have a case where I want to consume from a topic, count the number of certain ids in a given time period X, and emit a new record to a different topic after that same time period X has elapsed containing the aggregated value. I'm using suppress with Suppressed.untilWindowCloses, but not

Re: CVEs for the dependency software guava and rocksdbjni of Kafka

I don't think Guava is a dependency in master or 2.5.0. Ismael On Tue, Apr 14, 2020 at 11:08 AM Guozhang Wang wrote: > Thanks for the reported issue. > > For guava I think we should just upgrade version to 24.1.1 or newer to > resolve 10237. > > For rocksdbjni, I saw that at the moment even cur

How commits are tested for kafka? travis or jenkins?

Hi all, In .travis.yml , /bin/bash ./tests/docker/run_tests.sh is included in script, which will cost a lot time. And I noticed there is a file jenkins.sh. After commiting a patch, email from bui...@travis-ci.com is received. And I looked into errors , it seems the

Re: CVEs for the dependency software guava and rocksdbjni of Kafka

Thanks for the reported issue. For guava I think we should just upgrade version to 24.1.1 or newer to resolve 10237. For rocksdbjni, I saw that at the moment even current master is still using bzip version 1.0.6 so 3189 and 12900 would be existed in newest rocksDB version. I'd suggest you post on

Access Kafka cli for SASL Kafka cluster

Hi, I am having trouble accessing the Secured sasl Kafka cluster from my windows laptop. I do have Confluent Kafka installed but not able to access the Kafka cluster to create topic and change retention policy on topics residing in cluster. Any suggestions on how to achieve this ? Thanks, Asma

1 of 3 brokers can't replicate to specific 1 broker

Hello, I would like to consult regarding issue in one of my Kafka cluster which contain 3 brokers and 3 zookeepers. After broker unexpected restarted, 1 of my brokers stopped to replicate the data to specific 1 broker. To the other broker the data is replicated and on the opposite direction it

Essential of Kafka

Hi There! This is not really a development question, but I need some inspiration and feedback on my video about a Kafka streaming process. The link of the video is here: https://www.youtube.com/watch?v=G_kZc_eSLoo. And this is the process I have animated: [cid:image001.png@01D6124F.04183520]

[RESULTS] [VOTE] 2.5.0 RC3

Thanks everyone! The vote passes with 7 +1 votes (4 of which are binding) and no 0 or -1 votes. 4 binding +1 votes from PMC members Manikumar, Jun, Colin, and Matthias 1 committer +1 vote from Bill 2 community +1 votes from Israel Ekpo and Jonathan Santilli Voting email thread http://mail-archive

Re: How to alter topic config with broker endpoint

Hi Weichu, Use --bootstrap-server option instead. ex: *bin/kafka-configs.sh --bootstrap-server localhost:9092 --entity-type topics --entity-name test --alter --add-config max.message.bytes=124000* Thanks. On Tue, Apr 14, 2020 at 12:17 PM Weichu Liu wrote: > Hi, > > We have an in-house Kafka cl

Re: [kafka-clients] [VOTE] 2.5.0 RC3

Hello, I have ran the tests (passed) Follow the quick start guide with scala 2.12 (success) +1 Thanks! -- Jonathan On Tue, Apr 14, 2020 at 1:16 AM Colin McCabe wrote: > +1 (binding) > > verified checksums > ran unitTest > ran check > > best, > Colin > > On Tue, Apr 7, 2020, at 21:03, David Ar

Re: Process offsets from particular point

Hello, This isn't resource intensive at all, it merely just changes à value in the zookeeper instance and share it across the cluster. Le dim. 12 avr. 2020 à 05:56, KhajaAsmath Mohammed a écrit : > > Thanks Senthil. This is helpful but I am worried about doing it with > standalone process as our