I'm not sure. When I ran with trace logging turned on I saw a bunch of
messages like the ones below. Do those messages indicate
"enforced-processing"? It gets logged right after the call
to enforcedProcessingSensor.record.
Continuing to process although some partitions are empty on the broker.
Can you check if the program ever does "enforced processing", ie,
`max.task.idle.ms` passed, and we process despite an empty input buffer.
Cf https://kafka.apache.org/documentation/#kafka_streams_task_monitoring
As long as there is input data, we should never do "enforced processing"
and the
Just a quick update. Setting max.task.idle.ms to 1 (10 seconds) had no
effect on this issue.
On Tue, Nov 2, 2021 at 6:55 PM Chad Preisler
wrote:
> No unfortunately it is not the case. The table record is written about 20
> seconds before the stream record. I’ll crank up the time tomorrow
You could do something similar to what the WindowStore does and store a
key-timestamp pair as actual key. Given current wall-clock time, you can
compute the time for closed windows and do corresponding lookups (either
per key, or using range scans).
-Matthias
On 11/3/21 12:40 AM, Luigi
Hello
The idea behind a GlobalKTable is to materiliaze data (a kafka topic)
close from where it is used. Actually, each task/worker will materialize
the full GlobalKTable in order to use it. So in your scenario, what
should be shared between your services is ideally the Kafka topic used
to
Hello Matthias, thanks for your reply.
> Using a plain kv-store, whenever the punctuation runs you can find closed
windows, forward the result and also delete the row explicitly, which give
you more control.
What is the best way to find closed windows? Have you got any examples?
Thanks! :)
On
Hello Matthias, thanks for your reply.
> Using a plain kv-store, whenever the punctuation runs you can find closed
windows, forward the result and also delete the row explicitly, which give
you more control.
What is the best way to find closed windows? Have you got any examples?
Thanks! :)
Il
Hi,
+1 (binding)
- verified the signatures
- verified the quickstart with binary
Thanks for running the release!
Thanks,
Manikumar
On Tue, Nov 2, 2021 at 11:16 PM Mickael Maison wrote:
> Bumping the thread.
>
> Contributors, committers and PMC, please take some time to test this
> release
