No unfortunately it is not the case. The table record is written about 20
seconds before the stream record. I’ll crank up the time tomorrow and see
what happens.
On Tue, Nov 2, 2021 at 6:24 PM Matthias J. Sax wrote:
> Hard to tell, but as it seems that you can reproduce the issue, it might
> be
I did not study your code snippet, but yes, it sounds like a valid
approach from your description.
How can I be sure that the start of the window will
coincide with the Punctuator's scheduled interval?
For punctuations, there is always some jitter, because it's not possible
to run a punctuat
Hard to tell, but as it seems that you can reproduce the issue, it might
be worth a try to increase the idle time further.
I guess one corner case for stream-table join that is not resolved yet
is when stream and table record have the same timestamp... For this
case, the table record might not
Thank you for the information. We are using the Kafka 3.0 client library.
We are able to reliably reproduce this issue in our test environment now. I
removed my timestamp extractor, and I set the max.task.idle.ms to 2000. I
also turned on trace logging for package
org.apache.kafka.streams.processor
we have 2 microservices:
responsible for consuming message and update a globalKtable with
configuration information (key=id, value=myObject)
once it is activated with some id as an input it should look into the
configuration globalKtable and retrieve data by that id
how is it possible to access
Bumping the thread.
Contributors, committers and PMC, please take some time to test this
release candidate and vote.
Thanks,
Mickael
On Tue, Oct 26, 2021 at 7:38 PM Israel Ekpo wrote:
>
> Thanks Bill. That is greatly appreciated :)
>
> We need more PMC members with binding votes to participate.
I'm using Kafka Streams in a deduplication events problem over short time
windows (<= 1 minute).
First I've tried to tackle the problem by using DSL API with
[`.suppress(Suppressed.untilWindowCloses(...))`](
https://kafka.apache.org/21/documentation/streams/developer-guide/dsl-api.html)
operator bu
Hello,
Our system is using kafka for message notification, and sometimes, we
monitered the consumer lag begin to increase.
We can see the messages are handled by consumer quickly in our logs,but slower
than which are produced(Only less than 10 messages per second).
If we restart kafka service
Hi i am trying to build globalktable from a topic which consumes avro
messages.
I am using apicurio for the schema registry.
My problem is that even after the serialisation i receive a GenericRecord
and then i need to map it to my object. I expected to get my object after
the seriliaztion.
Any t
