Re: Understanding out of order message processing w/ Streaming

Makes sense. Thanks On 13 Oct 2016 12:42 pm, "Michael Noll" wrote: > > But if they arrive out of order, I have to detect / process that myself > in > > the processor logic. > > Yes -- if your processing logic depends on the specific ordering of > messages (which is the

Re: Understanding out of order message processing w/ Streaming

> But if they arrive out of order, I have to detect / process that myself in > the processor logic. Yes -- if your processing logic depends on the specific ordering of messages (which is the case for you), then you must manually implement this ordering-specific logic at the moment. Other use

Re: Understanding out of order message processing w/ Streaming

Thanks Matthias. So, if I'm understanding this right, Kafka will not discard which messages which arrive out of order. What it will do is show messages in the order in which they arrive. But if they arrive out of order, I have to detect / process that myself in the processor logic. Is that

Re: Understanding out of order message processing w/ Streaming

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Last question first: A KTable is basically in finite window over the whole stream providing a single result (that gets updated when new data arrives). If you use windows, you cut the overall stream into finite subsets and get a result per window.

Re: Understanding out of order message processing w/ Streaming

P.S, does my scenario require using windows, or can it be achieved using just KTable? On Wed, Oct 12, 2016 at 8:56 AM, Ali Akhtar wrote: > Heya, > > Say I'm building a live auction site, with different products. Different > users will bid on different products. And each

Understanding out of order message processing w/ Streaming

Heya, Say I'm building a live auction site, with different products. Different users will bid on different products. And each time they do, I want to update the product's price, so it should always have the latest price in place. Example: Person 1 bids $3 on Product A, and Person 2 bids $5 on