Re: Forcing consuming one stream completely prior to another starting

2018-01-26 Thread Aljoscha Krettek
Hi, How can you determine whether the required decoration data for an event from the main stream is there? If it works via event-time you could think about buffering main-input events in the operator until the corresponding decoration arrives. On a side note, we're currently working on

Re: Forcing consuming one stream completely prior to another starting

2018-01-20 Thread Maxim Parkachov
Hi Ron, I’m joining two streams - one is a “decoration” stream that we have in a > compacted Kafka topic, produced using a view on a MySQL table AND using > Kafka Connect; the other is the “event data” we want to decorate, coming in > over time via Kafka. These streams are keyed the same way -

Forcing consuming one stream completely prior to another starting

2018-01-19 Thread Ron Crocker
I’m joining two streams - one is a “decoration” stream that we have in a compacted Kafka topic, produced using a view on a MySQL table AND using Kafka Connect; the other is the “event data” we want to decorate, coming in over time via Kafka. These streams are keyed the same way - via an “id”