Re: Window-join DataStream (or KeyedStream) with a broadcast stream

2019-11-25 Thread Piotr Nowojski
Hi, So you are trying to use the same window definition, but you want to aggregate the data in two different ways: 1. keyBy(userId) 2. Global aggregation Do you want to use exactly the same aggregation functions? If not, you can just process the events twice: DataStream<…> events = …;

Window-join DataStream (or KeyedStream) with a broadcast stream

2019-11-24 Thread natasky
Hi all, I use window aggregation to create a stream of aggregated data per user, per some interval. Additionally, I use same windows to aggregate system-wide data per the same interval. I.e.: Per user stream: events keyed by user ID -> tumbling window -> aggregation System wide stream: events