Re: How & Where does flink stores data for aggregations.

2017-11-24 Thread Piotr Nowojski
Hi, Flink will have to maintain state of the defined aggregations per each window and key (the more names you have, the bigger the state). Flinkā€™s state backend will be used for that (for example memory or rocksdb). However in most cases state will be small and not dependent on the length of

How & Where does flink stores data for aggregations.

2017-11-23 Thread Shivam Sharma
Hi All, I have a small question regarding where does Flink stores data for doing window aggregations. Lets say I am running following query on Flink table: SELECT name, count(*) FROM testTable GROUP BY TUMBLE(rowtime, INTERVAL '1' MINUTE), name So, If I understand above query properly so it