GC state in case of global window

Hi, I implemented a Cortex sink that takes care of the constraint that Cortex requires samples to arrive ordered by time. The implementation is based on ideas of Kenn Knowles that he shared at https://stackoverflow.com/a/45911664/1517328. The gist is to use a stateful transform in combination wit

Re: Checking a Pcoll is empty in Apache Beam

Hi Reuven, Yes, for now this is a bounded PCollection. Thanks & Regards Rajnil Guha On Mon, Jul 19, 2021 at 12:02 AM Reuven Lax wrote: > Is this a bounded collection? > > On Sun, Jul 18, 2021, 11:17 AM Rajnil Guha > wrote: > >> Hi Beam Users, >> >> I have a use-case where I need to check whet

Checking a Pcoll is empty in Apache Beam

Hi Beam Users, I have a use-case where I need to check whether a Pcollection is empty or not. If it's not empty I need to write a message to a Pub/Sub topic. I am using the Python SDK and Dataflow to write and run my pipelines respectively. I searched but could not come across any concrete way on