Ah. And in re-reading your email, that also sounds like a bug we can fix.
Unbounded PCollections are quite new to the Go SDK, PubSub on Dataflow
being the only way to produce them for a long time. There's bound to be a
few of those .
A glance at the handling code doesn't indicate there should be
Hello Kane!
In chatting with Jack, this won't be possible to implement in the Go SDK
until 2.40. DoFn self checkpointing only made it into the Go SDK a week or
two ago. That is required for unbounded PCollections.
A Go native Periodic Sequence isn't yet implemented at head, but there
shouldn't be
Hi Jack,
Thanks for the quick reply. Having tried to add windowing that does not seem to
help. Here is an example pipeline [1].
I'm trying to re-create the slowly updating side-input outlined in [2], a
common beam pattern.
The side-input is created as a bounded node in the graph, and it is not
Hi there,
I’m trying out a streaming pipeline which reads events from a pubsub topic and
I want to pass a side input to the stage that processes this pubsub event,
updating the side input value every 5 minutes using an impulse that kicks off a
time.Ticker which emits every 5 minutes.
The strea
