Hello, I'm having issues running beam.util.GroupIntoBatches() in DataFlow.

I get the following error message:

Exception: Requested execution of a stateful DoFn, but no user state
> context is available. This likely means that the current runner does not
> support the execution of stateful DoFns


Seems to be related to:
https://stackoverflow.com/questions/56403572/no-userstate-context-is-available-google-cloud-dataflow

Is there another way I can achieve the same using other beam function?

I basically want to batch rows into groups of 100 as it is a lot faster to
transform all at once than doing it 1 by 1.

I also was planning to use this function for a custom snowflake sink (so I
could insert many rows at once)

I'm sure there must be another way to do this in DataFlow but not sure how?

Thanks so much!

Reply via email to