state, with a checkpoint duration of 280ms to 2 seconds.
Each of the 32 subtasks appear to be handling 1,700-50,000 records an hour with
a bytes received of 7mb and 170mb
Am I barking up the wrong tree?
-Steve
From: David Anderson
Sent: Friday, July 17, 2020 6:54 AM
To: Nelson Steven
Cc
Hello!
We are experiencing occasional backpressure on a Window function in our
pipeline. The window is on a KeyedStream and is triggered by an
EventTimeSessionWindows.withGap(Time.seconds(30)). The prior step does a fanout
and we use the window to sort things into batches based on the Key for t
