victorrgez commented on issue #27707: URL: https://github.com/apache/beam/issues/27707#issuecomment-2149697573
@kemkemG0 In case you did not manage to solve the issue, the whole problem is in the class `ImpulseSeqGenRestrictionProvider` in the method `restriction_size` which is the one that tells Dataflow how much backlog there is to be processed, and hence, it tells Dataflow not to downscale because there is too much to process yet. In can be solved "easily" by replacing this method in a subclass for: ``` def restriction_size(self, unused_element, restriction): """ This removes the backlog issue by specifying the size to be processed is 0 """ return 0 ``` And then subclass `ImpulseSeqGenDoFn` so that it uses this `RestrictionProvider` and, finally subclass `PeriodicImpulse` so that it uses your `ImpulseSeqGenDoFn` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org