scwhittle commented on issue #35934: URL: https://github.com/apache/beam/issues/35934#issuecomment-3659651097
I think that this could be due to the internal caching of global side-inputs within the python sdk. I previously added an experiment `disable_global_windowed_args_caching` to disable this, it would be interesting to see if using that matches your expectations. There was a performance impact so that wasn't enabled in all cases. I had previously put together https://github.com/apache/beam/pull/31356 to fix this by clearing per-bundle but it relied on the sdk cache which was disabled at the time and I lost track of it. Resurrecting that may be the fix to this bug. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
