mmckerns commented on issue #32617: URL: https://github.com/apache/beam/issues/32617#issuecomment-2994399244
If there's interest in unpicking old pickles from a particular version where the dill algorithm may have changed for whatever reason, there is a mechanism in dill to unpickle across algorithmic change. Essentially, one adds an unpickler for the old algorithm -- to what we have been calling a `shim`, which detects the old version and then uses the "alternate" algorithm. https://github.com/uqfoundation/dill/blob/master/dill/_shims.py -- Would something like this work for your case? We've had to use it a few times where python broke backward compatibility, and thus also forced backward incompatible changes in dill. If you have a handful of particular cases that are impacted, this might be a path forward... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
