potiuk commented on issue #20974: URL: https://github.com/apache/airflow/issues/20974#issuecomment-3038870068
> [@potiuk](https://github.com/potiuk) thanks for clarification! I will play a bit more with various combinations of options and try to conclude it somehow, just the last question for now - there are still no plans to make `dill` the default serializer (at least for `PythonVirtualOperator`), right? If anything, maybe `cloudpickle` (as being safer and more modern) but we also do not want to make it enabled by default as it has performance and - potentially - security implications. Serialization is generally "hard" problem and we have about 5 or 6 differnet serializations in Airflow (pickle, dill, cloudpickle, two or three implementation of "airflow serializer", Pydantic, and probably few more ....), We did not manage to get to conclusion whether to unify them or keep different serializations for different purposes even, so I doubt we will be able to get some conclusions on changing default behaviour. If anything - I think - maybe a good approach should be to catch the errors that are raised when you **really** need serialization here and provide a bit more descriptive error - linking - YES - to the documentation you might write about it :) . That would be even BETTER contribution than just writing docs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
