potiuk commented on issue #20974: URL: https://github.com/apache/airflow/issues/20974#issuecomment-3038796259
Sure. Happy to tell you my opinion - but remember it's an opinion, not "ultimate truth" and best way is to look at the code and verify it. 1) I think some kwargs might require dill or other form of serialization - this is pretty normal that some object cannot be serialized - that's why dill, cloudpickle and other serializers exist 2) As far as I know - no and it has never been planned for it to work. But I might be wrong - maybe someone planned it or maybe someone (you?) can contribute it so that it works. It would require to pass the whole context and serialize it back/forth in the script that is executed by PythonVirtualenvOperator 3) yes it has always been a universal solution, but if some context param cannot be serialized directly, it might require dill or cloudpickle - depends on the parameter you are passing. I think that is actually explaines somewhere in the docs that the parameters that you pass to Python Virtualenv need to be serializable, context parameters are no exception. Feel free to convert it to documentation update that will make it easier for others to understand it. For me those are pretty natural answers simply by knowing how things work and how passing parameters and serialization works, but - again - I have a lot of assumptions in my head so I do not even feel the need of explaining it - so you are probably the best person in the world now to attempt to do it so that people like you could understand it in a glance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
