GitHub user Snaptonis created a discussion: Serialization issues with external_python decorator
Hey everybody, I started changing my dags to use @task.external_python(). I am still running into issues and I don't know what to do anymore. A couple dags fail with: `PicklingError: Can't pickle <function get_connection at 0x7f105f947110>: it's not the same object as tasks.connections.get_connection`. Another fails with: `PicklingError: Can't pickle local object <function my_dag.<locals>.get_config at 0x7f105f94ba00>`. I have a mixture of normal tasks and external_python tasks. I think the the problems start when I have expanded tasks where the result (so the xcom) is used in another task but I'm not certain. Airflow Version: 3.3.0 If you need more infos I'm happy to provide. GitHub link: https://github.com/apache/airflow/discussions/71281 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
