[I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
potiuk opened a new issue, #35307: URL: https://github.com/apache/airflow/issues/35307 ### Body There is a regression that needs investigation. One of our tests is failing only on Python 3.11 `tests/operators/test_python.py::TestPythonVirtualenvOperator::test_airflow_context`

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-11-16 Thread via GitHub
NotYuki commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1814232866 If you don't need Airflow context you can try to pass `system_site_packages=False` to Operator as a workaround: ``` PythonVirtualenvOperator( ... system_site_package

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
potiuk commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1787874790 Detected it while improving our test suite - I found out that we have not run the `PlainAssert` tests for a while and well, of course it turned out that Python 3.11 has problem with

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
Taragolis commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1788030750 Assumption 1 --- Maybe it happen because we use [dill==3.1.1.1](https://github.com/apache/airflow/blob/eb0f00cf9c4c71fd871c970857da481d097a4733/constraints-3.11.txt

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
potiuk commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1788073199 Yes. It's very likely about old version and pendulum. Unfortunately beam is rather tightly pinning dill: https://github.com/apache/beam/blob/16fee7505e35e402cc28a55384c81fef

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
Taragolis commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1788084789 Maybe it is a good time to think about old issue https://github.com/apache/airflow/issues/7870 -- This is an automated message from the Apache Git Service. To respond to the me

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
potiuk commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1788091610 Yeah. Why not :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment