jens-scheffler-bosch opened a new pull request, #35258: URL: https://github.com/apache/airflow/pull/35258
This PR reverts PR #35252 as the fix made in this PR just fixed one side effect. Unfortunately when initially the PR #33355 was created I did not see that all temporary scripts and in/out serialized values are written into the tmp folder of the venv and thus pollute the venv. As the vench in the cached case might be used by multiple task slots in parallel, temporary files in a cached venc really generate a concurrency issue - more than just a termination log. This PR: - Revers the efforts of @potiuk in #35252 - Sorry as termination log is now not kept but in a separate tmp folder I needed to remove the newly contributed pytest :-( - Instead each execution of external python/venv is not generating a dedicated temp folder for call data - The generation and use of the tmp path is pushed into the execution to reduce redundant code. If there is a general demand to keep the termination log after a failed run, we need to find a mechanism on top of the tempfolder so that it is not deleted as cleanup. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
