dominikhei commented on issue #61716: URL: https://github.com/apache/airflow/issues/61716#issuecomment-3876810881
> > This looks like some kind of race condition. Having a retry delay is an option, I think if we could implement some kind of lock this would be even better. I can have a look at it if deemed necessary. > > Not sure why, but I'm seeing this "WARNING - Repository clone/open failed, ..." in almost every DAG run. `WARNING - Repository clone/open failed, cleaning up and retrying` The cleanup does not work as we have the root error: `stderr: 'fatal: destination path '/tmp/airflow/dag_bundles/.../versions/09b6...' already exists and is not an empty directory`. I am not sure how the git operator works, will have a look at it, but to me it looks like the cloning is tried before everything is cleaned up and thus either incomplete or not synchronized with the retry. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
