nwsparks commented on issue #35164: URL: https://github.com/apache/airflow/issues/35164#issuecomment-1779320595
so it does seem watchtower was updated to not do this every time, however the code for it is wrapped in a try/catch that first does describe log groups, then swallows any errors and the catch block just tries to create the log group...which is not ideal. we found via manual testing that the problem is we don't have permissions on the IAM role airflow is using to list all log groups, it just has `*` on the group we created....so per the above behavior it was calling createloggroup for every task. that said, I still think that the option to just disable creation of the group should be considered. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
