o-nikolas commented on issue #35164: URL: https://github.com/apache/airflow/issues/35164#issuecomment-1788121752
I think we're trying to resolve a non-existing problem here. The only reason throttling happened in this case was because of the issues with the Role. We do not generally see reports of hitting this throttling naturally very often (and we have some VERY big users with lots of tasks). I think the best course of action is to simply increase your quota if your task throughput is so massive that you do legitimately hit that throttling error. And in this specific case, I think some better logging of the errors with the describe request could help users like @nwsparks root cause their issue earlier. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org