ramonvermeulen commented on PR #46911:
URL: https://github.com/apache/airflow/pull/46911#issuecomment-2862130531

   > > Yes, something similar where the logs get fetched after completion via 
the logging API (or polled during job execution, but I think you will run into 
API limits even quicker). In the issue there is already [an 
example](https://github.com/apache/airflow/issues/36963#issuecomment-2669566660)
 provided, with a side note about the API limits.
   > 
   > in some of AWS operators that store logs in cloud watch there is the 
option to set fetch interval
   > 
   > 
https://github.com/apache/airflow/blob/cb295c351a016c0a10cab07f2a628b865cff3ca3/providers/amazon/src/airflow/providers/amazon/aws/operators/ecs.py#L375-L376
   > 
   > but lets not discuss this here. The reason I mentioned this is to ask if 
you can comment on the issue and explain what is left to implement after we 
merge this PR so it will be clear to the developer who takes the task
   
   Sure, that makes sense! I will give an update in the issue after the PR is 
merged 👍


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to