eladkal commented on PR #46911: URL: https://github.com/apache/airflow/pull/46911#issuecomment-2862072192
> Yes, something similar where the logs get fetched after completion via the logging API (or polled during job execution, but I think you will run into API limits even quicker). In the issue there is already [an example](https://github.com/apache/airflow/issues/36963#issuecomment-2669566660) provided, with a side note about the API limits. in some of AWS operators that store logs in cloud watch there is the option to set fetch interval https://github.com/apache/airflow/blob/cb295c351a016c0a10cab07f2a628b865cff3ca3/providers/amazon/src/airflow/providers/amazon/aws/operators/ecs.py#L375-L376 but lets not discuss this here. The reason I mentioned this is to ask if you can comment on the issue and explain what is left to implement after we merge this PR so it will be clear to the developer who takes the task -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
