derkuci commented on pull request #6722: URL: https://github.com/apache/airflow/pull/6722#issuecomment-1003754230
> In the 2.1.1 version, I tried to modify the airflow/utils/log/file_task_handler.py file to obtain the hostname information by reading the log table. I confirmed through debug that I could get the host information in this way, @xuemengran could you kindly point to how this could be done? With airflow 2.2.2 + Celery, I am seeing error messages like below due to `TaskInstance.hostname` being always the latest and not relying on the `try_number`. ``` "Failed to fetch log file from worker. Client error '404 NOT FOUND' for url ..." ``` If we try really hard, the logs can be found from the local storage of _some_ celery workers. But that is a huge burden for operational and/or debugging. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
