Vishal2696 opened a new issue, #23798: URL: https://github.com/apache/airflow/issues/23798
### Apache Airflow version 2.2.3 ### What happened Airflow Webserver is unable to fetch the logfiles from worker. I'm using celery executor with the airflow components deployed in kubernetes as pods (under a deployment). Below is the error I see from the webserver UI ``` *** Log file does not exist: /opt/airflow/airflow/logs/mydagname/mytaskname/2022-05-19T04:53:37.167551+00:00/2.log *** Fetching from: http://:8793/log/mydagname/mytaskname/2022-05-19T04:53:37.167551+00:00/2.log *** Failed to fetch log file from worker. Request URL missing either an 'http://' or 'https://' protocol. ``` Below is the error I see in worker pod's STDOUT. ``` self.protocol = self.protocol if parsed_url.scheme is '' else parsed_url.scheme [2022-05-19 10:06:22,046: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[feae5691-b147-4bea-9b4a-bed01b559539] raised unexpected: AirflowException('Celery command failed on host: 10.22.52.110') Traceback (most recent call last): File "/home/airflow/.local/lib/python3.8/site-packages/celery/app/trace.py", line 451, in trace_task R = retval = fun(*args, **kwargs) File "/home/airflow/.local/lib/python3.8/site-packages/celery/app/trace.py", line 734, in __protected_call__ return self.run(*args, **kwargs) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/executors/celery_executor.py", line 90, in execute_command _execute_in_fork(command_to_exec, celery_task_id) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/executors/celery_executor.py", line 101, in _execute_in_fork raise AirflowException('Celery command failed on host: ' + get_hostname()) airflow.exceptions.AirflowException: Celery command failed on host: 10.22.52.110 ``` I tried setting the `AIRFLOW__CORE__HOSTNAME_CALLABLE` to "airflow.utils.net.get_host_ip_address" in both webserver and worker but nothing changed. Still the same error. The worker is sitting behind a kubernetes service with port 8793 mapped to it. Metadata DB: Azure Postgres Server Version 11. ### What you think should happen instead _No response_ ### How to reproduce _No response_ ### Operating System Airflow docker image built from source code. ### Versions of Apache Airflow Providers _No response_ ### Deployment Other Docker-based deployment ### Deployment details kubernetes ### Anything else _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
