Team,
Is there a users@ mailing list for Apache Airflow? If not, is this where I
submit product questions to?
Let me do it anyways. I am new to Airflow and I just deployed it on Ubuntu.
I have also deployed Postgres as it's DB and Celery. I started the
scheduler and the web server. The UI comes up, but even the demo DAGs don't
run. I poked around the scheduler logs and I see these errors in a constant
loop. This is printed per task in the airflow-scheduler.log and out
files. Let me know if you whats going wrong here:
2019-04-30 20:23:51,087 ERROR - Process timed out, PID: 20761
2019-04-30 20:23:53,088 ERROR - Process timed out, PID: 20761
2019-04-30 20:23:55,089 ERROR - Process timed out, PID: 20761
2019-04-30 20:23:55,131 ERROR - Error sending Celery task:Timeout, PID:
20761
Celery Task ID: (u'example_bash_operator', u'runme_2',
datetime.datetime(2019, 4, 27, 0, 0, tzinfo=<TimezoneInfo [UTC, GMT,
+00:00:00, STD]>), 1)
Traceback (most recent call last):
File
"/usr/local/lib/python2.7/dist-packages/airflow/executors/celery_executor.py",
line 118, in send_task_to_executor
result = task.apply_async(args=[command], queue=queue)
File "/usr/local/lib/python2.7/dist-packages/celery/app/task.py", line
535, in apply_async
**options
File "/usr/local/lib/python2.7/dist-packages/celery/app/base.py", line
728, in send_task
amqp.send_task_message(P, name, message, **options)
File "/usr/local/lib/python2.7/dist-packages/celery/app/amqp.py", line
552, in send_task_message
**properties
File "/usr/local/lib/python2.7/dist-packages/kombu/messaging.py", line
181, in publish
exchange_name, declare,
File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line
510, in _ensured
return fun(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/kombu/messaging.py", line
187, in _publish
channel = self.channel
File "/usr/local/lib/python2.7/dist-packages/kombu/messaging.py", line
209, in _get_channel
channel = self._channel = channel()
File "/usr/local/lib/python2.7/dist-packages/kombu/utils/functional.py",
line 44, in __call__
value = self.__value__ = self.__contract__()
File "/usr/local/lib/python2.7/dist-packages/kombu/messaging.py", line
224, in <lambda>
channel = ChannelPromise(lambda: connection.default_channel)
File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line
852, in default_channel
self.ensure_connection(**conn_opts)
File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line
422, in ensure_connection
callback, timeout=timeout)
File "/usr/local/lib/python2.7/dist-packages/kombu/utils/functional.py",
line 355, in retry_over_time
sleep(1.0)
File "/usr/local/lib/python2.7/dist-packages/airflow/utils/timeout.py",
line 43, in handle_timeout
raise AirflowTaskTimeout(self.error_message)
AirflowTaskTimeout: Timeout, PID: 20761
Thanks,
Andy
