[ https://issues.apache.org/jira/browse/AIRFLOW-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ash Berlin-Taylor closed AIRFLOW-1029. -------------------------------------- Resolution: Cannot Reproduce Think this has been fixed now. Please open a new issue if this is still happening against 1.10.0+ > https://issues.apache.org/jira/browse/AIRFLOW > --------------------------------------------- > > Key: AIRFLOW-1029 > URL: https://issues.apache.org/jira/browse/AIRFLOW-1029 > Project: Apache Airflow > Issue Type: Bug > Components: scheduler > Affects Versions: 1.9.0 > Reporter: Alessio Palma > Priority: Major > Labels: amqp_compliance, rabbitmq, scheduler > Attachments: PannelloAIRFLOW 2.png, image (1).png > > > I'm using: > AIRFLOW 1.8.0RC5 > ERLANG 19.2 > RABBIT 3.6.7 > PYTHON 2.7 > When I start a DAG from the panel ( see picture ), Scheduler stop working. > After some investigation the problem raises here: > celery_executor.py: > 83 def sync(self): > 84 > 85 self.logger.debug( > 86 "Inquiring about {} celery task(s)".format(len(self.tasks))) > 87 > 88 for key, async in list(self.tasks.items()): > 90 state = async.state <---- HERE > Python stack trace says that the connection is closed; capturing some TCP > traffic I can see that the connection to RABBITMQ is closed ( TCP FIN ) > before to send a STOMP, so RABBITMQ replies with TCP RST. ( see picture 2: > 172.1.0.2 -> rabbitmq node, 172.1.0.1 -> airflow node ) > This exception stops the scheduler. > If you are using airflow-scheduler-failover-controller the scheduler is > restarted, but this is just a work around and does not fixes the problem at > the root. > Is safe to trap the exception ? -- This message was sent by Atlassian JIRA (v7.6.3#76005)