I get the same error in airflow-worker.err, the real underlying cause only
revealed itself in airflow-worker.out
Damian
-Original Message-
From: heng gu
Sent: Wednesday, February 26, 2020 12:35
To: dev@airflow.apache.org
Subject: Re: task failed without running
thanks for your
ot;, line 630, in
connect
raise exc
sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (2003, "Can't
connect to MySQL server on 'my_db.my_domain.net' (timed out)")
Regards
Damian
-Original Message-
From: Mehmet Ersoy
Sent: Wednesday, February 26, 2020 03:18
To
You should look in airflow-worker.out for an exception that's happening at
about the same time.
Damian
-Original Message-
From: heng gu
Sent: Wednesday, February 26, 2020 11:55
To: dev@airflow.apache.org
Subject: Re: task failed without running
I got an advice from slack to check
I got an advice from slack to check airflow-worker.err, and here is what I
found
File "python3.6/site-packages/airflow/executors/celery_executor.py", line 67,
in execute_command close_fds=True, env=env) File
"pypacks/lib/python3.6/subprocess.py", line 311, in check_call raise
/connections.py", line 630, in
connect
raise exc
sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (2003, "Can't
connect to MySQL server on 'my_db.my_domain.net' (timed out)")
Regards
Damian
-Original Message-
From: Mehmet Ersoy
Sent: Wednesday, February 26, 2020 03:
Hi Heng,
I have same problem. Failed jobs do not dump log files. Do you have this
problem too?
Have you been using Redis as message queue? Also can you send
configurations related parallelism and concurrent in airflow.cfg file?
Best regards,
Mehmet.
heng gu , 24 Şub 2020 Pzt, 17:51 tarihinde
I have this dag with a branchpythonoperator task kicking off many of 24 tasks,
in this case, 4 tasks. 2 of the tasks were successful, the other two
(register_YZ, register_ZY) were failed without running (see the attached UI
screen shots). There is no log for tasks register_YZ and register_ZY. I
