Yohei Onishi created AIRFLOW-2385:
-------------------------------------
Summary: Airflow task is not stopped when execution timeout gets
triggered
Key: AIRFLOW-2385
URL: https://issues.apache.org/jira/browse/AIRFLOW-2385
Project: Apache Airflow
Issue Type: Bug
Components: DAG
Affects Versions: 1.9.0
Reporter: Yohei Onishi
I have my own custom operator extends BaseOperator as follows. I tried to kill
a task if the task runs for more than 30 minutes. timeout seems to be triggered
according to a log but the task still continued.
Am I missing something? I checked the official document but do not know what is
wrong.[https://airflow.apache.org/code.html#baseoperator]
My operator is like as follows.
{code:java}
class MyOperator(BaseOperator):
@apply_defaults
def __init__(
self,
some_parameters_here,
*args,
**kwargs):
super(MyOperator, self).__init__(*args, **kwargs)
# some initialization here
def execute(self, context):
# some code here
{code}
{{}}My task is like as follows.
{code:java}
t = MyOperator(
task_id='task',
dag=scheduled_dag,
execution_timeout=timedelta(minutes=30)
{code}
I found this error but the task continued.
{code:java}
[2018-04-12 03:30:28,353] {base_task_runner.py:98} INFO - Subtask: [Stage
6:==================================================(1380 + -160) /
1224][2018-04- 12 03:30:28,353] {timeout.py:36} ERROR - Process timed out
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
