Chandu Kavar created AIRFLOW-3087: ------------------------------------- Summary: Task stuck in UP_FOR_RETRY and continuously showing Not In Retry Period Key: AIRFLOW-3087 URL: https://issues.apache.org/jira/browse/AIRFLOW-3087 Project: Apache Airflow Issue Type: Bug Components: scheduler Affects Versions: 1.9.0 Reporter: Chandu Kavar Attachments: Screen Shot 2018-09-19 at 10.27.25 AM.png
Hi, We are facing issues with "up_for_retry" of the task in few DAGs. When the task failed and scheduler picks up for "up_for_retry", it got stuck. In task instance details we see this log when the retry time appears: {{All dependencies are met but the task instance is not running. In most cases this just means that the task will probably be scheduled soon unless: - The scheduler is down or under heavy load If this task instance does not start soon please contact your Airflow administrator for assistance.}} after retry delay again it shows (and it keep showing this log): {{Not In Retry Period Task is not ready for retry yet but will be retried automatically. Current date is 2018-08-29T15:xx:xxxx and task will be retrieve. }} After an hour task is able to retry. Code: {code:java} from datetime import * from airflow import DAG from airflow.operators.python_operator import PythonOperator from airflow.operators.bash_operator import BashOperator default_args = { 'owner': 'Chandu', 'depends_on_past': False, 'retries': 3, 'retry_delay': timedelta(minutes=1), 'queue': 'worker_test' } dag = DAG('airflow-examples.test_failed_dag_v3', description='Failed DAG', schedule_interval='*/10 * * * *', start_date=datetime(2018, 9, 7), default_args=default_args) b = BashOperator( task_id="ls_command", bash_command="mdr", dag=dag ) {code} Tree view of the DAG: !Screen Shot 2018-09-19 at 10.27.25 AM.png! -- This message was sent by Atlassian JIRA (v7.6.3#76005)