[jira] [Commented] (AIRFLOW-3515) Remove the run_duration option
[ https://issues.apache.org/jira/browse/AIRFLOW-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180727#comment-17180727 ] ASF GitHub Bot commented on AIRFLOW-3515: - Fokko commented on pull request #4320: URL: https://github.com/apache/airflow/pull/4320#issuecomment-676572956 @shargal We've experienced similar issues at @godatadriven, this fixed itself by upgrading to the latest version. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Remove the run_duration option > -- > > Key: AIRFLOW-3515 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3515 > Project: Apache Airflow > Issue Type: Task >Reporter: Fokko Driesprong >Priority: Major > Fix For: 2.0.0 > > > We should not use the `run_duration` option anymore. This used to be for > restarting the scheduler from time to time, but right now the scheduler is > getting more stable and therefore using this setting is considered bad and > might cause an inconsistent state. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (AIRFLOW-3515) Remove the run_duration option
[ https://issues.apache.org/jira/browse/AIRFLOW-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150812#comment-17150812 ] ASF GitHub Bot commented on AIRFLOW-3515: - Fokko commented on pull request #4320: URL: https://github.com/apache/airflow/pull/4320#issuecomment-653407133 @shargal Restarting the scheduler isn't really a proper solution, right? Feels a bit like; have you tried turning it off and on again. Would be cool if we could isolate the problem of why the tasks get stuck or add logic to check which tasks are stuck and retry them. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Remove the run_duration option > -- > > Key: AIRFLOW-3515 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3515 > Project: Apache Airflow > Issue Type: Task >Reporter: Fokko Driesprong >Priority: Major > Fix For: 2.0.0 > > > We should not use the `run_duration` option anymore. This used to be for > restarting the scheduler from time to time, but right now the scheduler is > getting more stable and therefore using this setting is considered bad and > might cause an inconsistent state. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (AIRFLOW-3515) Remove the run_duration option
[ https://issues.apache.org/jira/browse/AIRFLOW-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147361#comment-17147361 ] ASF GitHub Bot commented on AIRFLOW-3515: - shargal edited a comment on pull request #4320: URL: https://github.com/apache/airflow/pull/4320#issuecomment-650777385 @Fokko Actually I was looking for this feature even with 1.10.10 as many times restarting the scheduler solved problems that came up. For example, tasks that stuck in queued state and not being invoked by KubernetesExecutor. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Remove the run_duration option > -- > > Key: AIRFLOW-3515 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3515 > Project: Apache Airflow > Issue Type: Task >Reporter: Fokko Driesprong >Priority: Major > Fix For: 2.0.0 > > > We should not use the `run_duration` option anymore. This used to be for > restarting the scheduler from time to time, but right now the scheduler is > getting more stable and therefore using this setting is considered bad and > might cause an inconsistent state. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (AIRFLOW-3515) Remove the run_duration option
[ https://issues.apache.org/jira/browse/AIRFLOW-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147360#comment-17147360 ] ASF GitHub Bot commented on AIRFLOW-3515: - shargal commented on pull request #4320: URL: https://github.com/apache/airflow/pull/4320#issuecomment-650777385 @Fokko Actually I looked for this feature even with 1.10.10 as many times restarting the scheduler solved problems that came up. For example, tasks that stuck in queued state and not being invoked by KubernetesExecutor. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Remove the run_duration option > -- > > Key: AIRFLOW-3515 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3515 > Project: Apache Airflow > Issue Type: Task >Reporter: Fokko Driesprong >Priority: Major > Fix For: 2.0.0 > > > We should not use the `run_duration` option anymore. This used to be for > restarting the scheduler from time to time, but right now the scheduler is > getting more stable and therefore using this setting is considered bad and > might cause an inconsistent state. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (AIRFLOW-3515) Remove the run_duration option
[ https://issues.apache.org/jira/browse/AIRFLOW-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736991#comment-16736991 ] ASF GitHub Bot commented on AIRFLOW-3515: - kaxil commented on pull request #4320: [AIRFLOW-3515] Remove the run_duration option URL: https://github.com/apache/airflow/pull/4320 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Remove the run_duration option > -- > > Key: AIRFLOW-3515 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3515 > Project: Apache Airflow > Issue Type: Task >Reporter: Fokko Driesprong >Priority: Major > > We should not use the `run_duration` option anymore. This used to be for > restarting the scheduler from time to time, but right now the scheduler is > getting more stable and therefore using this setting is considered bad and > might cause an inconsistent state. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
