Re: [I] Pause DAG such that all tasks complete [airflow]

eladkal closed issue #36539: Pause DAG such that all tasks complete URL: https://github.com/apache/airflow/issues/36539 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [I] Pause DAG such that all tasks complete [airflow]

eladkal commented on issue #36539: URL: https://github.com/apache/airflow/issues/36539#issuecomment-2134515816 Closing as duplicated of https://github.com/apache/airflow/issues/22006 lets continue discussion there -- This is an automated message from the Apache Git Service. To respond to

Re: [I] Pause DAG such that all tasks complete [airflow]

aritra24 commented on issue #36539: URL: https://github.com/apache/airflow/issues/36539#issuecomment-1891102592 That sounds reasonable, let me try it out and see how it goes. I'll update once I have something working on here. -- This is an automated message from the Apache Git Service. T

Re: [I] Pause DAG such that all tasks complete [airflow]

potiuk commented on issue #36539: URL: https://github.com/apache/airflow/issues/36539#issuecomment-1891095692 I do not have a clear vision on implementation details here, but intuitively, it seems that we should have a new state of dag (hold) which will be same as "paused" for scheduler but

Re: [I] Pause DAG such that all tasks complete [airflow]

aritra24 commented on issue #36539: URL: https://github.com/apache/airflow/issues/36539#issuecomment-1885241496 Hey @potiuk /@eladkal just wanted to bring this onto your radar, would you have any suggestions on the direction of implementation on this? -- This is an automated message from

Re: [I] Pause DAG such that all tasks complete [airflow]

kmehkeri commented on issue #36539: URL: https://github.com/apache/airflow/issues/36539#issuecomment-1880217208 It feels to me that the cleanest approach would be to strictly separate two effects currently being under one switch: - Pause (scheduler doesn't trigger new DAG runs) / unpause

Re: [I] Pause DAG such that all tasks complete [airflow]

aritra24 commented on issue #36539: URL: https://github.com/apache/airflow/issues/36539#issuecomment-1878875801 I was trying to look into this, what is the behaviour we're expecting? 1. Is it a parameter set in the configs that determines the behaviour on pause? (For example drain_current

Re: [I] Pause DAG such that all tasks complete [airflow]

vchiapaikeo commented on issue #36539: URL: https://github.com/apache/airflow/issues/36539#issuecomment-1877009529 Hey @rajrao - I've been talking to @eladkal about this and we both agree that this feature would be beneficial. One thing I wanted to suggest in the meantime (and possibly for

Re: [I] Pause DAG such that all tasks complete [airflow]

potiuk commented on issue #36539: URL: https://github.com/apache/airflow/issues/36539#issuecomment-1874645079 Agree nice feature to have. Let's see if someone will take it on. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [I] Pause DAG such that all tasks complete [airflow]

boring-cyborg[bot] commented on issue #36539: URL: https://github.com/apache/airflow/issues/36539#issuecomment-1874534773 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] Pause DAG such that all tasks complete [airflow]

rajrao opened a new issue, #36539: URL: https://github.com/apache/airflow/issues/36539 ### Description Currently when one pauses a DAG, it allows the currently executing task to complete and then leaves all downstream tasks to go to scheduled. I feel like there should be the abilit