Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-09-24 Thread via GitHub
dstandish commented on code in PR #33718: URL: https://github.com/apache/airflow/pull/33718#discussion_r1773558243 ## airflow/models/baseoperator.py: ## @@ -1600,7 +1601,10 @@ def resume_execution(self, next_method: str, next_kwargs: dict[str, Any] | None, tracebac

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-09-24 Thread via GitHub
dstandish commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-2371582212 > We need to keep this active and gain consistency. Ok @nathadfield I just rebased. I pinged @hussein-awala to pick the comment thread back up. If you could review the open co

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-09-24 Thread via GitHub
dstandish commented on code in PR #33718: URL: https://github.com/apache/airflow/pull/33718#discussion_r1773554065 ## airflow/sensors/base.py: ## @@ -285,6 +286,8 @@ def run_duration() -> float: def resume_execution(self, next_method: str, next_kwargs: dict[str, Any] | Non

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-09-24 Thread via GitHub
nathadfield commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-2370450444 We need to keep this active and gain consistency. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-09-23 Thread via GitHub
github-actions[bot] commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-2369824131 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-08-07 Thread via GitHub
kaxil commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-2274453418 Ping @dstandish -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] Deferrable sensors can timeout with no retries [airflow]

2024-08-07 Thread via GitHub
dstandish opened a new pull request, #33718: URL: https://github.com/apache/airflow/pull/33718 Alternative to https://github.com/apache/airflow/pull/32990 resolves https://github.com/apache/airflow/issues/32638 This is a less invasive approach. Essentially, what we do here is,

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-08-07 Thread via GitHub
robg-eb commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-2272967475 This is still an open issue that needs to be addressed for consistency between deferrable and non-deferrable sensors. -- This is an automated message from the Apache Git Service. To

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-08-04 Thread via GitHub
github-actions[bot] closed pull request #33718: Deferrable sensors can timeout with no retries URL: https://github.com/apache/airflow/pull/33718 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-03-26 Thread via GitHub
dstandish commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-2021039197 > @dstandish I had tested this out on Jan 29 2024 and left the feedback in the comment above - [#33718 (comment)](https://github.com/apache/airflow/pull/33718#issuecomment-1914788890)

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-03-26 Thread via GitHub
robg-eb commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-2020984126 @dstandish I had tested this out on Jan 29 2024 and left the feedback in the comment above - https://github.com/apache/airflow/pull/33718#issuecomment-1914788890. I see there's now a

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-03-26 Thread via GitHub
dstandish commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-2020964764 @robg-eb were you able to test this locally? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-03-17 Thread via GitHub
robg-eb commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-2002711347 @dstandish - I'd hate to see this PR get closed as we seemed to be on the right track here , and the issue still exists around this inconsistent behavior with deferrable sensors. Any

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-03-17 Thread via GitHub
github-actions[bot] commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-2002673729 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-01-29 Thread via GitHub
robg-eb commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1914788890 @dstandish and team - Thank you for creating this PR, as we are currently unable to properly use retries with Deferrable (Async) sensors, because of the inconsistency in retry / timeout

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-01-11 Thread via GitHub
nathadfield commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1887337460 I just raised [this](https://github.com/apache/airflow/issues/36734) issue but, it looks like it is covered by this PR. -- This is an automated message from the Apache Git Service

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-01-08 Thread via GitHub
robg-eb commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1881109501 We want to keep this PR active - I can test this week as needed! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-01-06 Thread via GitHub
github-actions[bot] commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1879887816 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2023-11-22 Thread via GitHub
dstandish commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1822858057 > @dstandish - To clarify, is this PR ready to test as-is? Right. In short what this does is, now when trigger times out we raise TaskDeferralTimeout instead of the gen

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2023-11-22 Thread via GitHub
robg-eb commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1822836815 @dstandish - To clarify, is this PR ready to test as-is? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2023-11-22 Thread via GitHub
dstandish commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1822833012 > @dstandish and team - I see this issue was auto-closed and now reopened. My team is struggling with the same issue, so we'd be happy to help/test in any way possible as needed - let

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2023-11-22 Thread via GitHub
dstandish commented on code in PR #33718: URL: https://github.com/apache/airflow/pull/33718#discussion_r1402113003 ## airflow/models/baseoperator.py: ## @@ -1600,7 +1601,10 @@ def resume_execution(self, next_method: str, next_kwargs: dict[str, Any] | None, tracebac

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2023-11-06 Thread via GitHub
robg-eb commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1795045195 @dstandish and team - I see this issue was auto-closed and now reopened. My team is struggling with the same issue, so we'd be happy to help/test in any way possible as needed - let us

[PR] Deferrable sensors can timeout with no retries [airflow]

2023-11-06 Thread via GitHub
dstandish opened a new pull request, #33718: URL: https://github.com/apache/airflow/pull/33718 Alternative to https://github.com/apache/airflow/pull/32990 resolves https://github.com/apache/airflow/issues/32638 This is a less invasive approach. Essentially, what we do here is,

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2023-10-18 Thread via GitHub
github-actions[bot] closed pull request #33718: Deferrable sensors can timeout with no retries URL: https://github.com/apache/airflow/pull/33718 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2023-10-13 Thread via GitHub
github-actions[bot] commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1762413696 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you