[GitHub] [airflow] eladkal commented on a diff in pull request #27613: Prepare docs for November 2022 wave of Providers

2022-11-10 Thread GitBox
eladkal commented on code in PR #27613: URL: https://github.com/apache/airflow/pull/27613#discussion_r1019953062 ## airflow/providers/tableau/provider.yaml: ## @@ -22,6 +22,8 @@ description: | `Tableau `__ versions: + - 4.0.0 + - 3.1.0 Review

[GitHub] [airflow] eladkal commented on a diff in pull request #27613: Prepare docs for November 2022 wave of Providers

2022-11-10 Thread GitBox
eladkal commented on code in PR #27613: URL: https://github.com/apache/airflow/pull/27613#discussion_r1019952530 ## airflow/providers/snowflake/CHANGELOG.rst: ## @@ -24,6 +24,28 @@ Changelog - +3.4.0 Review Comment: Should be 4.0.0 ( there is 5.0 entry in log but

[GitHub] [airflow] eladkal commented on a diff in pull request #27613: Prepare docs for November 2022 wave of Providers

2022-11-10 Thread GitBox
eladkal commented on code in PR #27613: URL: https://github.com/apache/airflow/pull/27613#discussion_r1019951961 ## airflow/providers/slack/CHANGELOG.rst: ## @@ -24,6 +24,19 @@ Changelog - +6.1.0 Review Comment: Should be with 7.0.0 ( there is an entry in change

[airflow] 01/01: Only run mypy/flake static tests for providers in main branch (#27608)

2022-11-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-4-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 1d22d31d38f4158f410371c010670d89a4ade292 Author: Jarek Potiuk AuthorDate: Thu Nov 10 23:38:06 2022 +0100

[airflow] branch v2-4-test updated (5cda86a2fa -> 1d22d31d38)

2022-11-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-4-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 5cda86a2fa Only run mypy/flake static tests for providers in main branch (#27608) new 1d22d31d38 On

[GitHub] [airflow] uranusjr commented on a diff in pull request #27599: Use unused SQLCheckOperator.parameters in SQLCheckOperator.execute.

2022-11-10 Thread GitBox
uranusjr commented on code in PR #27599: URL: https://github.com/apache/airflow/pull/27599#discussion_r1019951469 ## airflow/providers/common/sql/operators/sql.py: ## @@ -619,14 +619,21 @@ class SQLCheckOperator(BaseSQLOperator): ui_color = "#fff7e6" def __init__( -

[GitHub] [airflow] eladkal commented on a diff in pull request #27613: Prepare docs for November 2022 wave of Providers

2022-11-10 Thread GitBox
eladkal commented on code in PR #27613: URL: https://github.com/apache/airflow/pull/27613#discussion_r1019931245 ## airflow/providers/alibaba/CHANGELOG.rst: ## @@ -24,6 +24,20 @@ Changelog - +2.2.0 +. + +Misc + + +* ``Move min airflow version to 2.3.0 for all

[GitHub] [airflow] eladkal commented on a diff in pull request #27613: Prepare docs for November 2022 wave of Providers

2022-11-10 Thread GitBox
eladkal commented on code in PR #27613: URL: https://github.com/apache/airflow/pull/27613#discussion_r1019931245 ## airflow/providers/alibaba/CHANGELOG.rst: ## @@ -24,6 +24,20 @@ Changelog - +2.2.0 +. + +Misc + + +* ``Move min airflow version to 2.3.0 for all

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #27616: Flush the session in `handle_failure()` prior to invoking callbacks

2022-11-10 Thread GitBox
boring-cyborg[bot] commented on PR #27616: URL: https://github.com/apache/airflow/pull/27616#issuecomment-1311301644 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] sydykov opened a new pull request, #27616: Flush the session in `handle_failure()` prior to invoking callbacks

2022-11-10 Thread GitBox
sydykov opened a new pull request, #27616: URL: https://github.com/apache/airflow/pull/27616 Related: #27615. The full description can be found there. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] leehuwuj commented on pull request #27573: add dag parsed time in DAG view

2022-11-10 Thread GitBox
leehuwuj commented on PR #27573: URL: https://github.com/apache/airflow/pull/27573#issuecomment-1311297637 Just moved to `dag_code.html`: https://user-images.githubusercontent.com/39040748/201280742-d116bd35-3265-4f84-9b04-ffb178537234.png";> -- This is an automated message from th

[GitHub] [airflow] hankehly commented on pull request #27410: Use Boto waiters instead of customer _await_status method for RDS Operators

2022-11-10 Thread GitBox
hankehly commented on PR #27410: URL: https://github.com/apache/airflow/pull/27410#issuecomment-1311286820 I'm getting the following error on the "Build Images / Build CI images 3.7" step. Could someone please re-run it? ``` error: failed to receive status: rpc error: code = Unavailabl

[GitHub] [airflow] sydykov opened a new issue, #27615: Task's state is updated (the session is flushed) after on-failure, on-retry callbacks

2022-11-10 Thread GitBox
sydykov opened a new issue, #27615: URL: https://github.com/apache/airflow/issues/27615 ### Apache Airflow version 2.4.2 ### What happened Upon the refactor that happened in v.2.4, the logic in `handle_failure()` in `taskinstance.py` was changed, and now a task's state i

[GitHub] [airflow] boring-cyborg[bot] commented on issue #27615: Task's state is updated (the session is flushed) after on-failure, on-retry callbacks

2022-11-10 Thread GitBox
boring-cyborg[bot] commented on issue #27615: URL: https://github.com/apache/airflow/issues/27615#issuecomment-1311271246 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] mai-nakagawa commented on issue #27582: CronTriggerTimetable doesn't run the first scheduled job after creating a new DAG.

2022-11-10 Thread GitBox
mai-nakagawa commented on issue #27582: URL: https://github.com/apache/airflow/issues/27582#issuecomment-1311252990 Hmmm, there are only debug logs. I found nothing strange. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] Bowrna commented on issue #27614: Double execution of failure callback for task

2022-11-10 Thread GitBox
Bowrna commented on issue #27614: URL: https://github.com/apache/airflow/issues/27614#issuecomment-1311190678 I would like to submit a PR, but I want to confirm if this is an actual bug from committers and find out if my understanding is correct. -- This is an automated message from the A

[GitHub] [airflow] Bowrna opened a new issue, #27614: Double execution of failure callback for task

2022-11-10 Thread GitBox
Bowrna opened a new issue, #27614: URL: https://github.com/apache/airflow/issues/27614 ### Apache Airflow version 2.4.2 ### What happened I have applied task callback for failure and success case using Cluster policy for the specific dag [https://gist.github.com/Bowrna/

[GitHub] [airflow] bluek1te commented on issue #27582: CronTriggerTimetable doesn't run the first scheduled job after creating a new DAG.

2022-11-10 Thread GitBox
bluek1te commented on issue #27582: URL: https://github.com/apache/airflow/issues/27582#issuecomment-1311185737 Sure, just tested it again, before 9:25PM CST: ![image](https://user-images.githubusercontent.com/36559283/201256419-ed3aba66-6652-4c8a-8ba5-d4d4579bd492.png) After 9:25PM CS

[GitHub] [airflow] WestonKing-Leatham commented on pull request #27389: Replace urlparse with urlsplit

2022-11-10 Thread GitBox
WestonKing-Leatham commented on PR #27389: URL: https://github.com/apache/airflow/pull/27389#issuecomment-1311183609 > looks like something went wrong with your git operations. you have a lot of unrelated changes. This was fixed, could you review again? -- This is an automated mess

[airflow] branch constraints-main updated: Updating constraints. Build id:

2022-11-10 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 088333f816 Updating con

[GitHub] [airflow] rom1mouret commented on pull request #27111: Update SLA wording to reflect it is relative to Dag Run start

2022-11-10 Thread GitBox
rom1mouret commented on PR #27111: URL: https://github.com/apache/airflow/pull/27111#issuecomment-1311134448 I am not advocating for re-opening this issue now, but I wonder if it might still lack clarity? Contrary to what one would intuitively expect, isn't the SLA relative to the *n

[airflow] branch main updated (cc4cde987c -> 16b100169d)

2022-11-10 Thread xddeng
This is an automated email from the ASF dual-hosted git repository. xddeng pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from cc4cde987c Add max_wait for exponential_backoff in BaseSensor (#27597) add 16b100169d Make Kubernetes Executor & S

[GitHub] [airflow] XD-DENG merged pull request #27611: Make Kubernetes Executor & Scheduler Resilient to error during PMH execution

2022-11-10 Thread GitBox
XD-DENG merged PR #27611: URL: https://github.com/apache/airflow/pull/27611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

[GitHub] [airflow] potiuk opened a new pull request, #27613: Prepare docs for November 2022 wave of Providers

2022-11-10 Thread GitBox
potiuk opened a new pull request, #27613: URL: https://github.com/apache/airflow/pull/27613 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more info

[GitHub] [airflow] mai-nakagawa commented on issue #27582: CronTriggerTimetable doesn't run the first scheduled job after creating a new DAG.

2022-11-10 Thread GitBox
mai-nakagawa commented on issue #27582: URL: https://github.com/apache/airflow/issues/27582#issuecomment-1311128113 @bluek1te Do you see anything strange in Airflow Scheduler log? This could happen if Airflow Scheduler is down when it is supposed to trigger a DAG run. -- This is an automa

[GitHub] [airflow] XD-DENG commented on a diff in pull request #27611: Make Kubernetes Executor & Scheduler Resilient to error during PMH execution

2022-11-10 Thread GitBox
XD-DENG commented on code in PR #27611: URL: https://github.com/apache/airflow/pull/27611#discussion_r1019753709 ## tests/executors/test_kubernetes_executor.py: ## @@ -293,6 +293,41 @@ def test_run_next_exception_requeue( assert kubernetes_executor.task_queue.em

[GitHub] [airflow] jedcunningham commented on issue #27612: [Chart] Container security context is not defined

2022-11-10 Thread GitBox
jedcunningham commented on issue #27612: URL: https://github.com/apache/airflow/issues/27612#issuecomment-136563 This is coming (soon!) in #24588. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] jedcunningham commented on pull request #27597: Add max_wait for exponential_backoff in BaseSensor

2022-11-10 Thread GitBox
jedcunningham commented on PR #27597: URL: https://github.com/apache/airflow/pull/27597#issuecomment-134809 Thanks @hussein-awala! Congrats on your first commit 🎉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[airflow] branch main updated (1059de6294 -> cc4cde987c)

2022-11-10 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 1059de6294 Dataform operators, links, update system tests and docs (#27144) add cc4cde987c Add max_wait fo

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #27597: Add max_wait for exponential_backoff in BaseSensor

2022-11-10 Thread GitBox
boring-cyborg[bot] commented on PR #27597: URL: https://github.com/apache/airflow/pull/27597#issuecomment-134409 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] jedcunningham merged pull request #27597: Add max_wait for exponential_backoff in BaseSensor

2022-11-10 Thread GitBox
jedcunningham merged PR #27597: URL: https://github.com/apache/airflow/pull/27597 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[GitHub] [airflow] o-nikolas commented on pull request #27564: CloudWatch task handler doesn't fall back to local logs when Amazon CloudWatch logs aren't found

2022-11-10 Thread GitBox
o-nikolas commented on PR #27564: URL: https://github.com/apache/airflow/pull/27564#issuecomment-131630 :rocket: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [airflow] o-nikolas commented on a diff in pull request #27583: enable https requests with ssl verification

2022-11-10 Thread GitBox
o-nikolas commented on code in PR #27583: URL: https://github.com/apache/airflow/pull/27583#discussion_r1019743267 ## airflow/providers/apache/druid/hooks/druid.py: ## @@ -82,12 +84,29 @@ def get_auth(self) -> requests.auth.HTTPBasicAuth | None: else: retur

[GitHub] [airflow] mai-nakagawa commented on issue #27582: CronTriggerTimetable doesn't run the first scheduled job after creating a new DAG.

2022-11-10 Thread GitBox
mai-nakagawa commented on issue #27582: URL: https://github.com/apache/airflow/issues/27582#issuecomment-1311100780 I'm also trying to reproduce the reported issue. However, I haven't seen the issue so far. -- This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [airflow] jedcunningham commented on a diff in pull request #27611: Make Kubernetes Executor & Scheduler Resilient to error during PMH execution

2022-11-10 Thread GitBox
jedcunningham commented on code in PR #27611: URL: https://github.com/apache/airflow/pull/27611#discussion_r1019740790 ## tests/executors/test_kubernetes_executor.py: ## @@ -293,6 +293,41 @@ def test_run_next_exception_requeue( assert kubernetes_executor.task_qu

[GitHub] [airflow] boring-cyborg[bot] commented on issue #27612: [Chart] Container security context is not defined

2022-11-10 Thread GitBox
boring-cyborg[bot] commented on issue #27612: URL: https://github.com/apache/airflow/issues/27612#issuecomment-1311096858 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] NipunaPrashan opened a new issue, #27612: [Chart] Container security context is not defined

2022-11-10 Thread GitBox
NipunaPrashan opened a new issue, #27612: URL: https://github.com/apache/airflow/issues/27612 ### Apache Airflow version main (development) ### What happened Container security context is not defined to change through values yaml. This is a **security** issue for contain

[GitHub] [airflow] akizminet commented on pull request #27609: Handle json encoding of V1Pod in task callback

2022-11-10 Thread GitBox
akizminet commented on PR #27609: URL: https://github.com/apache/airflow/pull/27609#issuecomment-1311095217 Why don't we use `AirflowJsonEncoder` for `to_json` method like this PR: https://github.com/apache/airflow/issues/27593 ? It's more cleaner -- This is an automated message from the

[airflow] branch main updated (0a059eea67 -> 1059de6294)

2022-11-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 0a059eea67 sagemaker operators: mutualize init of aws_conn_id (#27579) add 1059de6294 Dataform operators, links, u

[GitHub] [airflow] potiuk merged pull request #27144: Dataform operators, links, update system tests and docs

2022-11-10 Thread GitBox
potiuk merged PR #27144: URL: https://github.com/apache/airflow/pull/27144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] potiuk commented on pull request #27144: Dataform operators, links, update system tests and docs

2022-11-10 Thread GitBox
potiuk commented on PR #27144: URL: https://github.com/apache/airflow/pull/27144#issuecomment-1311091139 Known main problems caused "red" (fixed already). Merging. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [airflow] XD-DENG commented on a diff in pull request #27611: Make Kubernetes Executor & Scheduler Resilient to error during PMH execution

2022-11-10 Thread GitBox
XD-DENG commented on code in PR #27611: URL: https://github.com/apache/airflow/pull/27611#discussion_r1019735200 ## airflow/executors/kubernetes_executor.py: ## @@ -646,6 +649,14 @@ def sync(self) -> None: json.loads(e.body)["message"],

[GitHub] [airflow] potiuk commented on pull request #27375: Migrate Dataflow system tests

2022-11-10 Thread GitBox
potiuk commented on PR #27375: URL: https://github.com/apache/airflow/pull/27375#issuecomment-1311087720 Still -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[airflow] branch main updated (c490a328f4 -> 0a059eea67)

2022-11-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from c490a328f4 CloudWatch task handler doesn't fall back to local logs when Amazon CloudWatch logs aren't found (#27564)

[GitHub] [airflow] potiuk merged pull request #27579: sagemaker operators: mutualize init of aws_conn_id

2022-11-10 Thread GitBox
potiuk merged PR #27579: URL: https://github.com/apache/airflow/pull/27579 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated (3aed495f50 -> c490a328f4)

2022-11-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 3aed495f50 Rename hook bigquery function `_bq_cast` to `bq_cast` (#27543) add c490a328f4 CloudWatch task handler

[GitHub] [airflow] potiuk merged pull request #27564: CloudWatch task handler doesn't fall back to local logs when Amazon CloudWatch logs aren't found

2022-11-10 Thread GitBox
potiuk merged PR #27564: URL: https://github.com/apache/airflow/pull/27564 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] potiuk closed issue #27396: CloudWatch task handler doesn't fall back to local logs when Amazon CloudWatch logs aren't found

2022-11-10 Thread GitBox
potiuk closed issue #27396: CloudWatch task handler doesn't fall back to local logs when Amazon CloudWatch logs aren't found URL: https://github.com/apache/airflow/issues/27396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] potiuk commented on pull request #27379: Making s3_to_redshift operator complete

2022-11-10 Thread GitBox
potiuk commented on PR #27379: URL: https://github.com/apache/airflow/pull/27379#issuecomment-1311083750 Tests failing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

[GitHub] [airflow] Dinghang commented on pull request #26639: Multi-threads support for processing diff queues in Kubernetes Executor

2022-11-10 Thread GitBox
Dinghang commented on PR #26639: URL: https://github.com/apache/airflow/pull/26639#issuecomment-1311081709 > I rebased it but it seems it needs rebase and re-push from the author - sorry for not looking at it before- been a little swamped and had some private errands and now I want to relea

[GitHub] [airflow] XD-DENG commented on a diff in pull request #27611: Make Kubernetes Executor & Scheduler Resilient to error during PMH execution

2022-11-10 Thread GitBox
XD-DENG commented on code in PR #27611: URL: https://github.com/apache/airflow/pull/27611#discussion_r1019730009 ## airflow/executors/kubernetes_executor.py: ## @@ -646,6 +649,14 @@ def sync(self) -> None: json.loads(e.body)["message"],

[airflow] branch main updated (eb06c65556 -> 3aed495f50)

2022-11-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from eb06c65556 Use new job search API for triggering Databricks job by name (#27446) add 3aed495f50 Rename hook bigq

[GitHub] [airflow] potiuk merged pull request #27543: Rename hook bigquery function `_bq_cast` to `bq_cast`

2022-11-10 Thread GitBox
potiuk merged PR #27543: URL: https://github.com/apache/airflow/pull/27543 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] jedcunningham commented on a diff in pull request #27611: Make Kubernetes Executor & Scheduler Resilient to error during PMH execution

2022-11-10 Thread GitBox
jedcunningham commented on code in PR #27611: URL: https://github.com/apache/airflow/pull/27611#discussion_r1019728052 ## airflow/executors/kubernetes_executor.py: ## @@ -646,6 +649,14 @@ def sync(self) -> None: json.loads(e.body)["message"],

[airflow] branch main updated (9f9ab30218 -> eb06c65556)

2022-11-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 9f9ab30218 SagemakerProcessingOperator stopped honoring `existing_jobs_found` (#27456) add eb06c65556 Use new job

[GitHub] [airflow] potiuk merged pull request #27446: Use new job search API for triggering Databricks job by name

2022-11-10 Thread GitBox
potiuk merged PR #27446: URL: https://github.com/apache/airflow/pull/27446 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated (e8ab8ccc0e -> 9f9ab30218)

2022-11-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from e8ab8ccc0e Add backward compatibility with old versions of Apache Beam (#27263) add 9f9ab30218 SagemakerProcessin

[GitHub] [airflow] potiuk closed issue #21711: SageMakerProcessingOperator does not honor action_if_job_exists

2022-11-10 Thread GitBox
potiuk closed issue #21711: SageMakerProcessingOperator does not honor action_if_job_exists URL: https://github.com/apache/airflow/issues/21711 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [airflow] potiuk merged pull request #27456: SagemakerProcessingOperator stopped honoring `existing_jobs_found`

2022-11-10 Thread GitBox
potiuk merged PR #27456: URL: https://github.com/apache/airflow/pull/27456 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] potiuk commented on pull request #27156: Add documentation for BigQuery transfer operators

2022-11-10 Thread GitBox
potiuk commented on PR #27156: URL: https://github.com/apache/airflow/pull/27156#issuecomment-1311072892 docs are failing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [airflow] potiuk commented on pull request #26639: Multi-threads support for processing diff queues in Kubernetes Executor

2022-11-10 Thread GitBox
potiuk commented on PR #26639: URL: https://github.com/apache/airflow/pull/26639#issuecomment-1311071690 I rebased it but it seems it needs rebase and re-push from the author - sorry for not looking at it before- been a little swamped and had some private errands and now I want to release a

[GitHub] [airflow] XD-DENG commented on a diff in pull request #27611: Make Kubernetes Executor & Scheduler Resilient to error during PMH execution

2022-11-10 Thread GitBox
XD-DENG commented on code in PR #27611: URL: https://github.com/apache/airflow/pull/27611#discussion_r1019723290 ## airflow/executors/kubernetes_executor.py: ## @@ -646,6 +649,14 @@ def sync(self) -> None: json.loads(e.body)["message"],

[GitHub] [airflow] github-actions[bot] closed pull request #26166: Fix scope of backfill job raise TaskConcurrencyLimitReached

2022-11-10 Thread GitBox
github-actions[bot] closed pull request #26166: Fix scope of backfill job raise TaskConcurrencyLimitReached URL: https://github.com/apache/airflow/pull/26166 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [airflow] github-actions[bot] commented on pull request #26669: change parquet_writer write a table for each row

2022-11-10 Thread GitBox
github-actions[bot] commented on PR #26669: URL: https://github.com/apache/airflow/pull/26669#issuecomment-1311067445 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

[GitHub] [airflow] potiuk commented on pull request #27405: Add deferrable mode to TestMLEngineStartTrainingJobOperator

2022-11-10 Thread GitBox
potiuk commented on PR #27405: URL: https://github.com/apache/airflow/pull/27405#issuecomment-1311067439 conflicts :( -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [airflow] github-actions[bot] commented on pull request #26675: WIP

2022-11-10 Thread GitBox
github-actions[bot] commented on PR #26675: URL: https://github.com/apache/airflow/pull/26675#issuecomment-1311067404 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

[GitHub] [airflow] dstandish commented on a diff in pull request #27609: Handle json encoding of V1Pod in task callback

2022-11-10 Thread GitBox
dstandish commented on code in PR #27609: URL: https://github.com/apache/airflow/pull/27609#discussion_r1019722375 ## airflow/models/taskinstance.py: ## @@ -2573,10 +2573,9 @@ def __eq__(self, other): def as_dict(self): new_dict = dict(self.__dict__) for k

[GitHub] [airflow] jedcunningham commented on a diff in pull request #27611: Make Kubernetes Executor & Scheduler Resilient to error during PMH execution

2022-11-10 Thread GitBox
jedcunningham commented on code in PR #27611: URL: https://github.com/apache/airflow/pull/27611#discussion_r1019721454 ## airflow/executors/kubernetes_executor.py: ## @@ -646,6 +649,14 @@ def sync(self) -> None: json.loads(e.body)["message"],

[GitHub] [airflow] potiuk commented on pull request #26970: Impala Hook

2022-11-10 Thread GitBox
potiuk commented on PR #26970: URL: https://github.com/apache/airflow/pull/26970#issuecomment-1311065794 Needs rebase. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [airflow] potiuk closed pull request #27406: examples

2022-11-10 Thread GitBox
potiuk closed pull request #27406: examples URL: https://github.com/apache/airflow/pull/27406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-un

[GitHub] [airflow] potiuk commented on pull request #27406: examples

2022-11-10 Thread GitBox
potiuk commented on PR #27406: URL: https://github.com/apache/airflow/pull/27406#issuecomment-1311065166 replaced with https://github.com/apache/airflow/pull/27522 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[airflow] branch main updated (f919abc918 -> e8ab8ccc0e)

2022-11-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from f919abc918 Fix backwards compatibility for RedshiftSQLOperator (#27602) add e8ab8ccc0e Add backward compatibility

[GitHub] [airflow] potiuk merged pull request #27263: Add backward compatibility with old versions of Apache Beam

2022-11-10 Thread GitBox
potiuk merged PR #27263: URL: https://github.com/apache/airflow/pull/27263 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] XD-DENG opened a new pull request, #27611: Make Kubernetes Executor & Scheduler Resilient to error during PMH execution

2022-11-10 Thread GitBox
XD-DENG opened a new pull request, #27611: URL: https://github.com/apache/airflow/pull/27611 Currently there is no try-catch logic when `pod_mutation_hook` is called in the Kubernetes Executor. So if there is any error/exception during the execution of the `pod_mutation_hook` user creat

[GitHub] [airflow] uranusjr commented on a diff in pull request #27609: Handle json encoding of V1Pod in task callback

2022-11-10 Thread GitBox
uranusjr commented on code in PR #27609: URL: https://github.com/apache/airflow/pull/27609#discussion_r1019708880 ## airflow/models/taskinstance.py: ## @@ -2573,10 +2573,9 @@ def __eq__(self, other): def as_dict(self): new_dict = dict(self.__dict__) for ke

[GitHub] [airflow] dstandish commented on a diff in pull request #27609: Handle json encoding of V1Pod in task callback

2022-11-10 Thread GitBox
dstandish commented on code in PR #27609: URL: https://github.com/apache/airflow/pull/27609#discussion_r1019704261 ## airflow/models/taskinstance.py: ## @@ -2573,10 +2573,9 @@ def __eq__(self, other): def as_dict(self): new_dict = dict(self.__dict__) for k

[GitHub] [airflow] boring-cyborg[bot] commented on issue #27610: TrinoOperator not allowing to run multiple sql statements from file

2022-11-10 Thread GitBox
boring-cyborg[bot] commented on issue #27610: URL: https://github.com/apache/airflow/issues/27610#issuecomment-1311039970 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] sbbagal13 opened a new issue, #27610: TrinoOperator not allowing to run multiple sql statements from file

2022-11-10 Thread GitBox
sbbagal13 opened a new issue, #27610: URL: https://github.com/apache/airflow/issues/27610 ### Apache Airflow Provider(s) trino ### Versions of Apache Airflow Providers apache-airflow-providers-trino4.0.0 ### Apache Airflow version 2.2.4 ##

[GitHub] [airflow] uranusjr commented on a diff in pull request #27609: Handle json encoding of V1Pod in task callback

2022-11-10 Thread GitBox
uranusjr commented on code in PR #27609: URL: https://github.com/apache/airflow/pull/27609#discussion_r1019700840 ## airflow/models/taskinstance.py: ## @@ -2573,10 +2573,9 @@ def __eq__(self, other): def as_dict(self): new_dict = dict(self.__dict__) for ke

[GitHub] [airflow] dstandish commented on a diff in pull request #27609: Handle json encoding of V1Pod in task callback

2022-11-10 Thread GitBox
dstandish commented on code in PR #27609: URL: https://github.com/apache/airflow/pull/27609#discussion_r1019699646 ## airflow/models/taskinstance.py: ## @@ -2573,10 +2573,9 @@ def __eq__(self, other): def as_dict(self): new_dict = dict(self.__dict__) for k

[GitHub] [airflow] o-nikolas commented on issue #25669: change Jira sdk to official atlassian sdk

2022-11-10 Thread GitBox
o-nikolas commented on issue #25669: URL: https://github.com/apache/airflow/issues/25669#issuecomment-1311037402 @Adityamalik123 I've assigned the task to you :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[airflow] branch v2-4-test updated (64af0b7605 -> 5cda86a2fa)

2022-11-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-4-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 64af0b7605 Only run mypy/flake static tests for providers in main branch (#27608) new 5cda86a2fa On

[airflow] 01/01: Only run mypy/flake static tests for providers in main branch (#27608)

2022-11-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-4-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 5cda86a2fa9da95e40999d87424f8f5d95e9e7c9 Author: Jarek Potiuk AuthorDate: Thu Nov 10 23:38:06 2022 +0100

[GitHub] [airflow] bluek1te commented on issue #27582: CronTriggerTimetable doesn't run the first scheduled job after creating a new DAG.

2022-11-10 Thread GitBox
bluek1te commented on issue #27582: URL: https://github.com/apache/airflow/issues/27582#issuecomment-1311026917 Sandboxed this all day today. It looks like every time that I have tested this so far, I have not been able to get the first run to occur Step 1: Create new DAG with ID that

[GitHub] [airflow] uranusjr commented on a diff in pull request #27609: Handle json encoding of V1Pod in task callback

2022-11-10 Thread GitBox
uranusjr commented on code in PR #27609: URL: https://github.com/apache/airflow/pull/27609#discussion_r1019690168 ## airflow/models/taskinstance.py: ## @@ -2573,10 +2573,9 @@ def __eq__(self, other): def as_dict(self): new_dict = dict(self.__dict__) for ke

[GitHub] [airflow] uranusjr commented on issue #27079: Option to deserialize JSON from last log line in BashOperator and DockerOperator before sending to XCom

2022-11-10 Thread GitBox
uranusjr commented on issue #27079: URL: https://github.com/apache/airflow/issues/27079#issuecomment-1311020592 If the goal is to make Jinja2 templating simpler (there’s no issue if it’s taskflow), the simplest way may be to add a built-in macro for this? ```jinja2 {{ json_loads(xc

[GitHub] [airflow] dstandish commented on pull request #27609: Handle json encoding of V1Pod in task callback

2022-11-10 Thread GitBox
dstandish commented on PR #27609: URL: https://github.com/apache/airflow/pull/27609#issuecomment-1311018428 chopped one more line here @uranusjr if you want to doublecheck https://github.com/apache/airflow/pull/27609/commits/35839ea0db3a7f7c900adcaa156dc42e2f4f69c3 -- This is an auto

[GitHub] [airflow] uranusjr commented on a diff in pull request #27609: Handle json encoding of V1Pod in task callback

2022-11-10 Thread GitBox
uranusjr commented on code in PR #27609: URL: https://github.com/apache/airflow/pull/27609#discussion_r1019683783 ## airflow/models/taskinstance.py: ## @@ -2572,12 +2572,13 @@ def __eq__(self, other): def as_dict(self): new_dict = dict(self.__dict__) -for

[airflow] branch v2-4-test updated (a3d3765e9e -> 64af0b7605)

2022-11-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-4-test in repository https://gitbox.apache.org/repos/asf/airflow.git from a3d3765e9e Add release notes add 74778545bf Fix caching in CI for pre-commits (#27368) add 64af

[GitHub] [airflow] dstandish opened a new pull request, #27609: Handle json encoding of V1Pod in task callbace

2022-11-10 Thread GitBox
dstandish opened a new pull request, #27609: URL: https://github.com/apache/airflow/pull/27609 Resolves #27593 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[GitHub] [airflow] potiuk commented on pull request #27602: Fix backwards compatibility for RedshiftSQLOperator

2022-11-10 Thread GitBox
potiuk commented on PR #27602: URL: https://github.com/apache/airflow/pull/27602#issuecomment-1310994489 Way better :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[airflow] branch main updated (9345953568 -> f919abc918)

2022-11-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 9345953568 Only run mypy/flake static tests for providers in main branch (#27608) add f919abc918 Fix backwards co

[GitHub] [airflow] potiuk merged pull request #27602: Fix backwards compatibility for RedshiftSQLOperator

2022-11-10 Thread GitBox
potiuk merged PR #27602: URL: https://github.com/apache/airflow/pull/27602 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated (3e3ff7ce52 -> 9345953568)

2022-11-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 3e3ff7ce52 Fix test hooks also for Azure Batch (#27607) add 9345953568 Only run mypy/flake static tests for provid

[GitHub] [airflow] potiuk merged pull request #27608: Only run mypy/flake static tests for providers in main branch

2022-11-10 Thread GitBox
potiuk merged PR #27608: URL: https://github.com/apache/airflow/pull/27608 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated: Fix test hooks also for Azure Batch (#27607)

2022-11-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3e3ff7ce52 Fix test hooks also for Azure Batch (#27

[GitHub] [airflow] potiuk merged pull request #27607: Fix test hooks also for Azure Batch

2022-11-10 Thread GitBox
potiuk merged PR #27607: URL: https://github.com/apache/airflow/pull/27607 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] potiuk opened a new pull request, #27608: Only run mypy/flake static tests for providers in main branch

2022-11-10 Thread GitBox
potiuk opened a new pull request, #27608: URL: https://github.com/apache/airflow/pull/27608 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more info

[GitHub] [airflow] dstandish commented on issue #27593: Object of type V1Pod is not JSON serializable after detecting zombie jobs cause Scheduler CrashLoopBack

2022-11-10 Thread GitBox
dstandish commented on issue #27593: URL: https://github.com/apache/airflow/issues/27593#issuecomment-1310972983 fix forthcoming -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[airflow] branch v2-4-test updated (b668e2d84d -> a3d3765e9e)

2022-11-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-4-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit b668e2d84d Add release notes omit 69139a3225 Update version to 2.4.3 omit aae63705e9 Fix double l

  1   2   3   >