(airflow) branch main updated: handle deprecation warning in google system test (#36116)

2023-12-07 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ba11449293 handle deprecation warning in google

Re: [PR] handle deprecation warning in google system test [airflow]

2023-12-07 Thread via GitHub
eladkal merged PR #36116: URL: https://github.com/apache/airflow/pull/36116 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] Update permission docs [airflow]

2023-12-07 Thread via GitHub
pankajastro opened a new pull request, #36120: URL: https://github.com/apache/airflow/pull/36120 Add admin permission too on the page and fix some typo --- **^ Add meaningful description above** Read the **[Pull Request

Re: [I] Connection Extra Field is not encrypted/masked on editing [airflow]

2023-12-07 Thread via GitHub
Bowrna commented on issue #11218: URL: https://github.com/apache/airflow/issues/11218#issuecomment-1846563569 Could I check if I could fix this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] Audit logs entry as clear event even if we click on the tasks. [airflow]

2023-12-07 Thread via GitHub
boring-cyborg[bot] commented on issue #36119: URL: https://github.com/apache/airflow/issues/36119#issuecomment-1846376385 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] Audit logs entry as clear event even if we click on the tasks. [airflow]

2023-12-07 Thread via GitHub
sktemkar16 opened a new issue, #36119: URL: https://github.com/apache/airflow/issues/36119 ### Apache Airflow version Other Airflow 2 version (please specify below) ### What happened Whenever I click on the task, there is an entry added in the audit logs as task being

Re: [I] Task succeeded but retried --> downstream task fails since upstream task is still running [airflow]

2023-12-07 Thread via GitHub
Raul824 commented on issue #35773: URL: https://github.com/apache/airflow/issues/35773#issuecomment-1846328402 I had the same issue but it was marked as discussion. #36039 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] Gitsync over https denied, unsupported by Github [airflow]

2023-12-07 Thread via GitHub
boring-cyborg[bot] commented on issue #36118: URL: https://github.com/apache/airflow/issues/36118#issuecomment-1846314392 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] Gitsync over https denied, unsupported by Github [airflow]

2023-12-07 Thread via GitHub
gregwhorley opened a new issue, #36118: URL: https://github.com/apache/airflow/issues/36118 ### Official Helm Chart version 1.11.0 (latest released) ### Apache Airflow version 2.7.3 ### Kubernetes Version 1.24 ### Helm Chart configuration ```

Re: [I] Status of testing Providers that were prepared on December 08, 2023 [airflow]

2023-12-07 Thread via GitHub
melugoyal commented on issue #36117: URL: https://github.com/apache/airflow/issues/36117#issuecomment-1846304738 #35694 working as expected -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Replace numpy example with practical exercise demonstrating top-level code [airflow]

2023-12-07 Thread via GitHub
github-actions[bot] commented on PR #35097: URL: https://github.com/apache/airflow/pull/35097#issuecomment-1846298315 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [PR] Update README_RELEASE_PROVIDER_PACKAGES.md [airflow]

2023-12-07 Thread via GitHub
eladkal merged PR #36115: URL: https://github.com/apache/airflow/pull/36115 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Update README_RELEASE_PROVIDER_PACKAGES.md (#36115)

2023-12-07 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a315165719 Update

[I] Status of testing Providers that were prepared on December 08, 2023 [airflow]

2023-12-07 Thread via GitHub
eladkal opened a new issue, #36117: URL: https://github.com/apache/airflow/issues/36117 ### Body I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers? The guidelines on

[PR] Add documentation for packages - 2023-12-08 [airflow-site]

2023-12-07 Thread via GitHub
eladkal opened a new pull request, #905: URL: https://github.com/apache/airflow-site/pull/905 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] Issue with Unreachable Page Due to Page Address Error [airflow-site]

2023-12-07 Thread via GitHub
eladkal commented on issue #903: URL: https://github.com/apache/airflow-site/issues/903#issuecomment-1846262625 fixed in https://github.com/apache/airflow-site/pull/904 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] Issue with Unreachable Page Due to Page Address Error [airflow-site]

2023-12-07 Thread via GitHub
eladkal closed issue #903: Issue with Unreachable Page Due to Page Address Error URL: https://github.com/apache/airflow-site/issues/903 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

(airflow-site) branch add-documentation-2023-12-08 created (now ecbe9d8e9f)

2023-12-07 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2023-12-08 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at ecbe9d8e9f Add documentation for packages - 2023-12-08 This branch includes the

Re: [PR] openlineage, aws: add OpenLineage support for Redshift SQL. [airflow]

2023-12-07 Thread via GitHub
ferruzzi commented on code in PR #35794: URL: https://github.com/apache/airflow/pull/35794#discussion_r1419751811 ## airflow/providers/openlineage/sqlparser.py: ## @@ -299,7 +304,8 @@ def create_information_schema_query( is_cross_db: bool,

Re: [PR] Remove MSSQL support from Airflow core [airflow]

2023-12-07 Thread via GitHub
potiuk commented on PR #35868: URL: https://github.com/apache/airflow/pull/35868#issuecomment-1846225990 > Anyway... so let put this PR on pause and merge it for 2.9.0... Well. I think we have all the building-blocks in place. Yes it might meen few people doing some out-of-hours

svn commit: r65928 [1/4] - /dev/airflow/providers/

2023-12-07 Thread eladkal
Author: eladkal Date: Thu Dec 7 22:46:24 2023 New Revision: 65928 Log: Add artifacts for Airflow Providers 2023-12-08 Added: dev/airflow/providers/apache_airflow_providers_airbyte-3.5.0-py3-none-any.whl (with props)

svn commit: r65928 [3/4] - /dev/airflow/providers/

2023-12-07 Thread eladkal
Added: dev/airflow/providers/apache_airflow_providers_http-4.8.0-py3-none-any.whl.asc == --- dev/airflow/providers/apache_airflow_providers_http-4.8.0-py3-none-any.whl.asc (added) +++

svn commit: r65928 [4/4] - /dev/airflow/providers/

2023-12-07 Thread eladkal
Added: dev/airflow/providers/apache_airflow_providers_samba-4.4.0-py3-none-any.whl == Binary file - no diff available. Propchange: dev/airflow/providers/apache_airflow_providers_samba-4.4.0-py3-none-any.whl

svn commit: r65928 [2/4] - /dev/airflow/providers/

2023-12-07 Thread eladkal
Added: dev/airflow/providers/apache_airflow_providers_apache_livy-3.7.0.tar.gz == Binary file - no diff available. Propchange: dev/airflow/providers/apache_airflow_providers_apache_livy-3.7.0.tar.gz

Re: [PR] Add security team rotation proposal to our security team process [airflow]

2023-12-07 Thread via GitHub
potiuk commented on PR #36049: URL: https://github.com/apache/airflow/pull/36049#issuecomment-1846217987 Time to merge, I think, and start following up :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

(airflow) branch main updated (999b70178a -> 3b978f2ef8)

2023-12-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 999b70178a Prepare docs 1st wave of Providers December 2023 (#36112) add 3b978f2ef8 Add security team rotation

Re: [PR] Add security team rotation proposal to our security team process [airflow]

2023-12-07 Thread via GitHub
potiuk merged PR #36049: URL: https://github.com/apache/airflow/pull/36049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-07 Thread via GitHub
potiuk commented on code in PR #36094: URL: https://github.com/apache/airflow/pull/36094#discussion_r1419731071 ## scripts/in_container/install_airflow_and_providers.py: ## @@ -0,0 +1,448 @@ +#!/usr/bin/env python3 + +# Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-07 Thread via GitHub
potiuk commented on code in PR #36094: URL: https://github.com/apache/airflow/pull/36094#discussion_r1419729586 ## scripts/in_container/install_airflow_and_providers.py: ## @@ -0,0 +1,448 @@ +#!/usr/bin/env python3 + +# Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-07 Thread via GitHub
potiuk commented on code in PR #36094: URL: https://github.com/apache/airflow/pull/36094#discussion_r1419728083 ## scripts/in_container/install_airflow_and_providers.py: ## @@ -0,0 +1,448 @@ +#!/usr/bin/env python3 + +# Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] Add devcontainer\Codespace with Breeze [airflow]

2023-12-07 Thread via GitHub
sgromme commented on PR #36109: URL: https://github.com/apache/airflow/pull/36109#issuecomment-1846208405 Instead of adding new code will fix the devcontainers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Add devcontainer\Codespace with Breeze [airflow]

2023-12-07 Thread via GitHub
sgromme closed pull request #36109: Add devcontainer\Codespace with Breeze URL: https://github.com/apache/airflow/pull/36109 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Add devcontainer\Codespace with Breeze [airflow]

2023-12-07 Thread via GitHub
sgromme commented on PR #36109: URL: https://github.com/apache/airflow/pull/36109#issuecomment-1846205603 Ok, I see what you mean. Canceling and will fix the existing devcontainers and update the docs. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-07 Thread via GitHub
potiuk commented on code in PR #36094: URL: https://github.com/apache/airflow/pull/36094#discussion_r1419723479 ## scripts/in_container/install_airflow_and_providers.py: ## @@ -0,0 +1,448 @@ +#!/usr/bin/env python3 + +# Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] Prepare docs 1st wave of Providers December 2023 [airflow]

2023-12-07 Thread via GitHub
eladkal merged PR #36112: URL: https://github.com/apache/airflow/pull/36112 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Increase timeout in `example_ec2` system test when hibernating an instance [airflow]

2023-12-07 Thread via GitHub
ferruzzi merged PR #36114: URL: https://github.com/apache/airflow/pull/36114 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Increase timeout in `example_ec2` system test when hibernating an instance (#36114)

2023-12-07 Thread ferruzzi
This is an automated email from the ASF dual-hosted git repository. ferruzzi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new abdd0454ec Increase timeout in `example_ec2`

[PR] handle deprecation warning in google system test [airflow]

2023-12-07 Thread via GitHub
eladkal opened a new pull request, #36116: URL: https://github.com/apache/airflow/pull/36116 Handle: `tests/system/providers/google/cloud/storage_transfer/example_cloud_storage_transfer_service_aws.py:113: [W0513(warning), ] The ``bucket`` parameter is deprecated and will be removed

Re: [PR] Remove MSSQL support from Airflow core [airflow]

2023-12-07 Thread via GitHub
jscheffl commented on PR #35868: URL: https://github.com/apache/airflow/pull/35868#issuecomment-1846192314 > I'm not confortable having this in 2.8.0. Let's leave it for 2.9.0 because the change is big and close to the release time. Also, I prefer we don't remove the mssql codes but

Re: [PR] Increase timeout in `example_ec2` system test when hibernating an instance [airflow]

2023-12-07 Thread via GitHub
ferruzzi commented on PR #36114: URL: https://github.com/apache/airflow/pull/36114#issuecomment-1846184437 When I timed it, they seemed to take 20-25 minutes, maybe I was just cutting it too close. 15 should be good, thanks for clarifying -- This is an automated message from the Apache

Re: [PR] Add security team rotation proposal to our security team process [airflow]

2023-12-07 Thread via GitHub
vincbeck commented on code in PR #36049: URL: https://github.com/apache/airflow/pull/36049#discussion_r1419709392 ## CONTRIBUTING.rst: ## @@ -216,6 +216,45 @@ There are certain expectations from the members of the security team: `Severity Rating blog post

(airflow) branch constraints-2-8 updated: Updating constraints. Github run id:7133837164

2023-12-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-8 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-8 by this push: new 6ff90d6f69 Updating

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-07 Thread via GitHub
vincbeck commented on code in PR #36094: URL: https://github.com/apache/airflow/pull/36094#discussion_r1419695530 ## scripts/in_container/install_airflow_and_providers.py: ## @@ -0,0 +1,448 @@ +#!/usr/bin/env python3 + +# Licensed to the Apache Software Foundation (ASF) under

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-07 Thread via GitHub
potiuk commented on PR #36094: URL: https://github.com/apache/airflow/pull/36094#issuecomment-1846154781 cc: @vincbeck @eladkal @amoghrajesh @ashb - but it's one-but-last step to remove all the remainders of bash scripts we had for the CI. The remaining part (which I did not want to

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-07 Thread via GitHub
potiuk commented on PR #36094: URL: https://github.com/apache/airflow/pull/36094#issuecomment-1846150521 I will likely need a few more rounds of fixes, but this is something I got to while iterating on the fix. - 800 lines of bash code replaced by much more approachable Python code

[PR] Update README_RELEASE_PROVIDER_PACKAGES.md [airflow]

2023-12-07 Thread via GitHub
eladkal opened a new pull request, #36115: URL: https://github.com/apache/airflow/pull/36115 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] Add devcontainer\Codespace with Breeze [airflow]

2023-12-07 Thread via GitHub
potiuk commented on PR #36109: URL: https://github.com/apache/airflow/pull/36109#issuecomment-1846136118 > Github Codespaces has around ~50 hours free for each month vs Gitpods around ~ 5 hours. You completely missed the point. I linked you the "codespaces" support not Github - you

Re: [PR] Add devcontainer\Codespace with Breeze [airflow]

2023-12-07 Thread via GitHub
potiuk commented on PR #36109: URL: https://github.com/apache/airflow/pull/36109#issuecomment-1846133474 Well. that's what the original devcontainer was supposed to do . What's the difference? We already have support for codes[aces, so my question is: a) does it fix something

Re: [I] dbt Cloud provider to support retry from point of failure [airflow]

2023-12-07 Thread via GitHub
josh-fell commented on issue #35772: URL: https://github.com/apache/airflow/issues/35772#issuecomment-1846124762 All yours @Bowrna! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Increase timeout in `example_ec2` system test when hibernating an instance [airflow]

2023-12-07 Thread via GitHub
vincbeck commented on PR #36114: URL: https://github.com/apache/airflow/pull/36114#issuecomment-1846116365 > How much time is added in total with both of those values getting changed? Before it was 75 * 20 seconds = 25 minutes. Now it is, 40 * 1 minute = 40 minutes. Hibernating seems

Re: [PR] Increase timeout in `example_ec2` system test when hibernating an instance [airflow]

2023-12-07 Thread via GitHub
ferruzzi commented on PR #36114: URL: https://github.com/apache/airflow/pull/36114#issuecomment-1846113401 How much time is added in total with both of those values getting changed? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[PR] Increase timeout in `example_ec2` system test when hibernating an instance [airflow]

2023-12-07 Thread via GitHub
vincbeck opened a new pull request, #36114: URL: https://github.com/apache/airflow/pull/36114 Our system test `example_ec2` failed recently because of that. See [dashboard](https://aws-mwaa.github.io/#/open-source/system-tests/dashboard.html) --- **^

[PR] Use `redshift-data` operators instead of SQL operators [airflow]

2023-12-07 Thread via GitHub
vincbeck opened a new pull request, #36113: URL: https://github.com/apache/airflow/pull/36113 Instead of using `SQLExecuteQueryOperator`, use AWS provided operator `RedshiftDataOperator` to run SQL queries in a Redshift cluster. --- **^ Add meaningful

(airflow) branch v2-8-test updated (f7b669945a -> f819449dd4)

2023-12-07 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit f7b669945a Fix optimization of PROD image building side-effect omit 454add44cd Update

Re: [PR] Fix for EksCreateClusterOperator deferrable mode [airflow]

2023-12-07 Thread via GitHub
vincbeck merged PR #36079: URL: https://github.com/apache/airflow/pull/36079 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Fix for `EksCreateClusterOperator` deferrable mode (#36079)

2023-12-07 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 7329e9eed9 Fix for `EksCreateClusterOperator`

Re: [I] Required to fix error handling in `EksCreateClusterOperator` in deferrable mode [airflow]

2023-12-07 Thread via GitHub
vincbeck closed issue #34844: Required to fix error handling in `EksCreateClusterOperator` in deferrable mode URL: https://github.com/apache/airflow/issues/34844 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Add devcontainer\Codespace with Breeze [airflow]

2023-12-07 Thread via GitHub
sgromme commented on PR #36109: URL: https://github.com/apache/airflow/pull/36109#issuecomment-1846087963 Github Codespaces has around ~50 hours free for each month vs Gitpods around ~ 5 hours. -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] Add devcontainer\Codespace with Breeze [airflow]

2023-12-07 Thread via GitHub
sgromme commented on PR #36109: URL: https://github.com/apache/airflow/pull/36109#issuecomment-1846070431 - Added the new Breeze devcontainer(Codespace) for Breeze support - integration and testing ( like Gitpod.io) - CONTRIBUTORS_QUICK_START_CODESPACES.rst will be updated next -

Re: [PR] Fix for EksCreateClusterOperator deferrable mode [airflow]

2023-12-07 Thread via GitHub
syedahsn commented on PR #36079: URL: https://github.com/apache/airflow/pull/36079#issuecomment-1846055794 Sorry missed that one. Everything is passing now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[PR] Prepare docs 1st wave of Providers December 2023 [airflow]

2023-12-07 Thread via GitHub
eladkal opened a new pull request, #36112: URL: https://github.com/apache/airflow/pull/36112 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Use query params to define cassandra keyspace and table in the query [airflow]

2023-12-07 Thread via GitHub
hussein-awala opened a new pull request, #36111: URL: https://github.com/apache/airflow/pull/36111 part of: #35638 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Webserver returns 500 for POST requests to api/dag/*/dagrun from anonymous user [airflow]

2023-12-07 Thread via GitHub
boring-cyborg[bot] commented on issue #36110: URL: https://github.com/apache/airflow/issues/36110#issuecomment-1845988218 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] Webserver returns 500 for POST requests to api/dag/*/dagrun from anonymous user [airflow]

2023-12-07 Thread via GitHub
eliskovets opened a new issue, #36110: URL: https://github.com/apache/airflow/issues/36110 ### Apache Airflow version 2.7.3 ### What happened After upgrade to 2.7.3 I noticed that webserver returns 500 for POST requests with a `note` field. After some investigation it

(airflow) branch main updated: Fix optimization of PROD image building side-effect (#36106)

2023-12-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 820cbe79b0 Fix optimization of PROD image building

Re: [PR] Fix optimization of PROD image building side-effect [airflow]

2023-12-07 Thread via GitHub
potiuk merged PR #36106: URL: https://github.com/apache/airflow/pull/36106 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Wrong execution date in SLA alerts [airflow]

2023-12-07 Thread via GitHub
hliu-VoleonGroup commented on issue #35415: URL: https://github.com/apache/airflow/issues/35415#issuecomment-1845958983 @pateash Thanks for the reply. To my understanding, `logicalDate` is a new concept in Airflow 2 and it is equivalent to `executionDate`. Please correct me if I am

Re: [PR] Fix parsing connection uri which contains a composite protocol sparated by : [airflow]

2023-12-07 Thread via GitHub
dstandish commented on PR #33531: URL: https://github.com/apache/airflow/pull/33531#issuecomment-1845917794 See, for example, ODBC hook, which allows you to specify the sqlalchemy scheme with `sqlalchemy_scheme`, either as hook init param, or as a connection extra. -- This is an

Re: [PR] Fix parsing connection uri which contains a composite protocol sparated by : [airflow]

2023-12-07 Thread via GitHub
uranusjr commented on PR #33531: URL: https://github.com/apache/airflow/pull/33531#issuecomment-1845908403 https://www.rfc-editor.org/rfc/rfc3986#section-3.1 ~~~ scheme = ALPHA *( ALPHA / DIGIT / "+" / "-" / "." ) ~~~ Having a colon in the scheme makes the URI

(airflow) branch main updated: Use UTC explicitly in timetable tests (#36082)

2023-12-07 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c1d28b36e4 Use UTC explicitly in timetable tests

Re: [PR] Use UTC explicitly in timetable tests [airflow]

2023-12-07 Thread via GitHub
uranusjr merged PR #36082: URL: https://github.com/apache/airflow/pull/36082 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Deferrable Operators Docs Edits (#33620)

2023-12-07 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 657223c0fd Deferrable Operators Docs Edits

Re: [PR] Deferrable Operators Docs Edits [airflow]

2023-12-07 Thread via GitHub
dstandish commented on code in PR #33620: URL: https://github.com/apache/airflow/pull/33620#discussion_r1419410836 ## docs/apache-airflow/authoring-and-scheduling/deferring.rst: ## @@ -18,45 +18,48 @@ Deferrable Operators & Triggers === -Standard

Re: [PR] Deferrable Operators Docs Edits [airflow]

2023-12-07 Thread via GitHub
dstandish merged PR #33620: URL: https://github.com/apache/airflow/pull/33620 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch fix-optimization-of-prod-image-building-for-non-main-branches updated (43400d5cfe -> be461148f8)

2023-12-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch fix-optimization-of-prod-image-building-for-non-main-branches in repository https://gitbox.apache.org/repos/asf/airflow.git omit 43400d5cfe Fix optimization of PROD image building

(airflow) branch v2-8-test updated (c5edc2406d -> f7b669945a)

2023-12-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit c5edc2406d Fix optimization of PROD image building side-effect add f7b669945a Fix optimization of PROD image

Re: [PR] Add helper function for CRUD operations on weaviate's schema and class objects [airflow]

2023-12-07 Thread via GitHub
ephraimbuddy commented on code in PR #35919: URL: https://github.com/apache/airflow/pull/35919#discussion_r1419355948 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -133,20 +140,201 @@ def create_class(self, class_json: dict[str, Any]) -> None: client =

Re: [I] make a trigger_rule for one upstream failed but wait the whole upstream tasks to finish [airflow]

2023-12-07 Thread via GitHub
salimmoulouel commented on issue #35149: URL: https://github.com/apache/airflow/issues/35149#issuecomment-1845776165 https://github.com/apache/airflow/issues/7858 i found an issue which look like mine. @eladkal thank you for time spent to understand my problem -- This is an

Re: [I] Delete DagRun event is not registered in audit log [airflow]

2023-12-07 Thread via GitHub
vchiapaikeo commented on issue #36057: URL: https://github.com/apache/airflow/issues/36057#issuecomment-1845672285 Actually @eladkal , wondering if the above is sufficient for what you need... the problem is that the action_logging decorator only logs a single row for both a single delete

Re: [I] make a trigger_rule for one upstream failed but wait the whole upstream tasks to finish [airflow]

2023-12-07 Thread via GitHub
salimmoulouel commented on issue #35149: URL: https://github.com/apache/airflow/issues/35149#issuecomment-1845672576 attached a picture of the dag If any of the four black-surrounded tasks completes and sends a skip signal to the green-surrounded task, the green-surrounded task will

(airflow) branch v2-8-test updated (4173f01683 -> c5edc2406d)

2023-12-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 4173f01683 Fix optimization of PROD image building side-effect add c5edc2406d Fix optimization of PROD image

(airflow) branch fix-optimization-of-prod-image-building-for-non-main-branches updated (5c5096b2d6 -> 43400d5cfe)

2023-12-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch fix-optimization-of-prod-image-building-for-non-main-branches in repository https://gitbox.apache.org/repos/asf/airflow.git omit 5c5096b2d6 Fix optimization of PROD image building

Re: [PR] Fix for EksCreateClusterOperator deferrable mode [airflow]

2023-12-07 Thread via GitHub
vincbeck commented on PR #36079: URL: https://github.com/apache/airflow/pull/36079#issuecomment-1845611956 Static check failure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Add retry mechanism and dataframe support for WeaviateIngestOperator [airflow]

2023-12-07 Thread via GitHub
ephraimbuddy commented on code in PR #36085: URL: https://github.com/apache/airflow/pull/36085#discussion_r1419153313 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -17,10 +17,14 @@ from __future__ import annotations +import contextlib +import json import warnings

Re: [I] make a trigger_rule for one upstream failed but wait the whole upstream tasks to finish [airflow]

2023-12-07 Thread via GitHub
eladkal commented on issue #35149: URL: https://github.com/apache/airflow/issues/35149#issuecomment-1845582073 This use case doesnt make sense to me. I assume your real case is: A >> [C, D] B >> [ C, E] Where A and B are branch operator. When A say to follow to D (thus

Re: [I] make a trigger_rule for one upstream failed but wait the whole upstream tasks to finish [airflow]

2023-12-07 Thread via GitHub
salimmoulouel commented on issue #35149: URL: https://github.com/apache/airflow/issues/35149#issuecomment-1845567233 Sorry i didn't describe well my problem bacause i was beginner when i wrote the issue A >> D B >> D A and B are BranchOperator, when one of them send skip signal to

(airflow) branch fix-optimization-of-prod-image-building-for-non-main-branches updated (a43bd0916c -> 5c5096b2d6)

2023-12-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch fix-optimization-of-prod-image-building-for-non-main-branches in repository https://gitbox.apache.org/repos/asf/airflow.git omit a43bd0916c Fix optimization of PROD image building

Re: [PR] Fix race condition in KubernetesExecutor with concurrently running schedulers [airflow]

2023-12-07 Thread via GitHub
droppoint commented on PR #35800: URL: https://github.com/apache/airflow/pull/35800#issuecomment-1845545959 We've refactored the _adopt_completed_pods function to the _delete_orphaned_completed_pods function and now it removes completed pods from failed schedulers properly. Here's a

[PR] Add Codespace with Breeze [airflow]

2023-12-07 Thread via GitHub
sgromme opened a new pull request, #36109: URL: https://github.com/apache/airflow/pull/36109 - new style devcontainer.json --- **^ Add meaningful description above** Read the **[Pull Request

Re: [I] Update Airflow Airbyte Provider to use the new Airbyte API [airflow]

2023-12-07 Thread via GitHub
vytautasnord commented on issue #35011: URL: https://github.com/apache/airflow/issues/35011#issuecomment-1845499046 Hello, I'm interested to know if there has been any progress with this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please

[PR] Add ability to run streaming Job for BeamRunPythonPipelineOperator in non deferrable mode [airflow]

2023-12-07 Thread via GitHub
MaksYermak opened a new pull request, #36108: URL: https://github.com/apache/airflow/pull/36108 In this PR I have fixed the problem when a Streaming Job, which is run by `BeamRunPythonPipelineOperator`, blocks the starting of the next task in the DAG. Expected behavior for

[PR] fix: downstream on list [airflow]

2023-12-07 Thread via GitHub
raphaelauv opened a new pull request, #36107: URL: https://github.com/apache/airflow/pull/36107 so currently ```python [op_d, op_c << op_b] << op_a ``` is not equivalent to ```python op_a >> [op_b >> op_c, op_d] ``` -- This is an automated message

Re: [PR] confirmation dialog box for DAG run actions [airflow]

2023-12-07 Thread via GitHub
theaadya commented on PR #35393: URL: https://github.com/apache/airflow/pull/35393#issuecomment-1845413662 Done with the requested changes! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Introduce @task.bash TaskFlow decorator [airflow]

2023-12-07 Thread via GitHub
potiuk commented on PR #30176: URL: https://github.com/apache/airflow/pull/30176#issuecomment-1845330672 > I would argue if you need logic it is better to create a shell script file and use templating to pass in the values instead. Trying to generate a shell command with Python codeā€”or

Re: [PR] Add helper function for CRUD operations on weaviate's schema and class objects [airflow]

2023-12-07 Thread via GitHub
utkarsharma2 commented on code in PR #35919: URL: https://github.com/apache/airflow/pull/35919#discussion_r1417042460 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -119,38 +125,204 @@ def test_connection(self) -> tuple[bool, str]: self.log.error("Error

Re: [PR] Add retry mechanism and dataframe support for WeaviateIngestOperator [airflow]

2023-12-07 Thread via GitHub
utkarsharma2 commented on code in PR #36085: URL: https://github.com/apache/airflow/pull/36085#discussion_r1418875440 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -135,22 +141,52 @@ def create_schema(self, schema_json: dict[str, Any]) -> None: client =

[PR] Fix optimization of PROD image building side-effect [airflow]

2023-12-07 Thread via GitHub
potiuk opened a new pull request, #36106: URL: https://github.com/apache/airflow/pull/36106 The change #35856 optimized waiting time before PROD image builds start - rather than waiting for full constratints generation, the PROD image building just used source constraints generated right

Re: [PR] Fix optimization of PROD image building side-effect [airflow]

2023-12-07 Thread via GitHub
potiuk closed pull request #36105: Fix optimization of PROD image building side-effect URL: https://github.com/apache/airflow/pull/36105 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

(airflow) branch fix-optimization-of-prod-image-building-for-non-main-branches created (now a43bd0916c)

2023-12-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch fix-optimization-of-prod-image-building-for-non-main-branches in repository https://gitbox.apache.org/repos/asf/airflow.git at a43bd0916c Fix optimization of PROD image building

(airflow) 01/01: Fix optimization of PROD image building side-effect

2023-12-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch fix-optimization-of-prod-image-building-for-non-main-branches in repository https://gitbox.apache.org/repos/asf/airflow.git commit a43bd0916cfb940edba90737e2f2fe05478cab31 Author: Jarek Potiuk

  1   2   >