[GitHub] [airflow] potiuk commented on issue #32048: Allow providers to add default connections

2023-06-23 Thread via GitHub
potiuk commented on issue #32048: URL: https://github.com/apache/airflow/issues/32048#issuecomment-1605064459 But yes. I am all for clarifying the behaviour, getting `airflow db init` to be renamed and defining when we create default conneciotns (and whether they should be coming from

[GitHub] [airflow] potiuk commented on issue #32048: Allow providers to add default connections

2023-06-23 Thread via GitHub
potiuk commented on issue #32048: URL: https://github.com/apache/airflow/issues/32048#issuecomment-1605062163 > How do we decide which providers would have default connections out of the box or in the past, since I don't see it for all of them? were there any criteria to be met? > >

[GitHub] [airflow] potiuk merged pull request #31920: Deprecate the 2 non-official elasticsearch libraries

2023-06-23 Thread via GitHub
potiuk merged PR #31920: URL: https://github.com/apache/airflow/pull/31920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #31920: Deprecate the 2 non-official elasticsearch libraries

2023-06-23 Thread via GitHub
potiuk commented on PR #31920: URL: https://github.com/apache/airflow/pull/31920#issuecomment-1605076347 Woooho! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[airflow] branch main updated: Deprecate the 2 non-official elasticsearch libraries (#31920)

2023-06-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b28c90354f Deprecate the 2 non-official

[GitHub] [airflow] github-actions[bot] closed pull request #31040: Added kube-prometheus-stack servicemonitor to gather metrics from Airflow statsd exporter

2023-06-23 Thread via GitHub
github-actions[bot] closed pull request #31040: Added kube-prometheus-stack servicemonitor to gather metrics from Airflow statsd exporter URL: https://github.com/apache/airflow/pull/31040 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] getaaron commented on issue #31105: airflow-webserver crashes if log files are larger than webserver available RAM

2023-06-23 Thread via GitHub
getaaron commented on issue #31105: URL: https://github.com/apache/airflow/issues/31105#issuecomment-1605119355 > Yeah, I thought of a way where we could maintain separate log_pos for different streams. This way we do not have to pull the whole file into memory just to get the final few

[GitHub] [airflow] ITJamie commented on a diff in pull request #30531: [WIP] Migrate core `EmailOperator` to SMTP provider

2023-06-23 Thread via GitHub
ITJamie commented on code in PR #30531: URL: https://github.com/apache/airflow/pull/30531#discussion_r1240510568 ## airflow/utils/email.py: ## @@ -19,22 +19,69 @@ import collections.abc import logging -import os import re -import smtplib import warnings -from

[GitHub] [airflow] potiuk commented on pull request #22253: Add SparkKubernetesOperator crd implementation

2023-06-23 Thread via GitHub
potiuk commented on PR #22253: URL: https://github.com/apache/airflow/pull/22253#issuecomment-1605071290 errors. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] github-actions[bot] commented on pull request #30581: Make pause DAG its own role separate from edit DAG

2023-06-23 Thread via GitHub
github-actions[bot] commented on PR #30581: URL: https://github.com/apache/airflow/pull/30581#issuecomment-1605178177 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

[GitHub] [airflow] vandonr-amz commented on a diff in pull request #32112: deferrable mode for `SageMakerTuningOperator`

2023-06-23 Thread via GitHub
vandonr-amz commented on code in PR #32112: URL: https://github.com/apache/airflow/pull/32112#discussion_r1240552004 ## tests/system/providers/amazon/aws/example_sagemaker.py: ## @@ -159,12 +159,11 @@ def _build_and_upload_docker_image(preprocess_script, repository_uri):

[GitHub] [airflow] amoghrajesh commented on pull request #31376: Add valid spark on k8s airflow connection urls to tests

2023-06-23 Thread via GitHub
amoghrajesh commented on PR #31376: URL: https://github.com/apache/airflow/pull/31376#issuecomment-1605244487 @hussein-awala can we merge this PR too as the dependent PR has been merged recently? -- This is an automated message from the Apache Git Service. To respond to the message,

[airflow] branch constraints-main updated: Updating constraints. Github run id:5360683424

2023-06-23 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new a5923a2b97 Updating

[GitHub] [airflow] potiuk commented on issue #32111: KubernetesPodOperator job intermittently fails - unable to retrieve json from xcom sidecar container due to network connectivity issues

2023-06-23 Thread via GitHub
potiuk commented on issue #32111: URL: https://github.com/apache/airflow/issues/32111#issuecomment-1605058814 Assigned you. Feel free to provide PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] vandonr-amz opened a new pull request, #32112: deferrable mode for `SageMakerTuningOperator`

2023-06-23 Thread via GitHub
vandonr-amz opened a new pull request, #32112: URL: https://github.com/apache/airflow/pull/32112 took the opportunity to fix tiny things in the system test, and also migrate to the trigger to the method that logs the status while it waits -- This is an automated message from the

[GitHub] [airflow] dstandish commented on pull request #32053: Change `as_setup` and `as_teardown` to instance methods

2023-06-23 Thread via GitHub
dstandish commented on PR #32053: URL: https://github.com/apache/airflow/pull/32053#issuecomment-1605068228 OK @uranusjr @ephraimbuddy @jedcunningham the scope of this PR expanded a little bit. I wanted to add validation so that (1) a task can't be both setup and teardown, (2) once you

[GitHub] [airflow] potiuk commented on pull request #32110: add deferrable mode for `AthenaOperator`

2023-06-23 Thread via GitHub
potiuk commented on PR #32110: URL: https://github.com/apache/airflow/pull/32110#issuecomment-1605084324 static checks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[airflow] branch constraints-main updated: Updating constraints. Github run id:5361110862

2023-06-23 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new b0a5ba8486 Updating

[GitHub] [airflow] potiuk merged pull request #32038: Add an option to load the dags from db for command tasks run

2023-06-23 Thread via GitHub
potiuk merged PR #32038: URL: https://github.com/apache/airflow/pull/32038 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk closed issue #32020: Airflow tasks run -m cli command giving 504 response

2023-06-23 Thread via GitHub
potiuk closed issue #32020: Airflow tasks run -m cli command giving 504 response URL: https://github.com/apache/airflow/issues/32020 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[airflow] branch main updated: Add an option to load the dags from db for command tasks run (#32038)

2023-06-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 05a67efe32 Add an option to load the dags from db

[GitHub] [airflow] potiuk commented on pull request #29055: [AIP-51] Executors vending CLI commands

2023-06-23 Thread via GitHub
potiuk commented on PR #29055: URL: https://github.com/apache/airflow/pull/29055#issuecomment-1605060078 > This is still blocked by #30727 waiting for a merge of that one Maybe good time to merge it. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #32113: Fix KubernetesPodOperator validate xcom json and add retries

2023-06-23 Thread via GitHub
boring-cyborg[bot] commented on PR #32113: URL: https://github.com/apache/airflow/pull/32113#issuecomment-1605198948 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] aagateuip opened a new pull request, #32113: Fix KubernetesPodOperator validate xcom json and add retries

2023-06-23 Thread via GitHub
aagateuip opened a new pull request, #32113: URL: https://github.com/apache/airflow/pull/32113 --- * Added retries to extract_xcom to guard against intermittent network connectivity failures. * xcom json is validated to make sure entire json was retrieved. * xcom sidecar is

[GitHub] [airflow] jedcunningham commented on a diff in pull request #32099: Support setting dependencies for tasks called outside setup/teardown context manager

2023-06-23 Thread via GitHub
jedcunningham commented on code in PR #32099: URL: https://github.com/apache/airflow/pull/32099#discussion_r1240592248 ## airflow/models/baseoperator.py: ## @@ -1001,6 +1001,14 @@ def __enter__(self): def __exit__(self, exc_type, exc_val, exc_tb):

[GitHub] [airflow] boring-cyborg[bot] commented on issue #32084: GKEStartPodOperator unnable to start pod

2023-06-23 Thread via GitHub
boring-cyborg[bot] commented on issue #32084: URL: https://github.com/apache/airflow/issues/32084#issuecomment-1603752959 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[GitHub] [airflow] vrumjantsev opened a new issue, #32084: GKEStartPodOperator unnable to start pod

2023-06-23 Thread via GitHub
vrumjantsev opened a new issue, #32084: URL: https://github.com/apache/airflow/issues/32084 ### Apache Airflow version 2.6.2 ### What happened I'm running airflow 2.6.2 installed in GKE private cluster, deployed via official helm chart 1.9.0 Aifflow image also

[airflow] branch main updated: Remove casting of forward_credentials for shell and start-airflow breeze (#32087)

2023-06-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3ead4aa610 Remove casting of forward_credentials

[GitHub] [airflow] potiuk merged pull request #32087: Remove casting of forward_credentials for shell and start-airflow breeze

2023-06-23 Thread via GitHub
potiuk merged PR #32087: URL: https://github.com/apache/airflow/pull/32087 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] Owen-CH-Leung commented on pull request #31920: Deprecate the 2 non-official elasticsearch libraries

2023-06-23 Thread via GitHub
Owen-CH-Leung commented on PR #31920: URL: https://github.com/apache/airflow/pull/31920#issuecomment-1603763991 @potiuk looks like multiple CI jobs fail at the `docker pull`...maybe a rerun would fix them -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #32085: Fix AWS "Operators and hooks" page to display "Sensors" item

2023-06-23 Thread via GitHub
boring-cyborg[bot] commented on PR #32085: URL: https://github.com/apache/airflow/pull/32085#issuecomment-1603852036 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] suzuryo97 opened a new pull request, #32085: Fix AWS "Operators and hooks" page to display "Sensors" item

2023-06-23 Thread via GitHub
suzuryo97 opened a new pull request, #32085: URL: https://github.com/apache/airflow/pull/32085 In the "Operators_and_hooks_ref.py" code, "sensors" has been replaced with "hooks". As a result, the "Sensors" items are not displayed on the [AWS "Operators and hooks"

[GitHub] [airflow] Owen-CH-Leung commented on pull request #31920: Deprecate the 2 non-official elasticsearch libraries

2023-06-23 Thread via GitHub
Owen-CH-Leung commented on PR #31920: URL: https://github.com/apache/airflow/pull/31920#issuecomment-1603877801 @potiuk The CI job `provider package wheel (verify)` is still failing : ```Command to run: 'git log --pretty=format:%H %h %cd %s --date=short

[GitHub] [airflow] potiuk commented on pull request #32087: Remove casting of forward_credentials for shell and start-airflow breeze

2023-06-23 Thread via GitHub
potiuk commented on PR #32087: URL: https://github.com/apache/airflow/pull/32087#issuecomment-1603910093 cc: @vandonr-amz -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [airflow] Adaverse commented on pull request #32082: Fix where account url is build if not provided using login (account name)

2023-06-23 Thread via GitHub
Adaverse commented on PR #32082: URL: https://github.com/apache/airflow/pull/32082#issuecomment-1603731755 cc @phanikumv -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [airflow] gartyanip commented on issue #32084: GKEStartPodOperator unnable to start pod

2023-06-23 Thread via GitHub
gartyanip commented on issue #32084: URL: https://github.com/apache/airflow/issues/32084#issuecomment-1603855805 thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [airflow] pierrejeambrun merged pull request #32060: Use re2 for matching untrusted regex

2023-06-23 Thread via GitHub
pierrejeambrun merged PR #32060: URL: https://github.com/apache/airflow/pull/32060 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Use re2 for matching untrusted regex (#32060)

2023-06-23 Thread pierrejeambrun
This is an automated email from the ASF dual-hosted git repository. pierrejeambrun pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 116e607ddc Use re2 for matching untrusted

[GitHub] [airflow] potiuk opened a new pull request, #32087: Remove casting of forward_credentials for shell and start-airflow breeze

2023-06-23 Thread via GitHub
potiuk opened a new pull request, #32087: URL: https://github.com/apache/airflow/pull/32087 The forward-credentials flag was supposed to be disabled when you run start-airflow and shell commands. However the flag boolean value has been casted to str so False became "False" and

[GitHub] [airflow] Adaverse commented on a diff in pull request #32089: Parameters for vertica

2023-06-23 Thread via GitHub
Adaverse commented on code in PR #32089: URL: https://github.com/apache/airflow/pull/32089#discussion_r1239623477 ## airflow/providers/vertica/hooks/vertica.py: ## @@ -45,6 +45,51 @@ def get_conn(self) -> connect: conn_config["port"] = 5433 else:

[airflow] branch main updated: Update comment for editable installs wrt setuptools (#32090)

2023-06-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ca13c7b77e Update comment for editable installs

[GitHub] [airflow] potiuk merged pull request #32090: Update comment for editable installs wrt setuptools

2023-06-23 Thread via GitHub
potiuk merged PR #32090: URL: https://github.com/apache/airflow/pull/32090 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: doc: fix Google authorization token command (#31893)

2023-06-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new fa07812d10 doc: fix Google authorization token

[GitHub] [airflow] eladkal merged pull request #31893: doc: fix Google authorization token command

2023-06-23 Thread via GitHub
eladkal merged PR #31893: URL: https://github.com/apache/airflow/pull/31893 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #31893: doc: fix Google authorization token command

2023-06-23 Thread via GitHub
boring-cyborg[bot] commented on PR #31893: URL: https://github.com/apache/airflow/pull/31893#issuecomment-1604067020 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional

[GitHub] [airflow] tomrutter opened a new pull request, #32092: Handle partially updated trigger/task_instance data in triggerr jobs

2023-06-23 Thread via GitHub
tomrutter opened a new pull request, #32092: URL: https://github.com/apache/airflow/pull/32092 Updates to triggerer job to improve robustness. Context: Triggerer runs two threads, one synchronous and one asynchronous. The synchronous thread handles db updates, and the asynchronous

[GitHub] [airflow] HaeSe0ng commented on pull request #32070: Fix name format in the batch requests

2023-06-23 Thread via GitHub
HaeSe0ng commented on PR #32070: URL: https://github.com/apache/airflow/pull/32070#issuecomment-1603932631 Thank you for the reviews. May I know what version would include this PR and when would it be released? -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] potiuk merged pull request #32088: Open links in new tab that take us away from Airflow UI

2023-06-23 Thread via GitHub
potiuk merged PR #32088: URL: https://github.com/apache/airflow/pull/32088 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Open links in new tab that take us away from Airflow UI (#32088)

2023-06-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 42c409dc43 Open links in new tab that take us away

[GitHub] [airflow] potiuk commented on pull request #29465: Use newer setuptools v67.2.0

2023-06-23 Thread via GitHub
potiuk commented on PR #29465: URL: https://github.com/apache/airflow/pull/29465#issuecomment-1604017790 We have an issue about it https://github.com/apache/airflow/issues/30764 already and yeah. I think it needs a bit closer look. I think it might be quite tricky to solve - our setup.py

[GitHub] [airflow] Adaverse commented on a diff in pull request #32089: Parameters for vertica

2023-06-23 Thread via GitHub
Adaverse commented on code in PR #32089: URL: https://github.com/apache/airflow/pull/32089#discussion_r1239630460 ## airflow/providers/vertica/hooks/vertica.py: ## @@ -45,6 +45,51 @@ def get_conn(self) -> connect: conn_config["port"] = 5433 else:

[GitHub] [airflow] pankajkoti opened a new pull request, #32090: Update comment for editable installs wrt setuptools

2023-06-23 Thread via GitHub
pankajkoti opened a new pull request, #32090: URL: https://github.com/apache/airflow/pull/32090 Editable installs are currently broken using setuptools 64.0.0 and above. Update comment describing the same and mention workarounds. --- **^ Add meaningful description

[GitHub] [airflow] potiuk commented on pull request #32085: Fix AWS "Operators and hooks" page to display "Sensors" item

2023-06-23 Thread via GitHub
potiuk commented on PR #32085: URL: https://github.com/apache/airflow/pull/32085#issuecomment-1604053680 Cc: @eladkal -> you might want to cherry-pick (or manually modify) that one and regenerate the provider documentation before merging it today. -- This is an automated message from the

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #32085: Fix AWS "Operators and hooks" page to display "Sensors" item

2023-06-23 Thread via GitHub
boring-cyborg[bot] commented on PR #32085: URL: https://github.com/apache/airflow/pull/32085#issuecomment-1604053979 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional

[airflow] branch main updated: Fix "operators_and_hooks_ref.py" to output "sensor" item. (#32085)

2023-06-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3bfc0817ec Fix "operators_and_hooks_ref.py" to

[GitHub] [airflow] potiuk merged pull request #32085: Fix AWS "Operators and hooks" page to display "Sensors" item

2023-06-23 Thread via GitHub
potiuk merged PR #32085: URL: https://github.com/apache/airflow/pull/32085 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on a diff in pull request #32052: Disable allowing by default testing of connnections in UI

2023-06-23 Thread via GitHub
potiuk commented on code in PR #32052: URL: https://github.com/apache/airflow/pull/32052#discussion_r1239687219 ## airflow/www/static/js/connection_form.js: ## @@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) { */ function handleTestConnection(connectionType,

[airflow] branch constraints-main updated: Updating constraints. Github run id:5355363884

2023-06-23 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new b4c88cbc01 Updating

[GitHub] [airflow] darkag opened a new pull request, #32089: Parameters for vertica

2023-06-23 Thread via GitHub
darkag opened a new pull request, #32089: URL: https://github.com/apache/airflow/pull/32089 Give the possibility to pass vertica connection parameters using extra. Especially it gives the possibility to enable load balancing (Vertica requires that load balancing is enabled client and

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #32089: Parameters for vertica

2023-06-23 Thread via GitHub
boring-cyborg[bot] commented on PR #32089: URL: https://github.com/apache/airflow/pull/32089#issuecomment-1603991143 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] potiuk commented on a diff in pull request #32052: Disable allowing by default testing of connnections in UI

2023-06-23 Thread via GitHub
potiuk commented on code in PR #32052: URL: https://github.com/apache/airflow/pull/32052#discussion_r1239681677 ## airflow/www/static/js/connection_form.js: ## @@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) { */ function handleTestConnection(connectionType,

[GitHub] [airflow] potiuk commented on a diff in pull request #32052: Disable allowing by default testing of connnections in UI

2023-06-23 Thread via GitHub
potiuk commented on code in PR #32052: URL: https://github.com/apache/airflow/pull/32052#discussion_r1239681677 ## airflow/www/static/js/connection_form.js: ## @@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) { */ function handleTestConnection(connectionType,

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #32092: Handle partially updated trigger/task_instance data in triggerr jobs

2023-06-23 Thread via GitHub
boring-cyborg[bot] commented on PR #32092: URL: https://github.com/apache/airflow/pull/32092#issuecomment-1604133897 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] pankajkoti opened a new pull request, #32088: Open links in new tab that take us away from Airflow UI

2023-06-23 Thread via GitHub
pankajkoti opened a new pull request, #32088: URL: https://github.com/apache/airflow/pull/32088 I am observing that clicking on the "Click here" links take us away from Airflow UI to the docs domain and I need to press on back button in the browser to get back to Airflow UI. Ideally,

[GitHub] [airflow] Adaverse commented on a diff in pull request #32089: Parameters for vertica

2023-06-23 Thread via GitHub
Adaverse commented on code in PR #32089: URL: https://github.com/apache/airflow/pull/32089#discussion_r1239630460 ## airflow/providers/vertica/hooks/vertica.py: ## @@ -45,6 +45,51 @@ def get_conn(self) -> connect: conn_config["port"] = 5433 else:

[GitHub] [airflow] pankajastro commented on a diff in pull request #32029: Add deferrable mode in EMR operator and sensor

2023-06-23 Thread via GitHub
pankajastro commented on code in PR #32029: URL: https://github.com/apache/airflow/pull/32029#discussion_r1239642693 ## airflow/providers/amazon/aws/sensors/emr.py: ## @@ -424,12 +431,16 @@ def __init__( job_flow_id: str, target_states: Iterable[str] | None =

[GitHub] [airflow] nathadfield opened a new issue, #32093: GCSToBQ operator does not respect `project_id` in deferrable mode with impersonation chain.

2023-06-23 Thread via GitHub
nathadfield opened a new issue, #32093: URL: https://github.com/apache/airflow/issues/32093 ### Apache Airflow version 2.6.2 ### What happened When using the `GCSToBigQueryOperator` in deferrable mode with an impersonation_chain service account which has a default

[GitHub] [airflow] Lee-W commented on a diff in pull request #32029: Add deferrable mode in EMR operator and sensor

2023-06-23 Thread via GitHub
Lee-W commented on code in PR #32029: URL: https://github.com/apache/airflow/pull/32029#discussion_r1239621504 ## airflow/providers/amazon/aws/sensors/emr.py: ## @@ -424,12 +431,16 @@ def __init__( job_flow_id: str, target_states: Iterable[str] | None = None,

[GitHub] [airflow] pankajastro commented on a diff in pull request #32029: Add deferrable mode in EMR operator and sensor

2023-06-23 Thread via GitHub
pankajastro commented on code in PR #32029: URL: https://github.com/apache/airflow/pull/32029#discussion_r1239641163 ## airflow/providers/amazon/aws/triggers/emr.py: ## @@ -317,3 +317,72 @@ async def run(self) -> AsyncIterator[TriggerEvent]: await

[GitHub] [airflow] tomrutter opened a new issue, #32091: Triggerer intermittent failure when running many triggerers

2023-06-23 Thread via GitHub
tomrutter opened a new issue, #32091: URL: https://github.com/apache/airflow/issues/32091 ### Apache Airflow version 2.6.2 ### What happened We are running a dag with many deferrable tasks using a custom trigger that waits for an Azure Batch task to complete. When many

[GitHub] [airflow] darkag commented on a diff in pull request #32089: Parameters for vertica

2023-06-23 Thread via GitHub
darkag commented on code in PR #32089: URL: https://github.com/apache/airflow/pull/32089#discussion_r1239780811 ## airflow/providers/vertica/hooks/vertica.py: ## @@ -45,6 +45,51 @@ def get_conn(self) -> connect: conn_config["port"] = 5433 else:

[GitHub] [airflow] jedcunningham commented on a diff in pull request #32052: Disable allowing by default testing of connnections in UI

2023-06-23 Thread via GitHub
jedcunningham commented on code in PR #32052: URL: https://github.com/apache/airflow/pull/32052#discussion_r1239804895 ## airflow/www/static/js/connection_form.js: ## @@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) { */ function

[airflow] branch main updated: Release notes for helm chart 1.10.0 (#31771)

2023-06-23 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new dfd827e447 Release notes for helm chart

[GitHub] [airflow] jedcunningham merged pull request #31771: Release notes for helm chart 1.10.0

2023-06-23 Thread via GitHub
jedcunningham merged PR #31771: URL: https://github.com/apache/airflow/pull/31771 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

svn commit: r62600 - /dev/airflow/helm-chart/1.9.0rc1/

2023-06-23 Thread jedcunningham
Author: jedcunningham Date: Fri Jun 23 13:31:44 2023 New Revision: 62600 Log: Remove old Helm Chart release: 1.9.0rc1 Removed: dev/airflow/helm-chart/1.9.0rc1/

[GitHub] [airflow] pankajkoti commented on a diff in pull request #32052: Disable allowing by default testing of connnections in UI

2023-06-23 Thread via GitHub
pankajkoti commented on code in PR #32052: URL: https://github.com/apache/airflow/pull/32052#discussion_r1239827440 ## airflow/www/static/js/connection_form.js: ## @@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) { */ function

[GitHub] [airflow] pankajkoti commented on a diff in pull request #32052: Disable allowing by default testing of connnections in UI

2023-06-23 Thread via GitHub
pankajkoti commented on code in PR #32052: URL: https://github.com/apache/airflow/pull/32052#discussion_r1239827440 ## airflow/www/static/js/connection_form.js: ## @@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) { */ function

[GitHub] [airflow] utkarsharma2 commented on a diff in pull request #31887: Adapt Notifier for sla_miss_callback

2023-06-23 Thread via GitHub
utkarsharma2 commented on code in PR #31887: URL: https://github.com/apache/airflow/pull/31887#discussion_r1239844698 ## airflow/utils/context.py: ## @@ -88,6 +88,10 @@ "var", "yesterday_ds", "yesterday_ds_nodash", +"task_list", +"blocking_task_list", +

[airflow] branch constraints-main updated: Updating constraints. Github run id:5356808734

2023-06-23 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new dae40aeca6 Updating

[GitHub] [airflow] Lee-W commented on a diff in pull request #32029: Add deferrable mode in EMR operator and sensor

2023-06-23 Thread via GitHub
Lee-W commented on code in PR #32029: URL: https://github.com/apache/airflow/pull/32029#discussion_r1239899387 ## airflow/providers/amazon/aws/triggers/emr.py: ## @@ -317,3 +317,72 @@ async def run(self) -> AsyncIterator[TriggerEvent]: await

[GitHub] [airflow] potiuk commented on pull request #32070: Fix name format in the batch requests

2023-06-23 Thread via GitHub
potiuk commented on PR #32070: URL: https://github.com/apache/airflow/pull/32070#issuecomment-1604391577 Srsly. Watch the announcements, and release notes if you want to know when it is released. In case of providers we determine the version and timing **Just** before releasing them -

[GitHub] [airflow] melugoyal commented on issue #32030: Status of testing Providers that were prepared on June 20, 2023

2023-06-23 Thread via GitHub
melugoyal commented on issue #32030: URL: https://github.com/apache/airflow/issues/32030#issuecomment-1604411678 validated #31659, looks good -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] potiuk merged pull request #32097: Adding `src_fmt_configs` to the list of template fields.

2023-06-23 Thread via GitHub
potiuk merged PR #32097: URL: https://github.com/apache/airflow/pull/32097 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] utkarsharma2 commented on a diff in pull request #31887: Adapt Notifier for sla_miss_callback

2023-06-23 Thread via GitHub
utkarsharma2 commented on code in PR #31887: URL: https://github.com/apache/airflow/pull/31887#discussion_r1239950506 ## tests/dag_processing/test_processor.py: ## @@ -124,6 +124,13 @@ def test_dag_file_processor_sla_miss_callback(self, mock_get_dagbag, create_dumm

[GitHub] [airflow] eladkal commented on issue #32030: Status of testing Providers that were prepared on June 20, 2023

2023-06-23 Thread via GitHub
eladkal commented on issue #32030: URL: https://github.com/apache/airflow/issues/32030#issuecomment-1604465569 Thank you everyone. Providers are released I invite everyone to help improve providers for the next release, a list of open issues can be found

[airflow] branch constraints-main updated: Updating constraints. Github run id:5357825290

2023-06-23 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 63a8e19d8e Updating

[GitHub] [airflow] darkag commented on a diff in pull request #32089: Parameters for vertica

2023-06-23 Thread via GitHub
darkag commented on code in PR #32089: URL: https://github.com/apache/airflow/pull/32089#discussion_r1239778451 ## airflow/providers/vertica/hooks/vertica.py: ## @@ -45,6 +45,51 @@ def get_conn(self) -> connect: conn_config["port"] = 5433 else:

[GitHub] [airflow] flinz commented on issue #30883: BranchPythonOperator skips downstream tasks for all mapped instances in TaskGroup mapping

2023-06-23 Thread via GitHub
flinz commented on issue #30883: URL: https://github.com/apache/airflow/issues/30883#issuecomment-1604262465 Can confirm this still exists in 2.6.0 and I independently hit this using: ```python import time from datetime import datetime from airflow import DAG from

[GitHub] [airflow] nathadfield opened a new pull request, #32097: Adding `src_fmt_configs` to the list of template fields.

2023-06-23 Thread via GitHub
nathadfield opened a new pull request, #32097: URL: https://github.com/apache/airflow/pull/32097 We have scenarios where we need to use Jinja templating on `src_fmt_configs` and currently have to create our own version of `GCSToBigQueryOperator` to achieve this. -- This is an automated

[GitHub] [airflow] jedcunningham commented on a diff in pull request #32052: Disable allowing by default testing of connnections in UI

2023-06-23 Thread via GitHub
jedcunningham commented on code in PR #32052: URL: https://github.com/apache/airflow/pull/32052#discussion_r1239847571 ## airflow/www/static/js/connection_form.js: ## @@ -123,6 +125,16 @@ function applyFieldBehaviours(connection) { */ function

[GitHub] [airflow] potiuk opened a new pull request, #32098: Update security model of Airflow

2023-06-23 Thread via GitHub
potiuk opened a new pull request, #32098: URL: https://github.com/apache/airflow/pull/32098 This change updates the security model of Airflow to better explain what are the capabilities of various kinds of users in Airflow deployments and give both users and security researchers a way to

[GitHub] [airflow] ephraimbuddy opened a new pull request, #32099: Support setting dependencies for tasks called outside setup/teardown context manager

2023-06-23 Thread via GitHub
ephraimbuddy opened a new pull request, #32099: URL: https://github.com/apache/airflow/pull/32099 This commit adds support for the setting of task dependencies w.r.t setup/teardown tasks even when the tasks are called outside the setup/teardown context manager. Previously, the dependencies

[GitHub] [airflow] Adaverse commented on a diff in pull request #32089: Parameters for vertica

2023-06-23 Thread via GitHub
Adaverse commented on code in PR #32089: URL: https://github.com/apache/airflow/pull/32089#discussion_r1239898290 ## airflow/providers/vertica/hooks/vertica.py: ## @@ -45,6 +45,51 @@ def get_conn(self) -> connect: conn_config["port"] = 5433 else:

[GitHub] [airflow] potiuk commented on pull request #32070: Fix name format in the batch requests

2023-06-23 Thread via GitHub
potiuk commented on PR #32070: URL: https://github.com/apache/airflow/pull/32070#issuecomment-1604388748 For providers it is always it's 'next' and 'when ready' -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] HaeSe0ng commented on pull request #32070: Fix name format in the batch requests

2023-06-23 Thread via GitHub
HaeSe0ng commented on PR #32070: URL: https://github.com/apache/airflow/pull/32070#issuecomment-1604406959 Oh, I see. I'll keep watching the announcements. Thanks for letting me know. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

svn commit: r62603 - /dev/airflow/providers/ /release/airflow/providers/

2023-06-23 Thread eladkal
Author: eladkal Date: Fri Jun 23 15:25:50 2023 New Revision: 62603 Log: Release Airflow Providers on 2023-06-23 Added: release/airflow/providers/apache-airflow-providers-airbyte-3.3.1.tar.gz - copied unchanged from r62602,

[GitHub] [airflow] potiuk commented on pull request #32098: Update security model of Airflow

2023-06-23 Thread via GitHub
potiuk commented on PR #32098: URL: https://github.com/apache/airflow/pull/32098#issuecomment-1604443661 For a bit more visual way. This is what github policy will have: ![image](https://github.com/apache/airflow/assets/595491/1ca2ed82-8ac4-43d9-a442-f8267519ea4f)

[GitHub] [airflow-site] eladkal merged pull request #819: Add documentation for packages - 2023-06-20

2023-06-23 Thread via GitHub
eladkal merged PR #819: URL: https://github.com/apache/airflow-site/pull/819 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] eladkal closed issue #32030: Status of testing Providers that were prepared on June 20, 2023

2023-06-23 Thread via GitHub
eladkal closed issue #32030: Status of testing Providers that were prepared on June 20, 2023 URL: https://github.com/apache/airflow/issues/32030 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[airflow] annotated tag helm-chart/1.10.0rc1 updated (913eff6759 -> 6b2c9804ac)

2023-06-23 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to annotated tag helm-chart/1.10.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag helm-chart/1.10.0rc1 was modified! *** from 913eff6759 (commit) to

  1   2   >