[GitHub] [airflow] jhtimmins opened a new pull request #11389: Use permission constants

jhtimmins opened a new pull request #11389: URL: https://github.com/apache/airflow/pull/11389 This uses the permissions.py constants file to reference resource-based permission values. Builds on PR https://github.com/apache/airflow/pull/11189

[GitHub] [airflow] github-actions[bot] commented on pull request #10643: ECSOperator: reattach flag

github-actions[bot] commented on pull request #10643: URL: https://github.com/apache/airflow/pull/10643#issuecomment-706490045 [The Workflow run](https://github.com/apache/airflow/actions/runs/298739649) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] github-actions[bot] commented on pull request #10643: ECSOperator: reattach flag

github-actions[bot] commented on pull request #10643: URL: https://github.com/apache/airflow/pull/10643#issuecomment-706484192 [The Workflow run](https://github.com/apache/airflow/actions/runs/298679977) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] raj-manvar commented on issue #9610: Pod logs from KubernetesPodOperator occasionally get replaced with "Task is not able to run"

raj-manvar commented on issue #9610: URL: https://github.com/apache/airflow/issues/9610#issuecomment-706471915 The current work-around we have is a view plugin which fetches logs from the workers instead of S3. This is an

[GitHub] [airflow] jhtimmins commented on pull request #11189: Prepend `DAG:` to dag permissions

jhtimmins commented on pull request #11189: URL: https://github.com/apache/airflow/pull/11189#issuecomment-706469601 @ashb @kaxil If y'all can take a look. As long as tests are passing, you can merge if you don't have any issues. The new support for multiple schedulers seems to

[GitHub] [airflow] github-actions[bot] commented on pull request #10643: ECSOperator: reattach flag

github-actions[bot] commented on pull request #10643: URL: https://github.com/apache/airflow/pull/10643#issuecomment-706460970 [The Workflow run](https://github.com/apache/airflow/actions/runs/298511806) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] pingzh commented on a change in pull request #10956: Fully support running more than one scheduler concurrently

pingzh commented on a change in pull request #10956: URL: https://github.com/apache/airflow/pull/10956#discussion_r502720900 ## File path: airflow/jobs/scheduler_job.py ## @@ -1705,62 +1305,216 @@ def _run_scheduler_loop(self) -> None: loop_duration =

[GitHub] [airflow] dennyac edited a comment on issue #9610: Pod logs from KubernetesPodOperator occasionally get replaced with "Task is not able to run"

dennyac edited a comment on issue #9610: URL: https://github.com/apache/airflow/issues/9610#issuecomment-706425932 Upvoted that ticket. I understand that this is tied to a celery issue about repeated enqueueing. But there could be valid scenarios where the same job is enqueued more than

[airflow] branch master updated (b7404b0 -> 8640fb6)

This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from b7404b0 KubernetesPodOperator should retry log tailing in case of interruption (#11325) add 8640fb6 fix

[airflow] branch master updated (b7404b0 -> 8640fb6)

This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from b7404b0 KubernetesPodOperator should retry log tailing in case of interruption (#11325) add 8640fb6 fix

[GitHub] [airflow] darwinyip commented on pull request #10643: ECSOperator: reattach flag

darwinyip commented on pull request #10643: URL: https://github.com/apache/airflow/pull/10643#issuecomment-706448338 @feluelle Can you recommend how to go about testing this? This is an automated message from the Apache

[GitHub] [airflow] dimberman merged pull request #11368: Add "already checked" to failed pods in K8sPodOperator

dimberman merged pull request #11368: URL: https://github.com/apache/airflow/pull/11368 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [airflow] dimberman closed issue #11005: Add annotation "already_checked=True" on failed pods.

dimberman closed issue #11005: URL: https://github.com/apache/airflow/issues/11005 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] github-actions[bot] commented on pull request #11385: Add capability of customising PyPI sources

github-actions[bot] commented on pull request #11385: URL: https://github.com/apache/airflow/pull/11385#issuecomment-706442207 [The Workflow run](https://github.com/apache/airflow/actions/runs/298388520) is cancelling this PR. Building images for the PR has failed. Follow the the workflow

[GitHub] [airflow] potiuk commented on pull request #11383: Spark Integration Configuration in Helm Chart

potiuk commented on pull request #11383: URL: https://github.com/apache/airflow/pull/11383#issuecomment-706440222 Kinda agree as well. Extracted it from our common work as part of the 20 or so commits, but indeed it does look a bit of out-of-the-blue change.

[GitHub] [airflow] github-actions[bot] commented on pull request #11385: Add capability of customising PyPI sources

github-actions[bot] commented on pull request #11385: URL: https://github.com/apache/airflow/pull/11385#issuecomment-706439629 [The Workflow run](https://github.com/apache/airflow/actions/runs/298365643) is cancelling this PR. Building images for the PR has failed. Follow the the workflow

[airflow] branch master updated: KubernetesPodOperator should retry log tailing in case of interruption (#11325)

This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new b7404b0 KubernetesPodOperator should retry

[GitHub] [airflow] dimberman closed issue #11324: KubernetesPodOperator stops tailing logs in long living task

dimberman closed issue #11324: URL: https://github.com/apache/airflow/issues/11324 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #11325: KubernetesPodOperator should retry log tailing in case of interruption

boring-cyborg[bot] commented on pull request #11325: URL: https://github.com/apache/airflow/pull/11325#issuecomment-706436134 Awesome work, congrats on your first merged pull request! This is an automated message from

[GitHub] [airflow] dimberman commented on pull request #11325: KubernetesPodOperator should retry log tailing in case of interruption

dimberman commented on pull request #11325: URL: https://github.com/apache/airflow/pull/11325#issuecomment-706436188 Thank you for this @michalmisiewicz! This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] dimberman merged pull request #11325: KubernetesPodOperator should retry log tailing in case of interruption

dimberman merged pull request #11325: URL: https://github.com/apache/airflow/pull/11325 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[airflow] branch master updated: Add tests for Custom cluster policy (#11381)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 6fe020e Add tests for Custom cluster policy

[GitHub] [airflow] potiuk merged pull request #11381: Add tests for Custom cluster policy

potiuk merged pull request #11381: URL: https://github.com/apache/airflow/pull/11381 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk commented on pull request #9544: Add metric for scheduling delay between first run task & expected start time

potiuk commented on pull request #9544: URL: https://github.com/apache/airflow/pull/9544#issuecomment-706434447 Yeah, I'd love to mrege this one. I had ~ 1hr discussion today on similar metrics so it is needed :) This is an

[GitHub] [airflow] turbaszek commented on a change in pull request #11308: Airflow tutorial to use functional DAGs

turbaszek commented on a change in pull request #11308: URL: https://github.com/apache/airflow/pull/11308#discussion_r502703560 ## File path: docs/tutorial_functional.rst ## @@ -0,0 +1,151 @@ + .. Licensed to the Apache Software Foundation (ASF) under one +or more

[airflow] branch master updated (3164025 -> 39fc961)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 3164025 Fix airflow_local_settings.py showing up as directory (#10999) add 39fc961 Fix case of JavaScript.

[GitHub] [airflow] potiuk merged pull request #10957: Fix case of JavaScript.

potiuk merged pull request #10957: URL: https://github.com/apache/airflow/pull/10957 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] turbaszek commented on a change in pull request #11308: Airflow tutorial to use functional DAGs

turbaszek commented on a change in pull request #11308: URL: https://github.com/apache/airflow/pull/11308#discussion_r502702913 ## File path: airflow/example_dags/tutorial_functional_etl_dag.py ## @@ -0,0 +1,111 @@ +# +# Licensed to the Apache Software Foundation (ASF) under

[airflow] branch master updated: Fix airflow_local_settings.py showing up as directory (#10999)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 3164025 Fix airflow_local_settings.py showing

[airflow] branch master updated: [airflow/providers/cncf/kubernetes] correct hook methods name (#11008)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 298052f [airflow/providers/cncf/kubernetes]

[GitHub] [airflow] potiuk merged pull request #10999: Fix airflow_local_settings.py showing up as directory

potiuk merged pull request #10999: URL: https://github.com/apache/airflow/pull/10999 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] turbaszek commented on a change in pull request #11308: Airflow tutorial to use functional DAGs

turbaszek commented on a change in pull request #11308: URL: https://github.com/apache/airflow/pull/11308#discussion_r502702913 ## File path: airflow/example_dags/tutorial_functional_etl_dag.py ## @@ -0,0 +1,111 @@ +# +# Licensed to the Apache Software Foundation (ASF) under

[GitHub] [airflow] potiuk commented on pull request #11008: [airflow/providers/cncf/kubernetes] correct hook methods name

potiuk commented on pull request #11008: URL: https://github.com/apache/airflow/pull/11008#issuecomment-706433546 cool Thanks @dungdm93 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #11008: [airflow/providers/cncf/kubernetes] correct hook methods name

boring-cyborg[bot] commented on pull request #11008: URL: https://github.com/apache/airflow/pull/11008#issuecomment-706433483 Awesome work, congrats on your first merged pull request! This is an automated message from

[GitHub] [airflow] potiuk merged pull request #11008: [airflow/providers/cncf/kubernetes] correct hook methods name

potiuk merged pull request #11008: URL: https://github.com/apache/airflow/pull/11008 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch v1-10-test updated: Add GCP Service Account rule (#11230)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v1-10-test by this push: new 8372ed3 Add GCP Service Account rule

[GitHub] [airflow] potiuk commented on pull request #11230: Add GCP Service Account rule

potiuk commented on pull request #11230: URL: https://github.com/apache/airflow/pull/11230#issuecomment-706432834 cool :) This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] potiuk merged pull request #11230: Add GCP Service Account rule

potiuk merged pull request #11230: URL: https://github.com/apache/airflow/pull/11230 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch v1-10-test updated: Add GCP Service Account rule (#11230)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v1-10-test by this push: new 8372ed3 Add GCP Service Account rule

[airflow] branch master updated: Replaced basestring with str in the Exasol hook (#11360)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 7b0a2f5 Replaced basestring with str in the

[GitHub] [airflow] potiuk merged pull request #11360: Replaced basestring with str in the Exasol hook

potiuk merged pull request #11360: URL: https://github.com/apache/airflow/pull/11360 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated: Revert "Revert "Adds --install-wheels flag to breeze command line (#11317)" (#11348)" (#11356)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new d752575 Revert "Revert "Adds --install-wheels

[GitHub] [airflow] potiuk merged pull request #11356: Revert "Revert "Adds --install-wheels flag to breeze command line (#1…

potiuk merged pull request #11356: URL: https://github.com/apache/airflow/pull/11356 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk commented on a change in pull request #11384: Mutual SSL added in PGBouncer configuration in the Chart

potiuk commented on a change in pull request #11384: URL: https://github.com/apache/airflow/pull/11384#discussion_r502696980 ## File path: chart/templates/_helpers.yaml ## @@ -262,6 +266,13 @@ max_client_conn = {{ .Values.pgbouncer.maxClientConn }} verbose = {{

[GitHub] [airflow] potiuk commented on a change in pull request #11384: Mutual SSL added in PGBouncer configuration in the Chart

potiuk commented on a change in pull request #11384: URL: https://github.com/apache/airflow/pull/11384#discussion_r502696980 ## File path: chart/templates/_helpers.yaml ## @@ -262,6 +266,13 @@ max_client_conn = {{ .Values.pgbouncer.maxClientConn }} verbose = {{

[GitHub] [airflow] pingzh commented on a change in pull request #10956: Fully support running more than one scheduler concurrently

pingzh commented on a change in pull request #10956: URL: https://github.com/apache/airflow/pull/10956#discussion_r502694216 ## File path: airflow/jobs/scheduler_job.py ## @@ -1705,62 +1305,216 @@ def _run_scheduler_loop(self) -> None: loop_duration =

[GitHub] [airflow] dennyac edited a comment on issue #9610: Pod logs from KubernetesPodOperator occasionally get replaced with "Task is not able to run"

dennyac edited a comment on issue #9610: URL: https://github.com/apache/airflow/issues/9610#issuecomment-706425932 Upvoted that ticket. I understand that this is tied to a celery issue about repeated enqueueing. But there could be valid scenarios where the same job is enqueued more than

[GitHub] [airflow] dennyac commented on issue #9610: Pod logs from KubernetesPodOperator occasionally get replaced with "Task is not able to run"

dennyac commented on issue #9610: URL: https://github.com/apache/airflow/issues/9610#issuecomment-706425932 Upvoted that ticket. I understand that this is tied to a celery issue about repeated enqueueing. But there could be valid scenarios where the same job is enqueued more than once.

[airflow] branch master updated (e198077 -> 73b9163)

This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from e198077 Add pypirc initialization (#11386) add 73b9163 Fully support running more than one scheduler

[GitHub] [airflow] potiuk commented on pull request #10956: Fully support running more than one scheduler concurrently

potiuk commented on pull request #10956: URL: https://github.com/apache/airflow/pull/10956#issuecomment-706423948 :tada: This is an automated message from the Apache Git Service. To respond to the message, please log on to

[airflow] branch master updated (e198077 -> 73b9163)

This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from e198077 Add pypirc initialization (#11386) add 73b9163 Fully support running more than one scheduler

[airflow] branch master updated (e198077 -> 73b9163)

This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from e198077 Add pypirc initialization (#11386) add 73b9163 Fully support running more than one scheduler

[GitHub] [airflow] ashb commented on pull request #10956: Fully support running more than one scheduler concurrently

ashb commented on pull request #10956: URL: https://github.com/apache/airflow/pull/10956#issuecomment-706413435 We got bored waiting for the Github Actions lottery (build timeouts, 137/OOM kill errors. We did have a green build just before though -

[GitHub] [airflow] ashb commented on a change in pull request #11384: Mutual SSL added in PGBouncer configuration in the Chart

ashb commented on a change in pull request #11384: URL: https://github.com/apache/airflow/pull/11384#discussion_r502686520 ## File path: chart/templates/_helpers.yaml ## @@ -262,6 +266,13 @@ max_client_conn = {{ .Values.pgbouncer.maxClientConn }} verbose = {{

[GitHub] [airflow] ashb merged pull request #10956: Fully support running more than one scheduler concurrently

ashb merged pull request #10956: URL: https://github.com/apache/airflow/pull/10956 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] thaohtp commented on issue #9941: Extra links for Google Cloud operators

thaohtp commented on issue #9941: URL: https://github.com/apache/airflow/issues/9941#issuecomment-706404020 @mik-laj Hi, I'm thinking to give a try on Cloud Storage, I'm new to this project. I'd love to get your clear idea on how do we get bucket name and object name for GCS link.

[GitHub] [airflow] potiuk commented on pull request #11356: Revert "Revert "Adds --install-wheels flag to breeze command line (#1…

potiuk commented on pull request #11356: URL: https://github.com/apache/airflow/pull/11356#issuecomment-706403629 @ashb - that one can be re-reverted. This is an automated message from the Apache Git Service. To respond to

[airflow] branch master updated (29a145c -> e198077)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 29a145c Add capability of adding service account annotations to Helm Chart (#11387) add e198077 Add pypirc

[airflow] branch master updated (29a145c -> e198077)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 29a145c Add capability of adding service account annotations to Helm Chart (#11387) add e198077 Add pypirc

[airflow] branch master updated (49aad02 -> 29a145c)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 49aad02 Users can specify sub-secrets and paths k8spodop (#11369) add 29a145c Add capability of adding

[airflow] branch master updated: Add capability of adding service account annotations to Helm Chart (#11387)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 29a145c Add capability of adding service

[GitHub] [airflow] potiuk merged pull request #11386: Add pypirc initialization

potiuk merged pull request #11386: URL: https://github.com/apache/airflow/pull/11386 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk merged pull request #11387: Add capability of adding service account annotations to Helm Chart

potiuk merged pull request #11387: URL: https://github.com/apache/airflow/pull/11387 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] dimberman commented on issue #9610: Pod logs from KubernetesPodOperator occasionally get replaced with "Task is not able to run"

dimberman commented on issue #9610: URL: https://github.com/apache/airflow/issues/9610#issuecomment-706395948 @dennyac @rmanvar-indeed @chrismclennon Could y'all please +1 that ticket? Hopefully will catch the attention of a Celery maintainer. Note that one potential solution in 2.0 for

[GitHub] [airflow] JeffryMAC opened a new issue #11388: Add ability to zoom into Graph view from selection in Tree View

JeffryMAC opened a new issue #11388: URL: https://github.com/apache/airflow/issues/11388 **Description** Currently to view DAG run in graph view you must first know it's execution date and then choose it from the drop list. This is annoying in some cases because you might want to

[GitHub] [airflow] dimberman commented on issue #9610: Pod logs from KubernetesPodOperator occasionally get replaced with "Task is not able to run"

dimberman commented on issue #9610: URL: https://github.com/apache/airflow/issues/9610#issuecomment-706395349 Hi @dennyac this is tied to a Celery issue https://github.com/celery/celery/issues/6229 This is an automated

[GitHub] [airflow] dennyac commented on issue #9610: Pod logs from KubernetesPodOperator occasionally get replaced with "Task is not able to run"

dennyac commented on issue #9610: URL: https://github.com/apache/airflow/issues/9610#issuecomment-706394744 We're experiencing the same issue across Operators/Sensors (Airflow 1.10.11, CeleryExecutor with Redis backend) For the two jobs of the same task that gets enqueued an hour

[GitHub] [airflow] mrrobby commented on a change in pull request #11113: Adding GreatExpectationsBigQueryOperator

mrrobby commented on a change in pull request #3: URL: https://github.com/apache/airflow/pull/3#discussion_r502658557 ## File path: airflow/providers/google/cloud/operators/bigquery.py ## @@ -2109,3 +2122,287 @@ def execute(self, context: Any): def on_kill(self):

[GitHub] [airflow] mik-laj edited a comment on issue #11376: Using rest api, we are not able to get the dag state using run_id.

mik-laj edited a comment on issue #11376: URL: https://github.com/apache/airflow/issues/11376#issuecomment-706372256 We have two API version: - Experimental API - available in Airflow 1.10 and new - Stable API - available in the Airflow 2.0 release.

[GitHub] [airflow] casassg commented on a change in pull request #11308: Airflow tutorial to use functional DAGs

casassg commented on a change in pull request #11308: URL: https://github.com/apache/airflow/pull/11308#discussion_r502639657 ## File path: airflow/example_dags/tutorial_functional_etl_dag.py ## @@ -0,0 +1,111 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [airflow] mik-laj commented on issue #11376: Using rest api, we are not able to get the dag state using run_id.

mik-laj commented on issue #11376: URL: https://github.com/apache/airflow/issues/11376#issuecomment-706372256 We have two types of API: - Experimental API - available in Airflow 1.10 and new - Stable API - available in Airflow 2.0 release.

[GitHub] [airflow] github-actions[bot] commented on pull request #11310: Merge Airflow and Backport Packages preparation instructions

github-actions[bot] commented on pull request #11310: URL: https://github.com/apache/airflow/pull/11310#issuecomment-706370099 [The Workflow run](https://github.com/apache/airflow/actions/runs/298120781) is cancelling this PR. Building images for the PR has failed. Follow the the workflow

[GitHub] [airflow] potiuk commented on a change in pull request #11382: Constraints and PIP packages can be installed from local sources

potiuk commented on a change in pull request #11382: URL: https://github.com/apache/airflow/pull/11382#discussion_r502634303 ## File path: docs/production-deployment.rst ## @@ -189,6 +189,71 @@ based on example in `this comment

[GitHub] [airflow] ashb edited a comment on pull request #10956: Fully support running more than one scheduler concurrently

ashb edited a comment on pull request #10956: URL: https://github.com/apache/airflow/pull/10956#issuecomment-706331789 We're trying to get this PR green before merging, because although it doesn't _matter_ we know it's possible and it feels like an important one to say "yes, this is all

[GitHub] [airflow] potiuk opened a new pull request #11387: Add capability of adding service account annotations to Helm Chart

potiuk opened a new pull request #11387: URL: https://github.com/apache/airflow/pull/11387 We can now add annotations to the service accounts in a generic way. This allows for example to add Workflow Identitty in GKE environment but it is not limited to it. Co-authored-by:

[GitHub] [airflow] kishvanchee commented on issue #9145: Enhance SnowflakeToSlackOperator to support attachments

kishvanchee commented on issue #9145: URL: https://github.com/apache/airflow/issues/9145#issuecomment-706335160 Ah okie. Does it make more sense to use `SlackHook` now just for the attachment part? Or should I try refactoring the current implementation with `SlackHook` itself? Not sure

[GitHub] [airflow] github-actions[bot] commented on pull request #11382: Constraints and PIP packages can be installed from local sources

github-actions[bot] commented on pull request #11382: URL: https://github.com/apache/airflow/pull/11382#issuecomment-706333547 [The Workflow run](https://github.com/apache/airflow/actions/runs/298009022) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] potiuk opened a new pull request #11386: Add pypirc initialization

potiuk opened a new pull request #11386: URL: https://github.com/apache/airflow/pull/11386 This PR needs to be merged first in order to handle the #11385 which requires .pypirc to be created before dockerfile gets build. This means that the script change needs to be merged to

[GitHub] [airflow] potiuk commented on pull request #11386: Add pypirc initialization

potiuk commented on pull request #11386: URL: https://github.com/apache/airflow/pull/11386#issuecomment-706333698 I need to merge that one first in order to get the images from #11385 build :( This is an automated message

[GitHub] [airflow] ashb commented on pull request #10956: Fully support running more than one scheduler concurrently

ashb commented on pull request #10956: URL: https://github.com/apache/airflow/pull/10956#issuecomment-706331789 We're trying to get this PR green before merging, because although it doesn't _matter_ we know it's possible and it feels like an important one to say "yes, this is all good"

[GitHub] [airflow] simond edited a comment on issue #9145: Enhance SnowflakeToSlackOperator to support attachments

simond edited a comment on issue #9145: URL: https://github.com/apache/airflow/issues/9145#issuecomment-706330446 Oof, I can't really remember the reason I used the `SlackWebHook` over `SlackHook` unfortunately. I think it was because it is simpler to use for basic messages. Now that you

[GitHub] [airflow] simond commented on issue #9145: Enhance SnowflakeToSlackOperator to support attachments

simond commented on issue #9145: URL: https://github.com/apache/airflow/issues/9145#issuecomment-706330446 Oof, I can't really remember the reason I used the `SlackWebHook` over `SlackHook` unfortunately. I think it was because it is simpler to use for basic messages. Now that you want to

[GitHub] [airflow] jhtimmins commented on a change in pull request #11189: WIP: Prepend `DAG:` to dag permissions

jhtimmins commented on a change in pull request #11189: URL: https://github.com/apache/airflow/pull/11189#discussion_r502594366 ## File path: airflow/www/security.py ## @@ -520,18 +560,23 @@ def merge_pv(perm, view_menu): def update_admin_perm_view(self): """

[GitHub] [airflow] github-actions[bot] commented on pull request #11385: Add capability of customising PyPI sources

github-actions[bot] commented on pull request #11385: URL: https://github.com/apache/airflow/pull/11385#issuecomment-706327965 [The Workflow run](https://github.com/apache/airflow/actions/runs/297983787) is cancelling this PR. Building images for the PR has failed. Follow the the workflow

[GitHub] [airflow] github-actions[bot] commented on pull request #11308: Airflow tutorial to use functional DAGs

github-actions[bot] commented on pull request #11308: URL: https://github.com/apache/airflow/pull/11308#issuecomment-706326543 [The Workflow run](https://github.com/apache/airflow/actions/runs/297983787) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] github-actions[bot] commented on pull request #11308: Airflow tutorial to use functional DAGs

github-actions[bot] commented on pull request #11308: URL: https://github.com/apache/airflow/pull/11308#issuecomment-706325899 [The Workflow run](https://github.com/apache/airflow/actions/runs/297982033) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] potiuk opened a new pull request #11385: Add capability of customising PyPI sources

potiuk opened a new pull request #11385: URL: https://github.com/apache/airflow/pull/11385 This change adds capability of customising installation of PyPI modules via custom .pypirc file. This might allow to install dependencies from in-house, vetted registry of PyPI ---

[GitHub] [airflow] potiuk commented on pull request #11383: Spark Integration Configuration in Helm Chart

potiuk commented on pull request #11383: URL: https://github.com/apache/airflow/pull/11383#issuecomment-706318488 @jaketf -> I think it's up to you if you would like to rework that one as @mik-laj suggests :) This is an

[GitHub] [airflow] potiuk commented on pull request #11384: Mutual SSL added in PGBouncer configuration in the Chart

potiuk commented on pull request #11384: URL: https://github.com/apache/airflow/pull/11384#issuecomment-706317232 cc: @jaketf This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk opened a new pull request #11384: Mutual SSL added in PGBouncer configuration in the Chart

potiuk opened a new pull request #11384: URL: https://github.com/apache/airflow/pull/11384 Adds SSL configuration for PGBouncer in the Helm Chart. PGBouncer is crucial to handle the big number of connections that airflow opens for the database, but often the database is outside of the

[GitHub] [airflow] brian-lavery commented on a change in pull request #11113: Adding GreatExpectationsBigQueryOperator

brian-lavery commented on a change in pull request #3: URL: https://github.com/apache/airflow/pull/3#discussion_r502582588 ## File path: airflow/providers/google/cloud/operators/bigquery.py ## @@ -2109,3 +2122,287 @@ def execute(self, context: Any): def

[GitHub] [airflow] brian-lavery commented on a change in pull request #11113: Adding GreatExpectationsBigQueryOperator

brian-lavery commented on a change in pull request #3: URL: https://github.com/apache/airflow/pull/3#discussion_r502582130 ## File path: airflow/providers/google/cloud/operators/bigquery.py ## @@ -2109,3 +2122,287 @@ def execute(self, context: Any): def

[GitHub] [airflow] mik-laj commented on pull request #11383: Spark Integration Configuration in Helm Chart

mik-laj commented on pull request #11383: URL: https://github.com/apache/airflow/pull/11383#issuecomment-706315893 I am not sure if we need such specialized configuration options, I would prefer fewer and more generic ones. Helm for Keycloak can be an inspiration for you. See:

[GitHub] [airflow] brian-lavery commented on a change in pull request #11113: Adding GreatExpectationsBigQueryOperator

brian-lavery commented on a change in pull request #3: URL: https://github.com/apache/airflow/pull/3#discussion_r502581259 ## File path: airflow/providers/google/cloud/operators/bigquery.py ## @@ -2109,3 +2122,287 @@ def execute(self, context: Any): def

[GitHub] [airflow] brian-lavery commented on a change in pull request #11113: Adding GreatExpectationsBigQueryOperator

brian-lavery commented on a change in pull request #3: URL: https://github.com/apache/airflow/pull/3#discussion_r502580282 ## File path: airflow/providers/greatexpectations/operators/greatexpectations_base.py ## @@ -0,0 +1,30 @@ +from airflow.models import

[GitHub] [airflow] github-actions[bot] commented on pull request #10956: Fully support running more than one scheduler concurrently

github-actions[bot] commented on pull request #10956: URL: https://github.com/apache/airflow/pull/10956#issuecomment-706313704 [The Workflow run](https://github.com/apache/airflow/actions/runs/297950829) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] brian-lavery commented on a change in pull request #11113: Adding GreatExpectationsBigQueryOperator

brian-lavery commented on a change in pull request #3: URL: https://github.com/apache/airflow/pull/3#discussion_r502579021 ## File path: airflow/providers/google/cloud/operators/bigquery.py ## @@ -2109,3 +2122,287 @@ def execute(self, context: Any): def

[GitHub] [airflow] brian-lavery commented on a change in pull request #11113: Adding GreatExpectationsBigQueryOperator

brian-lavery commented on a change in pull request #3: URL: https://github.com/apache/airflow/pull/3#discussion_r502578520 ## File path: airflow/providers/google/cloud/operators/bigquery.py ## @@ -2109,3 +2122,287 @@ def execute(self, context: Any): def

[GitHub] [airflow] github-actions[bot] commented on pull request #10956: Fully support running more than one scheduler concurrently

github-actions[bot] commented on pull request #10956: URL: https://github.com/apache/airflow/pull/10956#issuecomment-706312266 [The Workflow run](https://github.com/apache/airflow/actions/runs/297946414) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] github-actions[bot] commented on pull request #11383: Spark Integration Configuration in Helm Chart

github-actions[bot] commented on pull request #11383: URL: https://github.com/apache/airflow/pull/11383#issuecomment-706312275 [The Workflow run](https://github.com/apache/airflow/actions/runs/297946414) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

  1   2   3   4   5   >