[GitHub] [airflow] asitstands commented on issue #14529: Clear the entire TaskGroup section

2022-05-19 Thread GitBox
asitstands commented on issue #14529: URL: https://github.com/apache/airflow/issues/14529#issuecomment-1132494859 @potiuk We manually clear each task in a task group using the graph view. Such a manual manipulation is totally legitimated as far as I know. The suggested feature could be

[GitHub] [airflow] uranusjr closed issue #23533: Using `expand` on `PostgresOperator` with return value from `PythonOperator` crashes scheduler

2022-05-19 Thread GitBox
uranusjr closed issue #23533: Using `expand` on `PostgresOperator` with return value from `PythonOperator` crashes scheduler URL: https://github.com/apache/airflow/issues/23533 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] uranusjr commented on issue #23533: Using `expand` on `PostgresOperator` with return value from `PythonOperator` crashes scheduler

2022-05-19 Thread GitBox
uranusjr commented on issue #23533: URL: https://github.com/apache/airflow/issues/23533#issuecomment-1132489634 Yes this is a duplicate of #23642. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] patryk126p commented on issue #23727: Airflow 2.3 scheduler error: 'V1Container' object has no attribute '_startup_probe'

2022-05-19 Thread GitBox
patryk126p commented on issue #23727: URL: https://github.com/apache/airflow/issues/23727#issuecomment-1132480598 It's 1.21.9 on EKS -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[airflow] branch constraints-main updated: Updating constraints. Build id:2356093137

2022-05-19 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 948cc65dcb Updating

[GitHub] [airflow] tirkarthi commented on issue #23533: Using `expand` on `PostgresOperator` with return value from `PythonOperator` crashes scheduler

2022-05-19 Thread GitBox
tirkarthi commented on issue #23533: URL: https://github.com/apache/airflow/issues/23533#issuecomment-1132452265 @jedcunningham I guess this issue is similar to https://github.com/apache/airflow/issues/23642 and fixed with https://github.com/apache/airflow/pull/23771 -- This is an

[airflow] branch main updated: Grid data: do not load all mapped instances (#23813)

2022-05-19 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 7ab5ea7853 Grid data: do not load all mapped

[GitHub] [airflow] bbovenzi closed issue #23786: DAG Loading Slow with Dynamic Tasks - Including Test Results and Benchmarking

2022-05-19 Thread GitBox
bbovenzi closed issue #23786: DAG Loading Slow with Dynamic Tasks - Including Test Results and Benchmarking URL: https://github.com/apache/airflow/issues/23786 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] bbovenzi merged pull request #23813: Grid data: do not load all mapped instances

2022-05-19 Thread GitBox
bbovenzi merged PR #23813: URL: https://github.com/apache/airflow/pull/23813 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] Bowrna commented on pull request #23762: Split contributor's quick start into separate guides.

2022-05-19 Thread GitBox
Bowrna commented on PR #23762: URL: https://github.com/apache/airflow/pull/23762#issuecomment-1132439887 @potiuk Testing in VS Code follows older breeze commands https://github.com/apache/airflow/blob/main/CONTRIBUTORS_QUICK_START.rst#id11 while testing in PyCharm follows the new breeze

[GitHub] [airflow] github-actions[bot] commented on pull request #23817: Handler parameter from JdbcOperator to JdbcHook.run

2022-05-19 Thread GitBox
github-actions[bot] commented on PR #23817: URL: https://github.com/apache/airflow/pull/23817#issuecomment-1132435640 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not modify the

[GitHub] [airflow] uranusjr commented on a diff in pull request #23821: Document fix for broken elasticsearch logs with 2.3.0+ upgrade

2022-05-19 Thread GitBox
uranusjr commented on code in PR #23821: URL: https://github.com/apache/airflow/pull/23821#discussion_r877712265 ## RELEASE_NOTES.rst: ## @@ -131,6 +131,13 @@ If you are happy with the new config values you should *remove* the setting in ` If you have customized the

[airflow] branch main updated: Fix error when SnowflakeHook take empty list in `sql` param (#23767)

2022-05-19 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 86cfd1244a Fix error when SnowflakeHook take

[GitHub] [airflow] uranusjr closed issue #23623: SnowflakeHook.run() raises UnboundLocalError exception if sql argument is empty

2022-05-19 Thread GitBox
uranusjr closed issue #23623: SnowflakeHook.run() raises UnboundLocalError exception if sql argument is empty URL: https://github.com/apache/airflow/issues/23623 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] uranusjr merged pull request #23767: Fix error when SnowflakeHook take empty list in `sql` param

2022-05-19 Thread GitBox
uranusjr merged PR #23767: URL: https://github.com/apache/airflow/pull/23767 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr commented on a diff in pull request #23813: Grid data: do not load all mapped instances

2022-05-19 Thread GitBox
uranusjr commented on code in PR #23813: URL: https://github.com/apache/airflow/pull/23813#discussion_r877700821 ## airflow/www/utils.py: ## @@ -127,13 +128,22 @@ def get_mapped_summary(parent_instance, task_instances): } -def encode_ti( -task_instance:

[GitHub] [airflow] bbovenzi commented on a diff in pull request #23813: Grid data: do not load all mapped instances

2022-05-19 Thread GitBox
bbovenzi commented on code in PR #23813: URL: https://github.com/apache/airflow/pull/23813#discussion_r877700448 ## airflow/www/utils.py: ## @@ -127,13 +128,22 @@ def get_mapped_summary(parent_instance, task_instances): } -def encode_ti( -task_instance:

[GitHub] [airflow] uranusjr commented on a diff in pull request #23813: Grid data: do not load all mapped instances

2022-05-19 Thread GitBox
uranusjr commented on code in PR #23813: URL: https://github.com/apache/airflow/pull/23813#discussion_r877698564 ## airflow/www/utils.py: ## @@ -127,13 +128,22 @@ def get_mapped_summary(parent_instance, task_instances): } -def encode_ti( -task_instance:

[GitHub] [airflow] uranusjr commented on a diff in pull request #23813: Grid data: do not load all mapped instances

2022-05-19 Thread GitBox
uranusjr commented on code in PR #23813: URL: https://github.com/apache/airflow/pull/23813#discussion_r877697860 ## airflow/www/views.py: ## @@ -250,19 +250,15 @@ def _safe_parse_datetime(v): abort(400, f"Invalid datetime: {v!r}") -def

[GitHub] [airflow] github-actions[bot] commented on pull request #23678: Highlight task states by hovering on legend row

2022-05-19 Thread GitBox
github-actions[bot] commented on PR #23678: URL: https://github.com/apache/airflow/pull/23678#issuecomment-1132413792 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the

[GitHub] [airflow] ferruzzi commented on pull request #23567: Add Databricks sensor check partition and delta table events

2022-05-19 Thread GitBox
ferruzzi commented on PR #23567: URL: https://github.com/apache/airflow/pull/23567#issuecomment-1132398198 Nice. You'll need a committer's approval to merge it, but looks good to me. :+1: -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] ferruzzi commented on pull request #23745: Add tool to automaticaly update status of AIP-47 issues.

2022-05-19 Thread GitBox
ferruzzi commented on PR #23745: URL: https://github.com/apache/airflow/pull/23745#issuecomment-1132396723 Very cool :sunglasses: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] zachliu commented on issue #23472: Airflow hangs on "Found x duplicates in table task_fail. Will attempt to move them"

2022-05-19 Thread GitBox
zachliu commented on issue #23472: URL: https://github.com/apache/airflow/issues/23472#issuecomment-1132394022 https://github.com/apache/airflow/pull/23458 is a life saver! 20 hours db migration becomes 20 seconds! :joy: ```bash curl -L

[GitHub] [airflow] ferruzzi opened a new issue, #23822: Add an AWS operator for Create RDS Database

2022-05-19 Thread GitBox
ferruzzi opened a new issue, #23822: URL: https://github.com/apache/airflow/issues/23822 ### Description @eladkal suggested we add the operator and then incorporate it into https://github.com/apache/airflow/pull/23681. I have a little bit of a backlog right now trying to get the

[GitHub] [airflow] Asciotti commented on a diff in pull request #21077: Kubernetes decorator

2022-05-19 Thread GitBox
Asciotti commented on code in PR #21077: URL: https://github.com/apache/airflow/pull/21077#discussion_r877650210 ## airflow/providers/cncf/kubernetes/decorators/kubernetes.py: ## @@ -0,0 +1,161 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] kaojunsong closed issue #23609: "RuntimeError: dictionary changed size during iteration" happens in scheduler after running for a few hours

2022-05-19 Thread GitBox
kaojunsong closed issue #23609: "RuntimeError: dictionary changed size during iteration" happens in scheduler after running for a few hours URL: https://github.com/apache/airflow/issues/23609 -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] kaojunsong commented on issue #23609: "RuntimeError: dictionary changed size during iteration" happens in scheduler after running for a few hours

2022-05-19 Thread GitBox
kaojunsong commented on issue #23609: URL: https://github.com/apache/airflow/issues/23609#issuecomment-1132324471 @potiuk @tirkarthi The airflow has been running for a week, and the error does not happen again. So I think the issue is solved. Thanks a lot for your help. -- This is an

[GitHub] [airflow] fuxiao224 commented on pull request #23766: [Issue#22846] allow option to encode or not encode UUID when uploading from Cassandra to GCS

2022-05-19 Thread GitBox
fuxiao224 commented on PR #23766: URL: https://github.com/apache/airflow/pull/23766#issuecomment-1132322124 Hi @potiuk ! Thanks for reviewing and approving this PR! Seems like it's ready to merge now. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] potiuk merged pull request #23810: Reformat the whole AWS documentation

2022-05-19 Thread GitBox
potiuk merged PR #23810: URL: https://github.com/apache/airflow/pull/23810 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #23756: Amazon EKS example DAG raises warnning

2022-05-19 Thread GitBox
potiuk commented on issue #23756: URL: https://github.com/apache/airflow/issues/23756#issuecomment-1132297872 Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[airflow] branch constraints-2-3 updated: Updating constraints. Build id:2354962786

2022-05-19 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-3 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-3 by this push: new f352244f2f Updating

[GitHub] [airflow] jedcunningham commented on pull request #23821: Document fix for broken elasticsearch logs with 2.3.0+ upgrade

2022-05-19 Thread GitBox
jedcunningham commented on PR #23821: URL: https://github.com/apache/airflow/pull/23821#issuecomment-1132284476 I also just had an idea on how to cover one more scenario automatically, which I'll experiment with tomorrow and open a separate PR for if it works out. -- This is an automated

[airflow] branch main updated: update CloudSqlInstanceImportOperator to CloudSQLImportInstanceOperator (#23800)

2022-05-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 54aa234052 update CloudSqlInstanceImportOperator

[GitHub] [airflow] potiuk closed issue #23799: Fix typo in cloud_sql.rst

2022-05-19 Thread GitBox
potiuk closed issue #23799: Fix typo in cloud_sql.rst URL: https://github.com/apache/airflow/issues/23799 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [airflow] potiuk merged pull request #23800: update CloudSqlInstanceImportOperator to CloudSQLImportInstanceOperator

2022-05-19 Thread GitBox
potiuk merged PR #23800: URL: https://github.com/apache/airflow/pull/23800 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #23727: Airflow 2.3 scheduler error: 'V1Container' object has no attribute '_startup_probe'

2022-05-19 Thread GitBox
potiuk commented on issue #23727: URL: https://github.com/apache/airflow/issues/23727#issuecomment-1132280487 Which Kubernetes version do you run (cluster version) @patryk126p ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] github-actions[bot] commented on pull request #23821: Document fix for broken elasticsearch logs with 2.3.0+ upgrade

2022-05-19 Thread GitBox
github-actions[bot] commented on PR #23821: URL: https://github.com/apache/airflow/pull/23821#issuecomment-1132273409 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide that full

[GitHub] [airflow] potiuk commented on pull request #23821: Document fix for broken elasticsearch logs with 2.3.0+ upgrade

2022-05-19 Thread GitBox
potiuk commented on PR #23821: URL: https://github.com/apache/airflow/pull/23821#issuecomment-1132273458 I think in the next release we might an error linking to those release notes when logs cannot be retrieved - but it's not needed now. -- This is an automated message from the Apache

[airflow] branch main updated (00e78fd51a -> 8f3ce33e92)

2022-05-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 00e78fd51a Unbreak main after missing classes were added (#23819) add 8f3ce33e92 Fix python version command

[GitHub] [airflow] potiuk merged pull request #23818: Fix breeze version

2022-05-19 Thread GitBox
potiuk merged PR #23818: URL: https://github.com/apache/airflow/pull/23818 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jedcunningham opened a new pull request, #23821: Document fix for broken elasticsearch logs with 2.3.0+ upgrade

2022-05-19 Thread GitBox
jedcunningham opened a new pull request, #23821: URL: https://github.com/apache/airflow/pull/23821 In certain upgrade paths, Airflow isn't given an opportunity to track the old `log_id_template`, so document the fix for folks who run into trouble. I also removed superfluous ES

[airflow] branch v2-3-test updated (891102c28a -> 2f35d6e132)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 891102c28a fixup! Update version to 2.3.1 and add release notes omit 8db8b9e5db Update version to

[GitHub] [airflow] github-actions[bot] commented on pull request #23535: Fix regression in ignoring symlinks

2022-05-19 Thread GitBox
github-actions[bot] commented on PR #23535: URL: https://github.com/apache/airflow/pull/23535#issuecomment-1132264250 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the

[airflow] branch v2-3-test updated (8db8b9e5db -> 891102c28a)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git from 8db8b9e5db Update version to 2.3.1 and add release notes add 891102c28a fixup! Update version to

[GitHub] [airflow] repl-chris commented on pull request #23535: Fix regression in ignoring symlinks

2022-05-19 Thread GitBox
repl-chris commented on PR #23535: URL: https://github.com/apache/airflow/pull/23535#issuecomment-1132262090 FWIW I have pulled this change and tested it in my environment, and it resolves the issues I was having with symlinks in 2.3.0  -- This is an automated message from the Apache

[GitHub] [airflow] repl-chris commented on a diff in pull request #23535: Fix regression in ignoring symlinks

2022-05-19 Thread GitBox
repl-chris commented on code in PR #23535: URL: https://github.com/apache/airflow/pull/23535#discussion_r877568844 ## airflow/utils/file.py: ## @@ -208,10 +209,11 @@ def _find_path_from_directory( :return: a generator of file paths which should not be ignored. """ +

[GitHub] [airflow] github-actions[bot] commented on pull request #23818: Fix breeze version

2022-05-19 Thread GitBox
github-actions[bot] commented on PR #23818: URL: https://github.com/apache/airflow/pull/23818#issuecomment-1132244199 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the

[GitHub] [airflow] github-actions[bot] commented on pull request #23819: Unbreak main after missing classes were added

2022-05-19 Thread GitBox
github-actions[bot] commented on PR #23819: URL: https://github.com/apache/airflow/pull/23819#issuecomment-1132241641 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the

[airflow] branch main updated (f60fa98a2e -> 00e78fd51a)

2022-05-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from f60fa98a2e Cloud SQL assets & system tests migration (AIP-47) (#23583) add 00e78fd51a Unbreak main after missing

[GitHub] [airflow] potiuk merged pull request #23819: Unbreak main after missing classes were added

2022-05-19 Thread GitBox
potiuk merged PR #23819: URL: https://github.com/apache/airflow/pull/23819 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] repl-chris commented on a diff in pull request #23535: Fix regression in ignoring symlinks

2022-05-19 Thread GitBox
repl-chris commented on code in PR #23535: URL: https://github.com/apache/airflow/pull/23535#discussion_r877568844 ## airflow/utils/file.py: ## @@ -208,10 +209,11 @@ def _find_path_from_directory( :return: a generator of file paths which should not be ignored. """ +

[GitHub] [airflow] ephraimbuddy opened a new pull request, #23820: Sync `v2-3-stable` with `v2-3-test` to release `2.3.1`

2022-05-19 Thread GitBox
ephraimbuddy opened a new pull request, #23820: URL: https://github.com/apache/airflow/pull/23820 Time for `2.3.1rc1`! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk opened a new pull request, #23819: Unbreak main after missing classes were added

2022-05-19 Thread GitBox
potiuk opened a new pull request, #23819: URL: https://github.com/apache/airflow/pull/23819 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[airflow] branch v2-3-test updated: Update version to 2.3.1 and add release notes

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-3-test by this push: new 8db8b9e5db Update version to

[GitHub] [airflow] pierrejeambrun commented on pull request #23678: Highlight task states by hovering on legend row

2022-05-19 Thread GitBox
pierrejeambrun commented on PR #23678: URL: https://github.com/apache/airflow/pull/23678#issuecomment-1132221045 I just updated the PR. Jinja `tojson` function is sorting keys automatically in the returned json. We can add `flask_app.config['JSON_SORT_KEYS'] = False`, but that

[GitHub] [airflow] github-actions[bot] commented on pull request #23818: Fix breeze version

2022-05-19 Thread GitBox
github-actions[bot] commented on PR #23818: URL: https://github.com/apache/airflow/pull/23818#issuecomment-1132204677 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide that full

[GitHub] [airflow] potiuk opened a new pull request, #23818: Fix breeze version

2022-05-19 Thread GitBox
potiuk opened a new pull request, #23818: URL: https://github.com/apache/airflow/pull/23818 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] kazanzhy commented on issue #19313: JdbcOperator should pass handler parameter to JdbcHook.run

2022-05-19 Thread GitBox
kazanzhy commented on issue #19313: URL: https://github.com/apache/airflow/issues/19313#issuecomment-1132198837 Hi @nkyuray please have a look #23817 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] kazanzhy opened a new pull request, #23817: Handler parameter from JdbcOperator to JdbcHook.run

2022-05-19 Thread GitBox
kazanzhy opened a new pull request, #23817: URL: https://github.com/apache/airflow/pull/23817 Handler parameter from JdbcOperator to JdbcHook.run and return results to XCom closes: #19313 The main problem here was to make a comparable handler for testing because lambda

[GitHub] [airflow] Asciotti commented on pull request #21077: Kubernetes decorator

2022-05-19 Thread GitBox
Asciotti commented on PR #21077: URL: https://github.com/apache/airflow/pull/21077#issuecomment-1132196609 Bump? :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] kosteev commented on a diff in pull request #23773: Update credentials when using ADC in Compute Engine

2022-05-19 Thread GitBox
kosteev commented on code in PR #23773: URL: https://github.com/apache/airflow/pull/23773#discussion_r877529861 ## airflow/providers/google/cloud/utils/credentials_provider.py: ## @@ -248,6 +250,16 @@ def get_credentials_and_project(self) ->

[GitHub] [airflow] Asciotti commented on a diff in pull request #21077: Kubernetes decorator

2022-05-19 Thread GitBox
Asciotti commented on code in PR #21077: URL: https://github.com/apache/airflow/pull/21077#discussion_r877529729 ## airflow/providers/cncf/kubernetes/decorators/kubernetes.py: ## @@ -0,0 +1,161 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] ashb commented on issue #23588: After upgrade from Airflow 2.2.4, grid disappears for some DAGs

2022-05-19 Thread GitBox
ashb commented on issue #23588: URL: https://github.com/apache/airflow/issues/23588#issuecomment-1132187123 Do you have `task.params` or `dag.params` set to by any chance? If someone can share with me a dag that exhibits this behaviour that would be very useful. -- This is an

[GitHub] [airflow] github-actions[bot] commented on pull request #23813: Grid data: do not load all mapped instances

2022-05-19 Thread GitBox
github-actions[bot] commented on PR #23813: URL: https://github.com/apache/airflow/pull/23813#issuecomment-1132161380 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not modify the

[GitHub] [airflow] ashb commented on a diff in pull request #23813: Grid data: do not load all mapped instances

2022-05-19 Thread GitBox
ashb commented on code in PR #23813: URL: https://github.com/apache/airflow/pull/23813#discussion_r877498895 ## airflow/www/utils.py: ## @@ -127,13 +128,21 @@ def get_mapped_summary(parent_instance, task_instances): } -def encode_ti( -task_instance:

[GitHub] [airflow] gmcrocetti commented on a diff in pull request #23791: Fix DataprocJobBaseOperator not compatible with TaskGroups

2022-05-19 Thread GitBox
gmcrocetti commented on code in PR #23791: URL: https://github.com/apache/airflow/pull/23791#discussion_r877490814 ## tests/providers/google/cloud/operators/test_dataproc.py: ## @@ -1204,8 +1204,9 @@ class TestDataProcHiveOperator(unittest.TestCase): query = "define sin

[GitHub] [airflow] kazanzhy opened a new pull request, #23816: Fix UnboundLocalError when sql is empty list in DbApiHook

2022-05-19 Thread GitBox
kazanzhy opened a new pull request, #23816: URL: https://github.com/apache/airflow/pull/23816 Fixes UnboundLocalError: local variable 'results' referenced before assignment if the SQL parameter is an empty list in DbApiHook. related: #23767 -- This is an automated message from the

[GitHub] [airflow] potiuk commented on pull request #23745: Add tool to automaticaly update status of AIP-47 issues.

2022-05-19 Thread GitBox
potiuk commented on PR #23745: URL: https://github.com/apache/airflow/pull/23745#issuecomment-1132140958 BTW. @bhirsz @ferruzzi - you will be able to run the tool in `--dry-mode` once merged and see the stats and what will be updated when committer runs it with read-only token or even

[GitHub] [airflow] thcidale0808 commented on pull request #23567: Add Databricks sensor check partition and delta table events

2022-05-19 Thread GitBox
thcidale0808 commented on PR #23567: URL: https://github.com/apache/airflow/pull/23567#issuecomment-1132139044 @ferruzzi your comments make sense. I've pushed the fixes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] thcidale0808 commented on a diff in pull request #23567: Add Databricks sensor check partition and delta table events

2022-05-19 Thread GitBox
thcidale0808 commented on code in PR #23567: URL: https://github.com/apache/airflow/pull/23567#discussion_r877477543 ## tests/providers/databricks/sensors/test_databricks.py: ## @@ -0,0 +1,172 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] thcidale0808 commented on a diff in pull request #23567: Add Databricks sensor check partition and delta table events

2022-05-19 Thread GitBox
thcidale0808 commented on code in PR #23567: URL: https://github.com/apache/airflow/pull/23567#discussion_r877477381 ## airflow/providers/databricks/sensors/databricks.py: ## @@ -0,0 +1,140 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] kazanzhy opened a new pull request, #23815: Fix UnboundLocalError when sql is empty list in DatabricksSqlHook

2022-05-19 Thread GitBox
kazanzhy opened a new pull request, #23815: URL: https://github.com/apache/airflow/pull/23815 Fixes UnboundLocalError: local variable 'schema' referenced before assignment if the SQL parameter is an empty list in DatabricksSqlHook. related: #23767 -- This is an automated

[GitHub] [airflow] bbovenzi opened a new pull request, #23813: only get necessary task instances

2022-05-19 Thread GitBox
bbovenzi opened a new pull request, #23813: URL: https://github.com/apache/airflow/pull/23813 We were accidentally sending all mapped task instance data in `grid_data`. This was a lot of querying which took a long time. Instead we should only pass the summary. And use `/listMapped` to get

[GitHub] [airflow] potiuk commented on pull request #23745: Add tool to automaticaly update status of AIP-47 issues.

2022-05-19 Thread GitBox
potiuk commented on PR #23745: URL: https://github.com/apache/airflow/pull/23745#issuecomment-1132127532 BTW. @bhirsz @ferruzzi added some stats. Excerpt: ``` 1176814835: Migrate Google system tests to new design Summary of performed actions: for Migrate Google

[GitHub] [airflow] kazanzhy opened a new pull request, #23812: Fix UnboundLocalError when sql is empty list in ExasolHook

2022-05-19 Thread GitBox
kazanzhy opened a new pull request, #23812: URL: https://github.com/apache/airflow/pull/23812 Raises `ValueError` if the SQL parameter is an empty list in SnowflakeHook. related: #23767 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on pull request #23745: Add tool to automaticaly update status of AIP-47 issues.

2022-05-19 Thread GitBox
potiuk commented on PR #23745: URL: https://github.com/apache/airflow/pull/23745#issuecomment-1132113745 (but it works nicely BTW) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] potiuk commented on pull request #23745: Add tool to automaticaly update status of AIP-47 issues.

2022-05-19 Thread GitBox
potiuk commented on PR #23745: URL: https://github.com/apache/airflow/pull/23745#issuecomment-1132112558 Would be great to merge it so that I could run it every time I merge an AIP-47 change without rebasing it :) -- This is an automated message from the Apache Git Service. To respond to

[airflow] branch main updated (df84c4ad42 -> f60fa98a2e)

2022-05-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from df84c4ad42 Support host_name on Datadog provider (#23784) add f60fa98a2e Cloud SQL assets & system tests

[GitHub] [airflow] potiuk merged pull request #23583: Cloud SQL assets & system tests migration (AIP-47)

2022-05-19 Thread GitBox
potiuk merged PR #23583: URL: https://github.com/apache/airflow/pull/23583 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on a diff in pull request #23731: remove xfail test jobs in test_scheduler

2022-05-19 Thread GitBox
potiuk commented on code in PR #23731: URL: https://github.com/apache/airflow/pull/23731#discussion_r877427392 ## tests/jobs/test_scheduler_job.py: ## @@ -4120,22 +4120,40 @@ def test_task_with_upstream_skip_process_task_instances(): dr =

[airflow] branch constraints-2-3 updated: Updating constraints. Build id:2353814637

2022-05-19 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-3 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-3 by this push: new 78cf602e04 Updating

[GitHub] [airflow] vincbeck opened a new pull request, #23810: Reformat the whole AWS documentation

2022-05-19 Thread GitBox
vincbeck opened a new pull request, #23810: URL: https://github.com/apache/airflow/pull/23810 The purpose of this PR is to reformat the whole AWS documentation in order to have one consistent format across the Amazon provider package. The new format is: ``` ==

[GitHub] [airflow] kbendick commented on a diff in pull request #23704: Add Tabular provider

2022-05-19 Thread GitBox
kbendick commented on code in PR #23704: URL: https://github.com/apache/airflow/pull/23704#discussion_r877396148 ## airflow/providers/tabular/example_dags/example_tabular.py: ## @@ -0,0 +1,46 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] bbovenzi commented on pull request #23805: Don't refresh mapped instances list when states are final

2022-05-19 Thread GitBox
bbovenzi commented on PR #23805: URL: https://github.com/apache/airflow/pull/23805#issuecomment-1132050373 > Hmm, what if another user triggers the clear? Is there any way for "this" user to refresh without a full page refresh? > > Is it the API call that is slow, or updating the

[airflow] 08/10: Shorten max pre-commit hook name length (#23677)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7d4090d5fca3d9061f68468d19de4562aef64dd7 Author: Daniel Standish

[airflow] 06/10: Add version to migration prefix (#23564)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit bae9a1b2dd873a1a60926f12255bec62e9a3c64b Author: Daniel Standish

[airflow] 05/10: Fix typos in README.md and airflow_doc_issue_report.yml (#23294)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit b77e616aa4d4cd8ca1239dac6954fb9b473b86ff Author: TreyYi AuthorDate: Thu Apr 28 06:30:12 2022 +0900

[airflow] 10/10: Fix "breeze-legacy" after building images was removed (#23404)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit d8d87162ea664c660372885d390638e17e1b9818 Author: Jarek Potiuk AuthorDate: Mon May 2 16:26:05 2022 +0200

[airflow] 04/10: Fix `check_files.py` to work on new minor releases (#23287)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit f9287821cb4969b0f164a0e371ae8bf2ae49ae0a Author: Jed Cunningham

[airflow] 07/10: Make Breeze help generation indepdent from having breeze installed (#23612)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 6235ac248a56dc47081b34db3c2b6e97ac6bb8cd Author: Jarek Potiuk AuthorDate: Tue May 10 11:49:39 2022 +0200

[airflow] 01/10: Update Airflow Release Doc (#23322)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 8ed7a80eadc16280da740f69943bafa962d09381 Author: Ephraim Anierobi AuthorDate: Thu Apr 28 19:51:20 2022

[airflow] 03/10: Add missing steps to release process (#23384)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7de32629e26b53b73f91aec048dd777dfb697d16 Author: Jed Cunningham

[airflow] 09/10: Modify db clean to also catch the ProgrammingError exception (#23699)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 91438f4dc0244d6fa29c8fe8372ad5fcc04ae17e Author: Jian Yuan Lee AuthorDate: Thu May 19 17:47:56 2022 +0100

[airflow] 02/10: Remove tagging of `constraint-x-y` branch from release process (#23399)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 65f6a66f6238b9e3c4ef2e45f990bb6f2ce7bc6e Author: Ephraim Anierobi AuthorDate: Mon May 2 10:56:05 2022

[airflow] branch v2-3-test updated (ffb3ee0617 -> d8d87162ea)

2022-05-19 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-3-test in repository https://gitbox.apache.org/repos/asf/airflow.git from ffb3ee0617 Fix python version used for cache preparaation (#23785) new 8ed7a80ead Update Airflow

[GitHub] [airflow] potiuk commented on pull request #23762: Split contributor's quick start into separate guides.

2022-05-19 Thread GitBox
potiuk commented on PR #23762: URL: https://github.com/apache/airflow/pull/23762#issuecomment-1132027141 I think it's ready for the Summit's workshop ! We have 24 (!) people signed up so we better have it right. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] ust40611 commented on issue #23642: Dynamic Task Crashes scheduler - Non Empty Return

2022-05-19 Thread GitBox
ust40611 commented on issue #23642: URL: https://github.com/apache/airflow/issues/23642#issuecomment-1132024680 @alex-astronomer Thanks for your workaround, do you mind suggest how could we pull_message() from xcom and add that message as a param to trigger the databricks job using

[airflow-site] branch gh-pages updated: Deploying to gh-pages from @ 2033f8a4eb6ebdf028f41ae76122213a63059e0f 

2022-05-19 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/gh-pages by this push: new 327e4664a Deploying to gh-pages

[GitHub] [airflow] ei-grad commented on pull request #23720: Fix backfill queued task getting reset to scheduled state.

2022-05-19 Thread GitBox
ei-grad commented on PR #23720: URL: https://github.com/apache/airflow/pull/23720#issuecomment-1132018441 Having the same issue in airflow==2.2.5. Applying a slightly adapted patch from this pull request fixes the problem with broken backfill. -- This is an automated message from the

[airflow-site] branch main updated: Added integration-logos and updated integrations.json (#596)

2022-05-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new 2033f8a4e Added integration-logos and updated

  1   2   3   >