[GitHub] [airflow] eumiro opened a new pull request, #33520: Replace repr() with proper formatting

2023-08-18 Thread via GitHub
eumiro opened a new pull request, #33520: URL: https://github.com/apache/airflow/pull/33520 Refactor: replace `repr()` with `!r` in f-strings and `%r` in log messages. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [airflow] potiuk commented on pull request #33468: Replacing .gitignore with .gitkeep

2023-08-18 Thread via GitHub
potiuk commented on PR #33468: URL: https://github.com/apache/airflow/pull/33468#issuecomment-1684861316 Yeah. I am also with @uranusjr on that one. I think the ONLY benefit of using .gitkeep is that the name is explicit but all the other things are drawbacks. And having a directory which i

[GitHub] [airflow] potiuk commented on pull request #32607: Bring back hive support for Python 3.11

2023-08-18 Thread via GitHub
potiuk commented on PR #32607: URL: https://github.com/apache/airflow/pull/32607#issuecomment-1684856576 Seems that `pyhive 0.7.0 has been released and we can bring back Hive support for Python 3.11 finally -- This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [airflow] potiuk commented on a diff in pull request #32607: Bring back hive support for Python 3.11

2023-08-18 Thread via GitHub
potiuk commented on code in PR #32607: URL: https://github.com/apache/airflow/pull/32607#discussion_r1299130126 ## generated/provider_dependencies.json: ## @@ -119,8 +119,7 @@ "apache-airflow>=2.4.0", "hmsclient>=0.1.0", "pandas>=0.17.1", - "pyhive[hive

[GitHub] [airflow] potiuk commented on a diff in pull request #32607: Bring back hive support for Python 3.11

2023-08-18 Thread via GitHub
potiuk commented on code in PR #32607: URL: https://github.com/apache/airflow/pull/32607#discussion_r1299129989 ## airflow/providers/apache/hive/provider.yaml: ## @@ -60,18 +60,9 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - hmsclient>=0.1.0 - pandas>=

[airflow] branch main updated: Fix chart schema defaults (#33518)

2023-08-18 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 5e9254cb37 Fix chart schema defaults (#33518) 5e925

[GitHub] [airflow] potiuk merged pull request #33518: Fix chart schema defaults

2023-08-18 Thread via GitHub
potiuk merged PR #33518: URL: https://github.com/apache/airflow/pull/33518 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] eumiro opened a new pull request, #33519: Refactor: Do not create lists we don't need

2023-08-18 Thread via GitHub
eumiro opened a new pull request, #33519: URL: https://github.com/apache/airflow/pull/33519 In all these cases, complete lists are created although only their length or the first element are needed. This PR introduces shortcuts. -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] eumiro commented on pull request #33504: Replace fnmatch with pathlib

2023-08-18 Thread via GitHub
eumiro commented on PR #33504: URL: https://github.com/apache/airflow/pull/33504#issuecomment-1684823464 Looks like most of my suggested changes are not useful here. Will close this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [airflow] eumiro closed pull request #33504: Replace fnmatch with pathlib

2023-08-18 Thread via GitHub
eumiro closed pull request #33504: Replace fnmatch with pathlib URL: https://github.com/apache/airflow/pull/33504 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

[GitHub] [airflow] amoghrajesh commented on pull request #33468: Replacing .gitignore with .gitkeep

2023-08-18 Thread via GitHub
amoghrajesh commented on PR #33468: URL: https://github.com/apache/airflow/pull/33468#issuecomment-1684800027 @uranusjr I am ok abandoning the PR if you think it's not worthwhile doing this. Let me know what you think. -- This is an automated message from the Apache Git Service. To respon

[GitHub] [airflow] jedcunningham merged pull request #33514: Chart: pass workers.terminationGracePeriodSeconds into KubeExecutor pod template

2023-08-18 Thread via GitHub
jedcunningham merged PR #33514: URL: https://github.com/apache/airflow/pull/33514 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[airflow] branch main updated: Chart: pass workers.terminationGracePeriodSeconds into KubeExecutor pod template (#33514)

2023-08-18 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ad450308a2 Chart: pass workers.terminationGr

[GitHub] [airflow] jedcunningham opened a new pull request, #33518: Fix chart schema defaults

2023-08-18 Thread via GitHub
jedcunningham opened a new pull request, #33518: URL: https://github.com/apache/airflow/pull/33518 This fixes the static check failures in main. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [airflow] mdeshmu commented on pull request #32607: Bring back hive support for Python 3.11

2023-08-18 Thread via GitHub
mdeshmu commented on PR #32607: URL: https://github.com/apache/airflow/pull/32607#issuecomment-1684711281 PyHive 0.7.0 is released which includes Python 3.11 and SQLAlchemy 2.0 support. -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [airflow] shubham22 commented on issue #21867: Retry for TaskGroup

2023-08-18 Thread via GitHub
shubham22 commented on issue #21867: URL: https://github.com/apache/airflow/issues/21867#issuecomment-1684691599 Thank you for the very detailed explanation, @dstandish. Your insights are appreciated, and it took me three days to muster the courage to read through it 😅 > So this seem

[GitHub] [airflow] amoghrajesh commented on pull request #33379: Add `active_deadline_seconds` parameter to `KubernetesPodOperator`

2023-08-18 Thread via GitHub
amoghrajesh commented on PR #33379: URL: https://github.com/apache/airflow/pull/33379#issuecomment-1684539390 Silly mistake by me. Thanks Hussein! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] hussein-awala opened a new pull request, #33516: Stop adding values to rendered templates UI when there is no dagrun

2023-08-18 Thread via GitHub
hussein-awala opened a new pull request, #33516: URL: https://github.com/apache/airflow/pull/33516 closes: #33478 When there is no dag run (dag never being run, or wrong execution_date), we create the TI from the raw task, and in this case we load the rendered values as p

[GitHub] [airflow] jedcunningham commented on pull request #33514: Chart: pass workers.terminationGracePeriodSeconds into KubeExecutor pod template

2023-08-18 Thread via GitHub
jedcunningham commented on PR #33514: URL: https://github.com/apache/airflow/pull/33514#issuecomment-1684528549 Yep, no need for a new value. Can you add a test [here](https://github.com/apache/airflow/blob/main/helm_tests/airflow_aux/test_pod_template_file.py)? -- This is an automated me

[GitHub] [airflow] jedcunningham opened a new pull request, #33515: Move license templates out of repo root

2023-08-18 Thread via GitHub
jedcunningham opened a new pull request, #33515: URL: https://github.com/apache/airflow/pull/33515 Let's move the license templates out of the repo root - they don't need to be at the top level. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] SamWheating opened a new pull request, #33514: Chart: pass workers.terminationGracePeriodSeconds into KubeExecutor pod template

2023-08-18 Thread via GitHub
SamWheating opened a new pull request, #33514: URL: https://github.com/apache/airflow/pull/33514 While the chart allows users to specify a custom TerminationGracePeriodSeconds for the celery workers, this value is not passed into the Kubernetes Executor pod template, and thus pods use the d

[GitHub] [airflow] alexbegg commented on pull request #33427: Add `sql_hook_params` parameter to `S3ToSqlOperator`

2023-08-18 Thread via GitHub
alexbegg commented on PR #33427: URL: https://github.com/apache/airflow/pull/33427#issuecomment-1684520370 Please remove [area:core-operators](https://github.com/apache/airflow/labels/area%3Acore-operators) label from this PR now no longer changes the core operators -- This is an automat

[GitHub] [airflow] alexbegg commented on pull request #33427: Add `sql_hook_params` parameter to `S3ToSqlOperator`

2023-08-18 Thread via GitHub
alexbegg commented on PR #33427: URL: https://github.com/apache/airflow/pull/33427#issuecomment-1684519210 @uranusjr I corrected the test to access the hook using the changed method of getting it from `Connection.get_hook` (which supports `hook_params`) instead of `BaseHook.get_hook` (which

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #33513: Fix OpenLineage link in New Features notes

2023-08-18 Thread via GitHub
boring-cyborg[bot] commented on PR #33513: URL: https://github.com/apache/airflow/pull/33513#issuecomment-1684514446 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] ldacey opened a new pull request, #33513: Fix OpenLineage link in New Features notes

2023-08-18 Thread via GitHub
ldacey opened a new pull request, #33513: URL: https://github.com/apache/airflow/pull/33513 The label is provider:openlineage instead of API-53 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/a

[GitHub] [airflow] jedcunningham commented on pull request #32349: Chart: add support for container lifecycle hooks

2023-08-18 Thread via GitHub
jedcunningham commented on PR #32349: URL: https://github.com/apache/airflow/pull/32349#issuecomment-1684502017 Thanks @rzjfr! Congrats on your first commit 🎉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[airflow] branch main updated: Chart: add support for container lifecycle hooks (#32349)

2023-08-18 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 5fef1db0a7 Chart: add support for container

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #32349: Chart: add support for container lifecycle hooks

2023-08-18 Thread via GitHub
boring-cyborg[bot] commented on PR #32349: URL: https://github.com/apache/airflow/pull/32349#issuecomment-1684499703 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

[GitHub] [airflow] jedcunningham closed issue #32402: [Chart] Add support for container lifecycle

2023-08-18 Thread via GitHub
jedcunningham closed issue #32402: [Chart] Add support for container lifecycle URL: https://github.com/apache/airflow/issues/32402 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [airflow] jedcunningham merged pull request #32349: Chart: add support for container lifecycle hooks

2023-08-18 Thread via GitHub
jedcunningham merged PR #32349: URL: https://github.com/apache/airflow/pull/32349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[GitHub] [airflow] ephraimbuddy merged pull request #33501: Airflow 2.7.0 has been released

2023-08-18 Thread via GitHub
ephraimbuddy merged PR #33501: URL: https://github.com/apache/airflow/pull/33501 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

[GitHub] [airflow] functicons commented on pull request #33274: Add parameter sftp_prefetch to SFTPToGCSOperator

2023-08-18 Thread via GitHub
functicons commented on PR #33274: URL: https://github.com/apache/airflow/pull/33274#issuecomment-1684478864 Anyone can help merge this PR? We need it to unblock some users ASAP. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [airflow] hussein-awala opened a new pull request, #33512: Set strict to True when parsing dates in webserver views

2023-08-18 Thread via GitHub
hussein-awala opened a new pull request, #33512: URL: https://github.com/apache/airflow/pull/33512 related: #33478 (I prefer to keep it open after merging this one) This PR switch to strict datetime parsing to avoid rendering the views with unexpected dates: ```python >>>

[GitHub] [airflow] github-actions[bot] commented on issue #24963: Doc menu items are not collapsible

2023-08-18 Thread via GitHub
github-actions[bot] commented on issue #24963: URL: https://github.com/apache/airflow/issues/24963#issuecomment-1684464828 This issue has been automatically marked as stale because it has been open for 365 days without any activity. There has been several Airflow releases since last activit

[GitHub] [airflow] github-actions[bot] closed pull request #30581: Make pause DAG its own role separate from edit DAG

2023-08-18 Thread via GitHub
github-actions[bot] closed pull request #30581: Make pause DAG its own role separate from edit DAG URL: https://github.com/apache/airflow/pull/30581 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [airflow] github-actions[bot] closed pull request #31955: chore(script): add option to delete logs folders on clean-up

2023-08-18 Thread via GitHub
github-actions[bot] closed pull request #31955: chore(script): add option to delete logs folders on clean-up URL: https://github.com/apache/airflow/pull/31955 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] github-actions[bot] commented on pull request #31880: Add new "with-triggerer" option to Breeze CLI

2023-08-18 Thread via GitHub
github-actions[bot] commented on PR #31880: URL: https://github.com/apache/airflow/pull/31880#issuecomment-1684464439 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

[GitHub] [airflow] potiuk opened a new pull request, #33511: Remove "eager upgrade" from PROD image completely

2023-08-18 Thread via GitHub
potiuk opened a new pull request, #33511: URL: https://github.com/apache/airflow/pull/33511 There were still some left-overs of EAGER_UPGRADE in PROD image building. Howwever "eager upgrade" only makes sense for CI images. PROD images when being built should use eager upgrades as they are p

[GitHub] [airflow] hussein-awala commented on issue #33475: Connect "Deferrable" Sensor Attributes with BaseSensorOperator

2023-08-18 Thread via GitHub
hussein-awala commented on issue #33475: URL: https://github.com/apache/airflow/issues/33475#issuecomment-1684439093 There are two open PR to address the mentioned issues: - For timeout: #32990 - For soft_fail: #33424 Could you check them? And the new design proposed by #3

[airflow] branch main updated: Remove Pydantic limitation for version < 2 (#33507)

2023-08-18 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 754a4ab396 Remove Pydantic limitation for ve

[GitHub] [airflow] jedcunningham merged pull request #33507: Remove Pydantic limitation for version < 2

2023-08-18 Thread via GitHub
jedcunningham merged PR #33507: URL: https://github.com/apache/airflow/pull/33507 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[airflow] branch main updated: Update version_added field for configs in config file (#33509)

2023-08-18 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ba4f541fba Update version_added field for

[GitHub] [airflow] ephraimbuddy merged pull request #33509: Update version_added field for configs in config file

2023-08-18 Thread via GitHub
ephraimbuddy merged PR #33509: URL: https://github.com/apache/airflow/pull/33509 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

[GitHub] [airflow] kaxil commented on a diff in pull request #33479: Consolidate import and usage of itertools

2023-08-18 Thread via GitHub
kaxil commented on code in PR #33479: URL: https://github.com/apache/airflow/pull/33479#discussion_r1298841597 ## airflow/www/views.py: ## @@ -3229,8 +3229,7 @@ def duration(self, dag_id: str, session: Session = NEW_SESSION): # we must group any mapped TIs by dag_id,

[airflow] branch main updated: Fix typo in `db upgrade` warning message (#33510)

2023-08-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new bfba17bb37 Fix typo in `db upgrade` warning mess

[GitHub] [airflow] kaxil merged pull request #33510: Fix typo in `db upgrade` warning message

2023-08-18 Thread via GitHub
kaxil merged PR #33510: URL: https://github.com/apache/airflow/pull/33510 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.ap

[GitHub] [airflow] Taragolis commented on a diff in pull request #33504: Replace fnmatch with pathlib

2023-08-18 Thread via GitHub
Taragolis commented on code in PR #33504: URL: https://github.com/apache/airflow/pull/33504#discussion_r1298836748 ## airflow/providers/amazon/aws/hooks/s3.py: ## @@ -823,7 +817,7 @@ def _is_in_period(input_date: datetime) -> bool: if "Contents" in page:

[GitHub] [airflow] kaxil opened a new pull request, #33510: Fix typo in `db upgrade` warning message

2023-08-18 Thread via GitHub
kaxil opened a new pull request, #33510: URL: https://github.com/apache/airflow/pull/33510 `db updgrade` to `db upgrade` --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRI

[GitHub] [airflow] hussein-awala commented on pull request #33379: Add `active_deadline_seconds` parameter to `KubernetesPodOperator`

2023-08-18 Thread via GitHub
hussein-awala commented on PR #33379: URL: https://github.com/apache/airflow/pull/33379#issuecomment-1684369772 :tada: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[airflow] branch main updated: Add `active_deadline_seconds` parameter to `KubernetesPodOperator` (#33379)

2023-08-18 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e991f60a79 Add `active_deadline_seconds` para

[GitHub] [airflow] hussein-awala merged pull request #33379: Add `active_deadline_seconds` parameter to `KubernetesPodOperator`

2023-08-18 Thread via GitHub
hussein-awala merged PR #33379: URL: https://github.com/apache/airflow/pull/33379 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[airflow] branch main updated: Use `dialect.name` in custom SA types (#33503)

2023-08-18 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 46aa4294e4 Use `dialect.name` in custom SA ty

[GitHub] [airflow] hussein-awala merged pull request #33503: Use `dialect.name` in custom SA types

2023-08-18 Thread via GitHub
hussein-awala merged PR #33503: URL: https://github.com/apache/airflow/pull/33503 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[GitHub] [airflow] ephraimbuddy opened a new pull request, #33509: Update version_added field for configs in config file

2023-08-18 Thread via GitHub
ephraimbuddy opened a new pull request, #33509: URL: https://github.com/apache/airflow/pull/33509 The otel was 2.6.0 as can be seen here: https://github.com/apache/airflow/pull/30160 and the internal api and related were 2.6.0 even though they were under a flag. These need to be updated exc

[GitHub] [airflow] Gollum999 commented on issue #33053: ExternalTaskSensor waits forever if TaskGroup contains skipped tasks

2023-08-18 Thread via GitHub
Gollum999 commented on issue #33053: URL: https://github.com/apache/airflow/issues/33053#issuecomment-1684348348 IMO what matters most is that the behavior is consistent. If a TaskGroup behaves like a skipped task when it comes to things like `allowed_states` and `trigger_rule`s, it should

[airflow] branch main updated: Fix rendering the mapped parameters when using `expand_kwargs` method (#32272)

2023-08-18 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new d1e6a5c48d Fix rendering the mapped parameter

[GitHub] [airflow] hussein-awala closed issue #32260: Apparently the Jinja template does not work when using dynamic task mapping with SQLExecuteQueryOperator

2023-08-18 Thread via GitHub
hussein-awala closed issue #32260: Apparently the Jinja template does not work when using dynamic task mapping with SQLExecuteQueryOperator URL: https://github.com/apache/airflow/issues/32260 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] hussein-awala merged pull request #32272: Fix rendering the mapped parameters when using `expand_kwargs` method

2023-08-18 Thread via GitHub
hussein-awala merged PR #32272: URL: https://github.com/apache/airflow/pull/32272 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[airflow] branch main updated: Remove unnecessary loops to load env from helm values (#33506)

2023-08-18 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 58eb19fe76 Remove unnecessary loops to load e

[GitHub] [airflow] hussein-awala merged pull request #33506: Remove unnecessary loops used to load env from helm values

2023-08-18 Thread via GitHub
hussein-awala merged PR #33506: URL: https://github.com/apache/airflow/pull/33506 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[GitHub] [airflow] eumiro opened a new pull request, #33508: Replace OrderedDict with plain dict

2023-08-18 Thread via GitHub
eumiro opened a new pull request, #33508: URL: https://github.com/apache/airflow/pull/33508 Python dicts are ordered, so we do not need to use `collections.OrderedDict`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[airflow] branch main updated: Allowing ability to add custom env into pgbouncer container (#33438)

2023-08-18 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new bbdf43b01b Allowing ability to add custom env

[airflow] branch main updated: Add `CloudBatchHook` and operators (#32606)

2023-08-18 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c6a014a370 Add `CloudBatchHook` and operators (#326

[GitHub] [airflow] potiuk merged pull request #32606: Add `CloudBatchHook` and operators

2023-08-18 Thread via GitHub
potiuk merged PR #32606: URL: https://github.com/apache/airflow/pull/32606 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] jedcunningham commented on a diff in pull request #33501: Airflow 2.7.0 has been released

2023-08-18 Thread via GitHub
jedcunningham commented on code in PR #33501: URL: https://github.com/apache/airflow/pull/33501#discussion_r1298765522 ## RELEASE_NOTES.rst: ## @@ -21,6 +21,343 @@ .. towncrier release notes start +Airflow 2.7.0 (2023-08-10) Review Comment: ```suggestion Airflow 2.7.

[GitHub] [airflow] potiuk opened a new pull request, #33507: Remove Pydantic limitation for version < 2

2023-08-18 Thread via GitHub
potiuk opened a new pull request, #33507: URL: https://github.com/apache/airflow/pull/33507 We already fixed all deprecation warnings for Pydantic 2 and we can thus remove Pydantic 2 limitation. Even if we are waiting for other dependencies (aws-sam-translator) it should be save to remove t

[airflow] branch main updated: Chart: Add existing secret support for PGBouncer metrics exporter (#32724)

2023-08-18 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2c0fa0c93e Chart: Add existing secret suppor

[GitHub] [airflow] jedcunningham merged pull request #32724: feat(chart): Add existing secret support for PGBouncer metrics exporter.

2023-08-18 Thread via GitHub
jedcunningham merged PR #32724: URL: https://github.com/apache/airflow/pull/32724 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[airflow] branch main updated: Chart: Default airflow version to 2.7.0 (#33502)

2023-08-18 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 6d8b779e25 Chart: Default airflow version

[GitHub] [airflow] ephraimbuddy merged pull request #33502: Chart: Default airflow version to 2.7.0

2023-08-18 Thread via GitHub
ephraimbuddy merged PR #33502: URL: https://github.com/apache/airflow/pull/33502 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

[GitHub] [airflow] hussein-awala opened a new pull request, #33506: Remove unnecessary loops to load env from helm values

2023-08-18 Thread via GitHub
hussein-awala opened a new pull request, #33506: URL: https://github.com/apache/airflow/pull/33506 This PR removes unnecessary loops used to load env variables from helm values by using toYaml func. --- **^ Add meaningful description above** Read the **[Pull Requ

[GitHub] [airflow] hussein-awala commented on a diff in pull request #33438: Allowing ability to add custom env into pgbouncer container

2023-08-18 Thread via GitHub
hussein-awala commented on code in PR #33438: URL: https://github.com/apache/airflow/pull/33438#discussion_r1298740444 ## chart/templates/pgbouncer/pgbouncer-deployment.yaml: ## @@ -101,6 +101,13 @@ spec: args: {{ tpl (toYaml .Values.pgbouncer.args) . | nindent 12 }}

[GitHub] [airflow] jedcunningham commented on a diff in pull request #33502: Chart: Default airflow version to 2.7.0

2023-08-18 Thread via GitHub
jedcunningham commented on code in PR #33502: URL: https://github.com/apache/airflow/pull/33502#discussion_r1298735864 ## chart/Chart.yaml: ## Review Comment: It's not a huge deal though - that section gets replaced during the chart release process anyways so it'll have th

[GitHub] [airflow] Taragolis opened a new pull request, #33503: Use `dialect.name` in custom SA types

2023-08-18 Thread via GitHub
Taragolis opened a new pull request, #33503: URL: https://github.com/apache/airflow/pull/33503 When we use our custom SA types, we use global settings instead of `sqlalchemy.engine.Dialect` as result in some circumstances users might have performance degradation, see: https

[GitHub] [airflow] jedcunningham commented on a diff in pull request #33502: Chart: Default airflow version to 2.7.0

2023-08-18 Thread via GitHub
jedcunningham commented on code in PR #33502: URL: https://github.com/apache/airflow/pull/33502#discussion_r1298734483 ## chart/Chart.yaml: ## Review Comment: Yeah, that shouldn't have been updated last time around :) -- This is an automated message from the Apache Git

[GitHub] [airflow] jedcunningham commented on a diff in pull request #33502: Chart: Default airflow version to 2.7.0

2023-08-18 Thread via GitHub
jedcunningham commented on code in PR #33502: URL: https://github.com/apache/airflow/pull/33502#discussion_r1298733567 ## chart/Chart.yaml: ## @@ -47,23 +47,23 @@ annotations: url: https://airflow.apache.org/docs/helm-chart/1.8.0/ artifacthub.io/screenshots: | - t

[airflow] branch main updated: Fix striping tags when falling back to update in `SageMakerEndpointOperator` (#33487)

2023-08-18 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b555ed6f35 Fix striping tags when falling bac

[GitHub] [airflow] hussein-awala merged pull request #33487: bugfix: strip tags when falling back to update in `SageMakerEndpointOperator`

2023-08-18 Thread via GitHub
hussein-awala merged PR #33487: URL: https://github.com/apache/airflow/pull/33487 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #33502: Chart: Default airflow version to 2.7.0

2023-08-18 Thread via GitHub
ephraimbuddy commented on code in PR #33502: URL: https://github.com/apache/airflow/pull/33502#discussion_r1298721017 ## chart/Chart.yaml: ## Review Comment: So, I usually do search and replace on this file but today I had to look at it very well today and it seems I was w

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #33502: Chart: Default airflow version to 2.7.0

2023-08-18 Thread via GitHub
ephraimbuddy commented on code in PR #33502: URL: https://github.com/apache/airflow/pull/33502#discussion_r1298719550 ## chart/newsfragments/32517.significant.rst: ## @@ -1,3 +1,3 @@ -Default Airflow image is updated to ``2.6.3`` +Default Airflow image is updated to ``2.7.0``

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #33502: Chart: Default airflow version to 2.7.0

2023-08-18 Thread via GitHub
ephraimbuddy commented on code in PR #33502: URL: https://github.com/apache/airflow/pull/33502#discussion_r1298714906 ## chart/Chart.yaml: ## @@ -47,23 +47,23 @@ annotations: url: https://airflow.apache.org/docs/helm-chart/1.8.0/ artifacthub.io/screenshots: | - ti

[airflow] branch main updated: Fix broken link in Modules Management page (#33499)

2023-08-18 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 02d3378fc9 Fix broken link in Modules Managem

[GitHub] [airflow] hussein-awala merged pull request #33499: Fix broken link in Modules Management page

2023-08-18 Thread via GitHub
hussein-awala merged PR #33499: URL: https://github.com/apache/airflow/pull/33499 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[GitHub] [airflow] pankajkoti commented on a diff in pull request #33502: Chart: Default airflow version to 2.7.0

2023-08-18 Thread via GitHub
pankajkoti commented on code in PR #33502: URL: https://github.com/apache/airflow/pull/33502#discussion_r1298712523 ## chart/Chart.yaml: ## Review Comment: Do we also need to update on L118 to update the description? It still says 2.6.3. I mean similar to what we did h

[GitHub] [airflow] eumiro commented on a diff in pull request #33453: Simplify 'X for X in Y' to 'Y' where applicable

2023-08-18 Thread via GitHub
eumiro commented on code in PR #33453: URL: https://github.com/apache/airflow/pull/33453#discussion_r1298693274 ## tests/providers/google/cloud/transfers/test_sql_to_gcs.py: ## @@ -557,7 +557,7 @@ def test__write_local_data_files_csv_does_not_write_on_empty_rows(self):

[GitHub] [airflow] eumiro commented on a diff in pull request #33453: Simplify 'X for X in Y' to 'Y' where applicable

2023-08-18 Thread via GitHub
eumiro commented on code in PR #33453: URL: https://github.com/apache/airflow/pull/33453#discussion_r1298693274 ## tests/providers/google/cloud/transfers/test_sql_to_gcs.py: ## @@ -557,7 +557,7 @@ def test__write_local_data_files_csv_does_not_write_on_empty_rows(self):

[GitHub] [airflow] jedcunningham commented on a diff in pull request #33502: Chart: Default airflow version to 2.7.0

2023-08-18 Thread via GitHub
jedcunningham commented on code in PR #33502: URL: https://github.com/apache/airflow/pull/33502#discussion_r1298685370 ## chart/Chart.yaml: ## @@ -47,23 +47,23 @@ annotations: url: https://airflow.apache.org/docs/helm-chart/1.8.0/ artifacthub.io/screenshots: | - t

[GitHub] [airflow] ephraimbuddy opened a new pull request, #33502: Chart: Default airflow version to 2.7.0

2023-08-18 Thread via GitHub
ephraimbuddy opened a new pull request, #33502: URL: https://github.com/apache/airflow/pull/33502 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[airflow] branch main updated: Do not return ongoin dagrun when a end_date is less than utcnow (#33488)

2023-08-18 Thread pierrejeambrun
This is an automated email from the ASF dual-hosted git repository. pierrejeambrun pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 7c51c87503 Do not return ongoin dagrun when

[GitHub] [airflow] pierrejeambrun merged pull request #33488: Fix Cluster Activity historical metrics for ongoing dagrun if end_date is provided

2023-08-18 Thread via GitHub
pierrejeambrun merged PR #33488: URL: https://github.com/apache/airflow/pull/33488 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@a

[GitHub] [airflow] fdemiane opened a new pull request, #33500: Fix KubernetesPodOperator duplicating logs when interrupted

2023-08-18 Thread via GitHub
fdemiane opened a new pull request, #33500: URL: https://github.com/apache/airflow/pull/33500 The KubernetesPodOperator is duplicating logs when they are interrupted. When calling _client.read_namespaced_pod_log, we were passing an outdated since_seconds: we were not using the latest captur

[GitHub] [airflow] vijayasarathib opened a new pull request, #33499: Fix broken link in Modules Management page

2023-08-18 Thread via GitHub
vijayasarathib opened a new pull request, #33499: URL: https://github.com/apache/airflow/pull/33499 fixing broken link in Modules Management --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airf

[GitHub] [airflow] boring-cyborg[bot] commented on issue #33498: KubernetesPodOperator duplicating logs when they are being interrupted

2023-08-18 Thread via GitHub
boring-cyborg[bot] commented on issue #33498: URL: https://github.com/apache/airflow/issues/33498#issuecomment-1684185142 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[GitHub] [airflow] fdemiane opened a new issue, #33498: KubernetesPodOperator duplicating logs when they are being interrupted

2023-08-18 Thread via GitHub
fdemiane opened a new issue, #33498: URL: https://github.com/apache/airflow/issues/33498 ### Apache Airflow version main (development) ### What happened This is a random issue. The KubernetesPodOperator duplicates logs when they are interrupted. ### What you think

[airflow-site] branch gh-pages updated (fb96cee2ea -> f4cf3ae88a)

2023-08-18 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git discard fb96cee2ea Rewritten history to remove past gh-pages deployments new f4cf3ae88a Rewritten history to

[airflow-site] branch main updated: Airflow 2.7 blog posts and announcement (#848)

2023-08-18 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new 0fd4958294 Airflow 2.7 blog posts and

[airflow-site] branch 270 deleted (was a64043a03b)

2023-08-18 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch 270 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was a64043a03b add pypi links for the executors The revisions that were on this branch are still contained in

[GitHub] [airflow-site] ephraimbuddy merged pull request #848: Airflow 2.7 blog posts and announcement

2023-08-18 Thread via GitHub
ephraimbuddy merged PR #848: URL: https://github.com/apache/airflow-site/pull/848 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[airflow-site] branch 270 updated: add pypi links for the executors

2023-08-18 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch 270 in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/270 by this push: new a64043a03b add pypi links for the execu

[GitHub] [airflow] theskycow commented on issue #33484: Web server restart from airflow cli

2023-08-18 Thread via GitHub
theskycow commented on issue #33484: URL: https://github.com/apache/airflow/issues/33484#issuecomment-1684147415 Thank you for the details, this was helpful in understanding what's going on underneath the surface. I will investigate the other approaches you recommend. -- This is

  1   2   >