(airflow) branch constraints-2-8 updated: Updating constraints. Github run id:7163768807

2023-12-10 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-8 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-8 by this push: new 35ebec1d9a Updating const

(airflow) branch main updated: Review and mark found potential SSH security issues by bandit (#36162)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 343bac956b Review and mark found potential SSH secu

Re: [PR] Review and mark found potential SSH security issues by bandit [airflow]

2023-12-10 Thread via GitHub
potiuk commented on PR #36162: URL: https://github.com/apache/airflow/pull/36162#issuecomment-1849477241 Passed static checks. Merging -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Review and mark found potential SSH security issues by bandit [airflow]

2023-12-10 Thread via GitHub
potiuk merged PR #36162: URL: https://github.com/apache/airflow/pull/36162 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[PR] Upgrade to latest pre-commit plugins [airflow]

2023-12-10 Thread via GitHub
potiuk opened a new pull request, #36163: URL: https://github.com/apache/airflow/pull/36163 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)*

Re: [PR] Handling exit of kerberos sidecar container for k8s < 1.28 [airflow]

2023-12-10 Thread via GitHub
potiuk commented on code in PR #35748: URL: https://github.com/apache/airflow/pull/35748#discussion_r1422011784 ## chart/templates/_helpers.yaml: ## @@ -997,3 +997,27 @@ capabilities: app: keda-operator {{- end }} {{- end }} + +{{- define "kubernetesVersion" -}}

Re: [PR] Handling exit of kerberos sidecar container for k8s < 1.28 [airflow]

2023-12-10 Thread via GitHub
potiuk commented on code in PR #35748: URL: https://github.com/apache/airflow/pull/35748#discussion_r1422011496 ## chart/templates/_helpers.yaml: ## @@ -997,3 +997,27 @@ capabilities: app: keda-operator {{- end }} {{- end }} + +{{- define "kubernetesVersion" -}}

(airflow) branch main updated: Follow BaseHook connection fields method signature in child classes (#36086)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new cd476acd8f Follow BaseHook connection fields method

Re: [PR] Follow BaseHook connection fields method signature in providers hooks [airflow]

2023-12-10 Thread via GitHub
potiuk merged PR #36086: URL: https://github.com/apache/airflow/pull/36086 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Rewrite constraints generation in Python [airflow]

2023-12-10 Thread via GitHub
potiuk merged PR #36158: URL: https://github.com/apache/airflow/pull/36158 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] Rewrite the in-container scripts in Python [airflow]

2023-12-10 Thread via GitHub
potiuk closed issue #26019: Rewrite the in-container scripts in Python URL: https://github.com/apache/airflow/issues/26019 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

(airflow) branch main updated: Fix: Implement support for `fetchone()` in the ODBCHook and the Databricks SQL Hook (#36161)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 36010f6d0e Fix: Implement support for `fetchone()`

(airflow) branch main updated: Rewrite constraints generation in Python (#36158)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new f39cdcceff Rewrite constraints generation in Python

Re: [PR] Fix: Implement support for `fetchone()` in the ODBCHook and the Databricks SQL Hook [airflow]

2023-12-10 Thread via GitHub
potiuk merged PR #36161: URL: https://github.com/apache/airflow/pull/36161 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Fix: Implement support for `fetchone()` in the ODBCHook and the Databricks SQL Hook [airflow]

2023-12-10 Thread via GitHub
potiuk commented on PR #36161: URL: https://github.com/apache/airflow/pull/36161#issuecomment-1849436914 The static check handled in https://github.com/apache/airflow/pull/36162 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] Copy of [AIRFLOW-5071] JIRA: Thousands of Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally? [airflow]

2023-12-10 Thread via GitHub
github-actions[bot] closed issue #10790: Copy of [AIRFLOW-5071] JIRA: Thousands of Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally? URL: https://github.com/apache/airflow/issues/10790 -- This is an automated message from t

Re: [I] Copy of [AIRFLOW-5071] JIRA: Thousands of Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally? [airflow]

2023-12-10 Thread via GitHub
github-actions[bot] commented on issue #10790: URL: https://github.com/apache/airflow/issues/10790#issuecomment-1849436163 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

[PR] Review and mark found potential SSH security issues by bandit [airflow]

2023-12-10 Thread via GitHub
potiuk opened a new pull request, #36162: URL: https://github.com/apache/airflow/pull/36162 Bandit releaed new version (1.7.6) few days ago. We had >=1.7.5 and it started to detect new potential issue (Auto Add Hostkey) in Google and SSH providers. Both case are valid however (in the first

Re: [PR] Allow changing the unfinished ti state [airflow]

2023-12-10 Thread via GitHub
eladkal commented on code in PR #36078: URL: https://github.com/apache/airflow/pull/36078#discussion_r1421994420 ## tests/integration/executors/test_celery_executor.py: ## @@ -146,6 +147,9 @@ def fake_execute_command(command): executor._process_tasks(task_tupl

(airflow) branch v2-8-test updated (558e9654e6 -> d0c1c452ce)

2023-12-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard 558e9654e6 Update RELEASE_NOTES.rst add bdadabc8e7 Use S3 hook instead of AwsGenericHook in AWS S3 F

(airflow) branch v2-8-test updated (b167d36525 -> 558e9654e6)

2023-12-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit b167d36525 Update RELEASE_NOTES.rst add 558e9654e6 Update RELEASE_NOTES.rst This update added new r

Re: [PR] Sync v2-8-stable with v2-8-test to release 2.8.0 [airflow]

2023-12-10 Thread via GitHub
ephraimbuddy commented on code in PR #36065: URL: https://github.com/apache/airflow/pull/36065#discussion_r1421985220 ## RELEASE_NOTES.rst: ## @@ -146,6 +165,10 @@ Bug Fixes Misc/Internal Review Comment: Let me change it today :) -- This is an automated message from t

(airflow) branch v2-8-test updated (f819449dd4 -> b167d36525)

2023-12-10 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit f819449dd4 Update RELEASE_NOTES.rst add b167d36525 Update RELEASE_NOTES.rst This update added new r

Re: [PR] Sync v2-8-stable with v2-8-test to release 2.8.0 [airflow]

2023-12-10 Thread via GitHub
ephraimbuddy commented on code in PR #36065: URL: https://github.com/apache/airflow/pull/36065#discussion_r1421972947 ## RELEASE_NOTES.rst: ## @@ -63,6 +64,14 @@ New Features Improvements +- Account for change in UTC offset when calculating next schedule (#35887

Re: [PR] Sync v2-8-stable with v2-8-test to release 2.8.0 [airflow]

2023-12-10 Thread via GitHub
ephraimbuddy commented on code in PR #36065: URL: https://github.com/apache/airflow/pull/36065#discussion_r1421972743 ## RELEASE_NOTES.rst: ## @@ -63,6 +64,14 @@ New Features Improvements +- Account for change in UTC offset when calculating next schedule (#35887

Re: [PR] Handling exit of kerberos sidecar container for k8s < 1.28 [airflow]

2023-12-10 Thread via GitHub
amoghrajesh commented on code in PR #35748: URL: https://github.com/apache/airflow/pull/35748#discussion_r1421932601 ## chart/templates/_helpers.yaml: ## @@ -997,3 +997,27 @@ capabilities: app: keda-operator {{- end }} {{- end }} + +{{- define "kubernetesVersion

Re: [I] BigQuery with impersonation_chain does not accept custom scopes [airflow]

2023-12-10 Thread via GitHub
mai-nakagawa commented on issue #33400: URL: https://github.com/apache/airflow/issues/33400#issuecomment-1849156253 Yes, it picks up scopes from Airflow Connection's field. The problem is that we cannot set scopes with impersonation_chain, as written in the description field of this GitHub

Re: [I] Status of testing Providers that were prepared on December 08, 2023 [airflow]

2023-12-10 Thread via GitHub
Joffreybvn commented on issue #36117: URL: https://github.com/apache/airflow/issues/36117#issuecomment-1849141625 Fix for https://github.com/apache/airflow/pull/32319#discussion_r1421437350 is here -> #36161 -- This is an automated message from the Apache Git Service. To respond to the me

[PR] Fix: Implement support for `fetchone()` in the ODBCHook and the Databricks SQL Hook [airflow]

2023-12-10 Thread via GitHub
Joffreybvn opened a new pull request, #36161: URL: https://github.com/apache/airflow/pull/36161 This PR implements support for `fetchone()` in the ODBCHook and the Databricks SQL Hook. Fixing the bug described in https://github.com/apache/airflow/pull/32319#discussion_r1

(airflow) branch rewrite-generate-constraints-in-python updated (5b115dacb6 -> 501bd4eaed)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch rewrite-generate-constraints-in-python in repository https://gitbox.apache.org/repos/asf/airflow.git omit 5b115dacb6 Rewrite constraints generation in Python add 712df0463b Refactor Exte

(airflow) branch rewrite-generate-constraints-in-python updated (adc72ba93d -> 5b115dacb6)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch rewrite-generate-constraints-in-python in repository https://gitbox.apache.org/repos/asf/airflow.git discard adc72ba93d Rewrite constraints generation in Python add 5b115dacb6 Rewrite const

(airflow) branch rewrite-generate-constraints-in-python updated (a7ba7b53bf -> adc72ba93d)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch rewrite-generate-constraints-in-python in repository https://gitbox.apache.org/repos/asf/airflow.git discard a7ba7b53bf Rewrite constraints generation in Python add adc72ba93d Rewrite const

Re: [PR] Rewrite constraints generation in Python [airflow]

2023-12-10 Thread via GitHub
potiuk commented on code in PR #36158: URL: https://github.com/apache/airflow/pull/36158#discussion_r1421839341 ## scripts/in_container/run_generate_constraints.py: ## @@ -0,0 +1,460 @@ +#!/usr/bin/env python3 +# Licensed to the Apache Software Foundation (ASF) under one +# or m

(airflow) branch rewrite-generate-constraints-in-python updated (46d7fad62b -> a7ba7b53bf)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch rewrite-generate-constraints-in-python in repository https://gitbox.apache.org/repos/asf/airflow.git omit 46d7fad62b Rewrite constraints generation in Python add a7ba7b53bf Rewrite const

Re: [PR] Rewrite constraints generation in Python [airflow]

2023-12-10 Thread via GitHub
potiuk commented on code in PR #36158: URL: https://github.com/apache/airflow/pull/36158#discussion_r1421839093 ## scripts/in_container/run_generate_constraints.py: ## @@ -0,0 +1,460 @@ +#!/usr/bin/env python3 +# Licensed to the Apache Software Foundation (ASF) under one +# or m

Re: [PR] Rewrite constraints generation in Python [airflow]

2023-12-10 Thread via GitHub
potiuk commented on code in PR #36158: URL: https://github.com/apache/airflow/pull/36158#discussion_r1421837888 ## scripts/in_container/in_container_utils.py: ## @@ -0,0 +1,50 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreeme

Re: [I] Status of testing Providers that were prepared on December 08, 2023 [airflow]

2023-12-10 Thread via GitHub
potiuk commented on issue #36117: URL: https://github.com/apache/airflow/issues/36117#issuecomment-1849123662 Fix to the process to automatically generate removed providers here: https://github.com/apache/airflow/pull/36160 -- This is an automated message from the Apache Git Service. To r

[PR] Include removed providers when preparing packages [airflow]

2023-12-10 Thread via GitHub
potiuk opened a new pull request, #36160: URL: https://github.com/apache/airflow/pull/36160 As of recently, we have a possibility to schedule providers for removal. They should be removed once they got released the last time - with the removal note added to the documentation. We had a speci

Re: [PR] Rewrite constraints generation in Python [airflow]

2023-12-10 Thread via GitHub
Lee-W commented on code in PR #36158: URL: https://github.com/apache/airflow/pull/36158#discussion_r1421835178 ## scripts/in_container/in_container_utils.py: ## @@ -0,0 +1,50 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreemen

(airflow) branch rewrite-generate-constraints-in-python updated (12a3908e05 -> 46d7fad62b)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch rewrite-generate-constraints-in-python in repository https://gitbox.apache.org/repos/asf/airflow.git discard 12a3908e05 Rewrite constraints generation in Python add 46d7fad62b Rewrite const

Re: [PR] Increment try_number for externally failed tasks [airflow]

2023-12-10 Thread via GitHub
potiuk commented on PR #32825: URL: https://github.com/apache/airflow/pull/32825#issuecomment-1849105653 tests need fixing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] Handling exit of kerberos sidecar container for k8s < 1.28 [airflow]

2023-12-10 Thread via GitHub
potiuk commented on code in PR #35748: URL: https://github.com/apache/airflow/pull/35748#discussion_r1421827060 ## chart/templates/_helpers.yaml: ## @@ -997,3 +997,27 @@ capabilities: app: keda-operator {{- end }} {{- end }} + +{{- define "kubernetesVersion" -}}

Re: [PR] Bhavesh | Issue 12012: Updated INTHEWILD.md [airflow]

2023-12-10 Thread via GitHub
boring-cyborg[bot] commented on PR #36153: URL: https://github.com/apache/airflow/pull/36153#issuecomment-1849102275 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

(airflow) branch main updated: Update INTHEWILD.md (#36153)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c9fca899cc Update INTHEWILD.md (#36153) c9fca899cc

Re: [PR] Bhavesh | Issue 12012: Updated INTHEWILD.md [airflow]

2023-12-10 Thread via GitHub
potiuk merged PR #36153: URL: https://github.com/apache/airflow/pull/36153 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated (643b23448f -> 712df0463b)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 643b23448f Avoid race condition when generating constraints/installing providers (#36155) add 712df0463b Refactor

Re: [PR] Refactor ExternalDagLink to not create ad hoc TaskInstances [airflow]

2023-12-10 Thread via GitHub
potiuk merged PR #36135: URL: https://github.com/apache/airflow/pull/36135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch rewrite-generate-constraints-in-python updated (9351bbbb40 -> 12a3908e05)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch rewrite-generate-constraints-in-python in repository https://gitbox.apache.org/repos/asf/airflow.git omit 935140 Rewrite constraints generation in Python add 12a3908e05 Rewrite const

Re: [PR] fix connection type webhdfs [airflow]

2023-12-10 Thread via GitHub
potiuk commented on PR #36145: URL: https://github.com/apache/airflow/pull/36145#issuecomment-1849098325 needs static check fixing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [I] Can the BigQuery Partition Sensor be updated to sense a list of partition IDs instead of a single partition ID (string) [airflow]

2023-12-10 Thread via GitHub
potiuk closed issue #36142: Can the BigQuery Partition Sensor be updated to sense a list of partition IDs instead of a single partition ID (string) URL: https://github.com/apache/airflow/issues/36142 -- This is an automated message from the Apache Git Service. To respond to the message, pleas

(airflow) branch rewrite-generate-constraints-in-python updated (c85da98168 -> 9351bbbb40)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch rewrite-generate-constraints-in-python in repository https://gitbox.apache.org/repos/asf/airflow.git discard c85da98168 Rewrite constraints generation in Python add 935140 Rewrite const

Re: [I] Rewrite the in-container scripts in Python [airflow]

2023-12-10 Thread via GitHub
potiuk commented on issue #26019: URL: https://github.com/apache/airflow/issues/26019#issuecomment-1849089049 Finally all the "logic" scripts will be rewritten when #36158 is merged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

(airflow) branch rewrite-generate-constraints-in-python updated (c8f3e7d328 -> c85da98168)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch rewrite-generate-constraints-in-python in repository https://gitbox.apache.org/repos/asf/airflow.git discard c8f3e7d328 Rewrite constraints generation in Python add c85da98168 Rewrite const

[PR] Rewrite constraints generation in Python [airflow]

2023-12-10 Thread via GitHub
potiuk opened a new pull request, #36158: URL: https://github.com/apache/airflow/pull/36158 Historically constraints generation (like most in-container scripts) were written in Bash. But since then we rewrote all of the scripts that had some logic to Python - generating constraints was the

(airflow) 01/01: Rewrite constraints generation in Python

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch rewrite-generate-constraints-in-python in repository https://gitbox.apache.org/repos/asf/airflow.git commit c8f3e7d32874a70fac50f3fd612436910c161585 Author: Jarek Potiuk AuthorDate: Sun Dec 10 16

Re: [PR] Rewrite constraints generation in Python [airflow]

2023-12-10 Thread via GitHub
potiuk closed pull request #36157: Rewrite constraints generation in Python URL: https://github.com/apache/airflow/pull/36157 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

(airflow) branch rewrite-generate-constraints-in-python created (now c8f3e7d328)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch rewrite-generate-constraints-in-python in repository https://gitbox.apache.org/repos/asf/airflow.git at c8f3e7d328 Rewrite constraints generation in Python This branch includes the followi

Re: [PR] Rewrite constraints generation in Python [airflow]

2023-12-10 Thread via GitHub
potiuk commented on PR #36157: URL: https://github.com/apache/airflow/pull/36157#issuecomment-1849087950 I need to re-open it from apache repo - because build-image workflow uses the removed code. -- This is an automated message from the Apache Git Service. To respond to the message, plea

[PR] Rewrite constraints generation in Python [airflow]

2023-12-10 Thread via GitHub
potiuk opened a new pull request, #36157: URL: https://github.com/apache/airflow/pull/36157 Historically constraints generation (like most in-container scripts) were written in Bash. But since then we rewrote all of the scripts that had some logic to Python - generating constraints was the

(airflow) branch constraints-main updated: Updating constraints. Github run id:7159665143

2023-12-10 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 518fd0e11f Updating con

(airflow) branch main updated: Avoid race condition when generating constraints/installing providers (#36155)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 643b23448f Avoid race condition when generating con

Re: [PR] Avoid race condition when generating constraints/installing providers [airflow]

2023-12-10 Thread via GitHub
potiuk merged PR #36155: URL: https://github.com/apache/airflow/pull/36155 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Reorganize command options in Breeze (#36152)

2023-12-10 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2563442e5f Reorganize command options in Breeze (#

Re: [PR] Reorganize command options in Breeze [airflow]

2023-12-10 Thread via GitHub
eladkal merged PR #36152: URL: https://github.com/apache/airflow/pull/36152 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

[PR] Upgrade bitnami/postgresql subchart to 13.2.24 [airflow]

2023-12-10 Thread via GitHub
dnskr opened a new pull request, #36156: URL: https://github.com/apache/airflow/pull/36156 The PR upgrades postgresql dependency of Airflow helm chart: - `bitnami/postgresql` subchart upgraded from `12.10.0` to `13.2.24` - `PostgreSQL` upgraded from `PostgreSQL 11` to `PostgreSQL 16.1

Re: [I] Statsd metrics dagrun.schedule_delay sends time in different format against the seconds specified in docs [airflow]

2023-12-10 Thread via GitHub
potiuk commented on issue #33426: URL: https://github.com/apache/airflow/issues/33426#issuecomment-1849008476 Go ahead. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

(airflow) branch main updated: Fix extra "USE_AIRFLOW_VERSION" variable set in sdist package check (#36154)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 8b13c167a5 Fix extra "USE_AIRFLOW_VERSION" variable

[PR] Avoid race condition when generating constraints/installing providers [airflow]

2023-12-10 Thread via GitHub
potiuk opened a new pull request, #36155: URL: https://github.com/apache/airflow/pull/36155 The change #36131 when switching to docker-compose based running of scripts introduced a subtle race condition when several docker-compose runs were running in paralell and used the same project_name

(airflow) branch constraints-main updated: Updating constraints. Github run id:7158611431

2023-12-10 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new aa7c660e79 Updating con

Re: [PR] Fix extra "USE_AIRFLOW_VERSION" variable set in sdist package check [airflow]

2023-12-10 Thread via GitHub
potiuk commented on PR #36154: URL: https://github.com/apache/airflow/pull/36154#issuecomment-1849002020 Should fix https://github.com/apache/airflow/actions/runs/7158611431/job/19491070635 -- This is an automated message from the Apache Git Service. To respond to the message, please log

[PR] Fix extra "USE_AIRFLOW_VERSION" variable set in sdist package check [airflow]

2023-12-10 Thread via GitHub
potiuk opened a new pull request, #36154: URL: https://github.com/apache/airflow/pull/36154 When we are testing packages in main, we also test sdist packages, and main is the only build we run it, so when implementing #36131 we had no chance to test it. There was an etra USE_AIRFLOW_VERSION

Re: [PR] Reorganize command options in Breeze [airflow]

2023-12-10 Thread via GitHub
potiuk commented on PR #36152: URL: https://github.com/apache/airflow/pull/36152#issuecomment-1848992299 This one is really **just** moving command options between files - no functional changes implemented here. -- This is an automated message from the Apache Git Service. To respond to th

Re: [PR] Unify how docker commands get executed in Breeze [airflow]

2023-12-10 Thread via GitHub
potiuk merged PR #36131: URL: https://github.com/apache/airflow/pull/36131 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Bhavesh | Issue 12012: Updated INTHEWILD.md [airflow]

2023-12-10 Thread via GitHub
boring-cyborg[bot] commented on PR #36153: URL: https://github.com/apache/airflow/pull/36153#issuecomment-1848987932 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[PR] Bhavesh | Issue 12012: Updated INTHEWILD.md [airflow]

2023-12-10 Thread via GitHub
BhaveshSK opened a new pull request, #36153: URL: https://github.com/apache/airflow/pull/36153 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guideline

(airflow) branch constraints-main updated: Updating constraints. Github run id:7157571316

2023-12-10 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 899c17a7ca Updating con

Re: [PR] SparkSubmit Operator fixes [airflow]

2023-12-10 Thread via GitHub
pateash commented on PR #36151: URL: https://github.com/apache/airflow/pull/36151#issuecomment-1848970049 cc @eladkal -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] Update docs README.rst to clarify --package-filter usage [airflow]

2023-12-10 Thread via GitHub
potiuk commented on PR #35045: URL: https://github.com/apache/airflow/pull/35045#issuecomment-1848965491 Approved - proposed one NIT: improvement (`--package-filter` allows glob pattern matching), you will akso need to apply static checks to include the description in the help screenshots.

Re: [PR] Update docs README.rst to clarify --package-filter usage [airflow]

2023-12-10 Thread via GitHub
potiuk commented on code in PR #35045: URL: https://github.com/apache/airflow/pull/35045#discussion_r1421750483 ## dev/breeze/src/airflow_breeze/commands/developer_commands.py: ## @@ -480,7 +480,9 @@ def start_airflow( "--package-filter", help="List of packages to cons

Re: [PR] Update docs README.rst to clarify --package-filter usage [airflow]

2023-12-10 Thread via GitHub
potiuk commented on code in PR #35045: URL: https://github.com/apache/airflow/pull/35045#discussion_r1421750483 ## dev/breeze/src/airflow_breeze/commands/developer_commands.py: ## @@ -480,7 +480,9 @@ def start_airflow( "--package-filter", help="List of packages to cons

Re: [PR] Migrate provider-specific executor docs to providers [airflow]

2023-12-10 Thread via GitHub
potiuk commented on PR #34809: URL: https://github.com/apache/airflow/pull/34809#issuecomment-1848964051 > @lzdanski This is the spell check sphinx issue I was referring to. @RNHTTR - I think first thing to do is to rebase this one. It's quite far behind, we introduced a number of cha

Re: [I] Status of testing Providers that were prepared on December 08, 2023 [airflow]

2023-12-10 Thread via GitHub
potiuk commented on issue #36117: URL: https://github.com/apache/airflow/issues/36117#issuecomment-1848959588 One small update - as @pankajastro noticed in https://github.com/apache/airflow/pull/32319#discussion_r1421437350 - there is a case where we are not handling properly the fact that

Re: [PR] Make pyodbc.Row and databricks.Row JSON-serializable via new `make_serializable` method [airflow]

2023-12-10 Thread via GitHub
potiuk commented on code in PR #32319: URL: https://github.com/apache/airflow/pull/32319#discussion_r1421746096 ## airflow/providers/databricks/hooks/databricks_sql.py: ## @@ -240,6 +240,13 @@ def run( else: return results +@staticmethod +def _mak

Re: [I] Set up multiple Airflow instances under the same domain with different sessions [airflow]

2023-12-10 Thread via GitHub
BhaveshSK commented on issue #17689: URL: https://github.com/apache/airflow/issues/17689#issuecomment-1848957899 Hello @eladkal , I am new to the programming domain and would like to contribute to the documentation task. Could you please provide me a point of reference on how I can complete

Re: [PR] Unify how docker commands get executed in Breeze [airflow]

2023-12-10 Thread via GitHub
potiuk commented on PR #36131: URL: https://github.com/apache/airflow/pull/36131#issuecomment-1848950065 Right. Solved all the problems - should be ready to review now :). This is one more cleanup (including removal of +200 lines of redundant codee) where we have an easier way to unde

Re: [I] Status of testing Providers that were prepared on December 08, 2023 [airflow]

2023-12-10 Thread via GitHub
potiuk commented on issue #36117: URL: https://github.com/apache/airflow/issues/36117#issuecomment-1848947322 Tested mssql - all looks good. One more thing I noticed - the removed `daskexecutor` has not been prepared. We have this in the release process, so it's easy to miss:

(airflow) branch main updated: list pods performance optimization (#36092)

2023-12-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b9c574c61a list pods performance optimization (#360

Re: [I] Kubernetes Executor List Pods Performance Improvement [airflow]

2023-12-10 Thread via GitHub
potiuk closed issue #35599: Kubernetes Executor List Pods Performance Improvement URL: https://github.com/apache/airflow/issues/35599 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] list pods performance optimization [airflow]

2023-12-10 Thread via GitHub
potiuk merged PR #36092: URL: https://github.com/apache/airflow/pull/36092 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Sync v2-8-stable with v2-8-test to release 2.8.0 [airflow]

2023-12-10 Thread via GitHub
potiuk commented on code in PR #36065: URL: https://github.com/apache/airflow/pull/36065#discussion_r1421735310 ## RELEASE_NOTES.rst: ## @@ -146,6 +165,10 @@ Bug Fixes Misc/Internal Review Comment: Agree. `Misc` should be for those changes that do not introduce new featur

[PR] Reorganize command options in Breeze [airflow]

2023-12-10 Thread via GitHub
potiuk opened a new pull request, #36152: URL: https://github.com/apache/airflow/pull/36152 The command options in breeze have been rather badly organized. The "common_option" in utils package was misplaced and it contained a lot of options that were not really "common" - only used in one o

Re: [PR] Add SparkKubernetesOperator crd implementation [airflow]

2023-12-10 Thread via GitHub
bolkedebruin commented on PR #22253: URL: https://github.com/apache/airflow/pull/22253#issuecomment-1848914425 No worries @hamedhsn , get better first! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] Increase amount of memory available for tests in self-hosted runners ?? [airflow-ci-infra]

2023-12-10 Thread via GitHub
potiuk closed pull request #63: Increase amount of memory available for tests in self-hosted runners ?? URL: https://github.com/apache/airflow-ci-infra/pull/63 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [I] [QUARANTINED] test_scheduler_task_start_date is flaky [airflow]

2023-12-10 Thread via GitHub
potiuk commented on issue #15085: URL: https://github.com/apache/airflow/issues/15085#issuecomment-1848891709 Yeah. Let me re-open it then. Yes. Flaky tests with very low probability of failing are the worst to track. Parallel runs have this property that they are running in a very "SLOW" e

[I] [QUARANTINED] test_scheduler_task_start_date is flaky [airflow]

2023-12-10 Thread via GitHub
potiuk opened a new issue, #15085: URL: https://github.com/apache/airflow/issues/15085 I've seen this test failing more than once for example: https://github.com/potiuk/airflow/runs/2223465940?check_suite_focus=true#step:6:10954 Marking it as quarantined. ```