[PR] Add use_krb5ccache option to SparkSubmitOperator [airflow]

2023-10-31 Thread via GitHub
zeotuan opened a new pull request, #35331: URL: https://github.com/apache/airflow/pull/35331 Continue #34386 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Update providers metadata 2023-10-31 [airflow]

2023-10-31 Thread via GitHub
eladkal merged PR #35310: URL: https://github.com/apache/airflow/pull/35310 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated (6796b94518 -> 83b082dfd0)

2023-10-31 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 6796b94518 Fix small formatting changes from old version of Ruff (#35314) add 83b082dfd0 Update providers

[PR] add managed identity support to synapse hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35329: URL: https://github.com/apache/airflow/pull/35329 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to fileshare hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35330: URL: https://github.com/apache/airflow/pull/35330 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to azure datalake hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35328: URL: https://github.com/apache/airflow/pull/35328 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to azure batch hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35327: URL: https://github.com/apache/airflow/pull/35327 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to wasb hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35326: URL: https://github.com/apache/airflow/pull/35326 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to adx hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35325: URL: https://github.com/apache/airflow/pull/35325 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to asb hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35324: URL: https://github.com/apache/airflow/pull/35324 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to azure cosmos hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35323: URL: https://github.com/apache/airflow/pull/35323 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to azure data factory hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35322: URL: https://github.com/apache/airflow/pull/35322 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to azre container volume hook #35320 [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35321: URL: https://github.com/apache/airflow/pull/35321 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to azre container registry hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35320: URL: https://github.com/apache/airflow/pull/35320 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] add managed identity support to azre container instance hook [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35319: URL: https://github.com/apache/airflow/pull/35319 --- **^ Add meaningful description above** Read the **[Pull Request

Re: [I] Add `JiraNotifier` [airflow]

2023-10-31 Thread via GitHub
pubudu91 commented on issue #35261: URL: https://github.com/apache/airflow/issues/35261#issuecomment-1788351708 Hi @eladkal, I'd like to look into this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Switch from Black to Ruff formatter [airflow]

2023-10-31 Thread via GitHub
dhruvmanila commented on code in PR #35287: URL: https://github.com/apache/airflow/pull/35287#discussion_r1378344674 ## airflow/api/common/delete_dag.py: ## @@ -72,7 +72,7 @@ def delete_dag(dag_id: str, keep_records_in_log: bool = True, session: Session = ) ) -

[PR] reuse get_default_azure_credential method from azure utils for azure key valut [airflow]

2023-10-31 Thread via GitHub
Lee-W opened a new pull request, #35318: URL: https://github.com/apache/airflow/pull/35318 --- **^ Add meaningful description above** Read the **[Pull Request

(airflow) branch constraints-main updated: Updating constraints. Github run id:6714754967

2023-10-31 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 64f73b6529 Updating

Re: [PR] Add try_number to extra links query [airflow]

2023-10-31 Thread via GitHub
vchiapaikeo commented on code in PR #35317: URL: https://github.com/apache/airflow/pull/35317#discussion_r1378341742 ## airflow/www/static/js/api/useExtraLinks.ts: ## @@ -34,19 +34,22 @@ export default function useExtraLinks({ executionDate, mapIndex, extraLinks, +

[PR] Add try_number to extra links query [airflow]

2023-10-31 Thread via GitHub
vchiapaikeo opened a new pull request, #35317: URL: https://github.com/apache/airflow/pull/35317 Add try_number to extra links query closes: https://github.com/apache/airflow/issues/34623 Adds try_number to extra links query ## Test Plan

(airflow) branch main updated: Fix small formatting changes from old version of Ruff (#35314)

2023-10-31 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 6796b94518 Fix small formatting changes

Re: [PR] Fix small formatting changes from old version of Ruff [airflow]

2023-10-31 Thread via GitHub
jedcunningham merged PR #35314: URL: https://github.com/apache/airflow/pull/35314 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Add pytest-icdiff-plugin (#35315)

2023-10-31 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 16e8b80d4b Add pytest-icdiff-plugin

Re: [PR] Add pytest-icdiff-plugin [airflow]

2023-10-31 Thread via GitHub
jedcunningham merged PR #35315: URL: https://github.com/apache/airflow/pull/35315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Validate `dag.tasks` isn't empty when parsing [airflow]

2023-10-31 Thread via GitHub
jedcunningham commented on code in PR #35316: URL: https://github.com/apache/airflow/pull/35316#discussion_r1378317608 ## airflow/models/dag.py: ## @@ -746,6 +747,17 @@ def validate_setup_teardown(self): raise ValueError("Setup tasks must be followed

[PR] Validate `dag.tasks` isn't empty when parsing [airflow]

2023-10-31 Thread via GitHub
jedcunningham opened a new pull request, #35316: URL: https://github.com/apache/airflow/pull/35316 Somehow a DAG ended up in a state where `dag.tasks` was empty, but the root tasks group had an operator. I'm not sure how it got in this state, but it does kill the scheduler, and since it's

Re: [I] Extra Links not refresh by the "Auto-refresh" [airflow]

2023-10-31 Thread via GitHub
Rohxn16 commented on issue #34623: URL: https://github.com/apache/airflow/issues/34623#issuecomment-1788269220 @vchiapaikeo feel feee to do please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] Extra Links not refresh by the "Auto-refresh" [airflow]

2023-10-31 Thread via GitHub
vchiapaikeo commented on issue #34623: URL: https://github.com/apache/airflow/issues/34623#issuecomment-1788263449 @Rohxn16 , are you still working on this? Happy to take a look at it if you are no longer! -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] Grid UI Scrollbar / Cell Click Issue [airflow]

2023-10-31 Thread via GitHub
vchiapaikeo commented on issue #35074: URL: https://github.com/apache/airflow/issues/35074#issuecomment-1788241872 Hey @Adaverse , this is also really annoying for us over at Etsy as well. Please let me know if I can help at all on this! -- This is an automated message from the Apache

(airflow) branch constraints-main updated: Updating constraints. Github run id:6713604807

2023-10-31 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new bf62e4285c Updating

Re: [I] Kubernetes pod log reding [airflow]

2023-10-31 Thread via GitHub
vchiapaikeo commented on issue #35010: URL: https://github.com/apache/airflow/issues/35010#issuecomment-1788233599 Happy to take a look at this. Please feel free to assign. I can attempt to repro tmrw. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] fix(helm): safer worker pod annotations [airflow]

2023-10-31 Thread via GitHub
hakuno commented on PR #35309: URL: https://github.com/apache/airflow/pull/35309#issuecomment-1788216424 > It looks good! The failed test will be fixed by #35313; you need to merge/rebase main once the other PR is merged. All right. Thank you so! -- This is an automated message

Re: [PR] Refactor attempting loops in providers/amazons [airflow]

2023-10-31 Thread via GitHub
github-actions[bot] commented on PR #34053: URL: https://github.com/apache/airflow/pull/34053#issuecomment-1788203228 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [I] Skipping an Airflow task make the dynamic task skipped too even with TriggerRule.NONE_FAILED [airflow]

2023-10-31 Thread via GitHub
github-actions[bot] commented on issue #34754: URL: https://github.com/apache/airflow/issues/34754#issuecomment-1788203158 This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further

[PR] Add pytest-icdiff-plugin [airflow]

2023-10-31 Thread via GitHub
potiuk opened a new pull request, #35315: URL: https://github.com/apache/airflow/pull/35315 The Pytest-icdiff plugin produces much more readable, coloured diffs from failed essertions. --- **^ Add meaningful description above** Read the **[Pull

Re: [PR] Add pyspark decorator [airflow]

2023-10-31 Thread via GitHub
hussein-awala commented on PR #35247: URL: https://github.com/apache/airflow/pull/35247#issuecomment-1788188450 Merge main to check if the tests pass after Jarek PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Resolve `botocore.UNSIGNED` and `unsigned` in Amazon Provider [airflow]

2023-10-31 Thread via GitHub
o-nikolas commented on code in PR #35305: URL: https://github.com/apache/airflow/pull/35305#discussion_r1378255380 ## airflow/providers/amazon/aws/utils/boto.py: ## @@ -0,0 +1,65 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

(airflow) branch main updated (905e2249a8 -> b987a4a68f)

2023-10-31 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 905e2249a8 Disable common.io as preinstalled provider before we cut-off 2.8 branch (#35313) add b987a4a68f

Re: [PR] Fix Update providers metadata in README_RELEASE_PROVIDER_PACKAGES.md [airflow]

2023-10-31 Thread via GitHub
hussein-awala merged PR #35311: URL: https://github.com/apache/airflow/pull/35311 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] (AIP-44) Migrate TaskCommand._get_ti to Internal API [airflow]

2023-10-31 Thread via GitHub
hussein-awala commented on code in PR #35312: URL: https://github.com/apache/airflow/pull/35312#discussion_r1378253597 ## airflow/api/common/experimental/get_task_instance.py: ## @@ -42,5 +42,6 @@ def get_task_instance(dag_id: str, task_id: str, execution_date: datetime) -> Ta

[PR] Fix small formatting changes from old version of Ruff [airflow]

2023-10-31 Thread via GitHub
jlaneve opened a new pull request, #35314: URL: https://github.com/apache/airflow/pull/35314 As a follow-on to https://github.com/apache/airflow/pull/35287, there were a few minor formatting issues that came from running an old version of Ruff. Those formatting changes were

(airflow) branch main updated: Disable common.io as preinstalled provider before we cut-off 2.8 branch (#35313)

2023-10-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 905e2249a8 Disable common.io as preinstalled

Re: [PR] Disable common.io as preinstalled provider before we cut-off 2.8 branch [airflow]

2023-10-31 Thread via GitHub
potiuk merged PR #35313: URL: https://github.com/apache/airflow/pull/35313 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Use base aws classes in AWS Batch Operators/Sensors/Triggers [airflow]

2023-10-31 Thread via GitHub
Taragolis closed pull request #35226: Use base aws classes in AWS Batch Operators/Sensors/Triggers URL: https://github.com/apache/airflow/pull/35226 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Use base aws classes in AWS Batch Operators/Sensors/Triggers [airflow]

2023-10-31 Thread via GitHub
Taragolis commented on PR #35226: URL: https://github.com/apache/airflow/pull/35226#issuecomment-1788167258 Yet another tab vs spaces and ' vs " -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Use base aws classes in AWS Batch Operators/Sensors/Triggers [airflow]

2023-10-31 Thread via GitHub
o-nikolas commented on code in PR #35226: URL: https://github.com/apache/airflow/pull/35226#discussion_r1378245972 ## tests/providers/amazon/aws/sensors/test_batch.py: ## @@ -29,59 +30,86 @@ ) from airflow.providers.amazon.aws.triggers.batch import BatchJobTrigger +if

[PR] Disable common.io as preinstalled provider before we cut-off 2.8 branch [airflow]

2023-10-31 Thread via GitHub
potiuk opened a new pull request, #35313: URL: https://github.com/apache/airflow/pull/35313 We need to do it in order to be able to generate PyPI constraints, because common.io has apache-airflow>=2.8.0 requirement that conflicts with the current 2.8.0dev0

Re: [PR] Switch from Black to Ruff formatter [airflow]

2023-10-31 Thread via GitHub
kaxil merged PR #35287: URL: https://github.com/apache/airflow/pull/35287 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Switch from Black to Ruff formatter [airflow]

2023-10-31 Thread via GitHub
kaxil commented on PR #35287: URL: https://github.com/apache/airflow/pull/35287#issuecomment-1788142100 The current constraints failure is unrelated and affects other PRs too, example https://github.com/apache/airflow/pull/35312 , merging this PR -- This is an automated message from the

Re: [I] [helm] `strategy.type=Recreate` not fully supported by all deployments [airflow]

2023-10-31 Thread via GitHub
jiajie-chen commented on issue #35227: URL: https://github.com/apache/airflow/issues/35227#issuecomment-1788126499 @hakuno Thanks for the advice. I did see that `workers.strategy.rollingUpdate` has a default value set, while `scheduler.strategy` was set to `~`. This led me to try

Re: [I] logging/remote_logging - option to disable creation of cloudwatch log groups [airflow]

2023-10-31 Thread via GitHub
o-nikolas commented on issue #35164: URL: https://github.com/apache/airflow/issues/35164#issuecomment-1788121752 I think we're trying to resolve a non-existing problem here. The only reason throttling happened in this case was because of the issues with the Role. We do not generally see

Re: [PR] Add extra operator links for EMR Serverless [airflow]

2023-10-31 Thread via GitHub
o-nikolas commented on code in PR #34225: URL: https://github.com/apache/airflow/pull/34225#discussion_r1378208805 ## airflow/providers/amazon/aws/links/emr.py: ## @@ -66,3 +82,98 @@ def get_log_uri( return None log_uri =

Re: [I] logging/remote_logging - option to disable creation of cloudwatch log groups [airflow]

2023-10-31 Thread via GitHub
Taragolis commented on issue #35164: URL: https://github.com/apache/airflow/issues/35164#issuecomment-1788106289 My 50 cents. It is a classical Chicken And Egg problem. For write into the CloudWatch Logs you need to have Log Groups, so you need to check is this log group exists or not

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
potiuk commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1788091610 Yeah. Why not :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
Taragolis commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1788084789 Maybe it is a good time to think about old issue https://github.com/apache/airflow/issues/7870 -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
potiuk commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1788073199 Yes. It's very likely about old version and pendulum. Unfortunately beam is rather tightly pinning dill:

Re: [PR] (AIP-44) Migrate TaskCommand._get_ti to Internal API [airflow]

2023-10-31 Thread via GitHub
mhenc commented on PR #35312: URL: https://github.com/apache/airflow/pull/35312#issuecomment-1788068521 cc: @potiuk @vincbeck -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] (AIP-44) Migrate TaskCommand._get_ti to Internal API [airflow]

2023-10-31 Thread via GitHub
mhenc opened a new pull request, #35312: URL: https://github.com/apache/airflow/pull/35312 Change TaskCommand._get_ti to return either TaskInstance or TaskInstancePydantic, making sure it calls the InternalAPI in dbless mode. Some CLI commands, despite calling TaskCommand._get_ti

(airflow) branch main updated: Improve docs on objectstorage (#35294)

2023-10-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 69bac3fba8 Improve docs on objectstorage (#35294)

Re: [PR] Improve docs on objectstorage [airflow]

2023-10-31 Thread via GitHub
potiuk merged PR #35294: URL: https://github.com/apache/airflow/pull/35294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] Fix Update providers metadata in README_RELEASE_PROVIDER_PACKAGES.md [airflow]

2023-10-31 Thread via GitHub
eladkal opened a new pull request, #35311: URL: https://github.com/apache/airflow/pull/35311 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] apache-airflow-providers-databricks==4.3.0 breaks xcom parsing [airflow]

2023-10-31 Thread via GitHub
gustavohwulee commented on issue #35308: URL: https://github.com/apache/airflow/issues/35308#issuecomment-1788054295 On the OSS version there are no issues. I'll close this issue and open a ticket on AWS Support

Re: [I] apache-airflow-providers-databricks==4.3.0 breaks xcom parsing [airflow]

2023-10-31 Thread via GitHub
gustavohwulee closed issue #35308: apache-airflow-providers-databricks==4.3.0 breaks xcom parsing URL: https://github.com/apache/airflow/issues/35308 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[PR] Update providers metadata 2023-10-31 [airflow]

2023-10-31 Thread via GitHub
eladkal opened a new pull request, #35310: URL: https://github.com/apache/airflow/pull/35310 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] [helm] default broker url doesn't match Redis service name [airflow]

2023-10-31 Thread via GitHub
jiajie-chen commented on issue #35201: URL: https://github.com/apache/airflow/issues/35201#issuecomment-1788048687 Thanks, that PR looks like it resolved the issue I saw with Redis naming. Is there a similar PR that addresses the issue when `.Values.ports.redisDB` is not set to

Re: [I] logging/remote_logging - option to disable creation of cloudwatch log groups [airflow]

2023-10-31 Thread via GitHub
o-nikolas commented on issue #35164: URL: https://github.com/apache/airflow/issues/35164#issuecomment-1788043297 I don't think the best course of action is to disable this feature. For the vast majority of the time this feature works great and sets up the log groups seamlessly for users.

Re: [PR] Add back FAB backends used in webserver config [airflow]

2023-10-31 Thread via GitHub
jedcunningham commented on code in PR #35302: URL: https://github.com/apache/airflow/pull/35302#discussion_r1378161817 ## airflow/www/fab_security/manager.py: ## @@ -63,6 +63,35 @@ # Copyright 2013, Daniel Vaz Gaspar log = logging.getLogger(__name__) +__lazy_imports = { +

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
Taragolis commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1788030750 Assumption 1 --- Maybe it happen because we use

Re: [PR] Improve testing harness to separate DB and non-DB tests [airflow]

2023-10-31 Thread via GitHub
potiuk commented on PR #35160: URL: https://github.com/apache/airflow/pull/35160#issuecomment-1788018589 BOOM ,, MERGED -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Improve testing harness to separate DB and non-DB tests [airflow]

2023-10-31 Thread via GitHub
potiuk merged PR #35160: URL: https://github.com/apache/airflow/pull/35160 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] apache-airflow-providers-databricks==4.3.0 breaks xcom parsing [airflow]

2023-10-31 Thread via GitHub
gustavohwulee commented on issue #35308: URL: https://github.com/apache/airflow/issues/35308#issuecomment-1787999727 @Taragolis I've made some tests, this were the result MWAA 2.6.3 + Databricks 4.0.0 -> OK MWAA 2.6.3 + Databricks 4.3.0 -> BUG MWAA 2.6.3 + Databricks 4.3.3 -> BUG

[PR] fix(helm): safer worker pod annotations [airflow]

2023-10-31 Thread via GitHub
hakuno opened a new pull request, #35309: URL: https://github.com/apache/airflow/pull/35309 Hey, you all. How are you doing? It's an initiative of https://github.com/apache/airflow/pull/35130 This PR brings two things: 1. Values `workers.podAnnotations` and

Re: [I] Status of testing Providers that were prepared on October 28, 2023 [airflow]

2023-10-31 Thread via GitHub
eladkal commented on issue #35240: URL: https://github.com/apache/airflow/issues/35240#issuecomment-1787989625 Thank you everyone. Providers are released I invite everyone to help improve providers for the next release, a list of open issues can be found

Re: [I] Status of testing Providers that were prepared on October 28, 2023 [airflow]

2023-10-31 Thread via GitHub
eladkal closed issue #35240: Status of testing Providers that were prepared on October 28, 2023 URL: https://github.com/apache/airflow/issues/35240 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

(airflow-site) branch add-documentation-2023-10-28 deleted (was 562df6712d)

2023-10-31 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2023-10-28 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 562df6712d Add documentation for packages - 2023-10-28 The revisions that were on this

Re: [PR] Add documentation for packages - 2023-10-28 [airflow-site]

2023-10-31 Thread via GitHub
eladkal merged PR #885: URL: https://github.com/apache/airflow-site/pull/885 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] apache-airflow-providers-databricks==4.3.0 breaks xcom parsing [airflow]

2023-10-31 Thread via GitHub
Taragolis commented on issue #35308: URL: https://github.com/apache/airflow/issues/35308#issuecomment-1787982546 @gustavohwulee Just wondering did you test it on OSS version of Airflow and did you tried another versions of [databricks

Re: [PR] Clarify "task" in ECS Executor log messages [airflow]

2023-10-31 Thread via GitHub
ferruzzi commented on PR #35304: URL: https://github.com/apache/airflow/pull/35304#issuecomment-1787980098 Niko and Syed already saw this and approved it in person. With Elad's approval added above, I'm just going to merge it. -- This is an automated message from the Apache Git

(airflow) branch main updated (90953d1e2f -> 651b32606c)

2023-10-31 Thread ferruzzi
This is an automated email from the ASF dual-hosted git repository. ferruzzi pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 90953d1e2f Allow non-str value for path concat (#35290) add 651b32606c Clarify "task" in ECS Executor log

Re: [PR] Clarify "task" in ECS Executor log messages [airflow]

2023-10-31 Thread via GitHub
ferruzzi merged PR #35304: URL: https://github.com/apache/airflow/pull/35304 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

svn commit: r64958 - /dev/airflow/providers/ /release/airflow/providers/

2023-10-31 Thread eladkal
Author: eladkal Date: Tue Oct 31 20:20:21 2023 New Revision: 64958 Log: Release Airflow Providers on 2023-10-31 Added: release/airflow/providers/apache-airflow-providers-amazon-8.10.0.tar.gz - copied unchanged from r64957,

(airflow) branch main updated: Allow non-str value for path concat (#35290)

2023-10-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 90953d1e2f Allow non-str value for path concat

Re: [PR] Allow non-str value for path concat [airflow]

2023-10-31 Thread via GitHub
potiuk merged PR #35290: URL: https://github.com/apache/airflow/pull/35290 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] apache-airflow-providers-databricks==4.3.0 breaks xcom parsing [airflow]

2023-10-31 Thread via GitHub
Taragolis commented on issue #35308: URL: https://github.com/apache/airflow/issues/35308#issuecomment-1787958937 Let me add link to previous one issue: https://github.com/apache/airflow/issues/35197#issuecomment-1785715171 -- This is an automated message from the Apache Git Service. To

Re: [PR] Bump MySQL Innovation Release to 8.2 [airflow]

2023-10-31 Thread via GitHub
potiuk commented on PR #35286: URL: https://github.com/apache/airflow/pull/35286#issuecomment-1787957153 > Maybe in README replace 8.2 to Innovation? Yep. That will be good I think. -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] Hide logical date and run id in trigger UI form [airflow]

2023-10-31 Thread via GitHub
potiuk commented on PR #35284: URL: https://github.com/apache/airflow/pull/35284#issuecomment-1787955296 I like it. No good knowledge to comment on the code, but the ideas here are good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Bump MySQL Innovation Release to 8.2 [airflow]

2023-10-31 Thread via GitHub
Taragolis commented on PR #35286: URL: https://github.com/apache/airflow/pull/35286#issuecomment-1787954571 > And. I prefer manual dump in this case to be honest - even if it's a little annoying - it wil have more predictability. Ahhh.. that would be a nice way to break our main due

Re: [PR] Improve test coverage for the rest api modules [airflow]

2023-10-31 Thread via GitHub
Jorricks commented on PR #35219: URL: https://github.com/apache/airflow/pull/35219#issuecomment-1787954418 > except MultipleResultsFound: Yes I vaguely remember this and thinking as well that it should never be possible that it would get two results back. If it did, it would be a

[I] apache-airflow-providers-databricks==4.3.0 breaks xcom parsing [airflow]

2023-10-31 Thread via GitHub
gustavohwulee opened a new issue, #35308: URL: https://github.com/apache/airflow/issues/35308 ### Apache Airflow version Other Airflow 2 version (please specify below) ### What happened We upgraded from airflow 2.5.1 to airflow 2.6.3 and noticed that tuples returned in

Re: [PR] Resolve `botocore.UNSIGNED` and `unsigned` in Amazon Provider [airflow]

2023-10-31 Thread via GitHub
Taragolis commented on code in PR #35305: URL: https://github.com/apache/airflow/pull/35305#discussion_r1378103328 ## airflow/providers/amazon/aws/utils/boto.py: ## @@ -0,0 +1,65 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

Re: [PR] Add back FAB backends used in webserver config [airflow]

2023-10-31 Thread via GitHub
potiuk commented on code in PR #35302: URL: https://github.com/apache/airflow/pull/35302#discussion_r1378100220 ## airflow/www/fab_security/manager.py: ## @@ -63,6 +63,35 @@ # Copyright 2013, Daniel Vaz Gaspar log = logging.getLogger(__name__) +__lazy_imports = { +

(airflow) branch constraints-2-7 updated: Updating constraints. Github run id:6710944857

2023-10-31 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-7 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-7 by this push: new 4060361baa Updating

Re: [PR] Improve docs on objectstorage [airflow]

2023-10-31 Thread via GitHub
potiuk commented on code in PR #35294: URL: https://github.com/apache/airflow/pull/35294#discussion_r1378087328 ## docs/apache-airflow/core-concepts/objectstorage.rst: ## @@ -38,6 +44,21 @@ scheme. it depends on ``aiobotocore``, which is not installed by default as it can

(airflow) branch main updated: Add notes about Virtualenvs preventing the need for custom images (#35306)

2023-10-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e95156c26d Add notes about Virtualenvs preventing

Re: [PR] Add notes about Virtualenvs preventing the need for custom images [airflow]

2023-10-31 Thread via GitHub
potiuk merged PR #35306: URL: https://github.com/apache/airflow/pull/35306 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Resolve `botocore.UNSIGNED` and `unsigned` in Amazon Provider [airflow]

2023-10-31 Thread via GitHub
eladkal commented on code in PR #35305: URL: https://github.com/apache/airflow/pull/35305#discussion_r1378068831 ## airflow/providers/amazon/aws/utils/boto.py: ## @@ -0,0 +1,65 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

Re: [I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
potiuk commented on issue #35307: URL: https://github.com/apache/airflow/issues/35307#issuecomment-1787874790 Detected it while improving our test suite - I found out that we have not run the `PlainAssert` tests for a while and well, of course it turned out that Python 3.11 has problem

[I] Dill fails to serialize context in Python 3.11 correctly [airflow]

2023-10-31 Thread via GitHub
potiuk opened a new issue, #35307: URL: https://github.com/apache/airflow/issues/35307 ### Body There is a regression that needs investigation. One of our tests is failing only on Python 3.11 `tests/operators/test_python.py::TestPythonVirtualenvOperator::test_airflow_context`

[PR] Add notes about Virtualenvs preventing the need for custom images [airflow]

2023-10-31 Thread via GitHub
jens-scheffler-bosch opened a new pull request, #35306: URL: https://github.com/apache/airflow/pull/35306 This PR adds some hints into the docs that custom images are not needed if Python Virtualenvs can be used. -- This is an automated message from the Apache Git Service. To respond to

  1   2   3   >