Re: [PR] Add a method to find end date for previous success TI [airflow]

2023-11-01 Thread via GitHub
Bowrna closed pull request #34528: Add a method to find end date for previous success TI URL: https://github.com/apache/airflow/pull/34528 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] heartbeat recovery message [airflow]

2023-11-01 Thread via GitHub
Bowrna commented on code in PR #34457: URL: https://github.com/apache/airflow/pull/34457#discussion_r1379620724 ## airflow/jobs/job.py: ## @@ -213,9 +218,12 @@ def heartbeat( session.merge(self) self.latest_heartbeat = timezone.utcnow()

[PR] Add a method to find end date for previous success TI [airflow]

2023-11-01 Thread via GitHub
Bowrna opened a new pull request, #34528: URL: https://github.com/apache/airflow/pull/34528 related: #33375 closes: #33375 --- **^ Add meaningful description above** Read the **[Pull Request

Re: [PR] Add a method to find end date for previous success TI [airflow]

2023-11-01 Thread via GitHub
Bowrna closed pull request #34528: Add a method to find end date for previous success TI URL: https://github.com/apache/airflow/pull/34528 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Trino: support config timezone [airflow]

2023-11-01 Thread via GitHub
eladkal commented on PR #35147: URL: https://github.com/apache/airflow/pull/35147#issuecomment-1790043336 @duyet can you please add a unit test? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Add pagination to `HttpOperator` and make it more modular [airflow]

2023-11-01 Thread via GitHub
eladkal commented on PR #34669: URL: https://github.com/apache/airflow/pull/34669#issuecomment-1790016355 > Propose to make this into 2.8.0 This PR is part of peoviders code base thus its not part of Airflow core. In providers any merged PR is released in following cycle. -- This

Re: [PR] Fixes typing in `get_provider_name_from_short_hand` and its uses [airflow]

2023-11-01 Thread via GitHub
carterjfulcher commented on PR #34507: URL: https://github.com/apache/airflow/pull/34507#issuecomment-1790009225 > And static checks should be fixed. Fixed @potiuk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [I] Would it be possible to add 'name' to the list of template fields for EmrServerlessStartJobOperator? [airflow]

2023-11-01 Thread via GitHub
eladkal commented on issue #35341: URL: https://github.com/apache/airflow/issues/35341#issuecomment-1790005650 cc @dacort -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] Pgbouncer not set properly upon using data.metadataSecretName [airflow]

2023-11-01 Thread via GitHub
eladkal commented on issue #33924: URL: https://github.com/apache/airflow/issues/33924#issuecomment-178729 @hakuno if you have the time to look into this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] [helm] default broker url doesn't match Redis service name [airflow]

2023-11-01 Thread via GitHub
eladkal commented on issue #35201: URL: https://github.com/apache/airflow/issues/35201#issuecomment-1789995484 Fixed in https://github.com/apache/airflow/pull/34825 > I can push a PR with tests when I have time, if it's not currently being worked on. PRs are always welcome

Re: [I] [helm] default broker url doesn't match Redis service name [airflow]

2023-11-01 Thread via GitHub
eladkal closed issue #35201: [helm] default broker url doesn't match Redis service name URL: https://github.com/apache/airflow/issues/35201 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] helm chart doesn't support securityContext for airflow-run-airflow-migration and dag-processor init container [airflow]

2023-11-01 Thread via GitHub
eladkal commented on issue #34595: URL: https://github.com/apache/airflow/issues/34595#issuecomment-1789994285 > As there was a parallel BugReport for security context in OpenShift in #34599 does this belong together? It was closed as invalid

Re: [I] [helm] `strategy.type=Recreate` not fully supported by all deployments [airflow]

2023-11-01 Thread via GitHub
hakuno commented on issue #35227: URL: https://github.com/apache/airflow/issues/35227#issuecomment-1789971069 @jiajie-chen > However, I think it would be nice to have consistent configuration defaults for strategy. Yes, I think so. -- This is an automated message from the

[PR] fix(helm): add recreate strategy support [airflow]

2023-11-01 Thread via GitHub
hakuno opened a new pull request, #35362: URL: https://github.com/apache/airflow/pull/35362 closes: https://github.com/apache/airflow/issues/35227 Currently, these values don't support Recreate type. - `workers.strategy.type=Recreate` - `triggerer.strategy.type=Recreate`

Re: [I] Config-as-code for roles and access controls [airflow]

2023-11-01 Thread via GitHub
github-actions[bot] commented on issue #34718: URL: https://github.com/apache/airflow/issues/34718#issuecomment-1789860858 This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further

Re: [PR] Update SECURITY.md [airflow]

2023-11-01 Thread via GitHub
github-actions[bot] commented on PR #34439: URL: https://github.com/apache/airflow/pull/34439#issuecomment-1789860879 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [PR] Fix mapped task not waiting for upstream mapped to complete [airflow]

2023-11-01 Thread via GitHub
github-actions[bot] closed pull request #34138: Fix mapped task not waiting for upstream mapped to complete URL: https://github.com/apache/airflow/pull/34138 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] bump debian to bookworm [airflow]

2023-11-01 Thread via GitHub
potiuk commented on PR #32004: URL: https://github.com/apache/airflow/pull/32004#issuecomment-1789856336 BTW. Yes. i think it's about enough time after bookworm was released (more than year) to get all the "other" software to catch up already (without us loosing time on it). As

Re: [PR] bump debian to bookworm [airflow]

2023-11-01 Thread via GitHub
potiuk commented on PR #32004: URL: https://github.com/apache/airflow/pull/32004#issuecomment-1789845152 > But you need "committer" privileges for it. > @potiuk or @Taragolis what should we do about that ? thanks I think you should be able push your change as "main" to your fork,

[I] Dynamic Task Mapping: transforming dict data with map results in KeyError [airflow]

2023-11-01 Thread via GitHub
sc-anssi opened a new issue, #35361: URL: https://github.com/apache/airflow/issues/35361 ### Apache Airflow version 2.7.2 ### What happened Trying to map over a dict instead of a list results in a KeyError (the following backtrace is issued when running the DAG below

Re: [PR] Fix Scheduler and triggerer crashes in daemon mode when statsd metrics are enabled [airflow]

2023-11-01 Thread via GitHub
potiuk commented on PR #35181: URL: https://github.com/apache/airflow/pull/35181#issuecomment-1789835536 > Yes @potiuk I've verified all cases and works without any issue Which cases? out of curiosity? Do you know exactly what causes the problem in the first place? -- This is an

Re: [I] Dynamic Task Mapping: transforming dict data with map results in KeyError [airflow]

2023-11-01 Thread via GitHub
boring-cyborg[bot] commented on issue #35361: URL: https://github.com/apache/airflow/issues/35361#issuecomment-1789835413 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

(airflow) branch main updated: Update webserver.rst to include information of supported OAuth2 providers (#35237)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 283fb9fd31 Update webserver.rst to include

Re: [PR] Update webserver.rst to include information of supported OAuth2 providers [airflow]

2023-11-01 Thread via GitHub
boring-cyborg[bot] commented on PR #35237: URL: https://github.com/apache/airflow/pull/35237#issuecomment-1789834017 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional

Re: [I] Support for general OIDC providers or making it clear in document [airflow]

2023-11-01 Thread via GitHub
potiuk closed issue #35131: Support for general OIDC providers or making it clear in document URL: https://github.com/apache/airflow/issues/35131 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Update webserver.rst to include information of supported OAuth2 providers [airflow]

2023-11-01 Thread via GitHub
potiuk merged PR #35237: URL: https://github.com/apache/airflow/pull/35237 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Include debug information in more dagbag warnings [airflow]

2023-11-01 Thread via GitHub
potiuk commented on issue #33853: URL: https://github.com/apache/airflow/issues/33853#issuecomment-1789832354 Feel free. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

(airflow) branch constraints-main updated: Updating constraints. Github run id:6725713553

2023-11-01 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 78d39dcf7b Updating

(airflow) branch main updated: Fix changelog for Dockerfile with 2.7.3 cherry-pick (#35359)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 554e3c9c27 Fix changelog for Dockerfile with 2.7.3

Re: [PR] Fix changelog for Dockerfile with 2.7.3 cherry-pick [airflow]

2023-11-01 Thread via GitHub
potiuk merged PR #35359: URL: https://github.com/apache/airflow/pull/35359 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch constraints-2-7 updated: Updating constraints. Github run id:6725125104

2023-11-01 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-7 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-7 by this push: new c0d764a566 Updating

Re: [PR] Add `@final` decorator to DAG class [airflow]

2023-11-01 Thread via GitHub
potiuk commented on PR #35360: URL: https://github.com/apache/airflow/pull/35360#issuecomment-1789737980 See my follow-up in https://github.com/apache/airflow/discussions/31974#discussioncomment-6203057 My point is not that DAG should be final, but when you extend it you need to

Re: [PR] Add `@final` decorator to DAG class [airflow]

2023-11-01 Thread via GitHub
Taragolis commented on PR #35360: URL: https://github.com/apache/airflow/pull/35360#issuecomment-1789716824 > This is a breaking change where it could fail the Mypy test for the users who already subclass the DAG class. Not sure that static check could be counted as breaking change,

Re: [I] Include debug information in more dagbag warnings [airflow]

2023-11-01 Thread via GitHub
tsafacjo commented on issue #33853: URL: https://github.com/apache/airflow/issues/33853#issuecomment-1789704543 can I take this issue ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Relax mandatory requirement for start_date when schedule=None [airflow]

2023-11-01 Thread via GitHub
hussein-awala commented on code in PR #35356: URL: https://github.com/apache/airflow/pull/35356#discussion_r1379343241 ## tests/models/test_dag.py: ## @@ -827,6 +827,15 @@ def test_following_schedule_datetime_timezone(self): when = dag.following_schedule(start)

Re: [I] BaseBranchOperator should allow passing of a Taskgroup group_id. [airflow]

2023-11-01 Thread via GitHub
tsafacjo commented on issue #34526: URL: https://github.com/apache/airflow/issues/34526#issuecomment-1789700434 can I take this issue ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Add `@final` decorator to DAG class [airflow]

2023-11-01 Thread via GitHub
Taragolis closed pull request #35360: Add `@final` decorator to DAG class URL: https://github.com/apache/airflow/pull/35360 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Add `@final` decorator to DAG class [airflow]

2023-11-01 Thread via GitHub
Taragolis commented on PR #35360: URL: https://github.com/apache/airflow/pull/35360#issuecomment-1789695369 Better luck next time -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Add tests to `airflow/auth/managers/fab/decorators/auth.py` [airflow]

2023-11-01 Thread via GitHub
ephraimbuddy commented on code in PR #35358: URL: https://github.com/apache/airflow/pull/35358#discussion_r1379337932 ## tests/auth/managers/fab/decorators/test_auth.py: ## @@ -0,0 +1,141 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

Re: [PR] Add `@final` decorator to DAG class [airflow]

2023-11-01 Thread via GitHub
Taragolis commented on PR #35360: URL: https://github.com/apache/airflow/pull/35360#issuecomment-1789693925 A SerializedDAG  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Add tests to `airflow/auth/managers/fab/decorators/auth.py` [airflow]

2023-11-01 Thread via GitHub
ephraimbuddy commented on code in PR #35358: URL: https://github.com/apache/airflow/pull/35358#discussion_r1379337932 ## tests/auth/managers/fab/decorators/test_auth.py: ## @@ -0,0 +1,141 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

(airflow) 06/07: Fix pre-mature evaluation of tasks in mapped task group (#34337)

2023-11-01 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit e6662d0a59ea5277e0244bdae48cd670aa90bf95 Author: Ephraim Anierobi AuthorDate: Wed Nov 1 21:37:15 2023

(airflow) branch v2-7-test updated (9c88daeed3 -> f124353783)

2023-11-01 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 9c88daeed3 Use slightly nicer job name for Non-DB tests in CI (#35333) omit e5af6be625 Add pip

(airflow) 04/07: Add pip caching for faster build (#35026)

2023-11-01 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit fb2fcfeda72e919be5dc8d2a9aabe930bfadc32f Author: Arthur <37664438+v0lan...@users.noreply.github.com>

(airflow) 01/07: Upper bound `pendulum` requirement to <3.0 (#35336)

2023-11-01 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit c933cb81928f2a8a73ee6620841b4eb86a28abc8 Author: Andrey Anshin AuthorDate: Wed Nov 1 15:30:08 2023 +0400

(airflow) 07/07: Update RELEASE_NOTES.rst

2023-11-01 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit f1243537838516b8bb8156130bc001595bfbeb01 Author: Ephraim Anierobi AuthorDate: Mon Oct 30 12:24:12 2023

(airflow) 05/07: Use slightly nicer job name for Non-DB tests in CI (#35333)

2023-11-01 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 836ef42fc9eb1766450231e7ada4683bc601c21a Author: Jarek Potiuk AuthorDate: Wed Nov 1 09:15:55 2023 +0100

[PR] Add @final decorator to DAG class [airflow]

2023-11-01 Thread via GitHub
Taragolis opened a new pull request, #35360: URL: https://github.com/apache/airflow/pull/35360 Make DAG as [final classe](https://docs.python.org/3/library/typing.html#typing.final), it is just helper decorator for static checks and IDE and could be use for inform end

(airflow) branch main updated: Fix pre-mature evaluation of tasks in mapped task group (#34337)

2023-11-01 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 69938fd163 Fix pre-mature evaluation of

Re: [I] Trigger Rule ONE_FAILED does not work in task group with mapped tasks [airflow]

2023-11-01 Thread via GitHub
ephraimbuddy closed issue #34023: Trigger Rule ONE_FAILED does not work in task group with mapped tasks URL: https://github.com/apache/airflow/issues/34023 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Fix pre-mature evaluation of tasks in mapped task group [airflow]

2023-11-01 Thread via GitHub
ephraimbuddy merged PR #34337: URL: https://github.com/apache/airflow/pull/34337 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Logs no longer shown after task completed CeleryExecutor [airflow]

2023-11-01 Thread via GitHub
potiuk commented on issue #31059: URL: https://github.com/apache/airflow/issues/31059#issuecomment-1789627263 PLese open a new issue about it and add all details -what you see in your logs, what configuration you have etc. etc. All the things that can help to diagnose your issue. This is

Re: [PR] Fix changelog for Dockerfile with 2.7.3 cherry-pick [airflow]

2023-11-01 Thread via GitHub
potiuk commented on PR #35359: URL: https://github.com/apache/airflow/pull/35359#issuecomment-1789610512 cc: @V0lantis -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] Fix changelog for Dockerfile with 2.7.3 cherry-pick [airflow]

2023-11-01 Thread via GitHub
potiuk opened a new pull request, #35359: URL: https://github.com/apache/airflow/pull/35359 The #35026 has been cherry-picked to 2.7.3 (with updated changelog) so we need to also update changelog in main. --- **^ Add meaningful description above**

(airflow) branch v2-7-test updated (33f5d29e77 -> 9c88daeed3)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 33f5d29e77 Use slightly nicer job name for Non-DB tests in CI (#35333) omit d03df712a9 Add pip caching for

(airflow) 02/03: Add pip caching for faster build (#35026)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit e5af6be62597051d87259f428f220afc10d1998b Author: Arthur <37664438+v0lan...@users.noreply.github.com> AuthorDate: Tue

(airflow) 03/03: Use slightly nicer job name for Non-DB tests in CI (#35333)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 9c88daeed35171435610d5e21c201f7769533c9f Author: Jarek Potiuk AuthorDate: Wed Nov 1 09:15:55 2023 +0100 Use

Re: [I] Logs no longer shown after task completed CeleryExecutor [airflow]

2023-11-01 Thread via GitHub
MartinLutherdale commented on issue #31059: URL: https://github.com/apache/airflow/issues/31059#issuecomment-1789597529 I am experiencing the same issue with v2.7.2. ![Screenshot 2023-11-02 at 04 06

Re: [PR] Sync v2-7-stable with v2-7-test to release 2.7.3 [airflow]

2023-11-01 Thread via GitHub
potiuk commented on PR #35270: URL: https://github.com/apache/airflow/pull/35270#issuecomment-1789596501 Hey @ephraimbuddy - > As discussed: I cherry-picked few more changes - I marked them with milestone and classified, but have not updated RELEASE_NOTES - I will leave it up to you:

(airflow) 02/02: Use slightly nicer job name for Non-DB tests in CI (#35333)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 33f5d29e77222b71a3a3b36de9481371af624534 Author: Jarek Potiuk AuthorDate: Wed Nov 1 09:15:55 2023 +0100 Use

(airflow) branch v2-7-test updated (8fcef7e14a -> 33f5d29e77)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 8fcef7e14a Use slightly nicer job name for Non-DB tests in CI (#35333) omit fe1d8f4969 Add pip caching for

Re: [PR] Add extra operator links for EMR Serverless [airflow]

2023-11-01 Thread via GitHub
dacort commented on code in PR #34225: URL: https://github.com/apache/airflow/pull/34225#discussion_r1379278127 ## airflow/providers/amazon/aws/links/emr.py: ## @@ -66,3 +82,98 @@ def get_log_uri( return None log_uri = S3Hook.parse_s3_url(cluster_info["LogUri"])

(airflow) 01/02: Add pip caching for faster build (#35026)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit d03df712a98b8a6bf70400765d1fb5522b8245df Author: Arthur <37664438+v0lan...@users.noreply.github.com> AuthorDate: Tue

(airflow) branch main updated: Move methods used only in FAB from security managers to auth manager (#35203)

2023-11-01 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c2046245c0 Move methods used only in FAB from

Re: [PR] Move methods used only in FAB from security managers to auth manager [airflow]

2023-11-01 Thread via GitHub
vincbeck merged PR #35203: URL: https://github.com/apache/airflow/pull/35203 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] Add tests to `airflow/auth/managers/fab/decorators/auth.py` [airflow]

2023-11-01 Thread via GitHub
vincbeck opened a new pull request, #35358: URL: https://github.com/apache/airflow/pull/35358 Add tests to the module `airflow/auth/managers/fab/decorators/auth.py`. Part of the effort of #35127 --- **^ Add meaningful description above** Read the

(airflow) 04/05: Add pip caching for faster build (#35026)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit fe1d8f4969b309771e78db5e840ed0e30e532800 Author: Arthur <37664438+v0lan...@users.noreply.github.com> AuthorDate: Tue

(airflow) 01/05: Upper bound `pendulum` requirement to <3.0 (#35336)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit c2f519049170d656a7144f585a045d06a0ee7d38 Author: Andrey Anshin AuthorDate: Wed Nov 1 15:30:08 2023 +0400 Upper

(airflow) 05/05: Use slightly nicer job name for Non-DB tests in CI (#35333)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 8fcef7e14adcdf3648e4299522ffc0642649105f Author: Jarek Potiuk AuthorDate: Wed Nov 1 09:15:55 2023 +0100 Use

(airflow) branch v2-7-test updated (41178d9534 -> 8fcef7e14a)

2023-11-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git from 41178d9534 Update RELEASE_NOTES.rst new c2f5190491 Upper bound `pendulum` requirement to <3.0 (#35336)

Re: [PR] Add extra operator links for EMR Serverless [airflow]

2023-11-01 Thread via GitHub
dacort commented on code in PR #34225: URL: https://github.com/apache/airflow/pull/34225#discussion_r1379221966 ## airflow/providers/amazon/aws/links/emr.py: ## @@ -66,3 +82,98 @@ def get_log_uri( return None log_uri = S3Hook.parse_s3_url(cluster_info["LogUri"])

Re: [PR] Relax mandatory requirement for start_date when schedule=None [airflow]

2023-11-01 Thread via GitHub
vishnucoder1 commented on code in PR #35356: URL: https://github.com/apache/airflow/pull/35356#discussion_r1379203897 ## tests/models/test_dag.py: ## @@ -827,6 +827,15 @@ def test_following_schedule_datetime_timezone(self): when = dag.following_schedule(start)

Re: [PR] Relax mandatory requirement for start_date when schedule=None [airflow]

2023-11-01 Thread via GitHub
eladkal commented on code in PR #35356: URL: https://github.com/apache/airflow/pull/35356#discussion_r1379150779 ## tests/models/test_dag.py: ## @@ -827,6 +827,15 @@ def test_following_schedule_datetime_timezone(self): when = dag.following_schedule(start)

Re: [PR] Relax mandatory requirement for start_date when schedule=None [airflow]

2023-11-01 Thread via GitHub
hussein-awala commented on code in PR #35356: URL: https://github.com/apache/airflow/pull/35356#discussion_r1379146142 ## tests/models/test_dag.py: ## @@ -827,6 +827,15 @@ def test_following_schedule_datetime_timezone(self): when = dag.following_schedule(start)

Re: [PR] Relax mandatory requirement for start_date when schedule=None [airflow]

2023-11-01 Thread via GitHub
eladkal commented on code in PR #35356: URL: https://github.com/apache/airflow/pull/35356#discussion_r1379131926 ## tests/models/test_dag.py: ## @@ -827,6 +827,15 @@ def test_following_schedule_datetime_timezone(self): when = dag.following_schedule(start)

Re: [I] DAG runs from TriggerDagRunOperator is missing Start Date [airflow]

2023-11-01 Thread via GitHub
josh-fell commented on issue #35281: URL: https://github.com/apache/airflow/issues/35281#issuecomment-1789405028 Hi @sudiptad2017! Could you try reproducing this issue on a newer version of Airflow? 2.1.4 was released 2 years ago and there has been a tremendous number of changes to the UI

[PR] Relax mandatory requirement for start_date when schedule=None [airflow]

2023-11-01 Thread via GitHub
vishnucoder1 opened a new pull request, #35356: URL: https://github.com/apache/airflow/pull/35356 As a part of this PR, existing `start_date` validation is removed to handle `schedule=None` -- This is an automated message from the Apache Git Service. To respond to the message, please log

(airflow) branch main updated: Add startup_check_interval_seconds to PodManager's await_pod_start (#34231)

2023-11-01 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2b0bfea837 Add startup_check_interval_seconds to

Re: [PR] Add startup_check_interval_seconds to PodManager's await_pod_start [airflow]

2023-11-01 Thread via GitHub
boring-cyborg[bot] commented on PR #34231: URL: https://github.com/apache/airflow/pull/34231#issuecomment-1789397179 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional

Re: [PR] Add startup_check_interval_seconds to PodManager's await_pod_start [airflow]

2023-11-01 Thread via GitHub
eladkal merged PR #34231: URL: https://github.com/apache/airflow/pull/34231 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Dynamic task mapping over task_group expands over length of return_value dictionary instead of targeted XCom value [airflow]

2023-11-01 Thread via GitHub
boring-cyborg[bot] commented on issue #35355: URL: https://github.com/apache/airflow/issues/35355#issuecomment-1789374562 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] Dynamic task mapping over task_group expands over length of return_value dictionary instead of targeted XCom value [airflow]

2023-11-01 Thread via GitHub
asherkhb-ktx opened a new issue, #35355: URL: https://github.com/apache/airflow/issues/35355 ### Apache Airflow version 2.7.2 ### What happened When attempting to use dynamic task mapping over a task_group() based on a non-standard XCom (e.g. NOT return_value), the

Re: [PR] Fix query in `get_dag_by_pickle` util function [airflow]

2023-11-01 Thread via GitHub
syedahsn commented on code in PR #35339: URL: https://github.com/apache/airflow/pull/35339#discussion_r1379087446 ## airflow/utils/cli.py: ## @@ -269,7 +269,7 @@ def get_dag_by_pickle(pickle_id: int, session: Session = NEW_SESSION) -> DAG: """Fetch DAG from the database

Re: [I] Airflow Scheduler with Kubernetes Executor has errors in logs and stuck slots with no running tasks [airflow]

2023-11-01 Thread via GitHub
boring-cyborg[bot] commented on issue #35354: URL: https://github.com/apache/airflow/issues/35354#issuecomment-1789335981 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] Airflow Scheduler with Kubernetes Executor has errors in logs and stuck slots with no running tasks [airflow]

2023-11-01 Thread via GitHub
crabio opened a new issue, #35354: URL: https://github.com/apache/airflow/issues/35354 ### Apache Airflow version 2.7.2 ### What happened 1. Airflow Scheduler has periodic errors: ```log Traceback (most recent call last): File

Re: [PR] Fix query in `get_dag_by_pickle` util function [airflow]

2023-11-01 Thread via GitHub
Taragolis commented on code in PR #35339: URL: https://github.com/apache/airflow/pull/35339#discussion_r1379072906 ## airflow/utils/cli.py: ## @@ -269,7 +269,7 @@ def get_dag_by_pickle(pickle_id: int, session: Session = NEW_SESSION) -> DAG: """Fetch DAG from the database

Re: [PR] Fix query in `get_dag_by_pickle` util function [airflow]

2023-11-01 Thread via GitHub
Taragolis commented on code in PR #35339: URL: https://github.com/apache/airflow/pull/35339#discussion_r1379070387 ## airflow/utils/cli.py: ## @@ -269,7 +269,7 @@ def get_dag_by_pickle(pickle_id: int, session: Session = NEW_SESSION) -> DAG: """Fetch DAG from the database

Re: [I] MappedTasks: Very slow execution :: taskinstance.py seems to be a bottleneck. [airflow]

2023-11-01 Thread via GitHub
potiuk commented on issue #35267: URL: https://github.com/apache/airflow/issues/35267#issuecomment-1789323872 > Jarec, Thank you for your answer. You could run the code above on 2.7.1 too. Actually I don't have such a possibility now. It's. not the code, it's the scale. I am

Re: [PR] Fix query in `get_dag_by_pickle` util function [airflow]

2023-11-01 Thread via GitHub
syedahsn commented on code in PR #35339: URL: https://github.com/apache/airflow/pull/35339#discussion_r1379067138 ## airflow/utils/cli.py: ## @@ -269,7 +269,7 @@ def get_dag_by_pickle(pickle_id: int, session: Session = NEW_SESSION) -> DAG: """Fetch DAG from the database

Re: [PR] Fix query in `get_dag_by_pickle` util function [airflow]

2023-11-01 Thread via GitHub
Taragolis commented on code in PR #35339: URL: https://github.com/apache/airflow/pull/35339#discussion_r1379067692 ## airflow/utils/cli.py: ## @@ -269,7 +269,7 @@ def get_dag_by_pickle(pickle_id: int, session: Session = NEW_SESSION) -> DAG: """Fetch DAG from the database

Re: [PR] Fix query in `get_dag_by_pickle` util function [airflow]

2023-11-01 Thread via GitHub
Taragolis commented on code in PR #35339: URL: https://github.com/apache/airflow/pull/35339#discussion_r1379061352 ## airflow/utils/cli.py: ## @@ -269,7 +269,7 @@ def get_dag_by_pickle(pickle_id: int, session: Session = NEW_SESSION) -> DAG: """Fetch DAG from the database

[I] Official Airflow Helm Chart Adding EmptyDir Sizes and Basic Probes to all Containers to Values File [airflow]

2023-11-01 Thread via GitHub
ahipp13 opened a new issue, #35353: URL: https://github.com/apache/airflow/issues/35353 ### Description What I am requesting here is some changes to the Official Airflow Helm chart. What I am requesting is the addition in the values file to be able to edit the size limit on all the

Re: [PR] Fix query in `get_dag_by_pickle` util function [airflow]

2023-11-01 Thread via GitHub
syedahsn commented on code in PR #35339: URL: https://github.com/apache/airflow/pull/35339#discussion_r1379043315 ## airflow/utils/cli.py: ## @@ -269,7 +269,7 @@ def get_dag_by_pickle(pickle_id: int, session: Session = NEW_SESSION) -> DAG: """Fetch DAG from the database

(airflow) branch main updated: Fix parameter syntax in Amazon docstrings (#35349)

2023-11-01 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9782ee3bbc Fix parameter syntax in Amazon

Re: [PR] Fix parameter syntax in Amazon docstrings [airflow]

2023-11-01 Thread via GitHub
hussein-awala merged PR #35349: URL: https://github.com/apache/airflow/pull/35349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Fix parameter syntax in OpenSearch docstrings (#35345)

2023-11-01 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9e2f1ce4c3 Fix parameter syntax in

Re: [PR] Fix parameter syntax in OpenSearch docstrings [airflow]

2023-11-01 Thread via GitHub
hussein-awala merged PR #35345: URL: https://github.com/apache/airflow/pull/35345 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] MappedTasks: Very slow execution :: taskinstance.py seems to be a bottleneck. [airflow]

2023-11-01 Thread via GitHub
a-meledin commented on issue #35267: URL: https://github.com/apache/airflow/issues/35267#issuecomment-1789269209 Jarec, Thank you for your answer. You could run the code above on 2.7.1 too. Actually I don't have such a possibility now. On Tue, 31 Oct 2023 at 23:15, Jarek

Re: [PR] feat: add read access to pools for viewer role [airflow]

2023-11-01 Thread via GitHub
boring-cyborg[bot] commented on PR #35352: URL: https://github.com/apache/airflow/pull/35352#issuecomment-1789254629 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[PR] feat: add read access to pools for viewer role [airflow]

2023-11-01 Thread via GitHub
marekhanus opened a new pull request, #35352: URL: https://github.com/apache/airflow/pull/35352 Cluster Activity UI shows `FAILED TO FETCH DATA` error in pools section. Users with Viewer role do not have permission to read pools. --- **^ Add meaningful

  1   2   3   >