[PR] [API] can return the specified field when get dag/dagRun [airflow]

2024-01-06 Thread via GitHub
HarryWu-CHN opened a new pull request, #36641: URL: https://github.com/apache/airflow/pull/36641 relate to #29893 Hard to add generic retrieve capability to all `get` endpoints, so this PR is just add this capability in dag/dag_detail and dagRuns `get` endpoints, which I think need t

Re: [PR] [API] can return the specified field when get dag/dagRun [airflow]

2024-01-06 Thread via GitHub
boring-cyborg[bot] commented on PR #36641: URL: https://github.com/apache/airflow/pull/36641#issuecomment-1879980475 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[PR] Prepare docs 1st wave of Providers January 2024 [airflow]

2024-01-06 Thread via GitHub
eladkal opened a new pull request, #36640: URL: https://github.com/apache/airflow/pull/36640 ``` Summary of prepared documentation: Success: 13 amazon apache.hive apache.livy apache.spark atlassian.jira common.io google mysql openlineage opsgenie pagerduty redis samba

Re: [I] Airflow Python 3.12 support [airflow]

2024-01-06 Thread via GitHub
potiuk commented on issue #36546: URL: https://github.com/apache/airflow/issues/36546#issuecomment-1879977417 Re: old dependencies: This is no problem. You should always build your image with `--upgrade-to-newer-dependencies` locally - this will autoamatically get your dependencies upgraded

Re: [I] Airflow database migration fails in MySQL group replication mode [airflow]

2024-01-06 Thread via GitHub
github-actions[bot] commented on issue #27082: URL: https://github.com/apache/airflow/issues/27082#issuecomment-1879976338 This issue has been automatically marked as stale because it has been open for 365 days without any activity. There has been several Airflow releases since last activit

Re: [I] Double execution of failure callback for task [airflow]

2024-01-06 Thread via GitHub
github-actions[bot] commented on issue #27614: URL: https://github.com/apache/airflow/issues/27614#issuecomment-1879976321 This issue has been automatically marked as stale because it has been open for 365 days without any activity. There has been several Airflow releases since last activit

Re: [I] Task's state is updated (the session is flushed) after on-failure, on-retry callbacks [airflow]

2024-01-06 Thread via GitHub
github-actions[bot] commented on issue #27615: URL: https://github.com/apache/airflow/issues/27615#issuecomment-1879976308 This issue has been automatically marked as stale because it has been open for 365 days without any activity. There has been several Airflow releases since last activit

Re: [I] Viewing logs of running task in grid view hangs airflow-webserver [elasticsearch] [airflow]

2024-01-06 Thread via GitHub
github-actions[bot] commented on issue #28326: URL: https://github.com/apache/airflow/issues/28326#issuecomment-1879976301 This issue has been automatically marked as stale because it has been open for 365 days without any activity. There has been several Airflow releases since last activit

Re: [PR] enhance druid connection parameters [airflow]

2024-01-06 Thread via GitHub
eladkal commented on PR #35244: URL: https://github.com/apache/airflow/pull/35244#issuecomment-1879973087 @blcksrx are you planning completing this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] [FEAT] adds repair run functionality for databricks [airflow]

2024-01-06 Thread via GitHub
eladkal commented on PR #36601: URL: https://github.com/apache/airflow/pull/36601#issuecomment-1879940705 cc @alexott -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [I] Airflow Python 3.12 support [airflow]

2024-01-06 Thread via GitHub
dirrao commented on issue #36546: URL: https://github.com/apache/airflow/issues/36546#issuecomment-1879934143 Now, I can make progress. However, the 3.12 uploaded dependency constraint files are old as compared to 3.11. For the time being I am continuing with 3.11 as the base. As of now,

Re: [I] Support to delete datasets used in Data Aware Scheduling [airflow]

2024-01-06 Thread via GitHub
im-perativa commented on issue #36308: URL: https://github.com/apache/airflow/issues/36308#issuecomment-1879931534 @bbovenzi can I work on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Introduce Dag sla [airflow]

2024-01-06 Thread via GitHub
syun64 commented on PR #36024: URL: https://github.com/apache/airflow/pull/36024#issuecomment-1879890262 A new pull request had to be made because this the Git Diff got messy on this open PR after a git rebase based on current upstream main branch. The new PR based on the same branch is ope

[PR] Introduce DAG SLA [airflow]

2024-01-06 Thread via GitHub
syun64 opened a new pull request, #36639: URL: https://github.com/apache/airflow/pull/36639 closes #32816 ### Summary This PR introduces Dag SLAs as a part of **AIP-57 Refactor SLA Feature**. After many discussions, the community has voted to introduce new

Re: [PR] Introduce Dag sla [airflow]

2024-01-06 Thread via GitHub
syun64 closed pull request #36024: Introduce Dag sla URL: https://github.com/apache/airflow/pull/36024 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: c

Re: [PR] Remove elasticsearch constant USE_PER_RUN_LOG_ID [airflow]

2024-01-06 Thread via GitHub
github-actions[bot] commented on PR #35762: URL: https://github.com/apache/airflow/pull/35762#issuecomment-1879887790 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [PR] Can end task instance from trigger [airflow]

2024-01-06 Thread via GitHub
github-actions[bot] commented on PR #31808: URL: https://github.com/apache/airflow/pull/31808#issuecomment-1879887827 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-01-06 Thread via GitHub
github-actions[bot] commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1879887816 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [PR] Add extra operator links for EMR Serverless [airflow]

2024-01-06 Thread via GitHub
github-actions[bot] commented on PR #34225: URL: https://github.com/apache/airflow/pull/34225#issuecomment-1879887804 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [PR] Fix mypy errors resulting from all code mypy check [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36638: URL: https://github.com/apache/airflow/pull/36638#issuecomment-1879869221 And just to explain it better @jscheffl . What we **really* *want to achieve (and tihs ons is a step towards it): Imagine someone who modifies `airflow.nodels.dag.py` as par

Re: [PR] Fix mypy errors resulting from all code mypy check [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36638: URL: https://github.com/apache/airflow/pull/36638#issuecomment-1879848111 (BTW. I do seriously consider to run `mypy-everything` for all checks in CI that are changing any python code - but this would be another check) - we still have to leave the reagular `my

Re: [PR] Fix mypy errors resulting from all code mypy check [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36638: URL: https://github.com/apache/airflow/pull/36638#issuecomment-1879847137 > If the partly/differential mypy is "flaky"/not fully deterministic, should we not take the safe route and always run mypy over all files? As long as static checks are not the longest r

Re: [PR] Fix mypy errors resulting from all code mypy check [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36638: URL: https://github.com/apache/airflow/pull/36638#issuecomment-1879845746 > I do not really get the understanding for "mypy all" vs. "mypy everything". What is going to be checked pre-commit and what on PR and what on main. The difference is how pre-com

Re: [PR] Fix mypy errors resulting from all code mypy check [airflow]

2024-01-06 Thread via GitHub
jscheffl commented on PR #36638: URL: https://github.com/apache/airflow/pull/36638#issuecomment-1879841293 I do not really get the understanding for "mypy all" vs. "mypy everything". What is going to be checked pre-commit and what on PR and what on main. If the partly/differential myp

Re: [PR] Fix mypy errors resulting from all code mypy check [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36638: URL: https://github.com/apache/airflow/pull/36638#issuecomment-1879834841 Added a separate mypy check that runs a complete mypy check - this way we can prevent similar problems in the future. -- This is an automated message from the Apache Git Service. To re

Re: [PR] Fix attr-defined/override mypy errors [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36638: URL: https://github.com/apache/airflow/pull/36638#issuecomment-1879827941 I am about to add a permanent check to run such complete mypy check in canary build soon :) - but merging it now should fix the problem in main. -- This is an automated message from th

Re: [PR] Fix attr-defined/override mypy errors [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36638: URL: https://github.com/apache/airflow/pull/36638#issuecomment-1879823133 Example failure in main https://github.com/apache/airflow/actions/runs/7433525283/job/20226858854 -- This is an automated message from the Apache Git Service. To respond to the message

(airflow) branch main updated: Add section about live-upgrading Airflow (#36637)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ef1498831a Add section about live-upgrading Airflow

Re: [PR] Add section about live-upgrading Airflow [airflow]

2024-01-06 Thread via GitHub
potiuk merged PR #36637: URL: https://github.com/apache/airflow/pull/36637 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[PR] Fix attr-defined/override mypy errors [airflow]

2024-01-06 Thread via GitHub
potiuk opened a new pull request, #36638: URL: https://github.com/apache/airflow/pull/36638 MyPy as used in our static checks has slightly different heuristics when running on on individual files and whole packages. This sometimes causes semi-random failures when different set of files is p

Re: [PR] Add section about live-upgrading Airflow [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36637: URL: https://github.com/apache/airflow/pull/36637#issuecomment-1879814386 Added the advertising :) . Cross-promotion is important :D -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] Add section about live-upgrading Airflow [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36637: URL: https://github.com/apache/airflow/pull/36637#issuecomment-1879800827 > Besides the details, optionally "advertising" the Airflow Helm Chart is also possible, because most of the "rooling release" hazzle is included there out-of-the box. But not critical.

(airflow) branch main updated: Add docs on pagerduty connection (#36636)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4469baad4e Add docs on pagerduty connection (#36636

Re: [PR] Add docs on pagerduty connection [airflow]

2024-01-06 Thread via GitHub
potiuk merged PR #36636: URL: https://github.com/apache/airflow/pull/36636 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[PR] Add section about live-upgrading Airflow [airflow]

2024-01-06 Thread via GitHub
potiuk opened a new pull request, #36637: URL: https://github.com/apache/airflow/pull/36637 Our users are often asking about live-upgrading Airflow and the answer on what and how can be live-upgraded is not obvious and it depends on a number of factors - most importantly on the type of depl

Re: [PR] Fix reload gunicorn workers [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #32102: URL: https://github.com/apache/airflow/pull/32102#issuecomment-1879784804 > I think we should allow users to set auto-reload-when-plugins-change for scheduler also. The parsing_pre_import_modules doesn't take effect in some conditions, for example, a new-regis

[PR] Add docs on pagerduty connection [airflow]

2024-01-06 Thread via GitHub
shohamy7 opened a new pull request, #36636: URL: https://github.com/apache/airflow/pull/36636 --- Related: #28790 This PR adds docs on the PagerDuty connections. -- This is an automated message from the Apache Git Service. To respond to the message

Re: [PR] Fix reload gunicorn workers [airflow]

2024-01-06 Thread via GitHub
mujiannan commented on PR #32102: URL: https://github.com/apache/airflow/pull/32102#issuecomment-1879783170 I think we should allow users to set auto-reload-when-plugins-change for `scheduler` also. The `parsing_pre_import_modules` doesn't take effect in some conditions, for example, a new-

(airflow) branch switch-to-hatch updated (6fbf9220a2 -> 5cba0a1607)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch switch-to-hatch in repository https://gitbox.apache.org/repos/asf/airflow.git omit 6fbf9220a2 Standardize airflow build process and switch to Hatchling build backend add b5f4783407 Add

(airflow) branch main updated: Change detection mechanism for Breeze self-upgrade (#36635)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c5de0db05e Change detection mechanism for Breeze se

Re: [PR] Change detection mechanism for Breeze self-upgrade [airflow]

2024-01-06 Thread via GitHub
potiuk merged PR #36635: URL: https://github.com/apache/airflow/pull/36635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] KubernetesPodOperator prints empty log lines without respecting the log format [airflow]

2024-01-06 Thread via GitHub
potiuk commented on issue #36571: URL: https://github.com/apache/airflow/issues/36571#issuecomment-1879761764 Yeah. It's just strange changing provider version fixes it - but yeah it could be caused also by some changes to provider dependencies between those two versions: ```bash

(airflow) branch main updated: Check redshift cluster state before deferring to triggerer (#36416)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 1d41fc7ddb Check redshift cluster state before defe

Re: [PR] Check redshift cluster state before deferring to triggerer [airflow]

2024-01-06 Thread via GitHub
potiuk merged PR #36416: URL: https://github.com/apache/airflow/pull/36416 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] KubernetesPodOperator prints empty log lines without respecting the log format [airflow]

2024-01-06 Thread via GitHub
vatsrahul1001 commented on issue #36571: URL: https://github.com/apache/airflow/issues/36571#issuecomment-1879759250 @potiuk I also tried reproducing this as mentioned [here](https://github.com/apache/airflow/issues/36571#issuecomment-1876865865) and not able to repro with cncf 7.12.0, I al

Re: [I] KubernetesPodOperator prints empty log lines without respecting the log format [airflow]

2024-01-06 Thread via GitHub
hussein-awala commented on issue #36571: URL: https://github.com/apache/airflow/issues/36571#issuecomment-1879758569 @potiuk according to the provided log: ``` 2024-01-03T21:31:59.286+ | WARNING | Pod not yet started: my-pod-name-xutbmgq3 2024-01-03T21:32:00.313+ | WARNI

Re: [I] KubernetesPodOperator prints empty log lines without respecting the log format [airflow]

2024-01-06 Thread via GitHub
potiuk commented on issue #36571: URL: https://github.com/apache/airflow/issues/36571#issuecomment-1879756432 cc: @dstandish - likely #35416 was not THAT inconsequential -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

(airflow) branch main updated: Redirect to index when user does not have permission to access a page (#36623)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 535c8be599 Redirect to index when user does not hav

Re: [PR] Redirect to index when user does not have permission to access a page [airflow]

2024-01-06 Thread via GitHub
potiuk merged PR #36623: URL: https://github.com/apache/airflow/pull/36623 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Limit to 20 GitHub labels for the repo [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36633: URL: https://github.com/apache/airflow/pull/36633#issuecomment-1879751434 Even nicer :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443799186 ## dev/breeze/src/airflow_breeze/utils/path_utils.py: ## @@ -97,7 +97,7 @@ def get_package_setup_metadata_hash() -> str: return "NOT FOUND" -def get_sources_s

[PR] Change detection mechanism for Breeze self-upgrade [airflow]

2024-01-06 Thread via GitHub
potiuk opened a new pull request, #36635: URL: https://github.com/apache/airflow/pull/36635 Breeze auto-detects if it should upgrade itself - based on finding Airflow directory it is in and calculating the hash of the pyproject.toml it uses. Finding the airflow sources to act on was using s

Re: [PR] Allow override of hovered navbar colors [airflow]

2024-01-06 Thread via GitHub
hussein-awala commented on code in PR #36631: URL: https://github.com/apache/airflow/pull/36631#discussion_r1443798299 ## airflow/config_templates/config.yml: ## @@ -1633,6 +1633,20 @@ webserver: type: string example: ~ default: "#51504f" +navbar_hover_c

(airflow) branch main updated: Limit to 20 GitHub labels for the repo (#36633)

2024-01-06 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new f569d3cb2c Limit to 20 GitHub labels for the rep

Re: [PR] Limit to 20 GitHub labels for the repo [airflow]

2024-01-06 Thread via GitHub
kaxil merged PR #36633: URL: https://github.com/apache/airflow/pull/36633 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.ap

(airflow) branch switch-to-hatch updated (9f504b15cf -> 6fbf9220a2)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch switch-to-hatch in repository https://gitbox.apache.org/repos/asf/airflow.git omit 9f504b15cf Standardize airflow build process and switch to Hatchling build backend add 6fbf9220a2 Stan

Re: [PR] Limit to 20 GitHub labels for the repo [airflow]

2024-01-06 Thread via GitHub
jscheffl commented on code in PR #36633: URL: https://github.com/apache/airflow/pull/36633#discussion_r1443797073 ## .asf.yaml: ## @@ -33,17 +33,13 @@ github: - data-science - elt - etl -- job-scheduler -- kubernetes - machine-learning - mlops

Re: [PR] Add more labels to Airflow project [airflow]

2024-01-06 Thread via GitHub
kaxil commented on PR #36632: URL: https://github.com/apache/airflow/pull/36632#issuecomment-1879745718 @jscheffl This now fails with the following error, so created https://github.com/apache/airflow/pull/36633: ``` An error occurred while running github feature in .asf.yaml!: 4

[PR] Limit to 20 GitHub labels for the repo [airflow]

2024-01-06 Thread via GitHub
kaxil opened a new pull request, #36633: URL: https://github.com/apache/airflow/pull/36633 @jscheffl's PR (https://github.com/apache/airflow/pull/36632) added tags but now fails with the following error, can you filter the topics: ``` An error occurred while running github feature

Re: [PR] Add more labels to Airflow project [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36632: URL: https://github.com/apache/airflow/pull/36632#issuecomment-1879736354 NICE ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Error while running github feature from .asf.yaml in airflow!

2024-01-06 Thread Apache Infrastructure
An error occurred while running github feature in .asf.yaml!: 422 {"message": "Validation Failed", "errors": ["A repository cannot have more than 20 topics."], "documentation_url": "https://docs.github.com/rest/repos/repos#replace-all-repository-topics"}

(airflow) branch main updated: Add more labels to Airflow project (#36632)

2024-01-06 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b5f4783407 Add more labels to Airflow project (#

Re: [PR] Add more labels to Airflow project [airflow]

2024-01-06 Thread via GitHub
kaxil merged PR #36632: URL: https://github.com/apache/airflow/pull/36632 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.ap

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on PR #36537: URL: https://github.com/apache/airflow/pull/36537#issuecomment-1879735550 Thanks @jscheffl for VERY THOROUGH review. I addressed most comments (and the new iteration is way simpler and automatically addressed some of your comments regardles). I left a few unre

(airflow) branch switch-to-hatch updated (f04a2a9c4c -> 9f504b15cf)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch switch-to-hatch in repository https://gitbox.apache.org/repos/asf/airflow.git omit f04a2a9c4c Standardize airflow build process and switch to Hatchling build backend add 9f504b15cf Stan

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r144376 ## setup.cfg.back: ## Review Comment: Yep. Will leave the comment open to not forget it. -- This is an automated message from the Apache Git Service. To respo

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443788673 ## scripts/in_container/run_prepare_airflow_packages.py: ## @@ -79,31 +79,34 @@ def process_summary(success_message: str, error_message: str, completed_process: rich

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443788559 ## hatch_build.py: ## @@ -0,0 +1,144 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443788324 ## hatch_build.py: ## @@ -0,0 +1,144 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443784524 ## hatch_build.py: ## Review Comment: It's the convention, I think it can be moved and yes, I think it's a good idea to move it to dev. Will look at it and keep

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443784202 ## docs/apache-airflow/extra-packages-ref.rst: ## @@ -343,27 +350,278 @@ you need to list explicitly all the non-bundle extras that you want to install. +--

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443783166 ## docs/apache-airflow/extra-packages-ref.rst: ## @@ -343,27 +350,278 @@ you need to list explicitly all the non-bundle extras that you want to install. +--

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443782845 ## docs/apache-airflow/extra-packages-ref.rst: ## @@ -343,27 +350,278 @@ you need to list explicitly all the non-bundle extras that you want to install. +--

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443782734 ## docs/apache-airflow/extra-packages-ref.rst: ## @@ -343,27 +350,278 @@ you need to list explicitly all the non-bundle extras that you want to install. +--

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443782518 ## docs/apache-airflow/extra-packages-ref.rst: ## @@ -18,17 +18,24 @@ Reference for package extras -Here's the list of all the extra d

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443782500 ## docs/apache-airflow/extra-packages-ref.rst: ## @@ -18,17 +18,24 @@ Reference for package extras -Here's the list of all the extra d

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443782325 ## docs/apache-airflow/extra-packages-ref.rst: ## @@ -97,7 +106,7 @@ with a consistent set of dependencies based on constraint files provided by Airf .. code-block::

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443781658 ## docs/apache-airflow/extra-packages-ref.rst: ## @@ -18,17 +18,24 @@ Reference for package extras -Here's the list of all the extra d

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443781639 ## docs/apache-airflow-providers/howto/create-custom-providers.rst: ## @@ -211,16 +211,15 @@ You need to do the following to turn an existing Python package into a pr

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443781451 ## dev/old_setup/MANIFEST.in: ## Review Comment: I am keeping it for now just to see it easily without `git diff` - it will be helpful when I start compare gener

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443780984 ## dev/breeze/src/airflow_breeze/utils/path_utils.py: ## @@ -97,7 +97,7 @@ def get_package_setup_metadata_hash() -> str: return "NOT FOUND" -def get_sources_s

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443780075 ## dev/breeze/src/airflow_breeze/utils/packages.py: ## @@ -53,8 +53,8 @@ LONG_PROVIDERS_PREFIX = "apache-airflow-providers-" -# TODO: use single source of truth f

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443779482 ## airflow/utils/dot_renderer.py: ## @@ -19,9 +19,14 @@ """Renderer DAG (tasks and dependencies) to the graphviz object.""" from __future__ import annotations +imp

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443779310 ## airflow/providers/fab/provider.yaml: ## @@ -36,6 +36,11 @@ versions: dependencies: - apache-airflow>=2.9.0 - flask>=2.2,<2.3 + # We are tightly coupled with

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443778953 ## LOCAL_VIRTUALENV.rst: ## @@ -169,38 +171,31 @@ for different python versions). For development on current main source: .. code-block:: bash # use the sa

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443778925 ## CONTRIBUTING.rst: ## @@ -841,29 +841,106 @@ Extras -- There are a number of extras that can be specified when installing Airflow. Those -extras can be spec

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443778203 ## dev/breeze/src/airflow_breeze/prepare_providers/provider_documentation.py: ## @@ -656,7 +656,7 @@ def update_release_notes( ) -> tuple[bool, bool]: """Updates

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443778064 ## dev/breeze/SELECTIVE_CHECKS.md: ## @@ -74,7 +74,7 @@ together using `pytest-xdist` (pytest-xdist distributes the tests among parallel ## Selective check decision

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-06 Thread via GitHub
potiuk commented on code in PR #36537: URL: https://github.com/apache/airflow/pull/36537#discussion_r1443771750 ## dev/MANUALLY_GENERATING_IMAGE_CACHE_AND_CONSTRAINTS.md: ## @@ -424,7 +424,7 @@ The slight risk is that if there is a constraint problem that impacts regular PR ma

(airflow) branch switch-to-hatch updated (af9d712143 -> f04a2a9c4c)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch switch-to-hatch in repository https://gitbox.apache.org/repos/asf/airflow.git omit af9d712143 Standardize airflow build process and switch to Hatchling build backend add f04a2a9c4c Stan

Re: [I] SnowflakeSqlApiOperator does not support OAuth [airflow]

2024-01-06 Thread via GitHub
aritra24 commented on issue #36621: URL: https://github.com/apache/airflow/issues/36621#issuecomment-1879693392 Sure @ighoshsubho, assigning it to you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

(airflow) branch switch-to-hatch updated (9666bebca3 -> af9d712143)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch switch-to-hatch in repository https://gitbox.apache.org/repos/asf/airflow.git discard 9666bebca3 Standardize airflow build process and switch to Hatchling build backend add af9d712143 Stan

(airflow) branch switch-to-hatch updated (5c4a960ae5 -> 570a5f3b07)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch switch-to-hatch in repository https://gitbox.apache.org/repos/asf/airflow.git discard 5c4a960ae5 Standardize airflow build process and switch to Hatchling build backend add 570a5f3b07 Stan

(airflow) branch switch-to-hatch updated (570a5f3b07 -> 9666bebca3)

2024-01-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch switch-to-hatch in repository https://gitbox.apache.org/repos/asf/airflow.git omit 570a5f3b07 Standardize airflow build process and switch to Hatchling build backend add 365f206a32 Sele

[PR] Add more labels to Airflow project [airflow]

2024-01-06 Thread via GitHub
jscheffl opened a new pull request, #36632: URL: https://github.com/apache/airflow/pull/36632 As I was digesting for the question about "why do you use airflow and not Github Actions" I was looking for alternatives of making a DAG in a Github Action workflow. I ended up finding the list htt

Re: [PR] [FEAT] adds repair run functionality for databricks [airflow]

2024-01-06 Thread via GitHub
gaurav7261 commented on PR #36601: URL: https://github.com/apache/airflow/pull/36601#issuecomment-1879667224 Hi @dirrao, added test cases to get latest repair id, I look for earlier test cases for method `_handle_databricks_operator_execution`, but seems like since it is a handle function,

Re: [PR] Add data_interval_start and data_interval_end in dagrun create API endpoint [airflow]

2024-01-06 Thread via GitHub
pankajastro commented on code in PR #36630: URL: https://github.com/apache/airflow/pull/36630#discussion_r1443739164 ## airflow/api_connexion/endpoints/dag_run_endpoint.py: ## @@ -319,11 +320,38 @@ def post_dag_run(*, dag_id: str, session: Session = NEW_SESSION) -> APIResponse:

[PR] Allow override of hovered navbar colors [airflow]

2024-01-06 Thread via GitHub
ncrocfer opened a new pull request, #36631: URL: https://github.com/apache/airflow/pull/36631 This PR is a follow up of the #35505 and #35553 ones to customize the navbar color. When we hover the links with dark colors we can have this behavior with the background col

Re: [I] SnowflakeSqlApiOperator does not support OAuth [airflow]

2024-01-06 Thread via GitHub
ighoshsubho commented on issue #36621: URL: https://github.com/apache/airflow/issues/36621#issuecomment-1879655972 I would like to work on this issue, please assign it to me. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[PR] Add data_interval_start and data_interval_end in dagrun create API endpoint [airflow]

2024-01-06 Thread via GitHub
karakanb opened a new pull request, #36630: URL: https://github.com/apache/airflow/pull/36630 This PR introduces two new variables in the DAGRun create API endpoint to enable creating runs that cover a specific span. This allows triggering runs that span multiple interfaces in case of backf

  1   2   >