Re: [I] Backfill shouldn't interfere with scheduled run [airflow]

2023-12-31 Thread via GitHub
github-actions[bot] closed issue #16087: Backfill shouldn't interfere with scheduled run URL: https://github.com/apache/airflow/issues/16087 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] Backfill shouldn't interfere with scheduled run [airflow]

2023-12-31 Thread via GitHub
github-actions[bot] commented on issue #16087: URL: https://github.com/apache/airflow/issues/16087#issuecomment-1873192343 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] Hook notification when you turn on/off (pause/unpause) a DAG from the UI [airflow]

2023-12-31 Thread via GitHub
dirrao commented on issue #36516: URL: https://github.com/apache/airflow/issues/36516#issuecomment-1873181641 Yes, it's a useful feature. A use case could be notify when the production DAGs are turned off/on. So, it will be easy to know and react to them quickly. We have multiple

Re: [PR] Allow raising error if ``DagRun`` fails when running ``dag test`` [airflow]

2023-12-31 Thread via GitHub
dirrao commented on PR #36517: URL: https://github.com/apache/airflow/pull/36517#issuecomment-1873176047 > I am a bit wondering why we add another CLI parameter. If the DAG test fails and exit code 0 is returned I'd rather see this as a bug. > > Is there a reason adding a new CLI

Re: [PR] Remove option ot set a task instance to running state in UI [airflow]

2023-12-31 Thread via GitHub
dirrao commented on code in PR #36518: URL: https://github.com/apache/airflow/pull/36518#discussion_r1438966843 ## airflow/www/views.py: ## @@ -5727,15 +5726,6 @@ def set_task_instance_state( except Exception: flash("Failed to set state", "error") -

Re: [PR] Add `on_skipped_callback` in to `BaseOperator` [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on code in PR #36374: URL: https://github.com/apache/airflow/pull/36374#discussion_r1438943838 ## docs/apache-airflow/administration-and-deployment/logging-monitoring/callbacks.rst: ## @@ -49,6 +49,7 @@ NameDescription

Re: [PR] Add `on_skipped_callback` in to `BaseOperator` [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on code in PR #36374: URL: https://github.com/apache/airflow/pull/36374#discussion_r1438943686 ## airflow/models/baseoperator.py: ## @@ -597,6 +599,8 @@ class derived from this one results in the creation of a task object, that it is executed when

Re: [PR] Support encryption for triggers parameters [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on code in PR #36492: URL: https://github.com/apache/airflow/pull/36492#discussion_r1438942362 ## tests/models/test_trigger.py: ## @@ -337,3 +341,47 @@ def test_get_sorted_triggers_different_priority_weights(session, create_task_ins trigger_ids_query =

Re: [PR] Support encryption for triggers parameters [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on code in PR #36492: URL: https://github.com/apache/airflow/pull/36492#discussion_r1438942362 ## tests/models/test_trigger.py: ## @@ -337,3 +341,47 @@ def test_get_sorted_triggers_different_priority_weights(session, create_task_ins trigger_ids_query =

(airflow) branch main updated: Add docs for opsgenie connection (#36519)

2023-12-31 Thread jscheffl
This is an automated email from the ASF dual-hosted git repository. jscheffl pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 326ae6bdc2 Add docs for opsgenie connection

Re: [PR] Add docs for opsgenie connection [airflow]

2023-12-31 Thread via GitHub
jscheffl merged PR #36519: URL: https://github.com/apache/airflow/pull/36519 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438929790 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

[PR] Add docs for opsgenie connection [airflow]

2023-12-31 Thread via GitHub
shohamy7 opened a new pull request, #36519: URL: https://github.com/apache/airflow/pull/36519 --- Related: #28790 This PR adds docs about the Opsgenie connection and make it more user friendly in the UI form. **^ Add meaningful description above**

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on PR #36513: URL: https://github.com/apache/airflow/pull/36513#issuecomment-1873026702 And even a but nicer now :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

(airflow) branch main updated: Clarify how to find changelog for the RC candidates of providers (#36512)

2023-12-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new fd0facc9f0 Clarify how to find changelog for the

Re: [PR] Clarify how to find changelog for the RC candidates of providers [airflow]

2023-12-31 Thread via GitHub
potiuk merged PR #36512: URL: https://github.com/apache/airflow/pull/36512 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on PR #36513: URL: https://github.com/apache/airflow/pull/36513#issuecomment-1873023020 Right I think I found a nice-enough layout. Looks like "ortho" layout for edges is rather difficult for edge anchoring (even if Iike it most) - but with some graphviz tweaking

Re: [PR] Change AirflowTaskTimeout to inherit BaseException [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on PR #35653: URL: https://github.com/apache/airflow/pull/35653#issuecomment-1873017894 I was reading through the discussion and found this PR now being a bit stale. I'd make a full review if nobody objects. Before merge though I would kindly request a re-base

Re: [I] AirflowTaskTimeout should inherit BaseException instead of Exception? [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on issue #35644: URL: https://github.com/apache/airflow/issues/35644#issuecomment-1873017334 The bug report and discussion seems to be a bit stale. Just looking through the PR it looks good and reasonable for me. There might be side effects but we can handle this via a

[PR] Remove option ot set a task instance to running state in UI [airflow]

2023-12-31 Thread via GitHub
jscheffl opened a new pull request, #36518: URL: https://github.com/apache/airflow/pull/36518 Removes the "Set to state 'running'" option from UI for Task instances. If users are using this, immediately an "Zombie task" error like the following is produced in the task logs: ```

Re: [I] Status of testing Providers that were prepared on December 31, 2023 [airflow]

2023-12-31 Thread via GitHub
utkarsharma2 commented on issue #36511: URL: https://github.com/apache/airflow/issues/36511#issuecomment-1873013780 Thanks @potiuk for the ad-hoc release and yes, It's all working as expected. :) -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on PR #36513: URL: https://github.com/apache/airflow/pull/36513#issuecomment-1873012436 Should be quite a bit nicer (I will still need to figure out how to do anchoring a bit better but the icons should be nicer now. -- This is an automated message from the Apache Git

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
BasPH commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438914237 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

Re: [PR] Remove MSSQL support from Airflow core [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on PR #35868: URL: https://github.com/apache/airflow/pull/35868#issuecomment-1873001635 Closing this PR as the attempt is now super-seeded with PRs: - #36509 - #36514 - #36515 Leaving the cleanup of migration scripts "open for now" -- This is an

Re: [PR] Remove MSSQL support from Airflow core [airflow]

2023-12-31 Thread via GitHub
jscheffl closed pull request #35868: Remove MSSQL support from Airflow core URL: https://github.com/apache/airflow/pull/35868 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438910073 ## docs/apache-airflow/img/diagram_basic_airflow_architecture.png: ## Review Comment: Free for any usage, no attribution needed. Should be fine (matticons) --

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on PR #36513: URL: https://github.com/apache/airflow/pull/36513#issuecomment-1872996653 > While we're changing the diagram, how about displaying a generic "database" icon instead of the PostgreSQL logo? PostgreSQL is the most used database but we do support others too.

[PR] Allow raising error if ``DagRun`` fails when running ``dag test`` [airflow]

2023-12-31 Thread via GitHub
kaxil opened a new pull request, #36517: URL: https://github.com/apache/airflow/pull/36517 **Motivation**: Currently, when using `airflow dags test`, there is no easy way to know programmatically if a DagRun fails since the state is not stored in DB. The way to do know relies on log

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438907595 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438907553 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438907524 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438907293 ## docs/apache-airflow/img/diagram_basic_airflow_architecture.png: ## Review Comment: How about "just using"

[I] Hook notification when you turn on/off (pause/unpause) a DAG from the UI [airflow]

2023-12-31 Thread via GitHub
potiuk opened a new issue, #36516: URL: https://github.com/apache/airflow/issues/36516 ### Discussed in https://github.com/apache/airflow/discussions/18511 Originally posted by **salvob41** September 22, 2021 ### Description It would be useful if when someone decide

Re: [I] Hook notification when you turn on/off (pause/unpause) a DAG from the UI [airflow]

2023-12-31 Thread via GitHub
potiuk commented on issue #36516: URL: https://github.com/apache/airflow/issues/36516#issuecomment-1872989976 Just to note - this might be rather complex because it requires a new way of communication. Webserver / API uses DB to communicate with whatever can produce notifications

Re: [PR] Clarify how to find changelog for the RC candidates of providers [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36512: URL: https://github.com/apache/airflow/pull/36512#discussion_r1438906269 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -649,7 +648,11 @@ the artifact checksums when we actually release. The status of testing the providers by the

Re: [PR] Clarify how to find changelog for the RC candidates of providers [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36512: URL: https://github.com/apache/airflow/pull/36512#discussion_r1438906241 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -649,7 +648,11 @@ the artifact checksums when we actually release. The status of testing the providers by the

(airflow) branch main updated: Update description of release process to include options for next RCs (#36506)

2023-12-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 52a16bf332 Update description of release process

Re: [PR] Update description of release process to include options for next RCs [airflow]

2023-12-31 Thread via GitHub
potiuk merged PR #36506: URL: https://github.com/apache/airflow/pull/36506 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Remove MSSQL support form Airflow core [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on PR #36514: URL: https://github.com/apache/airflow/pull/36514#issuecomment-1872986011 [ ] Double check that with the removal of mssql also in CI do we have a whole in the text matrix of Python/DB editions? -- This is an automated message from the Apache Git Service.

Re: [I] Status of testing Providers that were prepared on December 31, 2023 [airflow]

2023-12-31 Thread via GitHub
potiuk commented on issue #36511: URL: https://github.com/apache/airflow/issues/36511#issuecomment-1872985623 @utkarsharma2 confirmed all changes work in the devlist thread :). Setting them as "marked". -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438904061 ## docs/apache-airflow/img/diagram_basic_airflow_architecture.png: ## Review Comment: You can provide custom icons - no problem - this is how I added "scalable

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438892537 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

Re: [PR] Announce MSSQL support end in Airflow 2.9.0, add migration script hints [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on PR #36509: URL: https://github.com/apache/airflow/pull/36509#issuecomment-1872980286 > > Which one of the PR will add the newsfragment? > > I guess the one that removes MsSQL support I added the newsfragment now to #36514 -- This is an automated message

Re: [PR] Improve TaskInstance typing hints [airflow]

2023-12-31 Thread via GitHub
hussein-awala commented on code in PR #36487: URL: https://github.com/apache/airflow/pull/36487#discussion_r1438901910 ## airflow/models/renderedtifields.py: ## @@ -49,7 +49,7 @@ from airflow.models.taskinstance import TaskInstance, TaskInstancePydantic -class

Re: [PR] Improve TaskInstance typing hints [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on code in PR #36487: URL: https://github.com/apache/airflow/pull/36487#discussion_r1438901189 ## airflow/models/renderedtifields.py: ## @@ -49,7 +49,7 @@ from airflow.models.taskinstance import TaskInstance, TaskInstancePydantic -class

[PR] Remove MSSQL support form Airflow core [airflow]

2023-12-31 Thread via GitHub
jscheffl opened a new pull request, #36514: URL: https://github.com/apache/airflow/pull/36514 This is a follow-up and split form original PR #35868 and just removes all MSSQL support from Airflow Core (w/o breeze, migrations). As discussed and voted in

Re: [PR] Improve TaskInstance typing hints [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on code in PR #36487: URL: https://github.com/apache/airflow/pull/36487#discussion_r1438901189 ## airflow/models/renderedtifields.py: ## @@ -49,7 +49,7 @@ from airflow.models.taskinstance import TaskInstance, TaskInstancePydantic -class

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438900041 ## docs/apache-airflow/img/diagram_basic_airflow_architecture.png: ## Review Comment: Just checking it seems this framework only contains "ugly" icons, then I

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
jscheffl commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438898796 ## docs/apache-airflow/img/diagram_basic_airflow_architecture.png: ## Review Comment: I dis-like the icon for the plugin-folder (in terms of visual style) and

Re: [PR] Update description of release process to include options for next RCs [airflow]

2023-12-31 Thread via GitHub
hussein-awala commented on code in PR #36506: URL: https://github.com/apache/airflow/pull/36506#discussion_r1438897456 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -992,36 +992,55 @@ that the Airflow works as you expected. Once the vote has been passed, you will need to

Re: [PR] Clarify how to find changelog for the RC candidates of providers [airflow]

2023-12-31 Thread via GitHub
hussein-awala commented on code in PR #36512: URL: https://github.com/apache/airflow/pull/36512#discussion_r1438897133 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -649,7 +648,11 @@ the artifact checksums when we actually release. The status of testing the providers by

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438896755 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on PR #36513: URL: https://github.com/apache/airflow/pull/36513#issuecomment-1872970410 > All the crossed dashed arrows make it difficult to follow the arrow. Would stick with solid lines. Yep. I will work a bit on those. -- This is an automated

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438892537 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438892404 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438892198 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on PR #36513: URL: https://github.com/apache/airflow/pull/36513#issuecomment-1872962105 > I feel all the different arrow styles require a legend. What does blue vs red and solid vs dashed indicate? Yep. Will add it. There is a good reasoning for that and deliberate

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
BasPH commented on code in PR #36513: URL: https://github.com/apache/airflow/pull/36513#discussion_r1438889862 ## docs/apache-airflow/core-concepts/overview.rst: ## @@ -43,13 +43,26 @@ An Airflow installation generally consists of the following components: Basic airflow

Re: [PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk commented on PR #36513: URL: https://github.com/apache/airflow/pull/36513#issuecomment-1872959349 This is part of preparation to the last stage of multi-tentant last AIP and documentation around it. It was also partially result of the issue

[PR] Include plugins in the architecture diagrams [airflow]

2023-12-31 Thread via GitHub
potiuk opened a new pull request, #36513: URL: https://github.com/apache/airflow/pull/36513 When it comes to access and management plugins management follows different pattern than DAG files. While DAG files can (and should) be modified by DAG authors, the whole idea of Plugins was to make

Re: [PR] [POC][WIP] Async SQLAlchemy sessions in Airflow [airflow]

2023-12-31 Thread via GitHub
hussein-awala commented on PR #36504: URL: https://github.com/apache/airflow/pull/36504#issuecomment-1872955940 > I expect a long time to go/test all cases . But I love it :). > > But yeah, if we limit it for Connections and Variables for now, that would be cool. I think one general

(airflow) branch constraints-2-8 updated: Updating constraints. Github run id:7370596467

2023-12-31 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-8 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-8 by this push: new a3f827db03 Updating

(airflow) branch v2-8-test updated: Upgrade to just released `pip` 23.3.2 (#36271)

2023-12-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-8-test by this push: new ba3213bb93 Upgrade to just released

[PR] Clarify how to find changelog for the RC candidates of providers [airflow]

2023-12-31 Thread via GitHub
potiuk opened a new pull request, #36512: URL: https://github.com/apache/airflow/pull/36512 We used to have changelog in wheel package description but since those changelogs are immutable in the released packages, we removed the changelog from description some time ago and instead we

(airflow) branch constraints-main updated: Updating constraints. Github run id:7370255704

2023-12-31 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 8e2779f22b Updating

[I] Status of testing Providers that were prepared on December 31, 2023 [airflow]

2023-12-31 Thread via GitHub
potiuk opened a new issue, #36511: URL: https://github.com/apache/airflow/issues/36511 I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers? The guidelines on how to test providers

[PR] Add documentation for packages - 2023-12-31 [airflow-site]

2023-12-31 Thread via GitHub
potiuk opened a new pull request, #922: URL: https://github.com/apache/airflow-site/pull/922 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

(airflow-site) branch add-documentation-2023-12-31 created (now 177736225c)

2023-12-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch add-documentation-2023-12-31 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 177736225c Add documentation for packages - 2023-12-31 This branch includes the

Re: [PR] Announce MSSQL support end in Airflow 2.9.0, add migration script hints [airflow]

2023-12-31 Thread via GitHub
potiuk commented on PR #36509: URL: https://github.com/apache/airflow/pull/36509#issuecomment-1872936324 > Which one of the PR will add the newsfragment? I guess the one that removes MsSQL support -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Fix passing dags.gitSync.sshKeySecret with dags.persistence.enabled=true [airflow]

2023-12-31 Thread via GitHub
potiuk commented on PR #34331: URL: https://github.com/apache/airflow/pull/34331#issuecomment-1872936159 > we are interested in this Feel free to create PR and lead it completion then @amoskueez . Nothing more is needed here. -- This is an automated message from the Apache Git

(airflow) annotated tag providers-weaviate/1.3.0rc2 updated (24a532fb4c -> ca75b203c6)

2023-12-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to annotated tag providers-weaviate/1.3.0rc2 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-weaviate/1.3.0rc2 was modified! *** from 24a532fb4c (commit)

svn commit: r66367 - /dev/airflow/providers/

2023-12-31 Thread potiuk
Author: potiuk Date: Sun Dec 31 12:17:57 2023 New Revision: 66367 Log: Add artifacts for Airflow Providers 2023-12-31 Added: dev/airflow/providers/apache_airflow_providers_weaviate-1.3.0-py3-none-any.whl (with props)

Re: [I] Unable to use Custom Triggers in Cloud Composer in Production as Dags folder is not synchronized with the Triggerer [airflow]

2023-12-31 Thread via GitHub
potiuk commented on issue #36510: URL: https://github.com/apache/airflow/issues/36510#issuecomment-1872934038 Just to add a bit more context: * https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/overview.html#basic-airflow-architecture - shows the basic architecture of

Re: [PR] Fix passing dags.gitSync.sshKeySecret with dags.persistence.enabled=true [airflow]

2023-12-31 Thread via GitHub
amoskueez commented on PR #34331: URL: https://github.com/apache/airflow/pull/34331#issuecomment-1872933817 we are interested in this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Announce MSSQL support end in Airflow 2.9.0, add migration script hints [airflow]

2023-12-31 Thread via GitHub
eladkal commented on PR #36509: URL: https://github.com/apache/airflow/pull/36509#issuecomment-1872933675 Which one of the PR will add the newsfragment? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] Unable to use Custom Triggers in Cloud Composer in Production as Dags folder is not synchronized with the Triggerer [airflow]

2023-12-31 Thread via GitHub
potiuk closed issue #36510: Unable to use Custom Triggers in Cloud Composer in Production as Dags folder is not synchronized with the Triggerer URL: https://github.com/apache/airflow/issues/36510 -- This is an automated message from the Apache Git Service. To respond to the message, please

(airflow) branch main updated: Prepare documentation for weaviate ad-hoc rc2 release (#36508)

2023-12-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 24a532fb4c Prepare documentation for weaviate

Re: [PR] Prepare documentation for weaviate ad-hoc rc2 release [airflow]

2023-12-31 Thread via GitHub
potiuk merged PR #36508: URL: https://github.com/apache/airflow/pull/36508 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Unable to use Custom Triggers in Cloud Composer in Production as Dags folder is not synchronized with the Triggerer [airflow]

2023-12-31 Thread via GitHub
boring-cyborg[bot] commented on issue #36510: URL: https://github.com/apache/airflow/issues/36510#issuecomment-1872929748 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] Unable to use Custom Triggers in Cloud Composer in Production as Dags folder is not synchronized with the Triggerer [airflow]

2023-12-31 Thread via GitHub
victorrgez opened a new issue, #36510: URL: https://github.com/apache/airflow/issues/36510 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.6.3 ### What happened? We need to

[PR] Announce MSSQL support end in Airflow 2.9.0, add migration script hints [airflow]

2023-12-31 Thread via GitHub
jscheffl opened a new pull request, #36509: URL: https://github.com/apache/airflow/pull/36509 As a split and increment of PR #35868, this PR contains the documentation parts announcing removal of MSSQL server support in Airflow 2.9. It also contains a link to the migration script

(airflow) branch constraints-main updated: Updating constraints. Github run id:7369964232

2023-12-31 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 04e9a9b03a Updating

Re: [I] Status of testing Providers that were prepared on December 28, 2023 [airflow]

2023-12-31 Thread via GitHub
potiuk commented on issue #36467: URL: https://github.com/apache/airflow/issues/36467#issuecomment-1872925643 Thank you everyone. Providers are released (except Waeviate that will have ad-hoc release shortly). I invite everyone to help improve providers for the next release, a list

[PR] Prepare documentation for weaviate ad-hoc rc2 release [airflow]

2023-12-31 Thread via GitHub
potiuk opened a new pull request, #36508: URL: https://github.com/apache/airflow/pull/36508 --- **^ Add meaningful description above** Read the **[Pull Request

Re: [I] Status of testing Providers that were prepared on December 28, 2023 [airflow]

2023-12-31 Thread via GitHub
potiuk closed issue #36467: Status of testing Providers that were prepared on December 28, 2023 URL: https://github.com/apache/airflow/issues/36467 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

(airflow-mssql-migration) branch main updated: Add compatability for Airflow 2.8.0

2023-12-31 Thread jscheffl
This is an automated email from the ASF dual-hosted git repository. jscheffl pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-mssql-migration.git The following commit(s) were added to refs/heads/main by this push: new e4791b6 Add compatability for

Re: [PR] Update description of release process to include options for next RCs [airflow]

2023-12-31 Thread via GitHub
potiuk commented on PR #36506: URL: https://github.com/apache/airflow/pull/36506#issuecomment-1872919193 Also improved notification message to always include list of packages as "appendix" - previously we had some conditional list there - in order to keep the message short for long list of

Re: [PR] Add documentation for packages - 2023-12-28 [airflow-site]

2023-12-31 Thread via GitHub
potiuk merged PR #921: URL: https://github.com/apache/airflow-site/pull/921 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Update providers metadata 2023-12-31 (#36507)

2023-12-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3aeb31b513 Update providers metadata 2023-12-31

Re: [PR] Update providers metadata 2023-12-31 [airflow]

2023-12-31 Thread via GitHub
potiuk merged PR #36507: URL: https://github.com/apache/airflow/pull/36507 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] Update providers metadata 2023-12-31 [airflow]

2023-12-31 Thread via GitHub
potiuk opened a new pull request, #36507: URL: https://github.com/apache/airflow/pull/36507 --- **^ Add meaningful description above** Read the **[Pull Request

(airflow-site) branch add-documentation-2023-12-28 updated (29f4c981b3 -> 10fab59006)

2023-12-31 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch add-documentation-2023-12-28 in repository https://gitbox.apache.org/repos/asf/airflow-site.git omit 29f4c981b3 Add documentation for packages - 2023-12-28 add 10fab59006 Add

Re: [PR] Update description of release process to include options for next RCs [airflow]

2023-12-31 Thread via GitHub
potiuk commented on code in PR #36506: URL: https://github.com/apache/airflow/pull/36506#discussion_r1438861450 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -992,36 +992,55 @@ that the Airflow works as you expected. Once the vote has been passed, you will need to send a

svn commit: r66366 - /dev/airflow/providers/ /release/airflow/providers/

2023-12-31 Thread potiuk
Author: potiuk Date: Sun Dec 31 10:23:26 2023 New Revision: 66366 Log: Release Airflow Providers on 2023-12-31 Added: release/airflow/providers/apache_airflow_providers_alibaba-2.7.1-py3-none-any.whl - copied unchanged from r66365,

Re: [PR] Update description of release process to include options for next RCs [airflow]

2023-12-31 Thread via GitHub
hussein-awala commented on code in PR #36506: URL: https://github.com/apache/airflow/pull/36506#discussion_r1438859874 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -992,36 +992,55 @@ that the Airflow works as you expected. Once the vote has been passed, you will need to

[PR] Update description of release process to include options for next RCs [airflow]

2023-12-31 Thread via GitHub
potiuk opened a new pull request, #36506: URL: https://github.com/apache/airflow/pull/36506 Often we excluded individual providers from release and we have two options how to handle them - either release them on their own with an accelerated vote, or include the providers in the next wave

(airflow) branch constraints-main updated: Updating constraints. Github run id:7369577956

2023-12-31 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 265e1dc96f Updating

Re: [PR] [POC][WIP] Async SQLAlchemy sessions in Airflow [airflow]

2023-12-31 Thread via GitHub
potiuk commented on PR #36504: URL: https://github.com/apache/airflow/pull/36504#issuecomment-1872896761 Also - I tihnk there is a completely separate question on what we do with "secrets" . I guess this sync/async configuration should also apply to secrets and we should extend our

(airflow) branch main updated: Add fab provider to boring-cyborg.yml (#36505)

2023-12-31 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new d7cb1a0498 Add fab provider to boring-cyborg.yml

Re: [PR] Add fab provider to boring-cyborg.yml [airflow]

2023-12-31 Thread via GitHub
eladkal merged PR #36505: URL: https://github.com/apache/airflow/pull/36505 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

  1   2   >