[airflow] branch main updated: Fix false-positive spellcheck failure (#29190)

2023-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e1a14ae9ee Fix false-positive spellcheck failure (#

[GitHub] [airflow] potiuk merged pull request #29190: Fix false-positive spellcheck failure

2023-01-26 Thread via GitHub
potiuk merged PR #29190: URL: https://github.com/apache/airflow/pull/29190 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] wonhyeongseo commented on pull request #29176: fix: type annotation for `num_of_dpus` in GlueJobHook

2023-01-26 Thread via GitHub
wonhyeongseo commented on PR #29176: URL: https://github.com/apache/airflow/pull/29176#issuecomment-1405968684 ![image](https://user-images.githubusercontent.com/29195190/215002637-9640348f-8c43-4138-898b-0376b264a8c6.png) Updated as you suggested, @Taragolis! Thank you so much for guidin

[airflow] branch constraints-main updated: Updating constraints. Build id:

2023-01-26 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 03266f3e01 Updating con

[GitHub] [airflow] o-nikolas commented on a diff in pull request #29190: Fix false-positive spellcheck failure

2023-01-26 Thread via GitHub
o-nikolas commented on code in PR #29190: URL: https://github.com/apache/airflow/pull/29190#discussion_r1088465313 ## airflow/providers/amazon/aws/utils/tags.py: ## @@ -24,7 +24,7 @@ def format_tags(source: Any, *, key_label: str = "Key", value_label: str = "Valu If given

[GitHub] [airflow] github-actions[bot] commented on pull request #28291: Add script to move providers to a new directory structure

2023-01-26 Thread github-actions
github-actions[bot] commented on PR #28291: URL: https://github.com/apache/airflow/pull/28291#issuecomment-1405841723 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

[GitHub] [airflow] github-actions[bot] commented on pull request #28292: Draft POC attempt to make a better structure for providers

2023-01-26 Thread github-actions
github-actions[bot] commented on PR #28292: URL: https://github.com/apache/airflow/pull/28292#issuecomment-1405841691 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

[GitHub] [airflow] Taragolis opened a new pull request, #29190: Fix false-positive spellcheck failure

2023-01-26 Thread via GitHub
Taragolis opened a new pull request, #29190: URL: https://github.com/apache/airflow/pull/29190 Annoying error in local AWS Documentation build ```console ❯ breeze build-docs --package-filter apache-airflow-providers-amazon == apache-airflow-provid

[GitHub] [airflow] snjypl commented on pull request #29188: AIP-44 Migrate Dagbag.sync_to_db to internal API.

2023-01-26 Thread via GitHub
snjypl commented on PR #29188: URL: https://github.com/apache/airflow/pull/29188#issuecomment-1405824206 i tried the below code to check the serialization/deserialization: ``` from airflow.models.dagbag import DagBag from airflow.serialization.serialized_objects import BaseSeriali

[GitHub] [airflow] snjypl commented on pull request #29188: AIP-44 Migrate Dagbag.sync_to_db to internal API.

2023-01-26 Thread via GitHub
snjypl commented on PR #29188: URL: https://github.com/apache/airflow/pull/29188#issuecomment-1405818900 Hi Team @potiuk @mhenc @mhenc this task appears to be more complex than i expected. i went through the [AIP 44, ](https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-44+Ai

[airflow] branch main updated: mark DBs created during RDS system tests as not publicly accessible (#29187)

2023-01-26 Thread onikolas
This is an automated email from the ASF dual-hosted git repository. onikolas pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e588c4a5d0 mark DBs created during RDS system tes

[GitHub] [airflow] o-nikolas merged pull request #29187: mark DBs created during RDS system tests as not publicly accessible

2023-01-26 Thread via GitHub
o-nikolas merged PR #29187: URL: https://github.com/apache/airflow/pull/29187 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

[GitHub] [airflow] snjypl opened a new pull request, #29188: AIP-44 Migrate Dagbag.sync_to_db to internal API.

2023-01-26 Thread via GitHub
snjypl opened a new pull request, #29188: URL: https://github.com/apache/airflow/pull/29188 Fixes: [#28615](https://github.com/apache/airflow/issues/28615) --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/b

[GitHub] [airflow] potiuk commented on pull request #29171: Added Snowflake provider to the Docker image

2023-01-26 Thread via GitHub
potiuk commented on PR #29171: URL: https://github.com/apache/airflow/pull/29171#issuecomment-1405787133 > I am not sure how to fix static check that is requiring to regenerate the image with `breeze`. The message printed is: ``` Image generation is needed. Please run this c

[airflow] branch main updated: Fix asset compilation in start-airflow (#29185)

2023-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c231f1174d Fix asset compilation in start-airflow (

[GitHub] [airflow] potiuk merged pull request #29185: Fix asset compilation in start-airflow

2023-01-26 Thread via GitHub
potiuk merged PR #29185: URL: https://github.com/apache/airflow/pull/29185 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] francescomucio commented on pull request #29171: Added Snowflake provider to the Docker image

2023-01-26 Thread via GitHub
francescomucio commented on PR #29171: URL: https://github.com/apache/airflow/pull/29171#issuecomment-1405760030 I am not sure how to fix static check that is requiring to regenerate the image with `breeze`. -- This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [airflow] potiuk commented on pull request #28444: Fix GCSToBigQueryOperator not respecting schema_obj

2023-01-26 Thread via GitHub
potiuk commented on PR #28444: URL: https://github.com/apache/airflow/pull/28444#issuecomment-1405760068 > Hi, when will this be released? It is not in apache-airflow[gcp]==2.5.1. Why do you think so ? -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [airflow] vandonr-amz opened a new pull request, #29187: mark DBs created during RDS system tests as not publicly accessible

2023-01-26 Thread via GitHub
vandonr-amz opened a new pull request, #29187: URL: https://github.com/apache/airflow/pull/29187 there is a security risk with having DBs publicly accessible, even if it's for a short time span and they are deleted afterwards. ran the tests on my machine, and they still pass with this

[airflow] branch main updated (2493476a7e -> 58d1fff27f)

2023-01-26 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 2493476a7e introduce base class for EKS sensors (#29053) add 58d1fff27f Also remove mypy cache when stopping bree

[GitHub] [airflow] eladkal merged pull request #29184: Also remove mypy cache when stopping breeze

2023-01-26 Thread via GitHub
eladkal merged PR #29184: URL: https://github.com/apache/airflow/pull/29184 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

[airflow] branch main updated (5f8ceb2ff3 -> 2493476a7e)

2023-01-26 Thread onikolas
This is an automated email from the ASF dual-hosted git repository. onikolas pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 5f8ceb2ff3 shorten poke intervals on systems tests (#29183) add 2493476a7e introduce base class for EKS sensors

[GitHub] [airflow] o-nikolas merged pull request #29053: introduce base class for EKS sensors

2023-01-26 Thread via GitHub
o-nikolas merged PR #29053: URL: https://github.com/apache/airflow/pull/29053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

[GitHub] [airflow] o-nikolas commented on issue #28289: Add AWS Neptune hook and operators

2023-01-26 Thread via GitHub
o-nikolas commented on issue #28289: URL: https://github.com/apache/airflow/issues/28289#issuecomment-1405698042 > Thanks for the patience @shubham22 @o-nikolas > > I am finished with the implementation. However, for writing tests for operators, I am not sure, how to proceed with the

[airflow] branch main updated: shorten poke intervals on systems tests (#29183)

2023-01-26 Thread onikolas
This is an automated email from the ASF dual-hosted git repository. onikolas pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 5f8ceb2ff3 shorten poke intervals on systems test

[GitHub] [airflow] o-nikolas merged pull request #29183: shorten poke intervals on systems tests

2023-01-26 Thread via GitHub
o-nikolas merged PR #29183: URL: https://github.com/apache/airflow/pull/29183 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

[GitHub] [airflow] syun64 commented on pull request #8545: [AIRFLOW-249] Refactor the SLA mechanism (Continuation from #3584 )

2023-01-26 Thread via GitHub
syun64 commented on PR #8545: URL: https://github.com/apache/airflow/pull/8545#issuecomment-1405683118 @auvipy are you currently working on this PR? If not, I'm happy to take the ideas and open up a new one that's works out of the DagFileProcessor/DagFileProcessingManager -- This is an a

[GitHub] [airflow] Taragolis commented on issue #29177: SimpleHttpOperator not working with loginless auth_type

2023-01-26 Thread via GitHub
Taragolis commented on issue #29177: URL: https://github.com/apache/airflow/issues/29177#issuecomment-1405669839 More constructive discussions usually happen in the PR! Looking forward to your Pull Request 🥳 BTW, you could create PR without creating issue there is no restriction for

[GitHub] [airflow] jens-scheffler-bosch commented on pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-26 Thread via GitHub
jens-scheffler-bosch commented on PR #27063: URL: https://github.com/apache/airflow/pull/27063#issuecomment-1405665838 Hi @ashb && @bbovenzi applied feedback, resolved merge conflict, added screen snippets, reverted part 2 of AIP-50 - ready for next stage of review! -- This is an automate

[GitHub] [airflow] jens-scheffler-bosch commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-26 Thread via GitHub
jens-scheffler-bosch commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1088336825 ## airflow/www/templates/airflow/trigger.html: ## @@ -27,11 +27,93 @@ {% endblock %} +{% macro form_element(form_key, form_details) %} + + +

[GitHub] [airflow] potiuk commented on pull request #29185: Fix asset compilation in start-airflow

2023-01-26 Thread via GitHub
potiuk commented on PR #29185: URL: https://github.com/apache/airflow/pull/29185#issuecomment-1405661526 After this one is merged, errors in asset compilation in start-airflow will be visible like that: https://user-images.githubusercontent.com/595491/214951998-06b4ffac-97e4-4592-b703

[GitHub] [airflow] Taragolis commented on pull request #29176: fix: type annotation for `num_of_dpus` in GlueJobHook

2023-01-26 Thread via GitHub
Taragolis commented on PR #29176: URL: https://github.com/apache/airflow/pull/29176#issuecomment-1405659794 🤣 `mypy` became crazy when tried to make static check against condition in Hook https://github.com/apache/airflow/blob/c4c14c07a99b1554346a426aa947e68eb52ce31e/airflow/provider

[GitHub] [airflow] potiuk opened a new pull request, #29185: Fix asset compilation in start-airflow

2023-01-26 Thread via GitHub
potiuk opened a new pull request, #29185: URL: https://github.com/apache/airflow/pull/29185 The recent change #29080 introduced missing black import in the pre-commit that run the compilation. The compilation happened in the background thread and it's ouptut was only visible in the asset_co

[GitHub] [airflow] Taragolis commented on pull request #28459: Migrate remaining Always & CLI tests to `pytest`

2023-01-26 Thread via GitHub
Taragolis commented on PR #28459: URL: https://github.com/apache/airflow/pull/28459#issuecomment-1405644763 👀 😢 👀 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[GitHub] [airflow] jens-scheffler-bosch commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-26 Thread via GitHub
jens-scheffler-bosch commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1088325402 ## airflow/www/templates/airflow/trigger.html: ## @@ -27,11 +27,93 @@ {% endblock %} +{% macro form_element(form_key, form_details) %} + + +

[GitHub] [airflow] jens-scheffler-bosch commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-26 Thread via GitHub
jens-scheffler-bosch commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1088324192 ## airflow/www/static/js/trigger.js: ## @@ -19,33 +19,190 @@ /* global document, CodeMirror, window */ -const textArea = document.getElementById('js

[GitHub] [airflow] jens-scheffler-bosch commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-26 Thread via GitHub
jens-scheffler-bosch commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1088323671 ## airflow/www/static/js/trigger.js: ## @@ -19,33 +19,190 @@ /* global document, CodeMirror, window */ -const textArea = document.getElementById('js

[GitHub] [airflow] jens-scheffler-bosch commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-26 Thread via GitHub
jens-scheffler-bosch commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1088323111 ## airflow/example_dags/example_params_ui_tutorial.py: ## @@ -0,0 +1,234 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more c

[GitHub] [airflow] jens-scheffler-bosch commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-26 Thread via GitHub
jens-scheffler-bosch commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1088321851 ## airflow/config_templates/config.yml: ## @@ -1529,6 +1529,19 @@ webserver: type: boolean example: ~ default: "False" +trigger_

[GitHub] [airflow] potiuk opened a new pull request, #29184: Also remove mypy cache when stopping breeze

2023-01-26 Thread via GitHub
potiuk opened a new pull request, #29184: URL: https://github.com/apache/airflow/pull/29184 When Breeze is stoped, by default all volumes created are removed, unless you specify `--preserve-volumes`. The "mypy-cache-volume" was not removed because it is not created by docker-compose.

[GitHub] [airflow] potiuk commented on pull request #29184: Also remove mypy cache when stopping breeze

2023-01-26 Thread via GitHub
potiuk commented on PR #29184: URL: https://github.com/apache/airflow/pull/29184#issuecomment-1405602489 cc: @ferruzzi @vincbeck -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [airflow] vincbeck commented on a diff in pull request #29183: shorten poke intervals on systems tests

2023-01-26 Thread via GitHub
vincbeck commented on code in PR #29183: URL: https://github.com/apache/airflow/pull/29183#discussion_r1088278788 ## tests/system/providers/amazon/aws/example_athena.py: ## @@ -117,6 +119,7 @@ def read_results_from_s3(bucket_name, query_execution_id): query=query_read_t

[GitHub] [airflow] vandonr-amz opened a new pull request, #29183: shorten poke intervals on systems tests

2023-01-26 Thread via GitHub
vandonr-amz opened a new pull request, #29183: URL: https://github.com/apache/airflow/pull/29183 since https://github.com/apache/airflow/pull/28528 was merged, we respect the polling times instead of pinging the API constantly. This means that some tests that have sensors that used to wait

[GitHub] [airflow] dstandish commented on pull request #27758: Enable trigger logging in webserver

2023-01-26 Thread via GitHub
dstandish commented on PR #27758: URL: https://github.com/apache/airflow/pull/27758#issuecomment-1405520466 added docs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [airflow] vchiapaikeo commented on pull request #28942: Fix @task.kubernetes to receive input and send output

2023-01-26 Thread via GitHub
vchiapaikeo commented on PR #28942: URL: https://github.com/apache/airflow/pull/28942#issuecomment-1405481755 Hey @uranusjr , anything else I can do here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [airflow] dstandish commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

2023-01-26 Thread via GitHub
dstandish commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1088184702 ## airflow/utils/db_cleanup.py: ## @@ -159,6 +170,14 @@ def _do_delete(*, query, orm_model, skip_archive, session): logger.debug("delete statement:\n%s", delet

[GitHub] [airflow] pankajastro commented on a diff in pull request #29136: Dataproc batches

2023-01-26 Thread via GitHub
pankajastro commented on code in PR #29136: URL: https://github.com/apache/airflow/pull/29136#discussion_r1088184228 ## airflow/providers/google/cloud/hooks/dataproc.py: ## @@ -985,6 +985,68 @@ def list_batches( ) return result +@GoogleBaseHook.fallback_t

[GitHub] [airflow] dstandish commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

2023-01-26 Thread via GitHub
dstandish commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1088179007 ## airflow/utils/db_cleanup.py: ## @@ -159,6 +170,14 @@ def _do_delete(*, query, orm_model, skip_archive, session): logger.debug("delete statement:\n%s", delet

[GitHub] [airflow] eladkal commented on issue #26207: update google-video-intelligence dependency in google provider

2023-01-26 Thread via GitHub
eladkal commented on issue #26207: URL: https://github.com/apache/airflow/issues/26207#issuecomment-1405320842 Duplicate of https://github.com/apache/airflow/issues/28045 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] eladkal closed issue #26207: update google-video-intelligence dependency in google provider

2023-01-26 Thread via GitHub
eladkal closed issue #26207: update google-video-intelligence dependency in google provider URL: https://github.com/apache/airflow/issues/26207 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [airflow] eladkal commented on issue #28045: GoogleDisplayVideo360 (hooks|operators|sensors) aren't compatible with v2 of the Display & Video 360 API

2023-01-26 Thread via GitHub
eladkal commented on issue #28045: URL: https://github.com/apache/airflow/issues/28045#issuecomment-1405318675 PRs are welcome -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [airflow] grimwm commented on pull request #28444: Fix GCSToBigQueryOperator not respecting schema_obj

2023-01-26 Thread via GitHub
grimwm commented on PR #28444: URL: https://github.com/apache/airflow/pull/28444#issuecomment-1405298383 Hi, when will this be released? It is not in 2.5.1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] jonheysek commented on issue #28045: GoogleDisplayVideo360 (hooks|operators|sensors) aren't compatible with v2 of the Display & Video 360 API

2023-01-26 Thread via GitHub
jonheysek commented on issue #28045: URL: https://github.com/apache/airflow/issues/28045#issuecomment-1405271309 Looks like DV360 v1.1 API will be fully sunsetted on Feb 28, 2022, at which point the current, stable GoogleDisplayVideo360 operators won't work. https://ads-developer

[GitHub] [airflow] kolfild26 commented on pull request #28998: write to DB a user who triggered a dag via API endpoint request

2023-01-26 Thread via GitHub
kolfild26 commented on PR #28998: URL: https://github.com/apache/airflow/pull/28998#issuecomment-1405236443 > We also need a test Ok, will update once it's done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [airflow] tqtensor opened a new pull request, #29181: feat: add Dataproc preemptibility to ClusterGenerator class

2023-01-26 Thread via GitHub
tqtensor opened a new pull request, #29181: URL: https://github.com/apache/airflow/pull/29181 motivation: allowing users to specify the type of VM machine in the `secondary_worker_config`, according to the enum definition from Google's [Dataproc Python client](https://github.com/googleapis

[airflow] branch main updated: improve README_RELEASE_PROVIDER_PACKAGES.md (#29180)

2023-01-26 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c4e10ac9e7 improve README_RELEASE_PROVIDER_PACKAGE

[GitHub] [airflow] eladkal merged pull request #29180: improve `README_RELEASE_PROVIDER_PACKAGES.md`

2023-01-26 Thread via GitHub
eladkal merged PR #29180: URL: https://github.com/apache/airflow/pull/29180 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

[GitHub] [airflow] potiuk commented on pull request #29171: Added Snowflake provider to the Docker image

2023-01-26 Thread via GitHub
potiuk commented on PR #29171: URL: https://github.com/apache/airflow/pull/29171#issuecomment-1405187009 Some failures to fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [airflow] eladkal opened a new pull request, #29180: improve README_RELEASE_PROVIDER_PACKAGES.md

2023-01-26 Thread via GitHub
eladkal opened a new pull request, #29180: URL: https://github.com/apache/airflow/pull/29180 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more inf

[GitHub] [airflow] eladkal commented on issue #29103: Status of testing Providers that were prepared on January 23, 2023

2023-01-26 Thread via GitHub
eladkal commented on issue #29103: URL: https://github.com/apache/airflow/issues/29103#issuecomment-1405134915 Thank you everyone. Providers are released I invite everyone to help improve providers for the next release, a list of open bugs can be found [here](https://github.com/apache

[GitHub] [airflow] eladkal closed issue #29103: Status of testing Providers that were prepared on January 23, 2023

2023-01-26 Thread via GitHub
eladkal closed issue #29103: Status of testing Providers that were prepared on January 23, 2023 URL: https://github.com/apache/airflow/issues/29103 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[airflow] annotated tag providers-papermill/3.1.1 updated (dd6cef7889 -> 3af8c9d0ba)

2023-01-26 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-papermill/3.1.1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-papermill/3.1.1 was modified! *** from dd6cef7889 (commit) to

[airflow] annotated tag providers-docker/3.5.0 updated (dd6cef7889 -> adc175fd6d)

2023-01-26 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-docker/3.5.0 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-docker/3.5.0 was modified! *** from dd6cef7889 (commit) to adc17

[airflow] annotated tag providers-apache-cassandra/3.1.1 updated (dd6cef7889 -> c59a3b29c9)

2023-01-26 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-apache-cassandra/3.1.1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-apache-cassandra/3.1.1 was modified! *** from dd6cef7889 (co

[GitHub] [airflow-site] eladkal merged pull request #728: Add documentation for packages - 2023-01-23

2023-01-26 Thread via GitHub
eladkal merged PR #728: URL: https://github.com/apache/airflow-site/pull/728 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

svn commit: r59596 - /dev/airflow/providers/ /release/airflow/providers/

2023-01-26 Thread eladkal
Author: eladkal Date: Thu Jan 26 14:40:29 2023 New Revision: 59596 Log: Release Airflow Providers on 2023-01-26 Added: release/airflow/providers/apache-airflow-providers-apache-cassandra-3.1.1.tar.gz - copied unchanged from r59595, dev/airflow/providers/apache-airflow-providers-apache

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

2023-01-26 Thread via GitHub
ephraimbuddy commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1087901858 ## airflow/utils/db_cleanup.py: ## @@ -159,6 +170,14 @@ def _do_delete(*, query, orm_model, skip_archive, session): logger.debug("delete statement:\n%s", de

[airflow-site] branch gh-pages updated: Deploying to gh-pages from @ 4384d31521b451184a22af23e224aa37e6c05321 🚀

2023-01-26 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/gh-pages by this push: new 611afc7828 Deploying to gh-pages f

[airflow-site] branch main updated: Add SAS provider to Ecosystem page

2023-01-26 Thread joshfell
This is an automated email from the ASF dual-hosted git repository. joshfell pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new 4384d31521 Add SAS provider to Ecosystem pag

[GitHub] [airflow-site] josh-fell merged pull request #730: Update _index.md

2023-01-26 Thread via GitHub
josh-fell merged PR #730: URL: https://github.com/apache/airflow-site/pull/730 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airfl

[GitHub] [airflow] Taragolis commented on a diff in pull request #29145: Reconfigure integration with codecov

2023-01-26 Thread via GitHub
Taragolis commented on code in PR #29145: URL: https://github.com/apache/airflow/pull/29145#discussion_r1087884202 ## .coveragerc: ## @@ -16,14 +16,25 @@ # specific language governing permissions and limitations # under the License. -[report] +[run] +branch = True +relative_

[GitHub] [airflow] Taragolis commented on a diff in pull request #29145: Reconfigure integration with codecov

2023-01-26 Thread via GitHub
Taragolis commented on code in PR #29145: URL: https://github.com/apache/airflow/pull/29145#discussion_r1087884202 ## .coveragerc: ## @@ -16,14 +16,25 @@ # specific language governing permissions and limitations # under the License. -[report] +[run] +branch = True +relative_

[GitHub] [airflow-site] AndrewShakinovsky-SAS opened a new pull request, #730: Update _index.md

2023-01-26 Thread via GitHub
AndrewShakinovsky-SAS opened a new pull request, #730: URL: https://github.com/apache/airflow-site/pull/730 Hi, please consider adding a link to our 3rd party Airflow provider. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] eladkal commented on issue #26494: [Helm Chart] Support multiple DagProcessors

2023-01-26 Thread via GitHub
eladkal commented on issue #26494: URL: https://github.com/apache/airflow/issues/26494#issuecomment-1404993715 @jtvmatos I think it's better to open a draft PR and discuss code changes over the PR -- This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [airflow] wonhyeongseo commented on pull request #29176: fix: type annotation for `num_of_dpus` in GlueJobHook

2023-01-26 Thread via GitHub
wonhyeongseo commented on PR #29176: URL: https://github.com/apache/airflow/pull/29176#issuecomment-1404906831 Ok @Taragolis. Adding in `float` instead of replacing `int` for backward compatability. I checked the files for `num_of_dpus`, and the modified two files are all there is. May you

[GitHub] [airflow] eladkal commented on issue #29153: [provider.FTP] FTP(S)FileTransmitOperator class should allow to use file-like buffer.

2023-01-26 Thread via GitHub
eladkal commented on issue #29153: URL: https://github.com/apache/airflow/issues/29153#issuecomment-1404874868 The project doesn't not require summiting Github issue for PRs so if you open a PR you can have all the information there. there is no need to also open issue. -- This is an aut

[GitHub] [airflow] eladkal commented on a diff in pull request #29145: Reconfigure integration with codecov

2023-01-26 Thread via GitHub
eladkal commented on code in PR #29145: URL: https://github.com/apache/airflow/pull/29145#discussion_r1087713721 ## .coveragerc: ## @@ -16,14 +16,25 @@ # specific language governing permissions and limitations # under the License. -[report] +[run] +branch = True +relative_fi

[GitHub] [airflow] manugarri opened a new issue, #29178: Add `output` format to missing cli commands

2023-01-26 Thread via GitHub
manugarri opened a new issue, #29178: URL: https://github.com/apache/airflow/issues/29178 ### Description I have noticed that for some commands, there is an option to get the output in json or yaml (as described in this PR from 2020 https://github.com/apache/airflow/issues/12699).

[GitHub] [airflow] Taragolis commented on pull request #29156: Add to provider.FTP possibility to use file-like objects.

2023-01-26 Thread via GitHub
Taragolis commented on PR #29156: URL: https://github.com/apache/airflow/pull/29156#issuecomment-1404751961 > The proposed fix solves my problem. And looks like might add problems for others. See [Best Practices -> Top level Python Code](https://airflow.apache.org/docs/apache-airflow

[GitHub] [airflow] Taragolis commented on pull request #29176: fix: type annotation for `num_of_dpus` in GlueJobHook

2023-01-26 Thread via GitHub
Taragolis commented on PR #29176: URL: https://github.com/apache/airflow/pull/29176#issuecomment-1404718315 Yeah, statics check failed: ```console airflow/providers/amazon/aws/hooks/glue.py:97: error: Incompatible types in assignment (expression has type "float", variable has typ

[GitHub] [airflow] potiuk commented on a diff in pull request #29147: Rename most pod_id usage to pod_name in KubernetesExecutor

2023-01-26 Thread via GitHub
potiuk commented on code in PR #29147: URL: https://github.com/apache/airflow/pull/29147#discussion_r1087574419 ## airflow/executors/kubernetes_executor.py: ## @@ -353,12 +353,12 @@ def run_next(self, next_job: KubernetesJobType) -> None: self.run_pod_async(pod, **self.

[GitHub] [airflow] boring-cyborg[bot] commented on issue #29177: SimpleHttpOperator not working with loginless auth_type

2023-01-26 Thread boring-cyborg
boring-cyborg[bot] commented on issue #29177: URL: https://github.com/apache/airflow/issues/29177#issuecomment-1404686007 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] sirVir opened a new issue, #29177: SimpleHttpOperator not working with loginless auth_type

2023-01-26 Thread via GitHub
sirVir opened a new issue, #29177: URL: https://github.com/apache/airflow/issues/29177 ### Apache Airflow Provider(s) http ### Versions of Apache Airflow Providers apache-airflow-providers-http==4.1.1 ### Apache Airflow version 2.5.0 ### Operating Sys

[GitHub] [airflow] kuikeelc commented on pull request #26993: Fix ti._try_number for deferred and up_for_reschedule tasks

2023-01-26 Thread via GitHub
kuikeelc commented on PR #26993: URL: https://github.com/apache/airflow/pull/26993#issuecomment-1404685906 @bbovenzi That is correct. We have an off-by-1 issue. It is the same issue with every task. There is no operator in particular that has this bug. I use the remote_logging option. The l

[GitHub] [airflow] Taragolis commented on pull request #29176: fix: type annotation for `num_of_dpus` in GlueJobHook

2023-01-26 Thread via GitHub
Taragolis commented on PR #29176: URL: https://github.com/apache/airflow/pull/29176#issuecomment-1404683241 You also need to change in Operator (potentially in other places) https://github.com/apache/airflow/blob/2e90c06c3eaf6a8cd0d7f4055274834158879440/airflow/providers/amazon/aws/op

[GitHub] [airflow] francescomucio commented on pull request #29171: Added Snowflake provider to the Docker image

2023-01-26 Thread via GitHub
francescomucio commented on PR #29171: URL: https://github.com/apache/airflow/pull/29171#issuecomment-1404674067 I did the changes in the doc files -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g