Re: [PR] Fix GCSSynchronizeBucketsOperator timeout error [airflow]

2024-02-16 Thread via GitHub
potiuk commented on code in PR #37237: URL: https://github.com/apache/airflow/pull/37237#discussion_r1492285015 ## airflow/providers/google/cloud/hooks/gcs.py: ## @@ -1295,37 +1300,45 @@ def _prepare_sync_plan( destination_object: str | None, recursive: bool,

Re: [PR] Fix GCSSynchronizeBucketsOperator timeout error [airflow]

2024-02-16 Thread via GitHub
potiuk merged PR #37237: URL: https://github.com/apache/airflow/pull/37237 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Fix GCSSynchronizeBucketsOperator timeout error [airflow]

2024-02-14 Thread via GitHub
kevgeo commented on code in PR #37237: URL: https://github.com/apache/airflow/pull/37237#discussion_r1482467030 ## airflow/providers/google/cloud/hooks/gcs.py: ## @@ -1295,37 +1300,45 @@ def _prepare_sync_plan( destination_object: str | None, recursive: bool,

Re: [PR] Fix GCSSynchronizeBucketsOperator timeout error [airflow]

2024-02-10 Thread via GitHub
kevgeo commented on code in PR #37237: URL: https://github.com/apache/airflow/pull/37237#discussion_r1485205691 ## airflow/providers/google/cloud/hooks/gcs.py: ## @@ -1295,37 +1300,45 @@ def _prepare_sync_plan( destination_object: str | None, recursive: bool,

Re: [PR] Fix GCSSynchronizeBucketsOperator timeout error [airflow]

2024-02-07 Thread via GitHub
kevgeo commented on code in PR #37237: URL: https://github.com/apache/airflow/pull/37237#discussion_r1482467030 ## airflow/providers/google/cloud/hooks/gcs.py: ## @@ -1295,37 +1300,45 @@ def _prepare_sync_plan( destination_object: str | None, recursive: bool,

Re: [PR] Fix GCSSynchronizeBucketsOperator timeout error [airflow]

2024-02-07 Thread via GitHub
dirrao commented on code in PR #37237: URL: https://github.com/apache/airflow/pull/37237#discussion_r1482341323 ## airflow/providers/google/cloud/hooks/gcs.py: ## @@ -1295,37 +1300,45 @@ def _prepare_sync_plan( destination_object: str | None, recursive: bool,

[PR] Fix GCSSynchronizeBucketsOperator timeout error [airflow]

2024-02-07 Thread via GitHub
kevgeo opened a new pull request, #37237: URL: https://github.com/apache/airflow/pull/37237 This PR fixes issue #27488. It solves the timeout error when trying to synchronize large files by using the `rewrite` function instead of `copy`. There was also previously a bug when syn