royberkoweee commented on pull request #9667: URL: https://github.com/apache/airflow/pull/9667#issuecomment-653909062
Hey! This small request is about allowing a `replace` flag in gcs_to_gcs operator. I thought it would be nice to have a 'replace' flag when moving files from GCS to GCS. replace meaning, ignore files that already exist in the destination and move all requested source files (True by default) If we are not replacing, list all files in the Destination GCS bucket and only keep those files which are present in Source GCS bucket and not in Destination GCS bucket Cheers ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
