Hey Puneet, You can use the GCS to GCS operator, you'll only need a service account with access in both buckets. https://airflow.apache.org/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/transfers/gcs_to_gcs/index.html
Carlos Magalhães (Ele/He/Él) Data Engineer [email protected] mobile: +55 (11) 9 3229-1706 phone: +55 (11) 3500-4570 <[email protected]> DP6 You imagine, our data science makes it possible On Thu, Sep 21, 2023 at 4:17 AM Puneet Jindal < [email protected]> wrote: > Hi Airflow community, > > I have a question for you. > > I need to transfer a large number of files(images/videos) from my > organisation's GCS bucket to my client's GCS bucket. > > How can I do that? > > Thanks, > Puneet > -- AVISO LEGAL: Esta mensagem e anexo(s) contém informações confidenciais e/ou legalmente protegidas. Caso tenha recebido por engano, favor devolvê-la ao remetente e eliminá-la do seu sistema, não divulgando ou utilizando a totalidade ou parte destas informações LEGAL NOTICE: This message and attached document(s) contain information of a confidential nature that is legally protected. If you have received this message by mistake, please reply to the sender, delete it from your system and do not disclose or use the information, in whole or in part.
