Hi Deepak, Thanks for reply.
Yes. That is the option I am considering now because even apache camel needs data in local. I might need to copy data from hdfs to local if I want apache camel ( to get rid of shell). Thanks Sachit On Mon, 26 Aug 2019, 21:11 Deepak Sharma, <deepakmc...@gmail.com> wrote: > Hi Schit > PGP Encrypt is something that is not inbuilt with spark. > I would suggest writing a shell script that would do pgp encrypt and use > it in spark scala program , which would run from driver. > > Thanks > Deepak > > On Mon, Aug 26, 2019 at 8:10 PM Sachit Murarka <connectsac...@gmail.com> > wrote: > >> Hi All, >> >> I want to encrypt my files available at HDFS location using PGP Encryption >> How can I do it in spark. I saw Apache Camel but it seems camel is used >> when source files are in Local location rather than HDFS. >> >> Kind Regards, >> Sachit Murarka >> > > > -- > Thanks > Deepak > www.bigdatabig.com > www.keosha.net >
