Re: Anyone has tried accessing TDE using HDFS Java APIs
Hi Ajay Did you get any chance to look into this. Thanks Regards Prav On Fri, Jan 26, 2018 at 8:48 AM, praveenesh kumar wrote: > Hi Ajay > > We are using HDP 2.5.5 with HDFS 2.7.1.2.5 > > Thanks > Prav > > On Thu, Jan 25, 2018 at 5:47 PM, Ajay Kumar > wrote: > >> Hi Praveenesh, >> >> >> >> What version of Hadoop you are using? >> >> >> >> Thanks, >> >> Ajay >> >> >> >> *From: *praveenesh kumar >> *Date: *Thursday, January 25, 2018 at 8:22 AM >> *To: *"user@hadoop.apache.org" >> *Subject: *Anyone has tried accessing TDE using HDFS Java APIs >> >> >> >> Hi >> >> >> >> We are trying to access TDE files using HDFS JAVA API. The user which is >> running the job has access to the TDE zone. We have tried accessing the >> file successfully in Hadoop FS Command shell. >> >> >> >> If we pass the same file in spark using the same user, it also gets read >> properly. >> >> >> >> Its just when we are trying to use the vanila HDFS APIs, its not able to >> pick the file. And when it picks, its not able to decipher the text. The >> data is not getting decrypted. My understanding is when you pass >> hdfs-site.xml, core-site.xml and kms-site.xml to the configuration object, >> it should be able to handle keys automatically. >> >> >> >> Not sure if we need to do anything extra in JAVA API. Any pointers. There >> aren't a single example in the documentation to get the TDE files via HDFS >> Java API. >> >> >> >> Any suggestions would be much appreciated. >> >> >> >> Regards >> >> Prav >> > >
Re: Anyone has tried accessing TDE using HDFS Java APIs
Hi Ajay We are using HDP 2.5.5 with HDFS 2.7.1.2.5 Thanks Prav On Thu, Jan 25, 2018 at 5:47 PM, Ajay Kumar wrote: > Hi Praveenesh, > > > > What version of Hadoop you are using? > > > > Thanks, > > Ajay > > > > *From: *praveenesh kumar > *Date: *Thursday, January 25, 2018 at 8:22 AM > *To: *"user@hadoop.apache.org" > *Subject: *Anyone has tried accessing TDE using HDFS Java APIs > > > > Hi > > > > We are trying to access TDE files using HDFS JAVA API. The user which is > running the job has access to the TDE zone. We have tried accessing the > file successfully in Hadoop FS Command shell. > > > > If we pass the same file in spark using the same user, it also gets read > properly. > > > > Its just when we are trying to use the vanila HDFS APIs, its not able to > pick the file. And when it picks, its not able to decipher the text. The > data is not getting decrypted. My understanding is when you pass > hdfs-site.xml, core-site.xml and kms-site.xml to the configuration object, > it should be able to handle keys automatically. > > > > Not sure if we need to do anything extra in JAVA API. Any pointers. There > aren't a single example in the documentation to get the TDE files via HDFS > Java API. > > > > Any suggestions would be much appreciated. > > > > Regards > > Prav >
Re: Anyone has tried accessing TDE using HDFS Java APIs
Hi Praveenesh, What version of Hadoop you are using? Thanks, Ajay From: praveenesh kumar Date: Thursday, January 25, 2018 at 8:22 AM To: "user@hadoop.apache.org" Subject: Anyone has tried accessing TDE using HDFS Java APIs Hi We are trying to access TDE files using HDFS JAVA API. The user which is running the job has access to the TDE zone. We have tried accessing the file successfully in Hadoop FS Command shell. If we pass the same file in spark using the same user, it also gets read properly. Its just when we are trying to use the vanila HDFS APIs, its not able to pick the file. And when it picks, its not able to decipher the text. The data is not getting decrypted. My understanding is when you pass hdfs-site.xml, core-site.xml and kms-site.xml to the configuration object, it should be able to handle keys automatically. Not sure if we need to do anything extra in JAVA API. Any pointers. There aren't a single example in the documentation to get the TDE files via HDFS Java API. Any suggestions would be much appreciated. Regards Prav
