Re: Retrieving keys via KMS from map/reduce phase.

2015-06-19 Thread Sagar Thacker
Dear Users, Please remove me from the thread. I am no longer associated with Hadoop On Fri, Jun 19, 2015 at 2:37 PM, Sitaraman Vilayannur < vrsitaramanietfli...@gmail.com> wrote: > Thanks for the info Arun. I asked this question for a custom application of > mine wherein i > need to retrieve the

Re: Retrieving keys via KMS from map/reduce phase.

2015-06-19 Thread Sitaraman Vilayannur
Thanks for the info Arun. I asked this question for a custom application of mine wherein i need to retrieve the key from MapReduce code. Is there a way that i can replicate my keyprovider across the data nodes and then access the local key provider from MR code at each data node? If so what method

Re: Retrieving keys via KMS from map/reduce phase.

2015-06-18 Thread Arun Suresh
You really do not need to talk to the KMS directly from the MR code.. The MR framework and the DFSClient will automatically decrypt for you when the mappers are reading a file (one of the reasons why this is called "transparent" data encryption). Similarly, files that are written to an output direc

Retrieving keys via KMS from map/reduce phase.

2015-06-18 Thread Sitaraman Vilayannur
Hi, Using the key management system will i be able to store a set of keys in my keystore and then retrieve those keys later based on their aliases from within the map/reduce phase to do my encyrption/decryption activities from map reduce? Thanks Sitaraman