Re: Fetch container list for failed application attempt
Hello IIUC, failed attempt is not removed from attempts list. While querying for containers of failed attempt, internally resource manager gives u container from running attempt. Its some what fine as we are transferring few containers from old attempt if available. If this behavior is not correct as per your usecase, I suggest you could raise a JIRA ticket explaining the problem and folks will help in discussing the same. Thanks Sunil On Wed, Dec 14, 2016 at 5:02 PM priyanka gugale wrote: > Hi, > > I am launching a yarn application. If I kill app master, it tries to > restart application with new attempt id. Now I use yarn command, > > yarn container -list > > When I provide the Application Attempt ID of failed attempt, it lists the > container from next attempt which is in "RUNNING" state right now. > > Shouldn't this return either list of killed containers from attempt 1 or > empty list? Is this a issue or it's expected behavior? > > -Priyanka >
Re: Encrypt a directory using some key (JAVA)
Thanks Wellington,
I already looked into that. But those KMS HTTP REST API are only for key
management like create key, rollover key, delete key etc. I didn't see any
API for encrypting a zone. If there exist any, then do tell me please!
Thanks Wei-Chiu,
I looked into that. I'm able to create and encrypt the zone by using the
following code from CryptoAdmin class:
Path deepZone = new Path("/d/e/e/p/zone");
fsWrapper.mkdir(deepZone, FsPermission.getDirDefault(), true);
dfsAdmin.createEncryptionZone(deepZone, TEST_KEY, NO_TRASH);
On Thu, Dec 15, 2016 at 1:55 AM, Wei-Chiu Chuang
wrote:
> Hi
> If you have access to Hadoop codebase, take a look at CryptoAdmin class,
> which implements these two commands.
> Internally, the commands are implemented via
> DistributedFileSystem#createEncryptionZone
> and DistributedFileSystem#listEncryptionZones
>
> Regards,
> Wei-Chiu Chuang
> A very happy Clouderan
>
> On Dec 14, 2016, at 5:39 AM, Aneela Saleem wrote:
>
> Hi,
>
> I have successfully enables Hadoop with KMS and now I want to write some
> java code to create key, get keys and encrypt a directory using a key. In
> other words, I want to translate this command
>
> hdfs hdfs crypto -createZone -keyName -path /encryption_zone
>
> and
>
> hdfs hdfs crypto -listZones
>
>
> into java code.
>
>
> Any suggestions will be appreciated.
>
> Thanks
>
>
>
Re: Fetch container list for failed application attempt
Hi, Any inputs on this? I have observed this behavior on hadoop v 2.5 and 2.6. Really appreciate any help on this. -Priyanka On Wed, Dec 14, 2016 at 5:02 PM, priyanka gugale wrote: > Hi, > > I am launching a yarn application. If I kill app master, it tries to > restart application with new attempt id. Now I use yarn command, > > yarn container -list > > When I provide the Application Attempt ID of failed attempt, it lists the > container from next attempt which is in "RUNNING" state right now. > > Shouldn't this return either list of killed containers from attempt 1 or > empty list? Is this a issue or it's expected behavior? > > -Priyanka >
