Re: suspend and resume a job in execution?

By job, I mean an mapreduce job. I would like to suspend and resume the mapreduce job whilst it is executing. On 18-02-2015 12:10, xeonmailinglist wrote: Hi, I want to suspend a job that it is in execution when all maptasks finishes, and then resume the job later. Can I do this in yarn?

Re: adding another namenode to an existing hadoop instance

Erratum : dfs.namenode.name.dir is not unique, it can be a comma-separated list in order to have more than one dir containing the fsimage, preferably with one pointing to an NFS mount or at least on different physical disks. Sorry about that Anyway, having more than one dir won't create a

Re: adding another namenode to an existing hadoop instance

Hi This is not your hadoop version but your java version you displayed For hadoop version remove the dash : hdfs version The dfs.namenode.name.dir is the dir for the namenode process to store the filesystem image. It is unique. What you seem to be looking for is Namenode HA, how to install a

suspend and resume a job in execution?

Hi, I want to suspend a job that it is in execution when all maptasks finishes, and then resume the job later. Can I do this in yarn? Is there an API for that, or I must use the command line? Thanks,

Re: Coding mappers and reducers in java

Hi, http://www.slideshare.net/AmazonWebServices/amazon-elastic-mapreduce-deep-dive-and-best-practices-bdt404-aws-reinvent-2013 http://www.slideshare.net/AmazonWebServices/amazon-elastic-mapreduce-deep-dive-and-best-practices-bdt404-aws-reinvent-2013 seems quite good. BR, AL On 18 Feb 2015,

Apache Sentry

Hi, Has anybody worked on Apache Sentry ? Is yes, what are the challenges, pros and cons ? Thanks Krish

Re: Kerberos Security in Hadoop

Cloureda also has good documentation on setting up kerberos based cluser - This can be used even if you are not using cloudera manager to setup your cluster. On Wed, Feb 18, 2015 at 4:51 PM, Alexander Pivovarov apivova...@gmail.com wrote:

Yarn AM is abending job when submitting a remote job to cluster

I have been searching for a handle on a problem without very little clues. Any help pointing me to the right direction will be huge. I have not received any input form the Cloudera google groups. Perhaps this is more Yarn based and I am hoping I have more luck here. Any help is greatly

Kerberos Security in Hadoop

Hi, Has anybody worked on Kerberos security on Hadoop ? Can you please guide me , any document link will be appreciated ? Thanks Krish

Re: Kerberos Security in Hadoop

http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SecureMode.html https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Managing_Smart_Cards/Configuring_a_Kerberos_5_Server.html On Wed, Feb 18, 2015 at 4:49 PM, Krish Donald gotomyp...@gmail.com

Re: Kerberos Security in Hadoop

http://www.cloudera.com/content/cloudera/en/documentation/core/v5-2-x/topics/cdh_sg_authentication.html On Wed, Feb 18, 2015 at 5:49 PM, Manoj Samel manojsamelt...@gmail.com wrote: Cloureda also has good documentation on setting up kerberos based cluser - This can be used even if you are not

Re: Yarn AM is abending job when submitting a remote job to cluster

I would guess you do not have your ssl certs set up, client or server, based on the error. *...* *“Life should not be a journey to the grave with the intention of arriving safely in apretty and well preserved body, but rather to skid in broadside in a cloud of smoke,thoroughly used