Adding to what Varun has said, Resource Manager log will be of help here to
confirm same.
The code snippet which you have mentioned is correct. But it also has a
check that if the number of active application is less than 1, this check
wont be performed. And it seems you have only one application.
Hi Philip,
The cluster metrics in the screenshot attached shows that there are no active
nodes.
Have you started any Node Manager process ?
-Varun Saxena.
From: Phillip Wu [mailto:phillip...@unsw.edu.au]
Sent: 15 June 2016 15:28
To: user@hadoop.apache.org
Cc: Sunil Govind; Varun saxena
Subject:
Hello Hadoop community,
we are running hadoop in AWS(not EMR) but hortonworks distro on EC2
instance. Everything is all setup and working as expected. Our design
calls for running HDFS/data nodes on local/ephemeral storage and we have 3X
replication enabled by default, all of the metastore (hive
Hi Max,
Unfortunately, we don’t have a better solution at the moment. I am wondering if
the right approach might be to use user-defined metadata
(http://docs.aws.amazon.com/AmazonS3/latest/dev/UsingMetadata.html) and put
that information along with the object that we are backing up.
However, t
Sorry for the late response. I finally caught up on most chapters on the
gitbook you linked. This was super helpful. Thanks for the pointer.
Just to make sure I understood it correctly,
1. One can send a secret as a command-line argument or environment
variable to the AM securely by
Hi Anu,
Thank for the information, the link you provided does not work.
@Hari,
Let me do some quick research on what you guys can provide and get back to
you.
On Wed, Jun 15, 2016, 10:59 AM Anu Engineer
wrote:
> Hi Max,
>
>
>
> Unfortunately, we don’t have a better solution at the moment. I a
Sorry my bad, http://docs.aws.amazon.com/AmazonS3/latest/dev/UsingMetadata.html
the closing bracket was attached to the URL.
Thanks
Anu
From: max scalf
Date: Wednesday, June 15, 2016 at 2:48 PM
To: Anu Engineer , HDP mailing list
Subject: Re: HDFS backup to S3
Hi Anu,
Thank for the infor
Hi,
How do people do multi node maintenance for HDFS without data loss?
We want to apply the ideas of immutable infrastructure to how we manage our
machines. We prebuild an OS image with the configuration and roll it out to
our nodes. When we have a patch we build a new image and roll that out
ag
Hi Community,
As part of the new authorisation changes, we need to change the permissions
and owners of many files in hdfs (2.6.0) with chmod and chown.
To do this we need to stop the processing on the directories to avoid
inconsistencies in permissions, hence we need to take a downtime for those
Hello Ravi,
You might consider using DistCh. In the same way that DistCp is a distributed
copy implemented as a MapReduce job, DistCh is a MapReduce job that distributes
the work of chmod/chown.
DistCh will become easier to access through convenient shell commands in Apache
Hadoop 3. In vers
10 matches
Mail list logo
