Re: hdfs daemon commands not working

2020-09-23 Thread Mingliang Liu
You need to check the NameNode service log to get more details. On Wed, Sep 16, 2020 at 9:45 AM Muthupandiyan, Kamaraj < kamaraj.muthupandi...@hpe.com> wrote: > Hi Team, > > > > hdfs - - daemon commands are not responding , whenever executing its > simply exiting . Please help me on this. > > >

Re: [DISCUSS] fate of branch-2.9

2020-08-27 Thread Mingliang Liu
> are there any Hadoop branch-2 releases planned, ever? If so I'll need to backport my s3a directory compatibility patch to whatever is still live. The branch-2 is gone. I think you mean branch-2.10, Steve. Many HBase users are still using Hadoop 2, so I hope Hadoop 2.10.x should still be

Re: [DISCUSS] fate of branch-2.9

2020-08-27 Thread Mingliang Liu
+1 for putting 2.9 lines to EOL. Let's focus on 2.10 releases for Hadoop 2. Also is there any plan for 2.10.1? It has been 11 months since 2.10 first release. Thanks, On Wed, Aug 26, 2020 at 10:57 PM Wei-Chiu Chuang wrote: > Bump up this thread after 6 months. > > Is anyone still interested

Re: setting up Load balancer for name nodes

2020-08-25 Thread Mingliang Liu
gt; [hdfs@sym-hdfsnn2 hadoop]$ hdfs --daemon stop datanode > > > > Regards, > > Kamaraj > > > > > > *From: *Muthupandiyan, Kamaraj > *Sent: *Sunday, August 23, 2020 9:22 PM > *To: *Mingliang Liu > *Cc: *user@hadoop.apache.org > *Subject: *RE:

Re: setting up Load balancer for name nodes

2020-08-21 Thread Mingliang Liu
Hi Kamaraj, I don't think the feature you are referring to exists in Hadoop 2.9.2. The feature was brought up by JIRA https://issues.apache.org/jira/browse/HADOOP-15707 which is released in Hadoop 3.2+ (see "Fixed Version") Also, you may want to go through the Hadoop manual/doc for your current

Re: Error while running "hdfs fs" commands

2020-08-21 Thread Mingliang Liu
Seems that you have a wrong fs.defaultFS configuration in your core-site.xml For the second command you should follow the user manual. The input is simply not valid. Try something like: hadoop fs -ls hdfs://sym-hdfsnn1.lvs.nimblestorage.com/user or hadoop fs -ls file:///tmp On Fri, Aug 21, 2020

Re: When is an hdfs-* service restart required?

2017-09-07 Thread Mingliang Liu
Restarting datanode(s) only is OK in this case. Thanks, > On Sep 7, 2017, at 10:46 AM, Kellen Arb wrote: > > Hello, > > I have a seemingly simple question, to which I can't find a clear answer. > > Which services/node-types must be restarted for each of the configuration

Re: Safe mode on after restarting hadoop

2016-12-22 Thread Mingliang Liu
Anu gave good analysis. Another simple case is that NN takes time to process the block reports before leaving the safe mode. You can monitor the safe mode report for progress. Check NN log for more information. L > On Dec 22, 2016, at 8:02 AM, Chathuri Wimalasena wrote:

Re: Class org.apache.hadoop.fs.s3a.S3A not found

2016-12-16 Thread Mingliang Liu
You may need the hadoop-aws-version.jar (and aws-java-sdk.jar) in your classpath. For new project, have a look at the latest S3A progress: https://github.com/apache/hadoop/blob/release-3.0.0-alpha1-RC0/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md

Re: HDFS Balancer - Recommended Threshold Value

2016-08-11 Thread Mingliang Liu
This email thread should go to user@ which is for end-user questions and discussion, instead of hdfs-dev@ My 2 cents: > The original design of Balancer is intentionally to make it run slowly so > that the balancing activities won't affect the normal cluster activities and > the running jobs.

Re: Unsubscribe footer for user@h.a.o messages

2015-11-05 Thread Mingliang Liu
+1 (non-binding) On Nov 5, 2015, at 12:50 PM, Arpit Agarwal > wrote: Apache project mailing lists can add unsubscribe footers to messages. E.g. >From spark-user.

Re: Hadoop Java exception

2015-10-08 Thread Mingliang Liu
If you use Maven or Gradle, you can set up your config files there. It’s easier to maintain the dependency. Mingliang Liu Member of Technical Staff - HDFS, Hortonworks Inc. m...@hortonworks.com<mailto:m...@hortonworks.com> On Oct 8, 2015, at 10:04 AM, Odin Guillermo Caudillo Ga