Re: how to add a shareable node label?

2016-10-04 Thread Sunil Govind
Hi Frank, As far as I checked, all labels are "exclusive" in 2.7. In upcoming 2.8 release, we can get "non-exclusive" or sharable node labels. Thanks Sunil On Wed, Oct 5, 2016 at 8:40 AM Frank Luo wrote: > I am using Hadoop 2.7.3, when I run: > > $ yarn rmadmin

how to add a shareable node label?

2016-10-04 Thread Frank Luo
I am using Hadoop 2.7.3, when I run: $ yarn rmadmin -addToClusterNodeLabels "Label1(exclusive=false)" I got an error as: … addToClusterNodeLabels: java.io.IOException: label name should only contains {0-9, a-z, A-Z, -, _} and should not started with {-,_} If I just use “Label1”, it will work

Re: native snappy library not available: this version of libhadoop was built without snappy support.

2016-10-04 Thread Wei-Chiu Chuang
It seems to me this issue is the direct result of MAPREDUCE-6577 Since you’re on a CDH cluster, I would suggest you to move up to CDH5.7.2 or above where this bug is fixed. Best, Wei-Chiu Chuang > On Oct 4, 2016, at 1:26 PM, Wei-Chiu

Test for INFRA-12554 - please ignore (user)

2016-10-04 Thread sebb
Test for INFRA-12554 - please ignore - To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org For additional commands, e-mail: user-h...@hadoop.apache.org

HDFS Issues.

2016-10-04 Thread Steve Brenneis
I have an HDFS cluster of three nodes. They are all running on Amazon EC2 instances. I am using HDFS for an HBase backing store. Periodically, I will start the cluster and the name node stays in safe mode because it says the number of live datanodes has dropped to 0. The number of live

Re: native snappy library not available: this version of libhadoop was built without snappy support.

2016-10-04 Thread Uthayan Suthakar
Hi Wei-Chiu, My Hadoop version is Hadoop 2.6.0-cdh5.7.0. But when I checked the native, it shows that it is installed: hadoop checknative 16/10/04 21:01:30 INFO bzip2.Bzip2Factory: Successfully loaded & initialized native-bzip2 library system-native 16/10/04 21:01:30 INFO zlib.ZlibFactory:

Re: native snappy library not available: this version of libhadoop was built without snappy support.

2016-10-04 Thread Wei-Chiu Chuang
Hi Uthayan, what’s the version of Hadoop you have? Hadoop 2.7.3 binary does not ship with snappy precompiled. If this is the version you have you may have to rebuild Hadoop yourself to include it. Wei-Chiu Chuang > On Oct 4, 2016, at 12:59 PM, Uthayan Suthakar >

native snappy library not available: this version of libhadoop was built without snappy support.

2016-10-04 Thread Uthayan Suthakar
Hello guys, I have a job that reads compressed (Snappy) data but when I run the job, it is throwing an error "native snappy library not available: this version of libhadoop was built without snappy support". . I followed this instruction but it did not resolve the issue:

HDFS Replication Issue

2016-10-04 Thread Eric Swenson
I have set up a single node cluster (initially) and am attempting to write a file from a client outside the cluster. I’m using the Java org.apache.hadoop.fs.FileSystem interface to write the file. While the write call returns, the close call hangs for a very long time, eventually returns, but