Re: Why block sizes shown by 'fsck' and '-stat' are inconsistent?

2014-04-05 Thread Harsh J
The fsck is showing you an average block size, not the block size metadata attribute of the file like stat shows. In this specific case, the average is just the length of your file, which is lesser than one whole block. On Sat, Apr 5, 2014 at 8:21 AM, sam liu samliuhad...@gmail.com wrote: Hi

Fwd: customize containter-log4j.properties

2014-04-05 Thread Federico Baldo
Hi there, I am trying to customize the log format of containers, as a first step I have tried using a containter-log4j.properties with a different value for log4j.appender.CLA.layout.ConversionPattern located in the container's classpath. Tthe result is that the syslog file is written to:

Re: Why block sizes shown by 'fsck' and '-stat' are inconsistent?

2014-04-05 Thread sam liu
Thanks for your comments! As I mentioned HDFS use only what it needs on the local file system. For example, a 16 KB hdfs file only use 16 KB local file system storage, not 64 MB(its hdfs block size) storage. In this case, *what's the use of the block size(64 MB) of the 16 KB file?* 2014-04-05

Re: Why block sizes shown by 'fsck' and '-stat' are inconsistent?

2014-04-05 Thread Harsh J
The block size is a meta attribute. If you append to the file later, it still needs to know when to split further - so it keeps that value as a mere metadata it can use to advise itself on write boundaries. On Sat, Apr 5, 2014 at 7:35 PM, sam liu samliuhad...@gmail.com wrote: Thanks for your

Re: customize containter-log4j.properties

2014-04-05 Thread Harsh J
This is intentional, and only within MR2's scope - we do not support configuring the formatting, but do support switching the levels (via job properties). You should still be able to customise your own YARN apps' logging configuration though. On Sat, Apr 5, 2014 at 7:09 PM, Federico Baldo

customize containter-log4j.properties

2014-04-05 Thread Federico Baldo
Hi there, I am trying to customize the log format of containers, as a first step I have tried using a containter-log4j.properties with a different value for log4j.appender.CLA.layout.ConversionPattern located in the container's classpath. Tthe result is that the syslog file is written to:

how to install and distribute master services in 4 nodes.

2014-04-05 Thread Alex Lee
Trying to install hadoop by horton, there some many master services, such as HDFS, Yarn+mapreduce, Nagios, Ganglia, Hive, Hbase and Pig as the image below. http://postimg.org/image/pwbv6go33/ Currently, only have 4 nodes, and as below, 3 nodes may ocuppy by master services, and only 1 node