Hadoop fs custom commands

2012-04-01 Thread JAX
Hi guys : I wanted to make se custom Hadoop fs - commands. Is this feasible/practical? In particular. , I wanted to summarize file sizes and print some usefull estimated of things on the fly from My cluster. I'm not sure how The hadoop Shell commands are implemented... But I thought maybe

Re: how to unit test my RawComparator

2012-04-01 Thread Chris White
When hadoop is merging spill outputs, or merging map outputs in the reducer, then i can see two byte arrays being used. WIth regards to pass by reference vs value, you're right, the byte arrays are passed 'by value', but the value passed is a copy of the reference to the byte array (if that makes

Re: Hadoop fs custom commands

2012-04-01 Thread madhu phatak
Hi, All commands invoke FSShell.java code. As per my knowledge you have to change the source code and build to support custom commands. On Sun, Apr 1, 2012 at 2:11 PM, JAX jayunit...@gmail.com wrote: Hi guys : I wanted to make se custom Hadoop fs - commands. Is this feasible/practical? In

Re: setting sample text-files error

2012-04-01 Thread madhu phatak
Hi, Can you tell which version of Hadoop you are using? It seems like duplicate jars are on the classpath. 2012/1/23 Aleksandar Hudić aleksandar.hu...@gmail.com Hi I am trying to setup node and test the word count and I have a problem with last few steps. after I pack classes in the jar

Re: Regarding Hadoop 1.0.0 release

2012-04-01 Thread madhu phatak
Hi , Security features of 1.0.0. are same as 0.20.203 version .So you should be able to find documentation under 0.20.203 version. On Fri, Jan 20, 2012 at 4:03 PM, renuka renumetuk...@gmail.com wrote: down vote favorite share [fb] share [tw] Hadoop 1.0.0 is released in dec 2011. And its