Re: Scheduler in Hadoop MR

sure, you can use multiple JTs. and also, you can deploy the every JT on different machine. On Wed, Dec 15, 2010 at 1:42 AM, Harsh J wrote: > On Thu, Dec 9, 2010 at 4:06 AM, Allen Wittenauer > wrote: > > > > On Dec 7, 2010, at 6:47 PM, Harsh J wrote: > >>> 1 - When we've two JobTrackers running

Question about copyFromLocal

Hi all, I have couple of boxes that need to periodically copy stuff from their local boxes to HDFS using HDFS Client by issuing hadoop fs -copyFromLocal src dest command on it. The file size is rather large and I am wondering is there anyway to make hadoop transmit the data compressed and when it

Re: Scheduler in Hadoop MR

On Thu, Dec 9, 2010 at 4:06 AM, Allen Wittenauer wrote: > > On Dec 7, 2010, at 6:47 PM, Harsh J wrote: >>> 1 - When we've two JobTrackers running simultaneously, each JobTracker is >>> running in a separate process? >> >> You can't run simultaneous JobTrackers for the same data-cluster >> AFAIK; o

RuntimeException: Error in configuring object - after switching from hadoop 0.20.2 to 0.21.0

Hi all, I'm using hadoop for my thesis and have implemented an application for hadoop 0.20.2 On 0.20.2 everything went fine but after switching to 0.21.0, I get the following error several times: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.Reflec