AW: Under-replication warnings for Distributed Cache?

2011-08-15 Thread Christoph Schmitz
> Von: Harsh J [mailto:ha...@cloudera.com] > Gesendet: Dienstag, 16. August 2011 07:15 > An: mapreduce-user@hadoop.apache.org > Betreff: Re: Under-replication warnings for Distributed Cache? > > On Mon, Aug 15, 2011 at 7:10 PM, Christoph Schmitz > wrote: > >

Re: Under-replication warnings for Distributed Cache?

2011-08-15 Thread Harsh J
On Mon, Aug 15, 2011 at 7:10 PM, Christoph Schmitz wrote: > Still, I have two questions: Shouldn't there be an automatic limit of > mapred.submit.replication to the number of data nodes? And more generally, > should I worry about this warning? 1> That'd somehow bind MR to HDFS more tightly. Bes

Under-replication warnings for Distributed Cache?

2011-08-15 Thread Christoph Schmitz
Hi, we're running an 8-node Hadoop cluster with CDH2. Recently, our monitoring tools caught warnings like this one when fsck'ing the HDFS: /tmp/hadoop-tgp/mapred/system/job_201105191458_1857/job.jar: Under replicated blk_-6996370258385460742_366223. Target Replicas is 10 but found 8 replica(s)