Re: HDFS DataNode daily log growing really high and fast

2011-11-01 Thread Ronen Itkin
...@cloudera.com wrote: Hi, On Mon, Oct 31, 2011 at 12:59 AM, Ronen Itkin ro...@taykey.com wrote: For instance, yesterday's daily log: /var/log/hadoop/hadoop-hadoop-datanode-ip-10-10-10-4.log on the problematic Node03 was in the size of 1.1 GB while on other Nodes the same log was in the size of 87

Re: HDFS DataNode daily log growing really high and fast

2011-10-31 Thread Ronen Itkin
, Ronen Itkin ro...@taykey.com wrote: Hey all! I am having an issue with hadoop's daily datanode log growing to + 1.8 GB. I have 3 Nodes in my hdfs cluster, all sharing the same configuration (including same log4j.properties). While running operations and jobs equally (automatically) on whole

Re: Question regarding hdfs synchronously / asynchronously block replication

2011-10-07 Thread Ronen Itkin
operation, quell the replica deficit. Don't think that's configurable, however, it would be interesting use case for speeding up writes, while trading off some reliability. EF On Wed, Oct 5, 2011 at 1:53 AM, Ronen Itkin ro...@taykey.com wrote: Hi all! My question is regarding hdfs block

Question regarding hdfs synchronously / asynchronously block replication

2011-10-05 Thread Ronen Itkin
! -- * Ronen Itkin* Taykey | www.taykey.com

Re: Timer jobs

2011-09-01 Thread Ronen Itkin
, no matter if one or two particular machines in the cluster is down. Any suggestions are very welcome. Regards, Per Steffensen -- * Ronen Itkin* Taykey | www.taykey.com

Re: Timer jobs

2011-09-01 Thread Ronen Itkin
in a distribued Oozie setup, so that jobs gets triggered even if one or two machines are down? Regards, Per Steffensen Ronen Itkin skrev: Hi Try to use Oozie for job coordination and work flows. On Thu, Sep 1, 2011 at 12:30 PM, Per Steffensen st...@designware.dk wrote: Hi I use