Re: lost data with 1 failed datanode and replication factor 3 in 6 node cluster

2011-10-22 Thread Uma Maheswara Rao G 72686
- Original Message - From: Ossi los...@gmail.com Date: Friday, October 21, 2011 2:57 pm Subject: lost data with 1 failed datanode and replication factor 3 in 6 node cluster To: common-user@hadoop.apache.org hi, We managed to lost data when 1 datanode broke down in a cluster of 6

Re: lost data with 1 failed datanode and replication factor 3 in 6 node cluster

2011-10-22 Thread Ossi
On Fri, Oct 21, 2011 at 3:04 PM, modemide modem...@gmail.com wrote: Hi Ossi, I'm not sure about how experienced you are with hadoop. I'm still learning myself. But here's my guess as to what happened. I apologize in advance if this is below your current knowledge of Hadoop. Hi and

lost data with 1 failed datanode and replication factor 3 in 6 node cluster

2011-10-21 Thread Ossi
hi, We managed to lost data when 1 datanode broke down in a cluster of 6 datanodes with replication factor 3. As far as I know, that shouldn't happen, since each blocks should have 1 copy in 3 different hosts. So, loosing even 2 nodes should be fine. Earlier we did some tests with replication

Re: lost data with 1 failed datanode and replication factor 3 in 6 node cluster

2011-10-21 Thread modemide
Hi Ossi, I'm not sure about how experienced you are with hadoop. I'm still learning myself. But here's my guess as to what happened. I apologize in advance if this is below your current knowledge of Hadoop. There are a couple of pieces which I know of that determine file replication in your