Re: Blocks replication in downtime even

2009-04-28 Thread Piotr
Hi

What happens when the node rejoins then ?

   - The replication level of several blocks increases ?
   - The old replicas are removed in favor of new replicas ? (Or the new
   ones)

regards
Piotr

2009/4/27 Stas Oskin stas.os...@gmail.com

 Thanks.

 2009/4/27 Koji Noguchi knogu...@yahoo-inc.com

  http://hadoop.apache.org/core/docs/current/hdfs_design.html#Data+Disk+Fa
  ilure%2C+Heartbeats+and+Re-Replication
 http://hadoop.apache.org/core/docs/current/hdfs_design.html#Data+Disk+Fa%0Ailure%2C+Heartbeats+and+Re-Replication
 
 
  hope this helps.
 
  Koji
 
  -Original Message-
  From: Stas Oskin [mailto:stas.os...@gmail.com]
  Sent: Monday, April 27, 2009 4:11 AM
  To: core-user@hadoop.apache.org
  Subject: Blocks replication in downtime even
 
  Hi.
 
  I have a question:
 
  If I have N of DataNodes, and one or several of the nodes have become
  unavailable, would HDFS re-synchronize the blocks automatically,
  according
  to replication level set?
  And if yes, when? As soon as the offline node was detected, or only on
  file
  access?
 
  Regards.
 



Re: Blocks replication in downtime even

2009-04-28 Thread Stas Oskin
Hi.

I think one needs to run balancer in order to clean out the redundant
blocks.

Can anyone confirm this?

Regards.

2009/4/28 Piotr piotr.prac...@gmail.com

 Hi

 What happens when the node rejoins then ?

   - The replication level of several blocks increases ?
   - The old replicas are removed in favor of new replicas ? (Or the new
   ones)

 regards
 Piotr

 2009/4/27 Stas Oskin stas.os...@gmail.com

  Thanks.
 
  2009/4/27 Koji Noguchi knogu...@yahoo-inc.com
 
  
 http://hadoop.apache.org/core/docs/current/hdfs_design.html#Data+Disk+Fa
   ilure%2C+Heartbeats+and+Re-Replication
 
 http://hadoop.apache.org/core/docs/current/hdfs_design.html#Data+Disk+Fa%0Ailure%2C+Heartbeats+and+Re-Replication
  
  
   hope this helps.
  
   Koji
  
   -Original Message-
   From: Stas Oskin [mailto:stas.os...@gmail.com]
   Sent: Monday, April 27, 2009 4:11 AM
   To: core-user@hadoop.apache.org
   Subject: Blocks replication in downtime even
  
   Hi.
  
   I have a question:
  
   If I have N of DataNodes, and one or several of the nodes have become
   unavailable, would HDFS re-synchronize the blocks automatically,
   according
   to replication level set?
   And if yes, when? As soon as the offline node was detected, or only on
   file
   access?
  
   Regards.
  
 



RE: Blocks replication in downtime even

2009-04-27 Thread Koji Noguchi
http://hadoop.apache.org/core/docs/current/hdfs_design.html#Data+Disk+Fa
ilure%2C+Heartbeats+and+Re-Replication

hope this helps.

Koji

-Original Message-
From: Stas Oskin [mailto:stas.os...@gmail.com] 
Sent: Monday, April 27, 2009 4:11 AM
To: core-user@hadoop.apache.org
Subject: Blocks replication in downtime even

Hi.

I have a question:

If I have N of DataNodes, and one or several of the nodes have become
unavailable, would HDFS re-synchronize the blocks automatically,
according
to replication level set?
And if yes, when? As soon as the offline node was detected, or only on
file
access?

Regards.


Re: Blocks replication in downtime even

2009-04-27 Thread Stas Oskin
Thanks.

2009/4/27 Koji Noguchi knogu...@yahoo-inc.com

 http://hadoop.apache.org/core/docs/current/hdfs_design.html#Data+Disk+Fa
 ilure%2C+Heartbeats+and+Re-Replicationhttp://hadoop.apache.org/core/docs/current/hdfs_design.html#Data+Disk+Fa%0Ailure%2C+Heartbeats+and+Re-Replication

 hope this helps.

 Koji

 -Original Message-
 From: Stas Oskin [mailto:stas.os...@gmail.com]
 Sent: Monday, April 27, 2009 4:11 AM
 To: core-user@hadoop.apache.org
 Subject: Blocks replication in downtime even

 Hi.

 I have a question:

 If I have N of DataNodes, and one or several of the nodes have become
 unavailable, would HDFS re-synchronize the blocks automatically,
 according
 to replication level set?
 And if yes, when? As soon as the offline node was detected, or only on
 file
 access?

 Regards.