Raghu Angadi wrote:

How often is safe depends on what probabilities you are willing to accept.

I just checked on one of clusters with 4PB of data, the scanner fixes about 1 block a day. Assuming avg size of 64MB per block (pretty high), probability that 3 copies of one replica go bad in 3 weeks is of the range 1e-12. In reality it is mostly 2-3 orders less probable.

Raghu.


That's quite interesting data. Any plans to publish a paper on disk failures in an HDFS cluster?

on a related note: do you ever scan the rest of the disk for trouble, that is the OS filesystem as root, just to catch problems in the server itself that could lead to failing jobs?


Reply via email to