Raghu Angadi wrote:
How often is safe depends on what probabilities you are willing to accept.
I just checked on one of clusters with 4PB of data, the scanner fixes
about 1 block a day. Assuming avg size of 64MB per block (pretty high),
probability that 3 copies of one replica go bad in 3 weeks is of the
range 1e-12. In reality it is mostly 2-3 orders less probable.
Raghu.
That's quite interesting data. Any plans to publish a paper on disk
failures in an HDFS cluster?
on a related note: do you ever scan the rest of the disk for trouble,
that is the OS filesystem as root, just to catch problems in the server
itself that could lead to failing jobs?