On Feb 9, 2009, at 6:41 PM, Amandeep Khurana wrote:
Why would you want to have another backup beyond HDFS? HDFS itself
replicates your data so if the reliability of the system shouldnt be a
concern (if at all it is)...
It should be. HDFS is not an archival system. Multiple replicas
does not equate a backup, just like having a RAID1 or RAID5 shouldn't
make you feel safe.
HDFS is actively developed with lots of new features. Bugs creep in.
Things can become inconsistent and mis-replicated. Even though loss
due to hardware failure is small, losses due to new bugs are still
possible!
Brian
Amandeep
Amandeep Khurana
Computer Science Graduate Student
University of California, Santa Cruz
On Mon, Feb 9, 2009 at 4:17 PM, Nathan Marz <[email protected]>
wrote:
How do people back up their data that they keep on HDFS? We have
many TB of
data which we need to get backed up but are unclear on how to do this
efficiently/reliably.
