On Thu, Oct 15, 2009 at 12:51 PM, Patrick Angeles
<[email protected]> wrote:
> On Thu, Oct 15, 2009 at 12:32 PM, Edward Capriolo 
> <[email protected]>wrote:
>
>>
>> >>No need for dedicated SATA drives with
>> >>RAID for your OS. Most of that is accessed during boot time so it won't
>> >>contend that much with HDFS.
>>
>> You may want to RAID your OS. If you lose a datanode with a large
>> volume of data say (8 TB) Hadoop will begin the process of
>> re-replicating that data elsewhere, that can use cluster resources.
>>
>> You MIGHT want to avoid that, or maybe you do not care.
>>
>> Having 2 disks for the OS is a waist of bays, so we got clever. Take a
>> system with 8 drives @ 1TB. Slice off ~30 GB from two of the disks and
>> use Linux software RAID-1 MIRROR for the OS+ swap.
>>
>> Now you don't need to separate disks for the OS and you don't run the
>> risk of losing that one disk that takes down the entire DataNode.
>>
>
> Forgot to mention it, but that is exactly what we do. We considered
> net-booting as an option, but we were time-constrained and so didn't look
> that deeply into it. I'd be interested in hearing others that have used
> networked boot...
>

Patrick,

I saw someone troubleshooting netboot recently on list. There was some
minor hangup, I they got it working

http://mail-archives.apache.org/mod_mbox/hadoop-common-user/200909.mbox/%[email protected]%3e

Ed

Reply via email to