On Tue, Feb 1, 2011 at 3:17 PM, Joseph Coleman <joe.cole...@infinitecampus.com> wrote: > Sorry that was a typo on the amount of Master node although what is the > limitation of how many masters you can have? Thank you for the feedback on > the JBOD however, I am a little lost on the setup of it. Looking at a Dell > 1950 or 2950 I do not see that as an option in the raid controller setup > nor do I see that as an option when setting up Ubuntu. Is this a hardware > or software option after the fact? Do I just setup raid0 do a ext root vol > and then run a command to convert to JBOD. Sorry for the ignorance this is > just new to me and I want to get it right the first time. > > Thanks > > > > > On 2/1/11 10:06 AM, "Sean Bigdatafun" <sean.bigdata...@gmail.com> wrote: > >>- hbase-user >> >>No raid should be used, use JBOD instead. I do not think you can setup 3 >>master nodes in current Hadoop version, can you explain why you believe >>so? >> >>Thanks, >> >> >>On Tue, Feb 1, 2011 at 7:50 AM, Joseph Coleman < >>joe.cole...@infinitecampus.com> wrote: >> >>> Hi all not sure where to ask this question but here it goes. I have been >>> playing with Hadoop for a while now in a test environment before we >>>setup >>> and deploy a productions environment. I am using Hadoop 0.20.0 on >>>Ubuntu >>> 10.04 LTS install on Dell 1950's currently. >>> >>> My question is what raid should I be using for my data nodes? I haven't >>> come across anything that clearly spells it out I have used raid1 and >>>then >>> EXT4 filesystem but I know this isn't right after further research but >>>not >>> sure what do do. I will be setting up 3 masters in a cluster which I >>>will >>> raid out. And roughly 10 datanodes running hdfs and hbase and a separate >>> zookeeper cluster. Any thoughts or recommendations on the clustering >>>would >>> be much appreciated. >>> >>> Thanks, >>> Joe >>> >>> >>> >> >> >>-- >>--Sean > >
JBOD in your case means either: 1) Do not use your RAID controller 2) Setup your raid controller with N devices using a 1 to 1 mapping with physical disks /dev/sda -> disk1 /dev/sdb -> disk2 ... Good luck.