Re: Hadoop hardware specs

2008-11-04 Thread Brian Bockelman
Hey Arjit, We use all internal SATA drives in our cluster, which is about 110TB today; if we grow it to our planned 350TB, it will be a healthy mix of worker nodes w/ SATA, large internal chases (12 - 48TB), SCSI attached vaults, and fibre channel vaults. Brian On Nov 4, 2008, at 4:16

Re: Hadoop hardware specs

2008-11-04 Thread Allen Wittenauer
On 11/4/08 2:16 AM, Arijit Mukherjee [EMAIL PROTECTED] wrote: * 1-5 TB external storage I'm curious to find out what sort of specs do people use normally. Is the external storage essential or will the individual disks on each node be sufficient? Why would you need an external storage in

RE: Hadoop hardware specs

2008-11-04 Thread Zhang, Roger
now. Anyone has any idea of a workaround? Thanks and best Rgds. Roger Zhang -Original Message- From: Brian Bockelman [mailto:[EMAIL PROTECTED] Sent: 2008年11月4日 21:36 To: core-user@hadoop.apache.org Subject: Re: Hadoop hardware specs Hey Arjit, We use all internal SATA

RE: Hadoop hardware specs

2008-11-04 Thread Arijit Mukherjee
One correction - the number 5 in the mail below is my estimation of the number of nodes we might need. Can this be too small a cluster? Arijit Dr. Arijit Mukherjee Principal Member of Technical Staff, Level-II Connectiva Systems (I) Pvt. Ltd. J-2, Block GP, Sector V, Salt Lake Kolkata 700 091,

Re: Hadoop hardware specs

2008-11-04 Thread Brian Bockelman
? Thanks and best Rgds. Roger Zhang -Original Message- From: Brian Bockelman [mailto:[EMAIL PROTECTED] Sent: 2008年11月4日 21:36 To: core-user@hadoop.apache.org Subject: Re: Hadoop hardware specs Hey Arjit, We use all internal SATA drives in our cluster, which is about 110TB today