Hey Imran, This looks reasonable but it's hard to say without knowing what the read/write workload is like. You say all searches are done using Solr... will that also be hosted on these servers?
One thing. It looks like you have two servers for ZK? ZK should always be run in odd numbers (1, 3, 5, or 7). For a cluster of this size, you are already sensitive to a failure of the NN so you could just put ZK on the master node. It has RAID so you won't be sensitive to a single disk failure. Otherwise 3 nodes. JG > -----Original Message----- > From: Imran M Yousuf [mailto:[email protected]] > Sent: Thursday, December 16, 2010 9:04 PM > To: [email protected] > Subject: [RFC] Deployment layout and server configurations > > Hi, > > I will go straight to the point, we are purchasing hardwares for going live. > Currently we are targeting a data capacity of ~5TB with a view to increase > capacity as the load increases. I have attached a tentative schematic as > attachment. Please give us feedback on the network organization and > additional tools as you see necessary. > > * The HBase cluster will be in a separate 1Gbps network, connected through > a managed switch. > * Currently we do not have any MapReduce jobs, only Gets and occasional > Scans. All searches are done using Solr. Application layer caching will also > be > in place. > * 6 DN+RS, each with 1TBX4 7.2k RPM Enterprise HDD, 12GB ECC RAM, 1 X > X3440/E5560 (4C/8T) > * 1 NN+MN RAID 1 with 400GB 15k SAS HDD, 12GB ECC RAM, 1 X > X3440/E5560 (4C/8T) > * ZK - 500GB 7.2k RPM, 4GB ECC RAM, 1 X X3440/E5560 (4C/8T) > * ZK + Gangrila + Nagios - 500GB 7.2k RPM, 8GB ECC RAM, 1 X X3440/E5560 > (4C/8T) > > It would really be helpful for me if you would kindly help us on whether > these configurations are sufficient or not. The nature of the application > running is a E-Commerce PaaS initially. Later when we add additional > applications to the stack we will be able to increase the capacity. > > Regards, > > -- > Imran M Yousuf > Twitter: @imyousuf - http://twitter.com/imyousuf > Blog: http://imyousuf-tech.blogs.smartitengineering.com/ > Mobile: +880-1711402557
