Jack,
sounds like a cool project indeed. Few questions for you...
1) how do you setup 50+ servers. What I mean is, installing OS,
installing all software. Setting up user accounts. Setting up SSH
keys ..etc
DO you use any software for this?
2) Is Hbase going to be the 'primary' storage for images? Meaning,
your front-end reads/writes to Hbase?
Do you also maintain a 'file storage' as a backup / alternative?
3) Do you only store the 'main image' in Hbase? How about
thumbnails, medium size, large size cousins?
4) Is this a dedicated Hbase cluster, or you are building this on top
of your existing Hadoop cluster. Will this be sharing resources with
MR jobs that you already run?
5) I notice you have 8G RAM for region servers. Hbase is very memory
hungry and specially dealing with large data sizes, I'd imagine you'd
need 24G-32G (as it was previously mentioned)
6) how long does it take for all regions to be available after a 'cold
start' of Hbase?
7) I'd be interested to know how do you do 'standby servers' for
HMaster and Hadoop Namenode
have fun
regards
Sujee
http://sujee.net
