Hi, I would really appreciate some guideline on it for 2 purpose: 1) To asses whether we have enough budget to start up and 2) to know what kind of setup we might need.
Eagerly looking forward for some help/guideline. Best regards, Imran On Wed, Apr 7, 2010 at 7:24 AM, Imran M Yousuf <[email protected]> wrote: > Hi Jonathan, > > Thanks for your reply. Please find my replies inline. > > On Wed, Apr 7, 2010 at 4:04 AM, Jonathan Gray <[email protected]> wrote: >> Or if you have a budget in mind, we can help you determine what would be the >> best way to allocate those dollars. >> > > That would be just great. Budget provisioned for the whole system is > approximately 27,000 USD. Among that we have budgeted for the > Hadoop+HBase cluster to 13,500 USD (for 10 servers). > >>> <snip /> >>> Have you run Solr atop HDFS? I doubt this will be performant. >>> > > We haven't tested it yet, but it is in our scope; after testing it we > will decide on which path to take. > >>> Also, to properly scope your cluster, you need to come up with actual >>> number targets if you want to be able to accurately provision hardware. >>> "not much" data now, but "lots" of data later could mean anything. >>> Decide what you want to provision for and then you can accurately do >>> so. >>> > > Hmm, I am not sure I understand correctly about provisioning but I am > giving it a try. > Our system composes of web applications for a CMS, > Accounting+Inventory System (SaaS), another web application > integrating CMS and Accounts, and Solr as a search engine. So in times > of data for the setup I would like to support 6TB of data and 4 > Billion rows. Some details are as follows. > > 2000 organizations using the SaaS. Each with 500 inventory items. Each > inventory item with MM would be at least 300k at an average. We want > to support a million transactions per organizations (average) with > each being 2k at an average. So total for the accounting system is > 4,300 GB ~ 5 TB (approx.) of data and 2,001,002,000 rows minimum. > > Each inventory item will be a content in the CMS; in addition users > can organize their contents; plus the MM will also be a content > (basically a copy of the record mentioned above). 750 GB and 2M rows > (minimum). > > I hope this helps. Eagerly waiting for some direction :). > > Thank you, > > Imran > >> <snip /> > > > > -- > Imran M Yousuf > Entrepreneur & Software Engineer > Smart IT Engineering > Dhaka, Bangladesh > Email: [email protected] > Blog: http://imyousuf-tech.blogs.smartitengineering.com/ > Mobile: +880-1711402557 > -- Imran M Yousuf Entrepreneur & Software Engineer Smart IT Engineering Dhaka, Bangladesh Email: [email protected] Blog: http://imyousuf-tech.blogs.smartitengineering.com/ Mobile: +880-1711402557
