Actually 3Gb of RAM will be required only during "index -D". It can take about 2 months to index 50M URLs Number of threads is 50-100.
Other requirements: Kernel version >= 2.4.xx Mysql version >= 3.23.xx. Also tables "urlword" and "urlwordsNN" should be created to allow total size of DB files > 4Gb using AVG_ROW_LENGTH and MAX_ROWS clauses of "create table". After indexing of those urls you can index another 50M urls using "-s0", so total size will be about 100M. Diego Montalvo �����(�): > Alex, > > 3Gb for index, while index is running? At how many > threads ./index -N "?" > > I how many days, do you think someone can make a 50 > million+ database with ASPSeek, with the above > hardware? > > Diego > > --- Alexander F Avdonkin <[EMAIL PROTECTED]> wrote: > > Theoretically ASPseek can handle 50M URLs > > Hardware required: > > RAM - 4Gb (1 Gb for MySQL + 3Gb for "index") > > HDD - 350Gb > > > > > > Diego Montalvo �����(�): > > > > > Hello, > > > > > > Is ASPSeek capable of handling 50 million + > > documents? > > > What about MySQL? > > > > > > Estimate: what type of Hardware would be needed? > > > Harddrives, RAM, etc... > > > > > > Rough estimates are cool! > > > > > > Diego > > > > > > __________________________________________________ > > > Do You Yahoo!? > > > Find the one for you at Yahoo! Personals > > > http://personals.yahoo.com > > > > __________________________________________________ > Do You Yahoo!? > Find the one for you at Yahoo! Personals > http://personals.yahoo.com
