here is my searchd.conf: Include db.conf MultipleDBConnections yes UtfStorage yes AllowFrom 127.0.0.1 MaxThreads 10 WordForms en,sp,es,ru WordForms on Include ucharset.conf Include stopwords.conf
and my searchd.conf Include db.conf UtfStorage yes MaxDocsAtOnce 100 Include ucharset.conf Include stopwords.conf HTTPHeader User-Agent: MSProxy/1.0 Period 90d MaxDocsPerServer 10000 Clones yes DeleteNoServer no Follow yes FollowOutside yes Server http://localhost/ CheckOnly \.arj$ \.tar$ \.zip$ \.tgz$ \.gz$ CheckOnly \.lha$ \.lzh$ \.tar\.Z$ \.rar$ \.zoo$ CheckOnly \.gif$ \.jpg$ \.jpeg$ \.bmp$ \.tiff$ CheckOnly \.vdo$ \.mpeg$ \.mpe$ \.mpg$ \.avi$ \.movie$ CheckOnly \.mid$ \.mp3$ \.rm$ \.ram$ \.wav$ \.aiff$ CheckOnly \.vrml$ \.wrl$ \.png$ CheckOnly \.exe$ \.cab$ \.dll$ \.bin$ \.class$ CheckOnly \.rtf$ \.pdf$ \.cdf$ \.ps$ CheckOnly \.rpm$ DisallowNoMatch ://[^/]*\.ar/ Disallow /cgi-bin/ \.cgi /nph Disallow redirect.php3 Disallow \.tif$ \.au$ \.mov$ \.jpe$ \.cur$ \.qt$ Disallow \.b$ \.sh$ \.md5$ \.rpm$ Disallow \.arj$ \.tar$ \.zip$ \.tgz$ \.gz$ Disallow \.lha$ \.lzh$ \.tar\.Z$ \.rar$ \.zoo$ Disallow \.gif$ \.jpg$ \.jpeg$ \.bmp$ \.tiff$ \.xpm$ \.xbm$ Disallow \.vdo$ \.mpeg$ \.mpe$ \.mpg$ \.avi$ \.movie$ Disallow \.mid$ \.mp3$ \.rm$ \.ram$ \.wav$ \.aiff$ \.ra$ Disallow \.vrml$ \.wrl$ \.png$ Disallow \.exe$ \.cab$ \.dll$ \.bin$ \.class$ Disallow \.tex$ \.texi$ \.xls$ \.doc$ \.texinfo$ Disallow \.rtf$ \.pdf$ \.cdf$ \.ps$ Disallow \.ai$ \.eps$ \.ppt$ \.hqx$ Disallow \.cpt$ \.bms$ \.oda$ \.tcl$ Disallow \.o$ \.a$ \.la$ \.so$ \.so\.[0-9]$ Disallow \.pat$ \.pm$ \.m4$ \.am$ Disallow \?D=A$ \?D=A$ \?D=D$ \?M=A$ \?M=D$ \?N=A$ \?N=D$ \?S=A$ \?S=D$ Disallow [^:]// AddType text/plain \.pl$ \.js$ \.txt$ \.h$ \.c$ \.pm$ \.e$ AddType text/html \.html$ \.htm$ AddType image/x-xpixmap \.xpm$ AddType image/x-xbitmap \.xbm$ AddType image/gif \.gif$ AddType application/unknown .* Tag 1 Server http://www.mysite.com/ Tag 2 Include domsnew1.txt Include domsnew2.txt Thank in advance, Dmitri ----- Original Message ----- From: "Alexander F Avdonkin" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Wednesday, May 15, 2002 4:16 AM Subject: Re: [aseek-users] Memory utilization and scalability > Dmitri Kovalsky wrote: > > > ----- Original Message ----- > > From: "Alexander F Avdonkin" <[EMAIL PROTECTED]> > > To: <[EMAIL PROTECTED]> > > Sent: Tuesday, May 14, 2002 12:01 PM > > Subject: Re: [aseek-users] Memory utilization and scalability > > > > > Dmitri Kovalsky wrote: > > > > > > > I have 13G binary database and 33G MySQL database, and I got two > > problems: > > > > - index -D always says mysql server is gone away, but I have mysql > > > > configured using my-huge.cnf, with hundreds of megs for primary keys and > > > > buffers. > > > > > > > > > > Which version of ASPseek and MySQL are you using ? > > > > I am using MySQL 3.23.41 and ASPseek 1.2.8, gradually upgraded > > from 1.2.6 > > > > Strange, do you use "IncremetalCitations yes" and "CompactStorage yes" ? > > > > > Best Regards. > > Dmitri Kovalsky > > > > > > > > > > > > > - searchd always consumes 1.5G of RAM > > > > > > On start searchd consumes at least MAX_URL_ID * 4 bytes. Recently we > > found > > > two memleaks in searchd. > > > Take latest CVS version. > > > > I will try it, it would not broke sql or binary databases? > > No > > > > > > > > > > > > > > > > > > > > > My machine is Dual 1Ghz pentium III with 2Gb of RAM running RedHat 7.2 > > with > > > > latest updates. > > > > So what I'd like to know, if, firstly I got something messed up or I > > just > > > > need more horsepower, and secondly, about searchd, is it ok or I should > > buy > > > > more RAM? > > > > > > > > Also, what is the best way to use more than one machine for aspseek? > > > > > > > > Best Regards, > > > > Dmitri > > > > > > > > > -- > > > www.Argentina.com > > > E-mail Profesional y Acceso a Internet UltraVeloz totalmente GRATIS en > > > Buenos Aires, Rosario, Cordoba, Mendoza, La Plata y Pilar > > > > > > > > > -- > www.Argentina.com > E-mail Profesional y Acceso a Internet UltraVeloz totalmente GRATIS en > Buenos Aires, Rosario, Cordoba, Mendoza, La Plata y Pilar > >
