Georgina, That would depend on your system, but approx 2GB is a common limit for various reasons. From what you describe that is probably not the problem, but it depends how you do your digs: are they Updates or Fresh?
Either way, have a look at the size of the databases that you have, and try and compare with known good versions from a backup. Mike > -----Original Message----- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf > Of Georgina Allbrook > Sent: Monday, March 13, 2006 8:49 PM > To: [email protected] > Subject: [htdig] RE: DB2 problem when running htdig > > Hi, > > Please forgive me if this is a silly question, > How would I know if the databases have grown to big? Is this > something > we can change on the server? > > I would have thought that since it sometimes works, then that > cannot be > the cause of the problem. > The last time I attempted to dig the site, it failed twice after about > 30mins any and was only sucessful the third time. It usually takes > about 6 hours for htdig create the index. This was all in one > afternoon. > > Georgina. > > -----Original Message----- > Subject: RE: [htdig] DB2 problem when running htdig > Date: Fri, 10 Mar 2006 09:45:19 -0000 > From: <[EMAIL PROTECTED]> > To: <[email protected]> > > Have your databases grown too big? The page number looks > rather large to > me, but I can't do the maths without knowing how large a page > is on your > system. > > Mike > > > -----Original Message----- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf=20 > > Of Georgina Allbrook > > Sent: Friday, March 10, 2006 3:10 AM > > To: [email protected] > > Subject: [htdig] DB2 problem when running htdig > >=20 > >=20 > > Hi all, > >=20 > > We are having a problem with our htdig process. It used to be an > > intermittent problem but now is occuring more often. > >=20 > > The output from dig has lots of lines like: > > DB2 problem...: /home/htdig/db/db.docdb: page 0: reference count > > overflow > > DB2 problem...: /home/htdig/db/db.docdb: page 137183088 > doesn't exist, > > create flag not set > > BAD TAG IN SERIALIZED DATA: 244 > > DB2 problem...: /home/htdig/db/db.docdb: page 137183088 > doesn't exist, > > create flag not set > > DB2 problem...: /home/htdig/db/db.docdb: page 137183088 > doesn't exist, > > create flag not set > >=20 > > The htdig process keeps running, but stops actually doing=20 > > anything, and > > starts to use almost all of the CPU. > > When the job is killed off htmerge does its thing but=20 > > searching returns > > no results. > >=20 > > I've searched the mailing list and have found posts reporting these > > types of errors, it seems that these errors are due to a corrupt > > database but they should not occur when running htdig with the -i > > option. =20 > >=20 > > We are using htdig -i -s and then running htmerge. > >=20 > > We are using 3.1.6, the config file has not changed for some time. > >=20 > > Does anyone have ideas or suggestions? > >=20 > > Thanks in advance, > > Georgina. > > > ------------------------------------------------------- > This SF.Net email is sponsored by xPML, a groundbreaking > scripting language > that extends applications into web and mobile media. Attend > the live webcast > and join the prime developer group breaking into this new > coding territory! > http://sel.as-us.falkag.net/sel?cmd=k&kid0944&bid$1720&dat1642 > _______________________________________________ > ht://Dig general mailing list: <[email protected]> > ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html > List information (subscribe/unsubscribe, etc.) > https://lists.sourceforge.net/lists/listinfo/htdig-general > ------------------------------------------------------- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642 _______________________________________________ ht://Dig general mailing list: <[email protected]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
