>>>>> On Mon, 20 Mar 2006 09:35:18 -0700, Michael Morgan <[EMAIL PROTECTED]> >>>>> said: > > I apologize for not posting this resolution sooner, but time has been > scarce lately. Most of the responses I received pointed to some sort of > index problem with the bacula database. I talked with my partner and he > reindexed the database and then set up a cron job to vacuum and reindex > the database every night. Since then, the problem has been solved. > > I can now build a restore directory tree of over 100k files in only a > second or two. A side benefit is that the backup job itself has been > reduced from 1.5 hours to just 30 minutes or less. > > As a side note, this was not a migrated or upgraded installation, it was > a new installation. There must be something in the initial tables or > configuration that does not index properly. Once the indexes were > cleaned up, everything went much more smoothly.
That's good hear. It might be the regular vacuum and reindex cron that keeps it fast. With some versions of PostgreSQL at least, indexes become less efficient if you delete and insert lots of the rows (like Bacula does with the File table). __Martin > > Thanks for all your help. > > Mike > > Martin Simmons wrote: > >>>>>>On Thu, 9 Mar 2006 08:40:25 -0000, "Andrew Paterson" <[EMAIL > >>>>>>PROTECTED]> said: > >> > >>Yes, > >> I've had this happen to me on at least one ocasion & I beleive it > >>ultimately amounts to the director (I think) running out of memory. > >>I sincerely hope I'm wrong, but it looks to me like bacula builds its file > >>tree in memory & if so, then well thats just asking for trouble isnt it - I > >>dread the days when I have to do a restore from a full backup for this very > >>reason. > >>Does anyone know if bacula builds its directory/file tree in memory or does > >>it use work files as it should? > > > > > > How many files? Note that even at 1KB per file entry in memory, 102000 > > files > > would only requie 100MB. > > > > A common cause of slowness in restore is missing indexes in the database. > > > > __Martin > > > > > > > >>Thanks > >> > >>Andrew R Paterson > >>DS Ltd. > >>Cedar Office Park > >>Cobham Road > >>Ferndown > >>Dorset BH21 7SB > >> > >>www.ds.co.uk > >> > >> > >>-----Original Message----- > >>From: [EMAIL PROTECTED] > >>[mailto:[EMAIL PROTECTED] Behalf Of Michael > >>Morgan > >>Sent: 08 March 2006 8:34PM > >>To: bacula-users@lists.sourceforge.net > >>Subject: [Bacula-users] Trouble restoring backed up file > >> > >> > >>I am trying to restore a single file or directory from a full backup > >>job. However, when I specify the jobid in the console, it just sits > >>there telling me it is building the file tree. I tried it from a > >>smaller, incremental job, and it seemed to build the tree ok, but this > >>large full backup just doesn't happen. > >> > >>The backup job is 102k file count and approximately 18GB. How long > >>should I expect this to take to build the file tree? > >> > >>Thanks > >>-- > >>Michael L. Morgan > >>Director of Operations > >>Iodynamics, LLC > >>(435) 760-1046 > >> > >> > >>------------------------------------------------------- > >>This SF.Net email is sponsored by xPML, a groundbreaking scripting language > >>that extends applications into web and mobile media. Attend the live webcast > >>and join the prime developer group breaking into this new coding territory! > >>http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642 > >>_______________________________________________ > >>Bacula-users mailing list > >>Bacula-users@lists.sourceforge.net > >>https://lists.sourceforge.net/lists/listinfo/bacula-users > >> > >> > >>------------------------------------------------------- > >>This SF.Net email is sponsored by xPML, a groundbreaking scripting language > >>that extends applications into web and mobile media. Attend the live webcast > >>and join the prime developer group breaking into this new coding territory! > >>http://sel.as-us.falkag.net/sel?cmd_______________________________________________ > >>Bacula-users mailing list > >>Bacula-users@lists.sourceforge.net > >>https://lists.sourceforge.net/lists/listinfo/bacula-users > >> > > > > > > > > ------------------------------------------------------- > > This SF.Net email is sponsored by xPML, a groundbreaking scripting language > > that extends applications into web and mobile media. Attend the live webcast > > and join the prime developer group breaking into this new coding territory! > > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642 > > _______________________________________________ > > Bacula-users mailing list > > Bacula-users@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/bacula-users > > -- > Michael L. Morgan > Director of Operations > Iodynamics, LLC > (435) 760-1046 > > > ------------------------------------------------------- > This SF.Net email is sponsored by xPML, a groundbreaking scripting language > that extends applications into web and mobile media. Attend the live webcast > and join the prime developer group breaking into this new coding territory! > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642 > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > ------------------------------------------------------- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642 _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
