Hello, thx for the suggestion, its defnitly worth a shot. Sooner or later we will need a script to sort the files anyway ;)
cya tobi Am Freitag, den 28.11.2008, 04:50 -0800 schrieb Kevin Keane: > This might be a totally off-the-wall idea, might not even work - or > if > it does, it may not help in the end. > > But how about doing your own "subdirectorying". Leave all 800,000 > files > in the directory where they are - and create your own parallel > directory > structure with subdirectories as you like. For instance, one per day. > > Then write a script that creates links (maybe soft links will work, > else > use hard links) from the original files into your subdirectories. You > will probably need to run this script daily. If you use hard links, > you > may be able to use the reference count for the file to find out which > files have already been linked into your directory, so you can create > new links only for those files with a reference count of 1. > > That way, the fax application will continue seeing the faxes where > you > expect them, and at the same time you have the files organized in a > backup-friendly structure. > > Now instead of backing up the single huge directory, back up the > directory structure you created yourself. > > Whether this will work, I don't know; I'm just trying to be creative. > Maybe running this script and creating all the links will take 48 > hours... > > Tobias Bartel wrote: > > Hello, > > > > i am tasked to set up daily full backups of our entire fax > communication > > and they are all stored in one single director ;). There are about > > 800.000 files in that directory what makes accessing that directory > > extremely slow. The target device is a LTO3 tape drive with an 8 > slots > > changer. > > > > With my current configuration Bacula needs ~48h to make a complete > > backup which kinda conflicts with the requirement of doing dailys. > > > > Does anybody have any suggestions on how i could speed things up? > > > > THX in advance - Tobi > > > > > > PS: I already talked to my boss and our developers and they will > change > > the system so the faxes get stored in subdirectories. But changing > that > > doesn't have a very high priority and got scheduled for next summer. > > > > > > > ------------------------------------------------------------------------- > > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > > Build the coolest Linux based applications with Moblin SDK & win > great prizes > > Grand prize is a trip for two to an Open Source event anywhere in > the world > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > > _______________________________________________ > > Bacula-users mailing list > > Bacula-users@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/bacula-users > > > > ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
