[Bacula-users] File Attributes Database Issues
Hi everyone, I am using Bacula 7.2.0 on RHEL7. Dir, sd and fd daemons running on same server. My backup size is almost 20 TB with millions of small files and writing the data to LTO4 tapes. I have run 8 jobs concurrently with different 8 LTO4 drives. While jobs are running, I had no problem with reading data from my storage device, and writing it to LTO4 tapes. I have not enabled data spooling. I have not enabled attribute spooling explicitly as well. When the running states finished, it turns "SD despooling Attributes". Eventough it is written in documentation, the default value of attribute spooling is off, it is enabled implicitly. This is the first problem. My second problem is related with the first one. My jobs are still despooling file attributes for over 24 hours. And the spool files' sizes are around 7~8 GB. I don't think it takes 24 hours to write that data to PostgreSQL database with default configuration. PostgreSQL engine is working on the same server as well. And the server has Xeon E5630 processor, 12 GB ram and 2 TB disk space for database engine. I have also tried to tune the Postgres configuration according to http://bacula.us/tuning/ . But nothing changed. Any advice and suggestions will be greatly appreciated... Thanks Can -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] File attributes report
On Apr 17, 2007, at 11:24 AM, Darien Hager wrote: > On Apr 17, 2007, at 10:25 AM, Carlos Cristóbal Sabroe Yde wrote: >> This is the scenario: >> I needed this because we had problems with file permissions >> on a file server (someone pressed the wrong combination of >> keys with a '-R' on it :- ( ) and I don't want to restore >> the whole directory tree, just see attributes of the stored >> files and work by hand from that. > > I'm guessing here... but perhaps you could try a Verify job with > Level=DiskToCatalog? Update: Nah, it seems it errors out on the first difference. I may fiddle with pulling stuff from the DB, but another possibility is to just restore the files to a seperate temporary location. If space is tight, a script could and have a script periodically cat /dev/null over the ones that are done being written... For example: find /var/temprestore/ -type f -and -mmin +5 -and -size +1 Should list all normal files in the directory that were not modified within the last five minutes and take up more than one block on the disk as candidates for space-saving wiping during the restore process. After that it should be possible to have a script iterate over all the files in the temp directory, get their permission bits, and apply them to the corresponding file in the real directory if it exists. -- --Darien A. Hager [EMAIL PROTECTED] - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] File attributes report
On Apr 17, 2007, at 10:25 AM, Carlos Cristóbal Sabroe Yde wrote:
> Thanks, I will try it.
>
> This is the scenario:
> I needed this because we had problems with file permissions on a
> file server
> (someone pressed the wrong combination of keys with a '-R' on it :-
> ( ) and I
> don't want to restore the whole directory tree, just see attributes
> of the
> stored files and work by hand from that.
I'm guessing here... but perhaps you could try a Verify job with
Level=DiskToCatalog? I'm not sure quite what the output will look
like or whether you can parse it, but it should compare the current
disk state to the state from a previous backup.
If fileset's options{} block has a verify=p, that would check only
the permission bits, and not hashes, modification times, etc. The
default is "pin5", so permission changes (even if nothing else is
different) should result in some sort of reporting.
Other alternatives include pulling the data from the catalog with SQL
queries...
--
--Darien A. Hager
[EMAIL PROTECTED]
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] File attributes report
Thanks, I will try it. This is the scenario: I needed this because we had problems with file permissions on a file server (someone pressed the wrong combination of keys with a '-R' on it :-( ) and I don't want to restore the whole directory tree, just see attributes of the stored files and work by hand from that. BTW, I'm using suse linux servers with bacula 2.0.3 on the dir, sd and fd's Thanks again. El Martes, 17 de Abril de 2007 12:38, escribió: > Use the command 'bls'. I didn't find a way to to it inside a bconsole. > > A bootstrap file is nice of course. > > Ryan Novosielski wrote: > > -BEGIN PGP SIGNED MESSAGE- > > Hash: SHA1 > > > > I could be wrong about this, but my suspicion is that you're going to > > need to supply more information than this. I personally don't know what > > you're talking about. > > > > =R > > > > Cristobal Sabroe Yde wrote: > >> Hi list. > >> > >> Is there a way to get a report of all the files with it's attibutes > >> backed up in a given jobid (and send it to a file)? > >> > >> > >> Thanks a lot! > > > > -BEGIN PGP SIGNATURE- > > Version: GnuPG v1.4.5 (MingW32) > > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org > > > > iD8DBQFGJNsGmb+gadEcsb4RAiBDAJ9n9KhDwDbgv4O8Upkj7tlk09umOgCgljXX > > wPgvZvhTHmfFZj+deM+z0VU= > > =gj07 > > -END PGP SIGNATURE- > > > > > > - > > This SF.net email is sponsored by DB2 Express > > Download DB2 Express C - the FREE version of DB2 express and take > > control of your XML. No limits. Just data. Click to get it now. > > http://sourceforge.net/powerbar/db2/ > > ___ > > Bacula-users mailing list > > Bacula-users@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Cris. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] File attributes report
Use the command 'bls'. I didn't find a way to to it inside a bconsole. A bootstrap file is nice of course. Ryan Novosielski wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > I could be wrong about this, but my suspicion is that you're going to > need to supply more information than this. I personally don't know what > you're talking about. > > =R > > Cristobal Sabroe Yde wrote: >> Hi list. >> >> Is there a way to get a report of all the files with it's attibutes >> backed up in a given jobid (and send it to a file)? >> >> >> Thanks a lot! >> > -BEGIN PGP SIGNATURE- > Version: GnuPG v1.4.5 (MingW32) > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org > > iD8DBQFGJNsGmb+gadEcsb4RAiBDAJ9n9KhDwDbgv4O8Upkj7tlk09umOgCgljXX > wPgvZvhTHmfFZj+deM+z0VU= > =gj07 > -END PGP SIGNATURE- > > > - > This SF.net email is sponsored by DB2 Express > Download DB2 Express C - the FREE version of DB2 express and take > control of your XML. No limits. Just data. Click to get it now. > http://sourceforge.net/powerbar/db2/ > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Johan Ehnberg Email: [EMAIL PROTECTED] GSM: +358503209688 WWW: http://www.ehnberg.net/johan/ - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] File attributes report
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I could be wrong about this, but my suspicion is that you're going to need to supply more information than this. I personally don't know what you're talking about. =R Cristobal Sabroe Yde wrote: > Hi list. > > Is there a way to get a report of all the files with it's attibutes > backed up in a given jobid (and send it to a file)? > > > Thanks a lot! > -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGJNsGmb+gadEcsb4RAiBDAJ9n9KhDwDbgv4O8Upkj7tlk09umOgCgljXX wPgvZvhTHmfFZj+deM+z0VU= =gj07 -END PGP SIGNATURE- - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] File attributes report
Hi list. Is there a way to get a report of all the files with it's attibutes backed up in a given jobid (and send it to a file)? Thanks a lot! -- Cristóbal Sabroe Yde [EMAIL PROTECTED] Tel.++54 358 4676183 Universidad Nacional de Río Cuarto Soporte Técnico - Centro de Cómputos Ruta 36 km. 601 X5804BYA - Río Cuarto, Córdoba Argentina Este mensaje ha sido enviado usando el servicio de Webmail de la Universidad Nacional de Rio Cuarto. Basado en Horde/IMP - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] File attributes
I'd like to write an SQL query to extract some information from the bacula catalog including file dates. I see from the bacula developers guide that the "File" table has a field named "LStat" that is defined as "File attributes in base64 encoding". I assume my file dates are in there, but how do I deal with the base64 bit? A typical entry looks like this: P0A HL4KO IHk B A A A BdD BAA Y BEU0tK BEHwQV BEHwQV A A C Thanks, Mark --- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
