[Bacula-users] Thank you bacula, it rock's
Hi all, sometimes it's also important to say that bacula rocks. Yesterday, one customer loose it's two disk of data on the same raid1. After changing the two disk, we start restoring the data from bacula. Some hours after, they can start working today, without any lost. If someone want to know, bacula is version 1.38.11 ( quiet old no ? ) It's always a real pleasure, to work with such a piece of cake software. Thank you to all -- Bruno Friedmann -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Secure way to move volumes between pools
Reynier Pérez Mira wrote: > Hi every: > I have a lot of Pools (one for each Client) and I want to move the > volumes stored in some of those Pools to another Pool for better > organization. For example I want to move all the volumes from > SP_F09_STA_Pool to Facultades_Pool. Is that possible? How to deal with > Catalog? Any advice on this? Any tip? Best -- Ing. Reynier Pérez Mira -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Automatic running backup Job when Client Online ?
Dear Bacula Users, Is there any documentation out there that i can read how to setup bacula, so when the client online (plug the cable to the network or through WiFi) the bacula backup job for that client run automatically after 10 minutes for example ? Thanks! Warm Regards, Wildan Maulana OpenThink Labs http://www.tobethink.com/ -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape size problem.
On 07/13/2009 14:41, sieber wrote: > I tryied with defcompression and compression... > > With estimate command I got: > *estimate > The defined Job resources are: > 1: BackupCatalog > 2: RestoreFiles > 3: bkp > 4: RestoreBkp > Select Job resource (1-4): 3 > Using Catalog "MyCatalog" > Connecting to Client cli01 at 192.168.2.2:9102 > 2000 OK estimate files=263224 bytes=96,554,302,366 > > So, the total size in estimate fits in the tape with HW comp. enabled. > > No, the total size is below the maximum compressed capacity of the tape. Hardware compression isn't magical. It's not even nearly as good as software compression, which itself cannot compress incompressible data. The only benefit to hardware compression is that the device does it without overhead (if the device is any good, anyway). Your tape capacity is 40GB, with up to 260% compression in hardware. If your data set includes a bunch of JPEGs, MPEGs, or archive files, you're only going to get 40GB of data on that tape. If there are a lot of text files and sparse binary files, you might get close to 104GB on the tape. Since you're getting 46GB, it would seem most of your data is pretty incompressible. -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape size problem.
On Mon, Jul 13, 2009 at 2:41 PM, sieber wrote: > > I tryied with defcompression and compression... > > With estimate command I got: > *estimate > The defined Job resources are: > 1: BackupCatalog > 2: RestoreFiles > 3: bkp > 4: RestoreBkp > Select Job resource (1-4): 3 > Using Catalog "MyCatalog" > Connecting to Client cli01 at 192.168.2.2:9102 > 2000 OK estimate files=263224 bytes=96,554,302,366 > > So, the total size in estimate fits in the tape with HW comp. enabled. > > So, after bacula writed 46GB he send's the message: > 13-Jul 11:39 bkp-sd JobId 12: Please mount Volume "seila" or label a new one > for: > Job: bkp.2009-07-13_09.28.22_03 > Storage: "AIT-1" (/dev/nst0) > Pool: Semanal > Media type: 8mm > 13-Jul 12:39 bkp-sd JobId 12: Please mount Volume "seila" or label a new one > for: > Job: bkp.2009-07-13_09.28.22_03 > Storage: "AIT-1" (/dev/nst0) > Pool: Semanal > Media type: 8mm > > I Understood that bacula wants another tape to continue the backup process > because the ftape is full. Is that right? > So, how can I enable the HW compression? > Its either full or the tape hit an error. Fitting 46GB on a 40GB tape looks to me that hardware compression is on. Is your data either random or already compressed? John -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tape size problem.
I tryied with defcompression and compression... With estimate command I got: *estimate The defined Job resources are: 1: BackupCatalog 2: RestoreFiles 3: bkp 4: RestoreBkp Select Job resource (1-4): 3 Using Catalog "MyCatalog" Connecting to Client cli01 at 192.168.2.2:9102 2000 OK estimate files=263224 bytes=96,554,302,366 So, the total size in estimate fits in the tape with HW comp. enabled. So, after bacula writed 46GB he send's the message: 13-Jul 11:39 bkp-sd JobId 12: Please mount Volume "seila" or label a new one for: Job: bkp.2009-07-13_09.28.22_03 Storage: "AIT-1" (/dev/nst0) Pool: Semanal Media type: 8mm 13-Jul 12:39 bkp-sd JobId 12: Please mount Volume "seila" or label a new one for: Job: bkp.2009-07-13_09.28.22_03 Storage: "AIT-1" (/dev/nst0) Pool: Semanal Media type: 8mm I Understood that bacula wants another tape to continue the backup process because the ftape is full. Is that right? So, how can I enable the HW compression? Thank You! +-- |This was sent by sie...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Speed writing to tape drive
On Mon, Jul 13, 2009 at 12:26 PM, Hayden Katzenellenbogen wrote: > John, > > For now the DB is on the same raid partition. I our DB admin is building > a new high availability pair that I will move it onto soon. > > The data that I am accessing is local but like you said spooling should > help I have about 1.3T of data. How much should I spool at a time? 50G? > I use 5G for multi-terabyte backups but I am also running multiple concurrent jobs from different servers at the same time. John -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Speed writing to tape drive
John, For now the DB is on the same raid partition. I our DB admin is building a new high availability pair that I will move it onto soon. The data that I am accessing is local but like you said spooling should help I have about 1.3T of data. How much should I spool at a time? 50G? Thanks H -Original Message- From: John Drescher [mailto:dresche...@gmail.com] Sent: Wednesday, July 08, 2009 9:28 AM To: Hayden Katzenellenbogen Cc: Bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Speed writing to tape drive On Wed, Jul 8, 2009 at 12:12 PM, Martin Simmons wrote: >> On Mon, 6 Jul 2009 10:14:09 -0700, Hayden Katzenellenbogen said: >> >> Hello, >> >> Thanks to a patch published two weeks ago I am finally making headway >> into the wonderful world of Bacula. I have a single machine right now >> with about 1.2T of data I am backing up. >> >> When I run the btape fill test I get write speeds of around 70MB/s when >> I run a full backup from the local machine I get about 20MB/s is there >> anyway to figure out where the bottle neck is? > > Are you using software compression (gzip) in Bacula? > > What do "top" and "iostat 10" show when running a backup? > > You could try using tar to check the speed of your filesystem, e.g. > > time tar cf /dev/null /some/very/large/directory > Could also be the database. I mean if the db is on the same raid array as the source disk do not expect 70MB/s backups. Spooling attributes should help some in this case. John -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Speed writing to tape drive
Martin, I am not using Gzip in Bacula. The drive I have does hardware compression I thought that would be enough for now. I seem to be getting about 1.2T on an 800G LTO4 tape. Here is the iostat output during a full backup. I will try and do the tar test later this week. avg-cpu: %user %nice %system %iowait %steal %idle 0.280.000.080.200.00 99.43 Device:tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn sda 0.41 3.9810.42 23966207 62765414 sdb 11.46 1159.01 623.79 6979515937 3756450992 sr1 0.00 0.00 0.00 8 0 sr2 0.00 0.00 0.00 8 0 avg-cpu: %user %nice %system %iowait %steal %idle 5.300.001.096.600.00 87.00 Device:tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn sda 2.50 2.4027.97 24280 sdb 222.88 47629.17 298.10 476768 2984 sr1 0.00 0.00 0.00 0 0 sr2 0.00 0.00 0.00 0 0 avg-cpu: %user %nice %system %iowait %steal %idle 6.260.001.446.090.00 86.21 Device:tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn sda 1.00 0.8037.60 8376 sdb 261.60 54036.00 132.80 540360 1328 sr1 0.00 0.00 0.00 0 0 sr2 0.00 0.00 0.00 0 0 avg-cpu: %user %nice %system %iowait %steal %idle 4.740.000.836.380.00 88.05 Device:tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn sda 1.40 0.0031.20 0312 sdb 181.70 39100.80 133.60 391008 1336 sr1 0.00 0.00 0.00 0 0 sr2 0.00 0.00 0.00 0 0 avg-cpu: %user %nice %system %iowait %steal %idle 6.270.001.365.590.00 86.78 Device:tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn sda 0.50 0.0029.60 0296 sdb 240.30 54162.40 135.20 541624 1352 sr1 0.00 0.00 0.00 0 0 sr2 0.00 0.00 0.00 0 0 -Original Message- From: Martin Simmons [mailto:mar...@lispworks.com] Sent: Wednesday, July 08, 2009 9:13 AM To: Bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Speed writing to tape drive > On Mon, 6 Jul 2009 10:14:09 -0700, Hayden Katzenellenbogen said: > > Hello, > > Thanks to a patch published two weeks ago I am finally making headway > into the wonderful world of Bacula. I have a single machine right now > with about 1.2T of data I am backing up. > > When I run the btape fill test I get write speeds of around 70MB/s when > I run a full backup from the local machine I get about 20MB/s is there > anyway to figure out where the bottle neck is? Are you using software compression (gzip) in Bacula? What do "top" and "iostat 10" show when running a backup? You could try using tar to check the speed of your filesystem, e.g. time tar cf /dev/null /some/very/large/directory __Martin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape size problem.
On Mon, Jul 13, 2009 at 10:41 AM, sieber wrote: > > More Information: > I'm trying do re-run the job after mt-st defcompreeion=1 and compression=1... > > using mt-st > bkp:/etc/bacula# mt-st -f /dev/nst0 status > SCSI 2 tape drive: > File number=1, block number=0, partition=0. > Tape block size 0 bytes. Density code 0x39 (no translation). > Soft error count since last status=0 > General status bits on (8101): > EOF ONLINE IM_REP_EN > bkp:/etc/bacula# mt-st -f /dev/nst0 defcompression 1 > bkp:/etc/bacula# mt-st -f /dev/nst0 status > SCSI 2 tape drive: > File number=1, block number=0, partition=0. > Tape block size 0 bytes. Density code 0x39 (no translation). > Soft error count since last status=0 > General status bits on (8101): > EOF ONLINE IM_REP_EN > > If you make these changes you must blank the tape. mt -f /dev/nst0 rewind mt -f /dev/nst0 weof John -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape size problem.
On Mon, Jul 13, 2009 at 10:22 AM, sieber wrote: > > Hello people > I Have a Bacula installed on Debian Lenny with a sony ait (40/104 GB) Tape > Drive. > Bacula is working fine with backups smaller than 40gb. > But when a try to runa job with 102 GB, bacula writes only something about > 40/42 GB (the size of tape without compression). > > This way I think: The Hardware Compression could be not active... > Could this make sense? > > some information about tape/drive: > bkp:/etc/bacula# cat /proc/scsi/scsi > Attached devices: > Host: scsi0 Channel: 00 Id: 00 Lun: 00 > Vendor: VMware Model: Virtual disk Rev: 1.0 > Type: Direct-Access ANSI SCSI revision: 02 > Host: scsi0 Channel: 00 Id: 01 Lun: 00 > Vendor: SONY Model: SDX-470V Rev: 0100 > Type: Sequential-Access ANSI SCSI revision: 02 > > > bkp:/etc/bacula# mt -f /dev/nst0 status > drive type = 114 > drive status = 956301312 > sense key error = 0 > residue count = 0 > file number = 1 > block number = 0 > bkp:/etc/bacula# > > Could someone help me? > Are you writing only compressed files (.mpg, .jpg, .zip, .bz2 ...) to your backup or is software compression on? John -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tape size problem.
More Information: I'm trying do re-run the job after mt-st defcompreeion=1 and compression=1... using mt-st bkp:/etc/bacula# mt-st -f /dev/nst0 status SCSI 2 tape drive: File number=1, block number=0, partition=0. Tape block size 0 bytes. Density code 0x39 (no translation). Soft error count since last status=0 General status bits on (8101): EOF ONLINE IM_REP_EN bkp:/etc/bacula# mt-st -f /dev/nst0 defcompression 1 bkp:/etc/bacula# mt-st -f /dev/nst0 status SCSI 2 tape drive: File number=1, block number=0, partition=0. Tape block size 0 bytes. Density code 0x39 (no translation). Soft error count since last status=0 General status bits on (8101): EOF ONLINE IM_REP_EN +-- |This was sent by sie...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tape size problem.
Hello people I Have a Bacula installed on Debian Lenny with a sony ait (40/104 GB) Tape Drive. Bacula is working fine with backups smaller than 40gb. But when a try to runa job with 102 GB, bacula writes only something about 40/42 GB (the size of tape without compression). This way I think: The Hardware Compression could be not active... Could this make sense? some information about tape/drive: bkp:/etc/bacula# cat /proc/scsi/scsi Attached devices: Host: scsi0 Channel: 00 Id: 00 Lun: 00 Vendor: VMware Model: Virtual disk Rev: 1.0 Type: Direct-AccessANSI SCSI revision: 02 Host: scsi0 Channel: 00 Id: 01 Lun: 00 Vendor: SONY Model: SDX-470V Rev: 0100 Type: Sequential-AccessANSI SCSI revision: 02 bkp:/etc/bacula# mt -f /dev/nst0 status drive type = 114 drive status = 956301312 sense key error = 0 residue count = 0 file number = 1 block number = 0 bkp:/etc/bacula# Could someone help me? Thank You! Ed, Sao Paulo - Brazil. +-- |This was sent by sie...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fwd: OT: More about concurrent jobs...
2009/7/13 Jose E. Molina : > Ah Ok, 1 Autochanger with 2 drives should be Ok. My question was more like 2 > separate autochangers doing backups at the same time, defined on the same > bacula-sd. thanks anyway > I have not tested this (do not have the hardware) but concurrency with 2 autochangers on the same bacula-sd should also work. John -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] efficient disk backups
Hi, On Mon, 13 Jul 2009, Gavin McCullagh wrote: > I guess the time to restore is a function of the number of volumes which > must be consulted and the time seeking through each one. A single file > restore should always be a single volume but multiple files (or even all > files) could potentially come from up to 36 incrementals, a differential > and a full. On reflection that worst case would be reading three volumes, but with multiple sessions per volume: - 1 incremental volume with up to 31 sessions - 1 differential volume - 1 full volume I guess that gets slower depending how old the full volume is, but also depending on how much data changes in the period between full backups. Our mail spool increases in size by about 5GB per month which should be a rough (under-)estimate of how much the data actually changes. Gavin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Append volume Issue
> Few of the important messages I missed are , > > > 13-Jul 08:59 saturn-sd JobId 2248: 3301 Issuing autochanger "loaded? drive 0" > command. > 13-Jul 08:59 saturn-sd JobId 2248: 3302 Autochanger "loaded? drive 0", result > is Slot 23. > 13-Jul 08:59 saturn-sd JobId 2248: Error: block.c:275 Volume data error at > 0:0! Wanted ID: "BB02", got "". Buffer discarded. > 13-Jul 08:59 saturn-sd JobId 2248: Warning: Device "Drive-1" (/dev/nst0) not > configured to autolabel Volumes. > 13-Jul 08:59 saturn-sd JobId 2248: Warning: Device "Drive-1" (/dev/nst0) not > configured to autolabel Volumes. > 13-Jul 08:59 saturn-sd JobId 2248: Warning: Device "Drive-1" (/dev/nst0) not > configured to autolabel Volumes. > 13-Jul 08:59 saturn-sd JobId 2248: Warning: Device "Drive-1" (/dev/nst0) not > configured to autolabel Volumes. > 13-Jul 08:59 saturn-sd JobId 2248: Warning: Device "Drive-1" (/dev/nst0) not > configured to autolabel Volumes. > 13-Jul 08:59 saturn-sd JobId 2248: Please mount Volume "AAD463" or label a > new one for: > Job: moon_system.2009-07-13_08.59.05 > Storage: "Drive-1" (/dev/nst0) > Pool: even_week > Media type: LTO-3 > It looks like the volume label was overwritten on this tape so bacula does not recognize it. John -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fwd: OT: More about concurrent jobs...
-- Forwarded message -- From: John Drescher Date: Mon, Jul 13, 2009 at 10:08 AM Subject: Re: [Bacula-users] OT: More about concurrent jobs... To: "Jose E. Molina" On Mon, Jul 13, 2009 at 5:42 AM, Jose E. Molina wrote: > John Drescher escribió: >> You do not want concurrent jobs on your LTO3 but you do with your >> disk? I would have it the other way since disk is generally slower >> than tape. Not using compression with the disk? >> >> >> BTW, I do not know the answer to your real question. I have my disk >> storage on a different machine than my 2 drive autochager. >> >> John > > Hi John, thanks for the reply, do you do backups at the same time in > both of your autochangers? If so, I guess I'd need 2 storage daemons in > the same machine to make concurrent backups to different devices. > > As for the LTO3, i'll possibly go for concurrent backups "everywhere", > that'll be easier than having 2 storage daemons on the same machine. I > didn't do it before because I wanted to keep straight easily recoverable > tapes, instead of having interleaved data on them. > Its a 2 drive autochanger and I have only 1 storage daemon. I achieve concurrency on each drive and I also use both drives at the same time. John -- John M. Drescher -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] OT: More about concurrent jobs...
John Drescher escribió: > You do not want concurrent jobs on your LTO3 but you do with your > disk? I would have it the other way since disk is generally slower > than tape. Not using compression with the disk? > > > BTW, I do not know the answer to your real question. I have my disk > storage on a different machine than my 2 drive autochager. > > John Hi John, thanks for the reply, do you do backups at the same time in both of your autochangers? If so, I guess I'd need 2 storage daemons in the same machine to make concurrent backups to different devices. As for the LTO3, i'll possibly go for concurrent backups "everywhere", that'll be easier than having 2 storage daemons on the same machine. I didn't do it before because I wanted to keep straight easily recoverable tapes, instead of having interleaved data on them. Thanks & Cheers, -- José E. Molina -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] efficient disk backups
Hi, thanks for the response. On Mon, 13 Jul 2009, Jon Schewe wrote: > The first thing I notice is that you're doing incremental backups every > other day. I'd really encourage you to do them everyday if you can, > otherwise on that odd day you're going to be really unhappy when a disk > crashes and you've lots 2 days worth of data rather than just 1. Sorry, that was badly phrased, I would indeed being using incrementals every day. By every "other day" I meant every day that the other (differential + full) backups didn't run. > As far as spreading out the full and differential backups, the only > downside that I can see is that it'll increase your restore time as > you'll need to go back to a differential and a full to do a restore and > a lot can change in there. I thought that might be a bit of an issue alright. I guess the time to restore is a function of the number of volumes which must be consulted and the time seeking through each one. A single file restore should always be a single volume but multiple files (or even all files) could potentially come from up to 36 incrementals, a differential and a full. I can see how that might be a little slow alright :-) > One question to think about is how far back do you need to be able to > restore? I'm finding that a lot of places only need to go back 60 to 90 > days. If that's the case, then you set your recycle time much lower on > your full backups and you only keep 1 or 2 full backups. To be honest, that requirement is not as well-defined as it might be, but I'll see if I can get better information. Instinctively, I'd rather put up with the slower restore if it gave me an extra few months of backups. Time to ask for more specifics. Many thanks for your help, Gavin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] efficient disk backups
Gavin McCullagh wrote: > Hi, > > up until now, we've tended to keep backups in a fairly ad hoc manner. > People looking after a particular system have worked out their own way, be > it a proprietary backup tool, or a script of some sort. We've started > setting up bacula and I hope we'll be in a position to backup nearly every > system with it, which will have substantial advantages. > > For several of the larger systems, the script used is a standard enough > combination of rsync and hard links. It's based on ideas used here: > > http://www.mikerubel.org/computers/rsync_snapshots/ > > As there is no one "full backup", you don't need to keep several full > backups, you basically just delete the tree of old backups you don't need. > A number of our servers tend to gradually accumulate files, most of which > then go unchanged (eg maildirs, video libraries, ...) so this backup method > tends to be very space efficient. > > One server has about 300GB of data. We keep 31 consecutive days and the 1st > of each month prior to that. This costs us about 450GB of disk space. > > I'm now looking at setting up bacula for this backup -- initially using > disk storage. As a starting point, looking at chapter 25 of the manual, it > would cost about (300GB*6)*(compression ratio) just for the full backups > which is a little rough and probably involves a very large amount of > redundancy. While SATA disks are pretty cheap, caddies for our Dell MD1000 > disk array aren't :-( > > To try and reduce the space requirements, I'm considering more spread out > schemes such as: > > - full backups on first sunday of the quarter to fullvol-[123] >-> recycled after 6 months > - differential backups on first sunday of the (other) months to > diffvol-[1234] >-> recycled after 3 months > - incremental backups every other day to incvol-1 >-> recycled at end of each month > > which I think should cost us more like (300GB*3+diffs+incs)*(comp_ratio). > > Are there pitfalls in spreading things out this far? We may move to tape > at some point (either spooling or migrate), but I don't have a budget to > buy LTO4 tape drives at the minute. Is there some other technique I'm > missing that would more efficiently store these larger data stores? > The first thing I notice is that you're doing incremental backups every other day. I'd really encourage you to do them everyday if you can, otherwise on that odd day you're going to be really unhappy when a disk crashes and you've lots 2 days worth of data rather than just 1. As far as spreading out the full and differential backups, the only downside that I can see is that it'll increase your restore time as you'll need to go back to a differential and a full to do a restore and a lot can change in there. One question to think about is how far back do you need to be able to restore? I'm finding that a lot of places only need to go back 60 to 90 days. If that's the case, then you set your recycle time much lower on your full backups and you only keep 1 or 2 full backups. -- Jon Schewe | http://mtu.net/~jpschewe If you see an attachment named signature.asc, this is my digital signature. See http://www.gnupg.org for more information. For I am convinced that neither death nor life, neither angels nor demons, neither the present nor the future, nor any powers, neither height nor depth, nor anything else in all creation, will be able to separate us from the love of God that is in Christ Jesus our Lord. - Romans 8:38-39 -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Backup - TRU64
Hello, We have a mix environment of UNIX systems. Few are SuSE and Few are Compaq TRU64 systems. We have been using Bacula for Linux systems over a year now. And there is a strong demand to add TRU64 systems in the Bacula. But unfortunately could not find the Bacula rpm for TRU64 systems ( V5.1 B , V4.0 D , V4.0F etc). Can someone suggest any way out? There is also a thought to look for other backup solutions if tru64 can not be covered in Bacula. Something like Amanda. Plz suggest. Thanx, admin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] efficient disk backups
Hi, up until now, we've tended to keep backups in a fairly ad hoc manner. People looking after a particular system have worked out their own way, be it a proprietary backup tool, or a script of some sort. We've started setting up bacula and I hope we'll be in a position to backup nearly every system with it, which will have substantial advantages. For several of the larger systems, the script used is a standard enough combination of rsync and hard links. It's based on ideas used here: http://www.mikerubel.org/computers/rsync_snapshots/ As there is no one "full backup", you don't need to keep several full backups, you basically just delete the tree of old backups you don't need. A number of our servers tend to gradually accumulate files, most of which then go unchanged (eg maildirs, video libraries, ...) so this backup method tends to be very space efficient. One server has about 300GB of data. We keep 31 consecutive days and the 1st of each month prior to that. This costs us about 450GB of disk space. I'm now looking at setting up bacula for this backup -- initially using disk storage. As a starting point, looking at chapter 25 of the manual, it would cost about (300GB*6)*(compression ratio) just for the full backups which is a little rough and probably involves a very large amount of redundancy. While SATA disks are pretty cheap, caddies for our Dell MD1000 disk array aren't :-( To try and reduce the space requirements, I'm considering more spread out schemes such as: - full backups on first sunday of the quarter to fullvol-[123] -> recycled after 6 months - differential backups on first sunday of the (other) months to diffvol-[1234] -> recycled after 3 months - incremental backups every other day to incvol-1 -> recycled at end of each month which I think should cost us more like (300GB*3+diffs+incs)*(comp_ratio). Are there pitfalls in spreading things out this far? We may move to tape at some point (either spooling or migrate), but I don't have a budget to buy LTO4 tape drives at the minute. Is there some other technique I'm missing that would more efficiently store these larger data stores? Many thanks in advance, Gavin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Append volume Issue
Hello, Few of the important messages I missed are , 13-Jul 08:59 saturn-sd JobId 2248: 3301 Issuing autochanger "loaded? drive 0" command. 13-Jul 08:59 saturn-sd JobId 2248: 3302 Autochanger "loaded? drive 0", result is Slot 23. 13-Jul 08:59 saturn-sd JobId 2248: Error: block.c:275 Volume data error at 0:0! Wanted ID: "BB02", got "". Buffer discarded. 13-Jul 08:59 saturn-sd JobId 2248: Warning: Device "Drive-1" (/dev/nst0) not configured to autolabel Volumes. 13-Jul 08:59 saturn-sd JobId 2248: Warning: Device "Drive-1" (/dev/nst0) not configured to autolabel Volumes. 13-Jul 08:59 saturn-sd JobId 2248: Warning: Device "Drive-1" (/dev/nst0) not configured to autolabel Volumes. 13-Jul 08:59 saturn-sd JobId 2248: Warning: Device "Drive-1" (/dev/nst0) not configured to autolabel Volumes. 13-Jul 08:59 saturn-sd JobId 2248: Warning: Device "Drive-1" (/dev/nst0) not configured to autolabel Volumes. 13-Jul 08:59 saturn-sd JobId 2248: Please mount Volume "AAD463" or label a new one for: Job: moon_system.2009-07-13_08.59.05 Storage: "Drive-1" (/dev/nst0) Pool: even_week Media type: LTO-3 Please suggest. Thanx, admin From: Holikar, Sachin (ext) Sent: Montag, 13. Juli 2009 08:49 To: Bacula-users Subject: [Bacula-users] Append volume Issue Hello, I have recently added a volumes ( already labelled) in one of the pools which was falling short of volumes. The added volume was lying around in the libraray as it is previously. Since it was already labelled , just added to the required pool and did update pool. The volume got added with the following status, MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten 26 | AAD463 | Append| 1 | 0 |0 | 7,776,000 | 1 | 23 | 1 | LTO-3 | -00-00 00:00:00 But when actual backup started , we got an error as , 11-Jul 09:22 saturn-sd JobId 2244: Please mount Volume "AAD463" or label a new one for: Job: saturn_special_home.2009-07-10_22.05.08 Storage: "Drive-1" (/dev/nst0) Pool: even_week Media type: LTO-3 We followed this path to add a volume to the pool, add select pool enter name of the volume enter the slot number InChanger = yes Is there anything more we need to do after we add a volume to the pool? Surprisingly the required volume AAD463 already exist in the Drive. Please suggest. Thanx Admin -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
