Re: [Bacula-users] tape drive on 2nd server
On Mon, May 7, 2012 at 10:01 AM, Bertrand, Guy wrote: > Hi all, > > > > I have a 2 server setup: > > > > Server 1: runs bacula-dir and has a lot of disk space, so I do nightly > backups to disk > > > > Server 2: has no disk space, but has a tape drive > > > > (and no, I cannot put the tape drive on server 1) > > > > I would like to run a COPY job from the main server to store to tape on the > 2nd server. > I do not think you can currently do that, The reason is (unless something has changed that I am not aware of) is that copy jobs can only use a single storage daemon since storage daemons can not communicate. > > > I do not seem to be able to find the instructions on how to configure the > bacula-dir or bacula-sd (on both servers) to make this work. > > > > Can somebody point me in the right direction on how to do this please?? > > > > Regards, > > > > Guy > > > > > This E-mail and any of its attachments may contain Company proprietary > information, which is privileged, confidential, or subject to copyright > belonging to the Company. This E-mail is intended solely for the use of the > individual or entity to which it is addressed. If you are not the intended > recipient of this E-mail, you are hereby notified that any dissemination, > distribution, copying, or action taken in relation to the contents of and > attachments to this E-mail is strictly prohibited and may be unlawful. If > you have received this E-mail in error, please notify the sender immediately > and permanently delete the original and any copy of this E-mail and any > printout. > > -- > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- John M. Drescher -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape drive on 2nd server
On 05/07/12 16:10, John Drescher wrote: > On Mon, May 7, 2012 at 10:01 AM, Bertrand, Guy > wrote: >> Hi all, >> >> >> >> I have a 2 server setup: >> >> >> >> Server 1: runs bacula-dir and has a lot of disk space, so I do nightly >> backups to disk >> >> >> >> Server 2: has no disk space, but has a tape drive >> >> >> >> (and no, I cannot put the tape drive on server 1) >> >> >> >> I would like to run a COPY job from the main server to store to tape on the >> 2nd server. >> > I do not think you can currently do that, The reason is (unless > something has changed that I am not aware of) is that copy jobs can > only use a single storage daemon since storage daemons can not > communicate. > I'm doing something like this, but I'm using a pass-through iscsi target. It works but is more difficult to setup and maintain. Such a setup is also very picky about the network environment. Gigabit ethernet is a minimum requirement, obviously. -- Guido Falsi -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape drive on 2nd server
hi, Am 07.05.2012 um 19:50 schrieb Guido Falsi: > I'm doing something like this, but I'm using a pass-through iscsi target. why don't use NFS? I use in my case a second bacula-sd which connects to an auto changer for the month job. cu denny -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape drive on 2nd server
On 05/07/2012 03:09 PM, Denny Schierz wrote: > hi, > > Am 07.05.2012 um 19:50 schrieb Guido Falsi: > >> I'm doing something like this, but I'm using a pass-through iscsi target. > > why don't use NFS? I use in my case a second bacula-sd which connects to an > auto changer for the month job. There are a number of different reasons why using a storage volume mounted over NFS for Bacula is likely to be a bad idea, beginning with the difficulty of obtaining effective file locking and the likelihood of poor throughput. When possible, it's much better to run a storage daemon local to the actual physical storage devices. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape drive on 2nd server
On 05/07/12 21:09, Denny Schierz wrote: > hi, > > Am 07.05.2012 um 19:50 schrieb Guido Falsi: > >> I'm doing something like this, but I'm using a pass-through iscsi target. > > why don't use NFS? I use in my case a second bacula-sd which connects to an > auto changer for the month job. > Forgot a detail. The first storage is tape too, then I make copies to another tape. First tape is attached to the SD directly, secondary tape is in another building. Company wanted some warranty to recovery data in case of physical disaster. -- Guido Falsi -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape drive on 2nd server
On Mon, May 7, 2012 at 4:01 PM, Guido Falsi wrote: > On 05/07/12 21:09, Denny Schierz wrote: >> hi, >> >> Am 07.05.2012 um 19:50 schrieb Guido Falsi: >> >>> I'm doing something like this, but I'm using a pass-through iscsi target. >> >> why don't use NFS? I use in my case a second bacula-sd which connects to an >> auto changer for the month job. >> > > Forgot a detail. The first storage is tape too, then I make copies to > another tape. First tape is attached to the SD directly, secondary tape > is in another building. Company wanted some warranty to recovery data in > case of physical disaster. > Is it possible to run your backups 2 times one to each SD? Without the iscsi sharing I believe that is all you can do while bacula does not allow SD to SD communication. John -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape drive on 2nd server
On 05/07/12 22:13, John Drescher wrote: > On Mon, May 7, 2012 at 4:01 PM, Guido Falsi wrote: >> On 05/07/12 21:09, Denny Schierz wrote: >>> hi, >>> >>> Am 07.05.2012 um 19:50 schrieb Guido Falsi: >>> I'm doing something like this, but I'm using a pass-through iscsi target. >>> >>> why don't use NFS? I use in my case a second bacula-sd which connects to an >>> auto changer for the month job. >>> >> >> Forgot a detail. The first storage is tape too, then I make copies to >> another tape. First tape is attached to the SD directly, secondary tape >> is in another building. Company wanted some warranty to recovery data in >> case of physical disaster. >> > > Is it possible to run your backups 2 times one to each SD? Without the > iscsi sharing I believe that is all you can do while bacula does not > allow SD to SD communication. > I use copy jobs. After performing backup on the first one I copy to the second one. I wrote this just to tell the first poster that what he wants to do can be done using iscsi, if he wants too and works quite well it the network is stable. -- Guido Falsi -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape drive on 2nd server
Guido, Do you have any details on how you setup your iSCSI pass-through?? Any URL you can share?? Regards, Guy -Message d'origine- De : Guido Falsi [mailto:m...@madpilot.net] Envoyé : 7 mai 2012 13:50 À : John Drescher Cc : Bertrand, Guy; bacula-users@lists.sourceforge.net Objet : Re: [Bacula-users] tape drive on 2nd server On 05/07/12 16:10, John Drescher wrote: > On Mon, May 7, 2012 at 10:01 AM, Bertrand, Guy > wrote: >> Hi all, >> I have a 2 server setup: >> Server 1: runs bacula-dir and has a lot of disk space, so I do >> nightly backups to disk >> Server 2: has no disk space, but has a tape drive >> (and no, I cannot put the tape drive on server 1) >> I would like to run a COPY job from the main server to store to tape >> on the 2nd server. >> > I do not think you can currently do that, The reason is (unless > something has changed that I am not aware of) is that copy jobs can > only use a single storage daemon since storage daemons can not > communicate. > I'm doing something like this, but I'm using a pass-through iscsi target. It works but is more difficult to setup and maintain. Such a setup is also very picky about the network environment. Gigabit ethernet is a minimum requirement, obviously. -- Guido Falsi This E-mail and any of its attachments may contain Company proprietary information, which is privileged, confidential, or subject to copyright belonging to the Company. This E-mail is intended solely for the use of the individual or entity to which it is addressed. If you are not the intended recipient of this E-mail, you are hereby notified that any dissemination, distribution, copying, or action taken in relation to the contents of and attachments to this E-mail is strictly prohibited and may be unlawful. If you have received this E-mail in error, please notify the sender immediately and permanently delete the original and any copy of this E-mail and any printout. -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape drive on 2nd server
On Tue, May 29, 2012 at 02:19:01PM +, Bertrand, Guy wrote: > Do you have any details on how you setup your iSCSI pass-through?? Any URL > you can share?? I use iSCSI instead of NFS, it feels quite a bit faster and enables me to span a volume group on local+remote disks. In your case it might be a better solution to import the tape via iSCSI as I assume you want to do some Backup to disk to tape stuff. The proxmox project has a guide for this. On a quick glance it looks not like it is limited to KVM/windows/proxmox: http://pve.proxmox.com/wiki/Tape_Drives#Using_Tape_Drives_as_iSCSI_target_.28for_Windows_KVM_guests.29 Regards, Adrian -- LiHAS - Adrian Reyer - Hessenwiesenstraße 10 - D-70565 Stuttgart Fon: +49 (7 11) 78 28 50 90 - Fax: +49 (7 11) 78 28 50 91 Mail: li...@lihas.de - Web: http://lihas.de Linux, Netzwerke, Consulting & Support - USt-ID: DE 227 816 626 Stuttgart -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape drive on 2nd server
Hi Adrian, Thanks for the info. I will look at that URL. I tried to setup the iSCSI and was able to successfully control the autochanger. However, I tried to configure the tape drive as pass-through, and seem to get some issues. I was lacking time, so I finally switched the servers, and make the single CPU with tape drive the main Bacula server, and the dual CPU with disk mounted as NFS. This works, but I was hoping to have the other way so that my backups would be faster. My full backups are quite long. When I have a chance, I'll revisit my config and try it again. Regards, Guy -Message d'origine- De : Adrian Reyer [mailto:bacula-li...@lihas.de] Envoyé : 6 juin 2012 17:01 À : Bertrand, Guy Cc : Guido Falsi; John Drescher; bacula-users@lists.sourceforge.net Objet : Re: [Bacula-users] tape drive on 2nd server On Tue, May 29, 2012 at 02:19:01PM +, Bertrand, Guy wrote: > Do you have any details on how you setup your iSCSI pass-through?? Any URL > you can share?? I use iSCSI instead of NFS, it feels quite a bit faster and enables me to span a volume group on local+remote disks. In your case it might be a better solution to import the tape via iSCSI as I assume you want to do some Backup to disk to tape stuff. The proxmox project has a guide for this. On a quick glance it looks not like it is limited to KVM/windows/proxmox: http://pve.proxmox.com/wiki/Tape_Drives#Using_Tape_Drives_as_iSCSI_target_.28for_Windows_KVM_guests.29 Regards, Adrian -- LiHAS - Adrian Reyer - Hessenwiesenstraße 10 - D-70565 Stuttgart Fon: +49 (7 11) 78 28 50 90 - Fax: +49 (7 11) 78 28 50 91 Mail: li...@lihas.de - Web: http://lihas.de Linux, Netzwerke, Consulting & Support - USt-ID: DE 227 816 626 Stuttgart This E-mail and any of its attachments may contain Company proprietary information, which is privileged, confidential, or subject to copyright belonging to the Company. This E-mail is intended solely for the use of the individual or entity to which it is addressed. If you are not the intended recipient of this E-mail, you are hereby notified that any dissemination, distribution, copying, or action taken in relation to the contents of and attachments to this E-mail is strictly prohibited and may be unlawful. If you have received this E-mail in error, please notify the sender immediately and permanently delete the original and any copy of this E-mail and any printout. -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape drive on 2nd server
On Thu, Jun 07, 2012 at 01:47:26PM +, Bertrand, Guy wrote: > Hi Adrian, > > Thanks for the info. I will look at that URL. > > I tried to setup the iSCSI and was able to successfully control the > autochanger. However, I tried to configure the tape drive as pass-through, > and seem to get some issues. I was lacking time, so I finally switched the > servers, and make the single CPU with tape drive the main Bacula server, and > the dual CPU with disk mounted as NFS. This works, but I was hoping to have > the other way so that my backups would be faster. My full backups are quite > long. Sorry for the delay in my answer. I saw this email just now. I have it working with an arch linux machine using the TGT iSCSI Target (on arch it's available from th AUR repository). I'm usually a FreeBSD user and had a working setup with FreeBSD and the net/istgt target. BTW lately another implementation (opentgt) was added to the FreeBSD ports collection, but I have not tested it. I had to move it to linux because HP (it's driving an HP changer) would not assist us with hardware problems if I was not using windows or linux. It's been linux since then. Not mush documentation around, I can give you this recipe for arch linux+tgt, I hope it translates easily to other linuxses. I have the following in /etc/tgt/mytargets: TGT="/usr/sbin/tgtadm" IQN="iqn.2012-01.org.test.machine:Ultrium" INI="192.168.1.1" $TGT --lld iscsi --op new --mode target --tid 1 -T $IQN $TGT --lld iscsi --op new --mode logicalunit --tid 1 --lun 1 \ --bstype=sg --device-type=pt -b /dev/sg3 $TGT --lld iscsi --op new --mode logicalunit --tid 1 --lun 2 \ --bstype=sg --device-type=pt -b /dev/sg4 $TGT --lld iscsi --op bind --mode target --tid 1 -I $INI $TGT --lld iscsi --mode target --op update --tid 1 \ --name MaxRecvDataSegmentLength --value 65536 $TGT --lld iscsi --mode target --op update --tid 1 \ --name MaxXmitDataSegmentLength --value 65536 sg3 is the tape, sg4 is the changer control. The will appear as LUN1 and LUN 2 on the iscsi device, as tgt will pick LUN 0 for itself. I modified the startup script in /etc/rc.d (arch way, other linux use /etc/init.d I think) to use the above script to configure targets. Not using authentication since it's a private network unaccessible from anywhere else. Anyway adding authentication is just a matter of a few more tgtadmin lines. > > When I have a chance, I'll revisit my config and try it again. Hope the information I gave you helps. I can also dig out the configuration I was using with FreeBSD for it. The bacula server is a FreeBSD 9.0-STABLE machine. If you need some more help just ask. Just CC me directly, so I notice the email earlier. -- Guido Falsi -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users