Re: [Bacula-users] using usb disk for daily off site backups with vchanger
On 2/17/2013 10:36 AM, fsy wrote: > Hi, > > i want to backup to usb disks every day, so i decided to install vchanger and > use one usb disk for every day. > > my problem is that vchanger/bacula sometimes doesn't recognize my disks. > > My vchanger config is: > > changer_name = vchanger > virtual_drives = 1 > slots_per_magazine = 6 > magazine_bays = 1 > automount_dir = /mnt/vchanger > magazine = UUID:c6aa86dc-0a2b-4386-81ae-79f8a6fd21d3 > magazine = UUID:ab3266ac-12f1-4dc6-9448-3b144ee9ba08 > magazine = UUID:047d3f77-b761-41d7-ab7a-0b98b9540ae3 > magazine = UUID:b7391bf8-2f50-431e-9124-d0e969af09cf > magazine = UUID:df31b95c-5986-4f67-a754-0379d92e92bf > magazine = UUID:2d85d8c1-c197-4d5a-b8fe-016e7c37c56d > > my autofs configuration: > > /mnt/vchanger /etc/auto.vchanger --timeout=30 > > my autofs vchanger config: > > * -fstype=auto,rw,sync :/dev/disk/by-uuid/& > > if i try to run a backup job on the vchanger device i get the following: > > 17-Feb 15:59 bacula-dir JobId 5665: shell command: run BeforeJob > "/etc/bacula/holiday.sh" > 17-Feb 15:59 bacula-dir JobId 5665: BeforeJob: Date is not a known vacation > day. > 17-Feb 15:59 bacula-dir JobId 5665: Start Backup JobId 5665, > Job=test-USB.2013-02-17_15.59.33_33 > 17-Feb 15:59 bacula-dir JobId 5665: Using Device "usb-changer-drive-0" > 17-Feb 15:59 bacula-sd JobId 5665: 3301 Issuing autochanger "loaded? drive 0" > command. > 17-Feb 15:59 bacula-sd JobId 5665: 3302 Autochanger "loaded? drive 0", > result: nothing loaded. > 17-Feb 15:59 bacula-sd JobId 5665: 3304 Issuing autochanger "load slot 2, > drive 0" command. > 17-Feb 15:59 bacula-sd JobId 5665: Fatal error: 3992 Bad autochanger "load > slot 2, drive 0": ERR=Unknown error during program execvp. > Results=failed to convert slot 2 to valid volume file name > > 17-Feb 15:59 -fd JobId 5665: Fatal error: job.c:2395 Bad response to Append > Data command. Wanted 3000 OK data > , got 3903 Error append data > > the contents of my usb disk: > > drive0 loaded0 loaded2 loaded4 lost+found vchanger_0006_0003 > vchanger_0006_0005 > index loaded1 loaded3 loaded5 vchanger_0006_0002 vchanger_0006_0004 > vchanger_0006_0006 > > What could be wrong with my configuration? Check the permissions. Each filesystem and all files on it should be owned by bacula:disk or whatever SD runs as. > > thanks a lot > > fsy > > +-- > |This was sent by j.ech...@gmx.de via Backup Central. > |Forward SPAM to ab...@backupcentral.com. > +-- > > > > -- > The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, > is your hub for all things parallel software development, from weekly thought > leadership blogs to news, videos, case studies, tutorials, tech docs, > whitepapers, evaluation guides, and opinion stories. Check out the most > recent posts - join the conversation now. http://goparallel.sourceforge.net/ > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials, tech docs, whitepapers, evaluation guides, and opinion stories. Check out the most recent posts - join the conversation now. http://goparallel.sourceforge.net/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] using usb disk for daily off site backups with vchanger
On 02/17/13 10:36, fsy wrote: > Hi, > > i want to backup to usb disks every day, so i decided to install vchanger and > use one usb disk for every day. > > my problem is that vchanger/bacula sometimes doesn't recognize my disks. > > My vchanger config is: > > changer_name = vchanger > virtual_drives = 1 > slots_per_magazine = 6 > magazine_bays = 1 > automount_dir = /mnt/vchanger > magazine = UUID:c6aa86dc-0a2b-4386-81ae-79f8a6fd21d3 > magazine = UUID:ab3266ac-12f1-4dc6-9448-3b144ee9ba08 > magazine = UUID:047d3f77-b761-41d7-ab7a-0b98b9540ae3 > magazine = UUID:b7391bf8-2f50-431e-9124-d0e969af09cf > magazine = UUID:df31b95c-5986-4f67-a754-0379d92e92bf > magazine = UUID:2d85d8c1-c197-4d5a-b8fe-016e7c37c56d > > my autofs configuration: > > /mnt/vchanger /etc/auto.vchanger --timeout=30 > > my autofs vchanger config: > > * -fstype=auto,rw,sync :/dev/disk/by-uuid/& > > if i try to run a backup job on the vchanger device i get the following: > > 17-Feb 15:59 bacula-dir JobId 5665: shell command: run BeforeJob > "/etc/bacula/holiday.sh" > 17-Feb 15:59 bacula-dir JobId 5665: BeforeJob: Date is not a known vacation > day. > 17-Feb 15:59 bacula-dir JobId 5665: Start Backup JobId 5665, > Job=test-USB.2013-02-17_15.59.33_33 > 17-Feb 15:59 bacula-dir JobId 5665: Using Device "usb-changer-drive-0" > 17-Feb 15:59 bacula-sd JobId 5665: 3301 Issuing autochanger "loaded? drive 0" > command. > 17-Feb 15:59 bacula-sd JobId 5665: 3302 Autochanger "loaded? drive 0", > result: nothing loaded. > 17-Feb 15:59 bacula-sd JobId 5665: 3304 Issuing autochanger "load slot 2, > drive 0" command. > 17-Feb 15:59 bacula-sd JobId 5665: Fatal error: 3992 Bad autochanger "load > slot 2, drive 0": ERR=Unknown error during program execvp. > Results=failed to convert slot 2 to valid volume file name > > 17-Feb 15:59 -fd JobId 5665: Fatal error: job.c:2395 Bad response to Append > Data command. Wanted 3000 OK data > , got 3903 Error append data > > the contents of my usb disk: > > drive0 loaded0 loaded2 loaded4 lost+found vchanger_0006_0003 > vchanger_0006_0005 > index loaded1 loaded3 loaded5 vchanger_0006_0002 vchanger_0006_0004 > vchanger_0006_0006 > > What could be wrong with my configuration? fsy, it looks to me that something went awry with your vchanger install/setup. On each USB drive (or stick), you should have a drive0, index, and loaded0 - assuming you have 1 virtual_drive defined in vchanger (which you do) Also, when swapping USB drives out, you will need to update what volumes Bacula thinks are available. For this you can manually issue the "update slots" command in bconsole, or as I do: - Create a job of type "Admin" - Set it to run at the same time as your nightly jobs but with a higher priority so it runs first - In the Admin job, issue the "update slots" command in a Run Script like so: # # Update Slots Job # Job { Name = UpdateSlots Client = None Type = Admin FileSet = None Storage = c0 Schedule = WeeklyToOffsiteDisk Messages = Standard Priority = 8 SpoolData = no Pool = Default # RunScript { RunsWhen = Before RunsOnClient = no Fail Job On Error = no Console = "update slots storage=c0 drive=0" } } Also, I have seen e some strange things with DELL's non-standard RD1000 device with regards to autofs and udev that required some special treatment. Basically it reqired a delay before after creating the mapper device, and before access to the autofs-controlled dir was attempted otherwise autofs would just fail to mount the device - resulting in the same errors you are seeing. I don't think your errors are caused by this issue (I believe your issue may be a simple update slots issue) but I thought I would mention this since it was a PITA to troubleshoot and figure out, and who knows, maybe this information will help someone else struggling with a DELL RD1000 device. :) And finally, a couple years back I wrote a rather lengthy howto called "Encrypted offsite backups on auto-mounted media with Bacula & vchanger" a lot of which might be helpful to you. (just sub USB for eSATA etc, and skip the encryption parts unless you need it :) http://revpol.com/node/140 Hope this helps. -- Bill Arlofski Reverse Polarity, LLC -- The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials, tech docs, whitepapers, evaluation guides, and opinion stories. Check out the most recent posts - join the conversation now. http://goparallel.sourceforge.net/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] using usb disk for daily off site backups with vchanger
> Hi James, > > i'll try that. > > How do you tell bacula which volumes it should use on the disks? > I forgot to mention that. I only have one volume on each disk. I suppose if you had multiple volumes you would need to set overwrite protection such that Bacula could only use one of them, eg with 5 disks rotated on a mon-fri schedule and 3 volumes per disk you might say each volume can only be reused after 18 days (a period that is longer than 2 weeks but shorter than 3). James -- The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials, tech docs, whitepapers, evaluation guides, and opinion stories. Check out the most recent posts - join the conversation now. http://goparallel.sourceforge.net/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] using usb disk for daily off site backups with vchanger
Hi James, i'll try that. How do you tell bacula which volumes it should use on the disks? Greets fsy +-- |This was sent by j.ech...@gmx.de via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials, tech docs, whitepapers, evaluation guides, and opinion stories. Check out the most recent posts - join the conversation now. http://goparallel.sourceforge.net/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] using usb disk for daily off site backups with vchanger
> Hi, > > i want to backup to usb disks every day, so i decided to install vchanger and > use one usb disk for every day. > > my problem is that vchanger/bacula sometimes doesn't recognize my disks. > I tried vchanger for this once but couldn't get it to do what I wanted. I had much more success with using autofs. auto.master looks like: /backup /etc/auto.backup --timeout=30 /etc/auto.backup looks like: offsite -fstype=auto,rw :/dev/disk/by-path/pci-\:02\:00.0-usb-0\:1\:1.0-scsi-0\:0\:0\:0-part1 so when you access /backup/offsite, the disk in the nominated USB slot is mounted, and is then unmounted 30 seconds after it is last accessed. the bacula-sd config looks like: Device { Name = offsite Media Type = File Archive Device = /backup/offsite Device Type = File AutomaticMount = yes; AlwaysOpen = no; Volume Poll Interval = 10; Random Access = yes; Spool Directory = /var/spool/bacula Label Media = no } This works really well for me. James -- The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials, tech docs, whitepapers, evaluation guides, and opinion stories. Check out the most recent posts - join the conversation now. http://goparallel.sourceforge.net/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] using usb disk for daily off site backups with vchanger
Op 20130217 om 21:18 schreef mikeegg1: > On Feb 17, 2013, at 9:36 AM, fsy wrote: > > > Hi, > > > > i want to backup to usb disks every day, so i decided to install vchanger > > and use one usb disk for every day. > > > > my problem is that vchanger/bacula sometimes doesn't recognize my disks. > > > > My vchanger config is: > > > > changer_name = vchanger > > virtual_drives = 1 > > slots_per_magazine = 6 > > magazine_bays = 1 > > automount_dir = /mnt/vchanger > > magazine = UUID:c6aa86dc-0a2b-4386-81ae-79f8a6fd21d3 > > magazine = UUID:ab3266ac-12f1-4dc6-9448-3b144ee9ba08 > > magazine = UUID:047d3f77-b761-41d7-ab7a-0b98b9540ae3 > > magazine = UUID:b7391bf8-2f50-431e-9124-d0e969af09cf > > magazine = UUID:df31b95c-5986-4f67-a754-0379d92e92bf > > magazine = UUID:2d85d8c1-c197-4d5a-b8fe-016e7c37c56d > > > > my autofs configuration: > > > > /mnt/vchanger /etc/auto.vchanger --timeout=30 > > > > my autofs vchanger config: > > > > * -fstype=auto,rw,sync :/dev/disk/by-uuid/& > > > > if i try to run a backup job on the vchanger device i get the following: > > > > 17-Feb 15:59 bacula-dir JobId 5665: shell command: run BeforeJob > > "/etc/bacula/holiday.sh" > > 17-Feb 15:59 bacula-dir JobId 5665: BeforeJob: Date is not a known vacation > > day. > > 17-Feb 15:59 bacula-dir JobId 5665: Start Backup JobId 5665, > > Job=test-USB.2013-02-17_15.59.33_33 > > 17-Feb 15:59 bacula-dir JobId 5665: Using Device "usb-changer-drive-0" > > 17-Feb 15:59 bacula-sd JobId 5665: 3301 Issuing autochanger "loaded? drive > > 0" command. > > 17-Feb 15:59 bacula-sd JobId 5665: 3302 Autochanger "loaded? drive 0", > > result: nothing loaded. > > 17-Feb 15:59 bacula-sd JobId 5665: 3304 Issuing autochanger "load slot 2, > > drive 0" command. > > 17-Feb 15:59 bacula-sd JobId 5665: Fatal error: 3992 Bad autochanger "load > > slot 2, drive 0": ERR=Unknown error during program execvp. > > Results=failed to convert slot 2 to valid volume file name > > > > 17-Feb 15:59 -fd JobId 5665: Fatal error: job.c:2395 Bad response to Append > > Data command. Wanted 3000 OK data > > , got 3903 Error append data > > > > the contents of my usb disk: > > > > drive0 loaded0 loaded2 loaded4 lost+found vchanger_0006_0003 > > vchanger_0006_0005 > > index loaded1 loaded3 loaded5 vchanger_0006_0002 vchanger_0006_0004 > > vchanger_0006_0006 > > > > What could be wrong with my configuration? > > > > thanks a lot > > > > fsy > > > > I backup to USB disk each day. I have a final job (priority 40, less > than everything else) that executes a pre-job-script (whatever). > > I can share the script with you tomorrow. Please share it with the whole mailinglist. > My fulls are now 2TB+ and run on the first Saturday of each month. I > have moved to 4TB USB drives (room to grow). > > Mike > Cheers Geert Stappers -- http://www.vanadcimplicity.com/ -- The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials, tech docs, whitepapers, evaluation guides, and opinion stories. Check out the most recent posts - join the conversation now. http://goparallel.sourceforge.net/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] using usb disk for daily off site backups with vchanger
I backup to USB disk each day. I have a final job (priority 40, less than everything else) that executes a pre-job-script (whatever). I can share the script with you tomorrow. My fulls are now 2TB+ and run on the first Saturday of each month. I have moved to 4TB USB drives (room to grow). Mike On Feb 17, 2013, at 9:36 AM, fsy wrote: > Hi, > > i want to backup to usb disks every day, so i decided to install vchanger and > use one usb disk for every day. > > my problem is that vchanger/bacula sometimes doesn't recognize my disks. > > My vchanger config is: > > changer_name = vchanger > virtual_drives = 1 > slots_per_magazine = 6 > magazine_bays = 1 > automount_dir = /mnt/vchanger > magazine = UUID:c6aa86dc-0a2b-4386-81ae-79f8a6fd21d3 > magazine = UUID:ab3266ac-12f1-4dc6-9448-3b144ee9ba08 > magazine = UUID:047d3f77-b761-41d7-ab7a-0b98b9540ae3 > magazine = UUID:b7391bf8-2f50-431e-9124-d0e969af09cf > magazine = UUID:df31b95c-5986-4f67-a754-0379d92e92bf > magazine = UUID:2d85d8c1-c197-4d5a-b8fe-016e7c37c56d > > my autofs configuration: > > /mnt/vchanger /etc/auto.vchanger --timeout=30 > > my autofs vchanger config: > > * -fstype=auto,rw,sync :/dev/disk/by-uuid/& > > if i try to run a backup job on the vchanger device i get the following: > > 17-Feb 15:59 bacula-dir JobId 5665: shell command: run BeforeJob > "/etc/bacula/holiday.sh" > 17-Feb 15:59 bacula-dir JobId 5665: BeforeJob: Date is not a known vacation > day. > 17-Feb 15:59 bacula-dir JobId 5665: Start Backup JobId 5665, > Job=test-USB.2013-02-17_15.59.33_33 > 17-Feb 15:59 bacula-dir JobId 5665: Using Device "usb-changer-drive-0" > 17-Feb 15:59 bacula-sd JobId 5665: 3301 Issuing autochanger "loaded? drive 0" > command. > 17-Feb 15:59 bacula-sd JobId 5665: 3302 Autochanger "loaded? drive 0", > result: nothing loaded. > 17-Feb 15:59 bacula-sd JobId 5665: 3304 Issuing autochanger "load slot 2, > drive 0" command. > 17-Feb 15:59 bacula-sd JobId 5665: Fatal error: 3992 Bad autochanger "load > slot 2, drive 0": ERR=Unknown error during program execvp. > Results=failed to convert slot 2 to valid volume file name > > 17-Feb 15:59 -fd JobId 5665: Fatal error: job.c:2395 Bad response to Append > Data command. Wanted 3000 OK data > , got 3903 Error append data > > the contents of my usb disk: > > drive0 loaded0 loaded2 loaded4 lost+found vchanger_0006_0003 > vchanger_0006_0005 > index loaded1 loaded3 loaded5 vchanger_0006_0002 vchanger_0006_0004 > vchanger_0006_0006 > > What could be wrong with my configuration? > > thanks a lot > > fsy > > +-- > |This was sent by j.ech...@gmx.de via Backup Central. > |Forward SPAM to ab...@backupcentral.com. > +-- > > > > -- > The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, > is your hub for all things parallel software development, from weekly thought > leadership blogs to news, videos, case studies, tutorials, tech docs, > whitepapers, evaluation guides, and opinion stories. Check out the most > recent posts - join the conversation now. http://goparallel.sourceforge.net/ > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials, tech docs, whitepapers, evaluation guides, and opinion stories. Check out the most recent posts - join the conversation now. http://goparallel.sourceforge.net/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] using usb disk for daily off site backups with vchanger
Hi, i want to backup to usb disks every day, so i decided to install vchanger and use one usb disk for every day. my problem is that vchanger/bacula sometimes doesn't recognize my disks. My vchanger config is: changer_name = vchanger virtual_drives = 1 slots_per_magazine = 6 magazine_bays = 1 automount_dir = /mnt/vchanger magazine = UUID:c6aa86dc-0a2b-4386-81ae-79f8a6fd21d3 magazine = UUID:ab3266ac-12f1-4dc6-9448-3b144ee9ba08 magazine = UUID:047d3f77-b761-41d7-ab7a-0b98b9540ae3 magazine = UUID:b7391bf8-2f50-431e-9124-d0e969af09cf magazine = UUID:df31b95c-5986-4f67-a754-0379d92e92bf magazine = UUID:2d85d8c1-c197-4d5a-b8fe-016e7c37c56d my autofs configuration: /mnt/vchanger /etc/auto.vchanger --timeout=30 my autofs vchanger config: * -fstype=auto,rw,sync :/dev/disk/by-uuid/& if i try to run a backup job on the vchanger device i get the following: 17-Feb 15:59 bacula-dir JobId 5665: shell command: run BeforeJob "/etc/bacula/holiday.sh" 17-Feb 15:59 bacula-dir JobId 5665: BeforeJob: Date is not a known vacation day. 17-Feb 15:59 bacula-dir JobId 5665: Start Backup JobId 5665, Job=test-USB.2013-02-17_15.59.33_33 17-Feb 15:59 bacula-dir JobId 5665: Using Device "usb-changer-drive-0" 17-Feb 15:59 bacula-sd JobId 5665: 3301 Issuing autochanger "loaded? drive 0" command. 17-Feb 15:59 bacula-sd JobId 5665: 3302 Autochanger "loaded? drive 0", result: nothing loaded. 17-Feb 15:59 bacula-sd JobId 5665: 3304 Issuing autochanger "load slot 2, drive 0" command. 17-Feb 15:59 bacula-sd JobId 5665: Fatal error: 3992 Bad autochanger "load slot 2, drive 0": ERR=Unknown error during program execvp. Results=failed to convert slot 2 to valid volume file name 17-Feb 15:59 -fd JobId 5665: Fatal error: job.c:2395 Bad response to Append Data command. Wanted 3000 OK data , got 3903 Error append data the contents of my usb disk: drive0 loaded0 loaded2 loaded4 lost+found vchanger_0006_0003 vchanger_0006_0005 index loaded1 loaded3 loaded5 vchanger_0006_0002 vchanger_0006_0004 vchanger_0006_0006 What could be wrong with my configuration? thanks a lot fsy +-- |This was sent by j.ech...@gmx.de via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials, tech docs, whitepapers, evaluation guides, and opinion stories. Check out the most recent posts - join the conversation now. http://goparallel.sourceforge.net/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users