[Bacula-users] migration
I'm trying to migrate from one disk based storage to another. I started with: http://bacula.org/5.0.x-manuals/en/main/main/Migration_Copy.html Following that, it seem that I need a new Pool, and that pool defines the new storage I'm moving to. I can't get that to work. I define my migrate jobs as: Job { Name = "migrate-gizmo" Type = Migrate Level = Full Client = gizmo-fd FileSet = "Full Set" Messages = Standard Pool = gizmoPool Maximum Concurrent Jobs = 4 Selection Type = Volume Selection Pattern = "gizmo" Priority = 9 } And define the storage and pools as below, I get the error when I try to load the config. gizmo-dir JobId 0: Fatal error: No storage specified in Job "migrate-gizmo" nor in Pool. gizmo-dir JobId 0: Error: Please correct configuration file: /etc/bacula/bacula-dir.conf gizmo-dir JobId 0: Error: Resetting previous configuration. If I add the new Storage to the pool I'm trying to move FROM, gizmonPool, the config loads. Running that though, results in all the jobs showing a status: migrate-gizmo.2010-03-12_00.19.09_07 is waiting on max Storage jobs Also, as I would expect, its reading and writing to the same storage: Run Migration job JobName: migrate-gizmo Bootstrap: *None* Client:gizmo-fd FileSet: Full Set Pool: gizmoPool (From Job resource) Read Storage: gizmoStore2 (From Pool resource) Write Storage: gizmoStore2 (From Storage from Pool's NextPool resource) JobId: *None* When: 2010-03-12 00:33:57 Catalog: MyCatalog Priority: 9 I've been fiddling with this for several hours. I'm sure its something simple and stupid on my part, but I can't figure out what. I'm running Bacula 5.0.1 on Centos 5.4. Thanks, Andy Storage { Name = gizmoStore Address = gizmo# N.B. Use a fully qualified name here SDPort = 9103 Password = "asdf" Device = gizmoStorage Media Type = FileGizmo AllowCompression = Yes } Storage { Name = gizmoStore2 Address = caprica# N.B. Use a fully qualified name here SDPort = 9103 Password = "asdf" Device = gizmoStorage2 Media Type = FileGizmo AllowCompression = Yes } Pool { Name = gizmoPool Volume Use Duration = 23 h Pool Type = Backup LabelFormat = "gizmo-" AutoPrune = yes VolumeRetention = 6 months Maximum Volumes = 181 Recycle = yes Recycle Oldest Volume = yes Next Pool = gizmoPool2 Action On Purge = Truncate } Pool { Name = gizmoPool2 Storage = gizmoStore2 Volume Use Duration = 23 h Pool Type = Backup LabelFormat = "gizmo2-" AutoPrune = yes VolumeRetention = 6 months Maximum Volumes = 181 Recycle = yes Recycle Oldest Volume = yes Storage = gizmoStore2 } -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Maximum Concurrent Jobs in job definition
Hi. Did it work like it should in Bacula 3.0? -- Silver On Friday 12 March 2010 02:21:13 Norberto Meijome wrote: > Anyone? > > btw, it is 5.0 , on Centos 5.4 64bit > _ > {Beto|Norberto|Numard} Meijome > > "The only people that never change are the stupid and the dead" > Jorge Luis Borges. > > I speak for myself, not my employer. Contents may be hot. Slippery when wet. > Reading disclaimers makes you go blind. Writing them is worse. You have been > Warned. > > > On 11 March 2010 13:40, Norberto Meijome wrote: > > > Hi everyone, > > I have a job that runs very frequently, and successive runs take different > > sets of data (as determined by a pre-job script). To avoid problems, my > > pre-job script sets a lock file and the post-clears it. > > > > When I configure my director for concurrent jobs = 2, i sometimes get 2 of > > these jobs trying to run in parallel (which is understandable, many times a > > run has more data than the average and is still running while the next one > > is due). My pre-script will then cancel the execution of the 2nd script > > (because it finds the lock file). Great. > > > > Of course, this is generating a bunch of (expected) errored jobs . I read > > in the documentaiton [1] that I can use "Maximum Concurrent Jobs" in the > > Job def, to determine how many of this jobs can start in parallel. So I set > > this to 1 [2] > > > > But it has no effect . I get 2 jobs running in parallel (for a short while, > > until the pre-script kills it). If I change the director's Max Concurrent > > Jobs to 1, then it's forced to 1 (but i need more than one, as I as have > > spooling enabled and other jobs writing to the tape too..) > > > > What is going on ? > > > > TIA! > > B > > _ > > {Beto|Norberto|Numard} Meijome > > > > "The only people that never change are the stupid and the dead" > > Jorge Luis Borges. > > > > I speak for myself, not my employer. Contents may be hot. Slippery when > > wet. > > Reading disclaimers makes you go blind. Writing them is worse. You have > > been > > Warned. > > > > [1] > > http://bacula.org/5.0.x- manuals/en/main/main/Configuring_Director.html#SECTION00173, way down... > > > > [2] > > [...] > > Job { > > Name = "assetBackups" > > JobDefs = "DefaultJob" > > Level = Full > > FileSet="publishedAssetsSet" > > Messages = Standard > > Pool = "productionPool" > > Storage = "berthaTape" > > Schedule = "PublishedAssetsSchedule" > > Write Bootstrap = "/var/lib/bacula/%n.bsr" > > Priority = 10 > > Accurate = yes > > Spool Data = yes > > # We only want one instance of this job running @ the same time. > > # enforced (errors out) in the apb_run.sh > > Maximum Concurrent Jobs = 1 > > # This the list of asset versions to be backed up. The parameter passed > > is the number of versions to include in this run > > RunBeforeJob = "/etc/bacula/backupFilelist/apb_run.sh 400" > > # This moves the current list out of the way and updates the offset > > # parameters passed are the jobId and the jobStatus > > RunAfterJob = "/etc/bacula/backupFilelist/apb_post.sh %i %e" > > } > > [...] -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Automatic labelling from barcodes ?
On 12 March 2010 13:04, John Drescher wrote: > > yeah, maybe it is a timing issue , (the changer isn't the newest) the > msgs > > didnt seem to be related to the job that was waiting, but i could be > wrong. > > The issue is that , say, slot 1 is labelled correctly, 2 and 3 not, 4 > > through 7 Ok. Sometimes it's one failed, sometimes 2, not the same all > the > > time. Not earth shattering, but non-automatic. > > > > If it is a timing issue then you need to fix your mtx-changer script > (to work with your changer) because your backups will have the same > problem as label barcodes. > > Did you run the autochanger tests that are described in the manual? > > John > thanks for the pointer, I'll look into that. I haven't seen any errors from the backups, so it may all be in my imagination. thanks again, _ {Beto|Norberto|Numard} Meijome "The only people that never change are the stupid and the dead" Jorge Luis Borges. I speak for myself, not my employer. Contents may be hot. Slippery when wet. Reading disclaimers makes you go blind. Writing them is worse. You have been Warned. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Automatic labelling from barcodes ?
> yeah, maybe it is a timing issue , (the changer isn't the newest) the msgs > didnt seem to be related to the job that was waiting, but i could be wrong. > The issue is that , say, slot 1 is labelled correctly, 2 and 3 not, 4 > through 7 Ok. Sometimes it's one failed, sometimes 2, not the same all the > time. Not earth shattering, but non-automatic. > If it is a timing issue then you need to fix your mtx-changer script (to work with your changer) because your backups will have the same problem as label barcodes. Did you run the autochanger tests that are described in the manual? John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Automatic labelling from barcodes ?
On 12 March 2010 12:44, John Drescher wrote: > > We have a tape library, 7 slots, 1 drive, barcode reader. All our tapes > are > > barcoded. > > > > I've been using 'label barcodes' with some success [1]. > > This should work 100% of the time. It has for me for the 80 tapes I > have had it label. When I add new tapes, I wait 5 minutes for my 24 > slot changer to stop doing inventory then after that I issue update > slots since I changed tapes. After that I run label barcodes and put > all new tapes in the Scratch pool. > > yeah, maybe it is a timing issue , (the changer isn't the newest) the msgs didnt seem to be related to the job that was waiting, but i could be wrong. The issue is that , say, slot 1 is labelled correctly, 2 and 3 not, 4 through 7 Ok. Sometimes it's one failed, sometimes 2, not the same all the time. Not earth shattering, but non-automatic. > > I would like to be > > able to just insert new tapes and let bacula automatically label them > using > > the barcode read from the tape. > > > > Is this possible, and if so, how ? > > > > I am not sure of that. Some users have done this but I do not know the > details. > do you have any pointers? > > > Running > > Version: 5.0.0 (26 January 2010) x86_64-redhat-linux-gnu redhat > > > > thanks!! > > > > [1] sometimes it throws some errors, tape i/o,etc, not sure it is related > to > > bacula, even though it crashed bacula-sd once or twice > > > The I/O read error on unused tapes is not an error. This is actually > normal behavior. > As for crashing bacula-sd, I have never had that > happen on a label barcodes. > > +1 . hasn't happened that much, just once or twice (once definitely related to this, the other i dont recall) thx!! _ {Beto|Norberto|Numard} Meijome "The only people that never change are the stupid and the dead" Jorge Luis Borges. I speak for myself, not my employer. Contents may be hot. Slippery when wet. Reading disclaimers makes you go blind. Writing them is worse. You have been Warned. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Automatic labelling from barcodes ?
> We have a tape library, 7 slots, 1 drive, barcode reader. All our tapes are > barcoded. > > I've been using 'label barcodes' with some success [1]. This should work 100% of the time. It has for me for the 80 tapes I have had it label. When I add new tapes, I wait 5 minutes for my 24 slot changer to stop doing inventory then after that I issue update slots since I changed tapes. After that I run label barcodes and put all new tapes in the Scratch pool. > I would like to be > able to just insert new tapes and let bacula automatically label them using > the barcode read from the tape. > > Is this possible, and if so, how ? > I am not sure of that. Some users have done this but I do not know the details. > Running > Version: 5.0.0 (26 January 2010) x86_64-redhat-linux-gnu redhat > > thanks!! > > [1] sometimes it throws some errors, tape i/o,etc, not sure it is related to > bacula, even though it crashed bacula-sd once or twice > The I/O read error on unused tapes is not an error. This is actually normal behavior. As for crashing bacula-sd, I have never had that happen on a label barcodes. John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Automatic labelling from barcodes ?
Hi everyone, We have a tape library, 7 slots, 1 drive, barcode reader. All our tapes are barcoded. I've been using 'label barcodes' with some success [1]. I would like to be able to just insert new tapes and let bacula automatically label them using the barcode read from the tape. Is this possible, and if so, how ? Running Version: 5.0.0 (26 January 2010) x86_64-redhat-linux-gnu redhat thanks!! [1] sometimes it throws some errors, tape i/o,etc, not sure it is related to bacula, even though it crashed bacula-sd once or twice _ {Beto|Norberto|Numard} Meijome "The only people that never change are the stupid and the dead" Jorge Luis Borges. I speak for myself, not my employer. Contents may be hot. Slippery when wet. Reading disclaimers makes you go blind. Writing them is worse. You have been Warned. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Maximum Concurrent Jobs in job definition
Anyone? btw, it is 5.0 , on Centos 5.4 64bit _ {Beto|Norberto|Numard} Meijome "The only people that never change are the stupid and the dead" Jorge Luis Borges. I speak for myself, not my employer. Contents may be hot. Slippery when wet. Reading disclaimers makes you go blind. Writing them is worse. You have been Warned. On 11 March 2010 13:40, Norberto Meijome wrote: > Hi everyone, > I have a job that runs very frequently, and successive runs take different > sets of data (as determined by a pre-job script). To avoid problems, my > pre-job script sets a lock file and the post-clears it. > > When I configure my director for concurrent jobs = 2, i sometimes get 2 of > these jobs trying to run in parallel (which is understandable, many times a > run has more data than the average and is still running while the next one > is due). My pre-script will then cancel the execution of the 2nd script > (because it finds the lock file). Great. > > Of course, this is generating a bunch of (expected) errored jobs . I read > in the documentaiton [1] that I can use "Maximum Concurrent Jobs" in the > Job def, to determine how many of this jobs can start in parallel. So I set > this to 1 [2] > > But it has no effect . I get 2 jobs running in parallel (for a short while, > until the pre-script kills it). If I change the director's Max Concurrent > Jobs to 1, then it's forced to 1 (but i need more than one, as I as have > spooling enabled and other jobs writing to the tape too..) > > What is going on ? > > TIA! > B > _ > {Beto|Norberto|Numard} Meijome > > "The only people that never change are the stupid and the dead" > Jorge Luis Borges. > > I speak for myself, not my employer. Contents may be hot. Slippery when > wet. > Reading disclaimers makes you go blind. Writing them is worse. You have > been > Warned. > > [1] > http://bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html#SECTION00173, > way down... > > [2] > [...] > Job { > Name = "assetBackups" > JobDefs = "DefaultJob" > Level = Full > FileSet="publishedAssetsSet" > Messages = Standard > Pool = "productionPool" > Storage = "berthaTape" > Schedule = "PublishedAssetsSchedule" > Write Bootstrap = "/var/lib/bacula/%n.bsr" > Priority = 10 > Accurate = yes > Spool Data = yes > # We only want one instance of this job running @ the same time. > # enforced (errors out) in the apb_run.sh > Maximum Concurrent Jobs = 1 > # This the list of asset versions to be backed up. The parameter passed > is the number of versions to include in this run > RunBeforeJob = "/etc/bacula/backupFilelist/apb_run.sh 400" > # This moves the current list out of the way and updates the offset > # parameters passed are the jobId and the jobStatus > RunAfterJob = "/etc/bacula/backupFilelist/apb_post.sh %i %e" > } > [...] > -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula to the Cloud
On 3/11/2010 4:31 PM, Peter Zenge wrote: > Following up on my own post, I had a little free time the other day and > decided to investigate whether this was feasible. Setting up the > necessary services on Amazon was trivial, including access control and > block storage. I tried s3fs first, and it worked, but it felt like there > was way too much i/o going on for that kind of data (which is pretty > much what I expected). Then I tried putting my bacula-sd on an EC2 node, > writing to files on EBS, and it worked great (spooling first to the > “local” drive on EC2). Throughput however was somewhat less than I was > hoping for, approx. 25% of what I get locally to spool and then to tape. > However, I found that there was NO performance penalty for running two > jobs concurrently. I didn’t try larger numbers, but my guess is you can > run a large number of concurrent jobs to get a pretty good effective > throughput, assuming you have lots of clients with similar data sizes. Would you care to add the steps to the wiki? Then post the URL here please? -- Dan Langille - http://langille.org/ -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Problems with storage device not being seen
I am setting up a new installation and I am having difficulty with the tape drive not being seen. Here is the error message: Job=TapeBackup.2010-03-11_14.34.23_05 11-Mar 14:34 distress-dir JobId 20: Fatal error: Storage daemon didn't accept Device "Drive-2" command. 11-Mar 14:34 distress-dir JobId 20: Error: Bacula distress-dir 5.0.1 (24Feb10): 11-Mar-2010 14:34:26 Build OS: x86_64-unknown-linux-gnu redhat JobId: 20 Job:TapeBackup.2010-03-11_14.34.23_05 Backup Level: Full (upgraded from Incremental) Client: "distress-fd" 5.0.1 (24Feb10) x86_64-unknown-linux-gnu,redhat, FileSet:"Tape Set" 2010-03-10 23:05:00 Pool: "Default" (From Job resource) Catalog:"MyCatalog" (From Client resource) Storage:"Tape-Left" (From Job resource) Scheduled time: 11-Mar-2010 14:34:14 - I have check both the dir-conf and the sd-conf and either I am blind due to the length of time I've spent on it or I am just missing it. Probably an easy fix. Here are the snapshots of the config files. DIR.conf # Definition of DLT tape storage device Storage { Name = Tape-Right # Do not use "localhost" here Address = distress # N.B. Use a fully qualified name here SDPort = 9103 Password = "" # password for Storage daemon Device = Drive-1 # must be same as Device in Storage daemon Media Type = DLT-V4 # must be same as MediaType in Storage daemon # Autochanger = yes # enable for autochanger device } # Definition of DLT tape storage device Storage { Name = Tape-Left # Do not use "localhost" here Address = distress # N.B. Use a fully qualified name here SDPort = 9103 Password = "" # password for Storage daemon Device = Drive-2 # must be same as Device in Storage daemon Media Type = DLT-V4 # must be same as MediaType in Storage daemon # Autochanger = yes # enable for autochanger device } SD.conf Device { Name = Drive-1 # Drive Index = 0 Media Type = DLT-V4 Archive Device = /dev/nst0 AutomaticMount = no; # when device opened, read it AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; AutoChanger = yes } Device { Name = Drive-2 # Drive Index = 1 Media Type = DLT-V4 Archive Device = /dev/nst1 AutomaticMount = no; # when device opened, read it AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; AutoChanger = yes } also get a GDB traceback each time the job errors: [?1034h[Thread debugging using libthread_db enabled] [New Thread 0x7fbb1e655710 (LWP 22578)] [New Thread 0x7fbb1f056710 (LWP 22530)] 0x003666cd6ca3 in select () from /lib64/libc.so.6 $1 = '\000' $2 = 0xa16058 "bacula-sd" $3 = 0xa16098 "/usr/bacula/bin/bacula-sd" $4 = 0x0 $5 = 0x7fbb258cbd9e "5.0.1 (24 February 2010)" $6 = 0x7fbb258cbdb7 "x86_64-unknown-linux-gnu" $7 = 0x7fbb258cbdd0 "redhat" $8 = 0x7fbb258cba7c "" $9 = "distress", '\000' #0 0x003666cd6ca3 in select () from /lib64/libc.so.6 #1 0x7fbb258a0ad4 in bnet_thread_server (addrs=, max_clients=, client_wq=, handle_client_request=) at bnet_server.c:161 #2 0x0040763e in main (argc=, argv=) at stored.c:312 Thread 3 (Thread 0x7fbb1f056710 (LWP 22530)): #0 0x00366740b3b9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x7fbb258c402c in watchdog_thread (arg=) at watchdog.c:308 #2 0x003667406a3a in start_thread () from /lib64/libpthread.so.0 #3 0x003666cddf3d in clone () from /lib64/libc.so.6 #4 0x in ?? () Thread 2 (Thread 0x7fbb1e655710 (LWP 22578)): #0 0x00366740eb3d in waitpid () from /lib64/libpthread.so.0 #1 0x7fbb258bb7ad in signal_handler (sig=11) at signal.c:229 #2 #3 0x00431bb3 in is_vol_in_autochanger (vol=, rctx=) at reserve.c:389 #4 find_suitable_device_for_job (vol=, rctx=) at reserve.c:456 #5 0x0043269a in use_storage_cmd (jcr=) at reserve.c:317 #6 use_cmd (jcr=) at reserve.c:71 #7 0x0041e80f in handle_connection_request (arg=0xa1aad8) at dircmd.c:233 #8 0x7fbb258c44a9 in workq_server (arg=0x651e20) at workq.c:346 #9 0x003667406a3a in start_thread () from /lib64/libpthread.so.0 #10 0x003666cddf3d in clone () from /lib64/libc.so.6 #11 0x in ?? () Thread 1 (Thread 0x7fbb25889720 (LWP 22522)): #0 0x003666cd6ca3 in select () from /lib64/libc.so.6 #1 0x7fbb258a0ad4 in bnet_thread_server (addrs=, max_clients=, client_wq=, handle_client_request=) at bnet_server.c:161 #2 0x0040763e in main (argc=, argv=) at stored.c:312 #0 0x003666cd6ca3 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x7fbb258a0ad4 in bnet_thread_server (addrs=, max_clients=, client_wq=, handle_client_request=) at bnet_server.c:161 161 if ((stat = select(maxfd + 1, &sockset, NULL, NULL, NULL)) < 0) { Current language: auto The current source language is "auto; currently c
[Bacula-users] Ubuntu 9.04 Easy Install Bacula + Postgresql
I have been a Bacula user off and on for the last year. Implemented a couple of instances and always had a confusing time installing it - on Ubuntu. Recently I happened upon an easy sequence which I am sharing in case someone else needs an easy on-ramp: a. Install postgresql while loading the OS, you could install it using sudo apt-get - Don't have the commands handy b. sudo apt-get upgrade c. sudo apt-get update d. sudo apt-get install g++ e. sudo apt-get install libpq-dev f. sudo apt-get install make g. compile bacula without bat That's it. Mehma -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula to the Cloud
Following up on my own post, I had a little free time the other day and decided to investigate whether this was feasible. Setting up the necessary services on Amazon was trivial, including access control and block storage. I tried s3fs first, and it worked, but it felt like there was way too much i/o going on for that kind of data (which is pretty much what I expected). Then I tried putting my bacula-sd on an EC2 node, writing to files on EBS, and it worked great (spooling first to the "local" drive on EC2). Throughput however was somewhat less than I was hoping for, approx. 25% of what I get locally to spool and then to tape. However, I found that there was NO performance penalty for running two jobs concurrently. I didn't try larger numbers, but my guess is you can run a large number of concurrent jobs to get a pretty good effective throughput, assuming you have lots of clients with similar data sizes. Our problem is that 80% of our data is on one client, and it would take 130 hours to do a full backup, and our backup window simply isn't that long. Then I thought I could break the FileSets into smaller pieces and run multiple backup jobs in parallel (and I'm assuming that my client is not the bottleneck). However, it wouldn't run more than one job on that client concurrently. Since I can run multiple clients concurrently, I'm pretty sure my bacula-dir.conf and bacula-sd.conf settings are correct, and my bacula-fd.conf specifies "Maximum Concurrent Jobs = 20"... Any other reason why I couldn't run say 5 parallel jobs with different filesets off the same client? From: Peter Zenge [mailto:pze...@ilinc.com] Sent: Tuesday, March 02, 2010 2:57 PM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] Bacula to the Cloud Hello, 2 year Bacula user but first-time poster. I'm currently dumping about 1.6TB to LTO2 tapes every week and I'm looking to migrate to a new storage medium. The obvious answer, I think, is a direct-attached disk array (which I would be able to put in a remote gigabit-attached datacenter before too long). However, I'm wondering if anyone is currently doing large (or what seem to me to be large) backups to the cloud in some way? Assuming I have a gigabit connection to the Internet from my datacenter, I'm wondering how feasible it would be to either use something like Amazon S3 with s3fs (I'm guessing way too much overhead to be efficient), or a bacula-SD implementation on an EC2 node, using Elastic Block Store (EBS) as "local" disk, and VPN (Amazon VPC) between my datacenter and the SD. Substitute your favorite cloud provider for Amazon above; I don't use any right now so not tied to any particular provider. It just seems like Amazon has all the necessary pieces today. To do this, and keep customers comfortable with the idea of data in the cloud, we would need to encrypt, so I'm also wondering if it would be possible for the SD to encrypt the backup volume, rather than the FD encrypt the data before sending it to SD (which is what we do now)? Easier to manage if we just handled encryption in one place for all clients. I would love to hear what other people are either doing with Bacula and the cloud, or why you have decided not to. Thanks Peter Zenge Pzenge .at. ilinc .dot. com -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Automatic labelling with different pools is not sequential anymore?
On Thu, Mar 11, 2010 at 2:14 PM, Steen Meyer wrote: > Torsdag den 11. Marts 2010 15:50:36 skrev John Drescher: >> WOW! You must not have upgraded in some time. I believe this change >> came in 2008 or earlier.. >> >> > I have several pools in one filestorage directory. >> > Bacula automatically labels new media as needed with the "LabelMedia = >> > yes" parameter. >> > >> > Count Bacula usually labelled each pools media sequentially from 1 going >> > upwards in steps of one. >> > >> > Now with my new setup version 5.0.1 he mixes up the pools, so that the >> > next number in any pool get to be the highest number of all the pools + >> > 1. >> > >> > Is this intended? >> >> Yes. This was a bug fix to prevent duplicate ids being assigned in the >> case that the user deleted some volumes. >> > I understand that in terms of each pool, but I do not see that it would be > necessary to make that span the different pools with different label > templates? > A volume can be moved from 1 pool to the other. Also different pools do not have to have different label templates. John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fwd: Can someone help me to solve my logical problem... ?
ok, there does not appear to be an easy way to schedule for every 20 days. But for every 21 days it can by easy: w01, w04, w07, w10, w13, ... w5x Mon at 22:00 will do the trick! -- Forwarded message -- From: John Drescher Date: Thu, Mar 11, 2010 at 1:43 PM Subject: Re: [Bacula-users] Can someone help me to solve my logical problem... ? To: gnowar Cc: bacula-users@lists.sourceforge.net On Thu, Mar 11, 2010 at 11:22 AM, gnowar wrote: > >>If the volume is pruned then the jobs and files on that volume have to >>be pruned. If bacula is not operating this way this is a bug. > > I think it is. I understood that should works this way when I read the spec > but that doesn't work on my system.. > What is the status of that volume? Use the console list media command: list media > >>You need to modify your schedule how I explained in my first post. > > As you saw, I don't speak english so well, Yes. I guarantee that your English is better than the only other language I know somewhat.. > I didn't find anything relevent > in the spec you gave me. I understand how to use one pool for the twentieth > day of a month, but not for every 20 days. It's different cause it's > completly random comared to the day, of a month (I don't know if I'm clear, > that should work like a "counter" ?) > I think you are correct. There does not appear to be an easy way to schedule this. > > I don't know if it's possible, and if it is, that's the key of my problem. > You could use a bash script that feeds commands to bconsole to force bacula to run jobs on the 20th day. > Hope you understand me. > I'm trying.. John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Marcos de Oliveira Leão Consultor Linux/Unix LPIC/1 - Linux Professional Institute Certification (55 61) 8556-9956 leao.mar...@gmail.com marcos_l...@hotmail.com -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Automatic labelling with different pools is not sequential anymore?
Torsdag den 11. Marts 2010 15:50:36 skrev John Drescher: > WOW! You must not have upgraded in some time. I believe this change > came in 2008 or earlier.. > > > I have several pools in one filestorage directory. > > Bacula automatically labels new media as needed with the "LabelMedia = > > yes" parameter. > > > > Count Bacula usually labelled each pools media sequentially from 1 going > > upwards in steps of one. > > > > Now with my new setup version 5.0.1 he mixes up the pools, so that the > > next number in any pool get to be the highest number of all the pools + > > 1. > > > > Is this intended? > > Yes. This was a bug fix to prevent duplicate ids being assigned in the > case that the user deleted some volumes. > I understand that in terms of each pool, but I do not see that it would be necessary to make that span the different pools with different label templates? -- Steen -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows XP File Daemon - Service Stops With Unknown Error
On Wed, Mar 10, 2010 at 11:46 AM, Josh Fisher wrote: > > On 3/9/2010 10:02 AM, Bob Hetzel wrote: >> 3 things that have given me grief due to the windows FD stopping or being >> unresponsive (but still mysteriously running)... >> a) buggy network driver--in one case I was able to update the driver to fix. >> > > I'll second that one. I have had several occasions of a buggy NIC driver > causing the TCP connection to be dropped. In all cases it was fixed by > an updated driver, or by turning off the NIC driver's power management > features. Particularly for laptops, it seems unfortunately common for > the driver to turn off the NIC to save power, even though there is an > active TCP connection. Web browsers and such simply re-connect, so the > dropped connection isn't noticed. But TCP connections for Bacula may be > open for quite some time, so Bacula is more sensitive to network problems. > The only reason I'm ruling this out is that the bacula-fd service dies when it's just sitting idle, usually dying well before the director makes contact to initiate a backup request. All other network seems okay and the person that uses Quickbooks never has issues connecting, etc. I'll check further but at this time, I've installed the bacula-fd client on several other machine of same OS and architecture/hardware and those are not dying. It's starting to point to some service or process I'm overlooking perhaps killing it or maybe just a bad install. I might start by reinstalling bacula and see what happens then. Thanks, -Drew >> b) bad network switch or network port >> c) infection with a virus/malware that was using up the "max tcp >> connections". Check the event log for that error. >> d) regex in the fileset had a bug but that's been fixed around bacula >> version 2.5 or so. Along the way I learned that regex was slower to >> process than wilddir and wildfile so I stopped using it for windows >> filesets anyway. >> >> In all cases these issues caused the windows FD to stop during a backup, so >> I hope this helps but if not, you may have to turn on debugging in the FD >> and cross your fingers that it happens and logs what went wrong. >> >> Bob >> >> >>> From: Drew Bentley >>> > I can't seem to figure out what's going on because I've never > encountered this issue when backing up a Windows XP client with the > latest version of Bacula. > > I have no problems backing up the client but the file daemon > unexpectedly dies randomly, usually before a backup is even scheduled. > > The error I'm seeing in the event log goes something like this: > > Bacula Error: /home/kern/bacula/k/bacula/src/lib/bsock.c:518 > Read error from Director daemon::9101: > ERR=Unknown error > > Above that it complains about local computer and registry info or > message DLL files to display messages from a remote computer, use > /AUXSOURCE=flag to retrieve this description, see Help and Support for > more details. > > Anyone encounter this? Is this machine missing something? I'm not a > Windows guy, more of a Unix guy. Everything seems to work okay when I > restart the FD service and backups run without issues. I have backups > kick off at like 7pm and it always seems to die before 3 or 4pm. No > one really remotes into this machine, it's a Quickbooks machine and > only shares out the Intuit QB stuff to the HR persons machine. > > Any other info I can provide if necessary. I couldn't seem to locate > this type of issue in the mailing list archives. > > -Drew > > >>> No ideas from anyone? Now it seems to die without any reports in the >>> event viewer or logs. >>> >>> -Drew >>> >>> >> -- >> Download Intel® Parallel Studio Eval >> Try the new software tools for yourself. Speed compiling, find bugs >> proactively, and fine-tune applications for parallel performance. >> See why Intel Parallel Studio got high marks during beta. >> http://p.sf.net/sfu/intel-sw-dev >> ___ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users >> > > -- > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs
Re: [Bacula-users] Can someone help me to solve my logical problem... ?
On Thu, Mar 11, 2010 at 11:22 AM, gnowar wrote: > >>If the volume is pruned then the jobs and files on that volume have to >>be pruned. If bacula is not operating this way this is a bug. > > I think it is. I understood that should works this way when I read the spec > but that doesn't work on my system.. > What is the status of that volume? Use the console list media command: list media > >>You need to modify your schedule how I explained in my first post. > > As you saw, I don't speak english so well, Yes. I guarantee that your English is better than the only other language I know somewhat.. > I didn't find anything relevent > in the spec you gave me. I understand how to use one pool for the twentieth > day of a month, but not for every 20 days. It's different cause it's > completly random comared to the day, of a month (I don't know if I'm clear, > that should work like a "counter" ?) > I think you are correct. There does not appear to be an easy way to schedule this. > > I don't know if it's possible, and if it is, that's the key of my problem. > You could use a bash script that feeds commands to bconsole to force bacula to run jobs on the 20th day. > Hope you understand me. > I'm trying.. John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can someone help me to solve my logical problem... ?
>If the volume is pruned then the jobs and files on that volume have to >be pruned. If bacula is not operating this way this is a bug. I think it is. I understood that should works this way when I read the spec but that doesn't work on my system.. >You need to modify your schedule how I explained in my first post. As you saw, I don't speak english so well, I didn't find anything relevent in the spec you gave me. I understand how to use one pool for the twentieth day of a month, but not for every 20 days. It's different cause it's completly random comared to the day, of a month (I don't know if I'm clear, that should work like a "counter" ?) I don't know if it's possible, and if it is, that's the key of my problem. Hope you understand me. Thx for your help -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- View this message in context: http://old.nabble.com/Can-someone-help-me-to-solve-my-logical-problem...---tp27864557p27865765.html Sent from the Bacula - Users mailing list archive at Nabble.com. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can someone help me to solve my logical problem... ?
> I don't know if it's "normal", but I can't reuse a tape if files and jobs are > not pruned, even if the volume is. Files retention and Jobs retention ar > definited in the client section. > If the volume is pruned then the jobs and files on that volume have to be pruned. If bacula is not operating this way this is a bug. > > Plus, how can I say to bacula, "use this pool every twentieth backup" ? > You need to modify your schedule how I explained in my first post. See the examples in the documentation here: http://www.bacula.org/en/dev-manual/Configuring_Director.html#SECTION00145 John John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Automatic labelling with different pools is not sequential anymore?
WOW! You must not have upgraded in some time. I believe this change came in 2008 or earlier.. > I have several pools in one filestorage directory. > Bacula automatically labels new media as needed with the "LabelMedia = yes" > parameter. > > Count Bacula usually labelled each pools media sequentially from 1 going > upwards in steps of one. > > Now with my new setup version 5.0.1 he mixes up the pools, so that the next > number in any pool get to be the highest number of all the pools + 1. > > Is this intended? Yes. This was a bug fix to prevent duplicate ids being assigned in the case that the user deleted some volumes. > Are there any ways to turn this back to 'normal'? > Not that I know of. John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can someone help me to solve my logical problem... ?
I don't know if it's "normal", but I can't reuse a tape if files and jobs are not pruned, even if the volume is. Files retention and Jobs retention ar definited in the client section. Plus, how can I say to bacula, "use this pool every twentieth backup" ? John M. Drescher wrote: > > On Thu, Mar 11, 2010 at 10:01 AM, gnowar wrote: >> >> Hello, >> >> I have a problem with my personnal cycle tape. Let's see how it works : >> >> I have 20 tapes who are changed everyday. Everytime the 20s tape comes, I >> put it in a box during 365 days. >> >> It's like that : >> >> 1- >> 2- >> 3- >> 4- >> 5- >> . >> . >> . >> 20--> In the box during 1 year >> >> And so on... >> >> 1- (New tape) >> 2- (Ex 1st tape) >> 3- (Ex 2nd tape) >> . >> . >> . >> 20--> In the box during 1 year >> >> >> You see my problem ? I haven't the same retention times for the tapes who >> are rewritted every 20 days, and those who are keeped during one year. >> >> The problem is that I put the catalog name, the file and job retention in >> the client definition... and as I know, I can't have two same client >> right ? >> >> I can't find any solution, excepted keeping files, jobs and volumes >> during >> only 20 days and save the catalog in each tape, and rebuilt the catalog >> to >> recover datas... But that's not easy to use.. >> >> Can someone has an idea ? >> > > Use 1 pool for the tapes you keep for 1 year and 1 pool for the tapes > that you rotate. Adjust your schedule to make a full backup to the > "Year Pool" every 20 days. > > John > > -- > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > > -- View this message in context: http://old.nabble.com/Can-someone-help-me-to-solve-my-logical-problem...---tp27864557p27865142.html Sent from the Bacula - Users mailing list archive at Nabble.com. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can someone help me to solve my logical problem... ?
Well, it looks like I can create 2 same client with a different name.. THAT'S GREAT ! gnowar wrote: > > Hello, > > I have a problem with my personnal cycle tape. Let's see how it works : > > I have 20 tapes who are changed everyday. Everytime the 20s tape comes, I > put it in a box during 365 days. > > It's like that : > > 1- > 2- > 3- > 4- > 5- > . > . > . > 20--> In the box during 1 year > > And so on... > > 1- (New tape) > 2- (Ex 1st tape) > 3- (Ex 2nd tape) > . > . > . > 20--> In the box during 1 year > > > You see my problem ? I haven't the same retention times for the tapes who > are rewritted every 20 days, and those who are keeped during one year. > > The problem is that I put the catalog name, the file and job retention in > the client definition... and as I know, I can't have two same client right > ? > > I can't find any solution, excepted keeping files, jobs and volumes during > only 20 days and save the catalog in each tape, and rebuilt the catalog to > recover datas... But that's not easy to use.. > > Can someone has an idea ? > > Thanks ! > -- View this message in context: http://old.nabble.com/Can-someone-help-me-to-solve-my-logical-problem...---tp27864557p27864957.html Sent from the Bacula - Users mailing list archive at Nabble.com. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can someone help me to solve my logical problem... ?
On Thu, Mar 11, 2010 at 10:01 AM, gnowar wrote: > > Hello, > > I have a problem with my personnal cycle tape. Let's see how it works : > > I have 20 tapes who are changed everyday. Everytime the 20s tape comes, I > put it in a box during 365 days. > > It's like that : > > 1- > 2- > 3- > 4- > 5- > . > . > . > 20--> In the box during 1 year > > And so on... > > 1- (New tape) > 2- (Ex 1st tape) > 3- (Ex 2nd tape) > . > . > . > 20--> In the box during 1 year > > > You see my problem ? I haven't the same retention times for the tapes who > are rewritted every 20 days, and those who are keeped during one year. > > The problem is that I put the catalog name, the file and job retention in > the client definition... and as I know, I can't have two same client right ? > > I can't find any solution, excepted keeping files, jobs and volumes during > only 20 days and save the catalog in each tape, and rebuilt the catalog to > recover datas... But that's not easy to use.. > > Can someone has an idea ? > Use 1 pool for the tapes you keep for 1 year and 1 pool for the tapes that you rotate. Adjust your schedule to make a full backup to the "Year Pool" every 20 days. John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Can someone help me to solve my logical problem... ?
Hello, I have a problem with my personnal cycle tape. Let's see how it works : I have 20 tapes who are changed everyday. Everytime the 20s tape comes, I put it in a box during 365 days. It's like that : 1- 2- 3- 4- 5- . . . 20--> In the box during 1 year And so on... 1- (New tape) 2- (Ex 1st tape) 3- (Ex 2nd tape) . . . 20--> In the box during 1 year You see my problem ? I haven't the same retention times for the tapes who are rewritted every 20 days, and those who are keeped during one year. The problem is that I put the catalog name in the client... and as I know, I can't have two same client right ? I can't find any solution, excepted keeping files, jobs and volumes during only 20 days and save the catalog in each tape, and rebuilt the catalog to recover datas... But that's not easy to use.. Can someone has an idea ? Thanks ! -- View this message in context: http://old.nabble.com/Can-someone-help-me-to-solve-my-logical-problem...---tp27864557p27864557.html Sent from the Bacula - Users mailing list archive at Nabble.com. -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Automatic labelling with different pools is not sequential anymore?
Hello, I have several pools in one filestorage directory. Bacula automatically labels new media as needed with the "LabelMedia = yes" parameter. Count Bacula usually labelled each pools media sequentially from 1 going upwards in steps of one. Now with my new setup version 5.0.1 he mixes up the pools, so that the next number in any pool get to be the highest number of all the pools + 1. Is this intended? Are there any ways to turn this back to 'normal'? -- Thanks Steen -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula-dir 5.01 no listen
2010/3/11 mario parreño : > Hi Greg, first, thanks for reading the question. > > I execute netstat -tanp > debian-bacula:/etc/bacula# netstat -tanp > Active Internet connections (servers and established) > Proto Recv-Q Send-Q Local Address Foreign Address > State PID/Program name > tcp 0 0 127.0.0.1:3306 0.0.0.0:* > LISTEN 2427/mysqld > tcp 0 0 0.0.0.0:9102 0.0.0.0:* > LISTEN 25815/bacula-fd > tcp 0 0 0.0.0.0:9103 0.0.0.0:* > LISTEN 25794/bacula-sd > tcp 0 0 0.0.0.0:111 0.0.0.0:* > LISTEN 1961/portmap > tcp 0 0 127.0.0.1:631 0.0.0.0:* > LISTEN 2537/cupsd > tcp 0 0 0.0.0.0:36023 0.0.0.0:* > LISTEN 1978/rpc.statd > tcp 0 0 127.0.0.1:25 0.0.0.0:* > LISTEN 2835/exim4 > tcp 0 0 192.168.47.129:46738 92.122.207.136:80 > ESTABLISHED 3299/firefox-bin > tcp 0 0 192.168.47.129:54912 65.55.149.123:80 > ESTABLISHED 3299/firefox-bin > tcp6 0 0 ::1:631 :::* > LISTEN 2537/cupsd > > I view the ports 9102 y 9103 listen, but no 9101. > > My files conf are: > > DIRECTOR: > Director { # define myself > Name = debian-bacula-dir > DIRport = 9101 # where we listen for UA connections > QueryFile = "/etc/bacula/query.sql" > WorkingDirectory = "/var/bacula/working" > PidDirectory = "/var/run" > Maximum Concurrent Jobs = 1 > Password = "0rHjNtqeYu3kOIIrGl+WW0MlO7zoDq+Cxo7sb1tvFKLR" # > Console password > Messages = Daemon > } > . > . > Client { > Name = debian-bacula-fd > Address = 127.0.0.1 > FDPort = 9102 > Catalog = MyCatalog > Password = "yyjjEFvz/Jf3YknWe10jibTL9S3oI02Zv2QOsLznX5vd" # > password for FileDaemon > File Retention = 30 days # 30 days > Job Retention = 6 months # six months > AutoPrune = yes # Prune expired Jobs/Files > } > . > . > Storage { > Name = File > # Do not use "localhost" here > Address = 127.0.0.1 # N.B. Use a fully qualified name here > SDPort = 9103 > Password = "zV6DkSAOLoXSL96779RE75yFyrS1r2wYKFAtaydwbdFs" > Device = FileStorage > Media Type = File > } > > STORAGE > > Storage { # definition of myself > Name = debian-bacula-sd > SDPort = 9103 # Director's port > WorkingDirectory = "/var/bacula/working" > Pid Directory = "/var/run" > Maximum Concurrent Jobs = 20 > } > > Director { > Name = debian-bacula-dir > Password = "zV6DkSAOLoXSL96779RE75yFyrS1r2wYKFAtaydwbdFs" > } > > > CLIENT > > Director { > Name = debian-bacula-mon > Password = "mM1qkD9zXeGCRiscDEpSHW6I60v2IZZb8Qo/zVdlRfse" > Monitor = yes > } > .. > > FileDaemon { # this is me > Name = debian-bacula-fd > FDport = 9102 # where we listen for the director > WorkingDirectory = /var/bacula/working > Pid Directory = /var/run > Maximum Concurrent Jobs = 20 > } > > NOTE: when I installed Bacula 2.4.4 bconsole no connected with director, and > the solution was > stop director > execute bacula-dir -d 100 -c /etc/bacula-dir.conf > > > > You can help me? First off remove 127.0.0.1 and local host from all bacula configuration files. Using either of these will prevent bacula from being a network backup program. Secondly start the director from the console bacula-dir -c /etc/bacula/bacula-dir.conf -d 100 and email the error you get. I am going to guess that the database is either not configured or not running. John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can volumes on an internal HDD be synchronised to more than one external HDD?
>> I would like to implement a Bacula 5.0.1 system with backup volumes on >> internal HDD storage and to have at least two external HDDs which >> essentially mirror the internal HDD storage. The purpose is to have one of >> the external HDDs off site at all times. >> >> Is this possible? > > Yes. Use a tool like rsync. Do not involve Bacula. > Agreed, This is the method I would use. Just make sure you have the volume size limited on the internal bacula storage so that bacula is not always expanding a single file. I would limit the disk volumes to at most 1/10 the total storage size. John -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Don't work automount for hdd partition
Hi all I wont make backup on partition which not mounted as default. In fstab it is like : #Entry for /dev/sdc2 (backup) : UUID=44a05141-9107-4288-bc71-1ccdaa04d0b1/backupreiserfs relatime,noauto02 So bacula should mount partition before start backup and unmount after backup in bacula-sd.conf i write this: Storage { # definition of myself Name = vanuch-sd SDPort = 9103 # Director's port WorkingDirectory = "/var/lib/bacula" Pid Directory = "/var/run/bacula" Maximum Concurrent Jobs = 20 } Director { Name = vanuch-dir Password = "d6mVbcoWYZbTlyWs3ccYu927QRv3TM23c" } Director { Name = vanuch-mon Password = "awHa8ySSpEfiVXhfe2gLTX6EnkfSGyzIR" Monitor = yes }Device { Name = FileStorage Media Type = File Device Type = File Archive Device = /backup LabelMedia = Yes; # lets Bacula label unlabeled media Removable media = Yes; Random Access = Yes; AutomaticMount = Yes; # when device opened, read it Requires Mount = Yes; Mount Point = /backup/ Mount Command = "/bin/mount %m" Unmount Command = "/bin/umount %m" AlwaysOpen = no; } bat this did not work:( pls, explain me, how turn on automount I use ubuntu 9.04 and bacula 2.4.4 from ubuntu repositories. P.S. sorry for my bad English, it not my native language -- Feci, quod potui, faciant meliora potentes я сделал всё что мог, кто может, пусть сделает лучше -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula-dir 5.01 no listen
Hi Greg, first, thanks for reading the question. I execute netstat -tanp debian-bacula:/etc/bacula# netstat -tanp Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp0 0 127.0.0.1:3306 0.0.0.0:* LISTEN 2427/mysqld tcp0 0 0.0.0.0:91020.0.0.0:* LISTEN 25815/bacula-fd tcp0 0 0.0.0.0:91030.0.0.0:* LISTEN 25794/bacula-sd tcp0 0 0.0.0.0:111 0.0.0.0:* LISTEN 1961/portmap tcp0 0 127.0.0.1:631 0.0.0.0:* LISTEN 2537/cupsd tcp0 0 0.0.0.0:36023 0.0.0.0:* LISTEN 1978/rpc.statd tcp0 0 127.0.0.1:250.0.0.0:* LISTEN 2835/exim4 tcp0 0 192.168.47.129:4673892.122.207.136:80 ESTABLISHED 3299/firefox-bin tcp0 0 192.168.47.129:5491265.55.149.123:80ESTABLISHED 3299/firefox-bin tcp6 0 0 ::1:631 :::*LISTEN 2537/cupsd I view the ports 9102 y 9103 listen, but no 9101. My files conf are: DIRECTOR: Director {# define myself Name = debian-bacula-dir DIRport = 9101# where we listen for UA connections QueryFile = "/etc/bacula/query.sql" WorkingDirectory = "/var/bacula/working" PidDirectory = "/var/run" Maximum Concurrent Jobs = 1 Password = "0rHjNtqeYu3kOIIrGl+WW0MlO7zoDq+Cxo7sb1tvFKLR" # Console password Messages = Daemon } . . Client { Name = debian-bacula-fd Address = 127.0.0.1 FDPort = 9102 Catalog = MyCatalog Password = "yyjjEFvz/Jf3YknWe10jibTL9S3oI02Zv2QOsLznX5vd" # password for FileDaemon File Retention = 30 days# 30 days Job Retention = 6 months# six months AutoPrune = yes # Prune expired Jobs/Files } . . Storage { Name = File # Do not use "localhost" here Address = 127.0.0.1# N.B. Use a fully qualified name here SDPort = 9103 Password = "zV6DkSAOLoXSL96779RE75yFyrS1r2wYKFAtaydwbdFs" Device = FileStorage Media Type = File } STORAGE Storage { # definition of myself Name = debian-bacula-sd SDPort = 9103 # Director's port WorkingDirectory = "/var/bacula/working" Pid Directory = "/var/run" Maximum Concurrent Jobs = 20 } Director { Name = debian-bacula-dir Password = "zV6DkSAOLoXSL96779RE75yFyrS1r2wYKFAtaydwbdFs" } CLIENT Director { Name = debian-bacula-mon Password = "mM1qkD9zXeGCRiscDEpSHW6I60v2IZZb8Qo/zVdlRfse" Monitor = yes } .. FileDaemon { # this is me Name = debian-bacula-fd FDport = 9102 # where we listen for the director WorkingDirectory = /var/bacula/working Pid Directory = /var/run Maximum Concurrent Jobs = 20 } NOTE: when I installed Bacula 2.4.4 bconsole no connected with director, and the solution was stop director execute bacula-dir -d 100 -c /etc/bacula-dir.conf You can help me? Thanks. _ Ahora Messenger en tu Blackberry® 8520 con Movistar por 0 €. ¿A qué esperas? http://serviciosmoviles.es.msn.com/messenger/blackberry.aspx-- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How to use another system disk partition as backup storage?
Thanks for reply. I will try to install bacula-sd on second machine. +-- |This was sent by vishuind...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to use another system disk partition as backup storage?
I guess what you like to do can be better done with a second bacula-sd installed on the second server.Otherwise (if I have understand right what you plan to do) if you backup a client over the network the hole traffic would go from the client to the first (bacula) server (that runs bacula-dir and bacula-sd that is using local storage but pointed to some mounted NFS share) and then again over network through NFS to the final storage on another system. It should be more efficient if the the client may talk directly to the system that hold the backup. Greetings, user100 Am 11.03.2010 06:12, schrieb vishesh: > Dear all >I am new to bacula and implemented it on my RHEl server 5.2. Everything is > working great and now i want to use my another linux system disk partition as > backup storage. Should i use NFS or similar network protocol or any other way? > > Thanks > > +-- > |This was sent by vishuind...@gmail.com via Backup Central. > |Forward SPAM to ab...@backupcentral.com. > +-- > > > > -- > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users