Re: [Bacula-users] batch ?
"Gary R. Schmidt" writes: >Strong suggestion that you ran out of temporary file space during the >batch insert. No, but I do seem to be getting some disk errors. I think I found the problem. :( --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] batch ?
Greetings. My bacula instance has, as far as I know, been running for many months without issue. Suddenly, it has generated the following SQL query which crashed my SQL server: 05-Sep 01:14 herman-dir JobId 1955: sql_create.c:731 INSERT INTO batch VALUES (138780,1955,'/home/hymie/BrettspielWelt/rotacticalPics/levels/levels/','level_097.txt','gn YR6 IGk B y Bk A Jk BAA I BQQEgJ +60Mh BFalPG A A C','26E4+aYmrT4Wxos4e34ysA') As far as I can tell, there is no table named "batch". None of my bacula instances (5.0.3) have a table named "batch". The "make-mysql-tables" file also has no reference to a table named "batch". Can somebody tell me (or guide me to troubleshoot) what happened? --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] suspend a running backup?
So my backup runs at 1am when I'm supposed to be asleep. Sometimes, however, something comes up, and I need to wake up and use the machine that is being backed up. Is there a way that I can pause or suspend a running backup, so that my machine is not slowed by the file-system and network activity of the backup? Then when I'm finished working, I can re-activate the backup, and have it pick up where it left off? I don't want to completely cancel the backup, especially if it's a "full", because it will just have to do it again. Thanks. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] No space left on device.
"Luis H. Forchesatto" writes: >Trying to make run an job via bconsole I got the followin logs: >failed: ERR=No space left on device >failed: ERR=No space left on device >failed: ERR=No space left on device >failed: ERR=No space left on device >Surely there's space left on the disk. That's a question only you can answer. --hymie! http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] iptables problem
>>> bacula returns this error message: >>> >>> 06-juin 14:56 Bacula-dir JobId 1569 : Warning: bsock.c:129 impossible to >>> connect at Storage daemon on 192.168.1.15:9103. ERR=3DConnection failed >> What happens when you telnet 192.168.1.15 9103 ? Do you get a connection? >it works only when i invoke the command connected on the server, not >from outside "From outside" ? Umm, you do understand who 192.168.X.X addresses work, right? So you can telnet from the Bacula director to the Bacula storage daemon on port 9103. At that point, I need to defer to other people -- on all of my setups, the bacula director and the Storage daemon are the same machine. Do the individual client machines need to connect directly to the Storage Daemon, or do they go through the director? I assume they need to connect directly ... in which case, I would ask you the same question about your various bacula clients. Can they telnet 192.168.1.15 9103 ? --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] iptables problem
Laurent MANCHON writes: >bacula returns this error message: > >06-juin 14:56 Bacula-dir JobId 1569 : Warning: bsock.c:129 impossible to >connect at Storage daemon on 192.168.1.15:9103. ERR=Connection failed > >i think i have a problem with my iptables rules but i don't know where, >i need somebody help to resolve this problem. I'm not an iptables expert, but your rules seem **very** complex for a machine whose IP address begins with 192.168 . You didn't specify if these are the iptables rules on your bacula server, or on the storage server (or if they are the same machine). That said ... What happens when you telnet 192.168.1.15 9103 ? Do you get a connection? SYN_SENT? SYN_RECV? ># bacula rules >$IPT -A OUTPUT -p tcp --dport 9102:9103 -o $INTERNET -m state --state >NEW -j ACCEPT >$IPT -A INPUT -m state --state NEW -m tcp -p tcp --dport 9101:9103 -j ACCEPT I'm not sure why you're restricting yourself to only NEW connections. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] retentions
Konstantin Khomoutov writes: >hymie! wrote: > >> A volume will not be recycled until the Volume Retention has expired, >> even if all of the backups stored in that volume have expired. If my >> Job Retention is 1 month, and my Volume Retention is 3 months, then my >> volumes are not available after 1 month even though the jobs in those >> volumes are expired. >Possibly there's an error in the last sentence. Yes, I screwed up the last sentence. Let me try again please. If my Job Retention is 1 month, and my Volume Retention is 3 months, then at the end of 1 month, my volumes are still marked as "Full", and will not be pruned, recycled or written to, even though the jobs in those volumes are expired. >Volumes will continue to live on, just you won't be able to >*directly* restore anything from then (that is, simply using bconsole >commands) because no catalog entries would exist describing jobs. >But that does not prevent you from doing emergency recovery using those >volumes Gotcha. Actually, what I'm looking for is the opposite. I'd like Bacula to recognize that the jobs on the volume have expired, and the volumes can be pruned and recycled. But it appears that it does not matter when the Job Retention is, only the Volume Retention decides when my volumes are pruned. ...or maybe it's "Whichever one is longer" ? Maybe I need to set up separate pools, based on retention, so that jobs with a 1 month retention are stored on volumes with 1 month retention, and jobs with a 3 month retention are stored on volumes with 3 month retention? --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] retentions
Do I understand this correctly? A volume will not be recycled until the Volume Retention has expired, even if all of the backups stored in that volume have expired. If my Job Retention is 1 month, and my Volume Retention is 3 months, then my volumes are not available after 1 month even though the jobs in those volumes are expired. Thanks. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- EMC VNX: the world's simplest storage, starting under $10K The only unified storage solution that offers unified management Up to 160% more powerful than alternatives and 25% more efficient. Guaranteed. http://p.sf.net/sfu/emc-vnx-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] disk backup -- swapping out disks?
So the question has come up about storing our backups off-site.
We're using disk backups, with two USB disks. Each disk is a
Storage, and each Storage has a single Pool, and each Pool has max
200 4GB volumes. Part of my configuration is below.
What I'd like to do is buy a second matching set of USB disks,
take the existing disks off, mount the new disks in the same place,
and just have Bacula pick up where it left off, seeing no volumes
and creating them as it needs to.
(We do full backups once a month anyway, and I would probably do it that
morning.)
Then in a month, I will do it again, take the disks off, put the
old disks back in, and Bacula will just notice all of its old volumes
are back.
Is this a workable solution?
--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
---
(from bacula-sd.conf)
Device {
Name = FileStorage
Device Type = File
Media Type = File
Archive Device = /storage
Maximum Concurrent Jobs = 1
LabelMedia = yes; # lets Bacula label unlabeled media
Random Access = Yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = yes;
AlwaysOpen = yes;
}
(from bacula-dir.conf)
Storage {
Name = File
Address = 10.0.xxx.xxx # N.B. Use a fully qualified name here
SDPort = 9103
Password = ""
Maximum Concurrent Jobs = 1
Device = FileStorage
Media Type = File
}
Pool {
Name = Pool1
Pool Type = Backup
Recycle = yes # Bacula can automatically recycle Volumes
AutoPrune = yes # Prune expired volumes
Volume Retention = 6 months
Maximum Volume Bytes = 4g
LabelFormat = "S1Vol"
Maximum Volumes = 200
Action On Purge = Truncate
}
--
BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA
The must-attend event for mobile developers. Connect with experts.
Get tools for creating Super Apps. See the latest technologies.
Sessions, hands-on labs, demos & much more. Register early & save!
http://p.sf.net/sfu/rim-blackberry-1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Device is BLOCKED waiting to create a volume for
scar writes: >> So I used the "label" command to create the volume S1Vol0809 in the >> appropriate pool, and it seems to have liked it so far, as "ls -l" tells me: >> -rw-r- 1 bacula tape201 2011-07-28 14:51 S1Vol0809 >> >> and yet, my backup is still stuck. > >if you check the SD status, How embarrassing. In all of my troubleshooting and testing (and swearing), I never actually bounced the SD. That resolved my problem. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Device is BLOCKED waiting to create a volume for
Greetings. So bacula has been running fine for a while, until it suddenly stopped on 12 July. The message I am seeing is this: Device status: Device "FileStorage" (/disk1/bacula-backups/) is mounted with: Volume: S1Vol0809 Pool:Pool1 Media type: File Device is BLOCKED waiting to create a volume for: Pool:Pool1 Media type: File Total Bytes Read=0 Blocks Read=0 Bytes/block=0 Positioned at File=0 Block=200 So I used the "label" command to create the volume S1Vol0809 in the appropriate pool, and it seems to have liked it so far, as "ls -l" tells me: -rw-r- 1 bacula tape201 2011-07-28 14:51 S1Vol0809 and yet, my backup is still stuck. Can somebody point me in the right direction? --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Setting Priority
I personally found the built-in Priority system to be unsuitable for my
needs. I am instead using the (undocumented) feature that backups
are typically executed in the order that they are placed into the schedule.
So in my case, I have four different machines, and each machine gets a
full backup on a specific Friday, and differentials on the other
Fridays, and incremntals Sunday - Thursday.
Job {
Name = "CEPub1Backup"
JobDefs = "DefaultJob"
Client = nycepub1-fd
Schedule = "Weekly1stFriCycleP2"
}
Job {
Name = "CESub1Backup"
JobDefs = "DefaultJob"
Client = nycesub1-fd
Schedule = "Weekly2ndFriCycleP2"
}
and so on ...
Schedule {
Name = "Weekly1stFriCycle"
Run = Full 1st fri at 21:05
Run = Differential 2nd-5th fri at 21:10
Run = Incremental sun-thu at 21:10
}
Schedule {
Name = "Weekly2ndFriCycle"
Run = Full 2nd fri at 21:05
Run = Differential 1st fri at 21:10
Run = Differential 3rd-5th fri at 21:10
Run = Incremental sun-thu at 21:10
}
Schedule {
Name = "Weekly4thFriCycleP2"
Run = Full 4th fri at 21:15
Run = Differential 1st-3rd fri at 21:15
Run = Differential 5th fri at 21:15
Run = Incremental sun-thu at 21:15
}
This typically ensure that the Full backup will start before the
Differentials are even scheduled. It also ensures that the largest
machine, which takes 12 hours just to do an incremental backup,
always starts last, at a lower pseudo-priority than the other three
machines.
You will, of course, want to do it the other way, with your incrementals
scheduled 5 minutes earlier than your fulls.
However, I might suggest that, since Incremental/Differential backups
depend on having a Full backup already completed, you have your
priorities backwards. The Full backups, imho, should be given the higher
priority than the incrementals.
Anyway, These four machines run their Full/Diff backups on Friday,
and they take about 36 hours to complete. I have no backups at all
on Saturday, to ensure that nothing clogs the queue while my important
Full/Diff backups are running. They are finished in time for the Sunday
night incrementals.
Mike Hobbs writes:
>Hello, I was wondering if someone could help me out with an issue.
--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
---
--
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2d-c2
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup Progress
Rickifer Barros writes: >There's some way to see the progress of a Backup or Restore during your >execution? Because with the "status dir" command, I can just see the "backup >is running" and nothing more. I didn't found nothing in the Manual about >that too. Once you know which client is running, the "status client" command will tell you which file (or perhaps which directory) is being backed up, as well as the number of files and the number of bytes that have been processed. You can use this information to estimate how far along the backup has gone. That's probably about the best you're going to get. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] friday vs saturday
Kevin Keane writes:
>How is your concurrency configured? If you only have one concurrent job, the a
>ctual dates you have in your schedule aren't related to reality in the first p
>lace. If that is your configuration, your backups aren't going to run on Satur
>day anyway, but on Sunday or whenever the full backups are finished. That mean
>s that the exact time you schedule the differentials doesn't matter. Just sche
>dule them to start five minutes after the fulls (at 22:10), and with a lower p
>riority.
I think you missed the point of my question. That's probably my fault, for
being too verbose.
But my question was, how do I
* schedule a full backup on a specific Friday
* schedule differential backups on Saturdays
* * but not the day immediately after a full backup
?
>-Original Message-
>From: hymie! [mailto:hy...@lactose.homelinux.net]
>Sent: Monday, April 25, 2011 9:43 AM
>To: bacula-users@lists.sourceforge.net
>Subject: [Bacula-users] friday vs saturday
>
>
>So I have four machines whose full backups take more than 24 hours.
>As an additional problem, one of those 4 machines takes 12 hours just to do an
> Incremental/Differential backup. (The full backup takes 43
>hours.)
>
>I had the idea that I would assign each machine its own Friday to do a full ba
>ckup, where no other backups would take place. Then on Saturday, each of the
>machines that didn't just do a full backup would do a Differential backup. Fi
>nally, incrementals the rest of the week.
>
>I was just about to set up schedules for these boxes that look something like
>this:
>
>Schedule {
> Name = "1stFridayFull"
> Run = Full 1st fri at 22:05
> Run = Differential 2nd-5th sat at 22:05
> Run = Incremental sun-thu at 22:05
>}
>Schedule {
> Name = "2ndFridayFull"
> Run = Full 2nd fri at 22:05
> Run = Differential 1st sat at 22:05
> Run = Differential 3nd-5th sat at 22:05
> Run = Incremental sun-thu at 22:05
>}
>
>But then I realized -- sometimes, the day after the 1st Friday is the 2nd Satu
>rday.
>
>(caution: monospaced font ahead)
>October 2011
>Su Mo Tu We Th Fr Sa
> 1
> 2 3 4 5 6 7 8
> 9 10 11 12 13 14 15
>16 17 18 19 20 21 22
>23 24 25 26 27 28 29
>30 31
>
>So it seems that, on Fri 7 October, my 1stFriFull machine will do a full backu
>p; on Sat 8 October, that same machine will do a Differential backup.
>
>Meanwhile, my 2ndFriFull machine will do a Differential on Sat 1 October, incr
>ementals during the week, nothing at all on the 7th or 8th, more incrementals,
> before finally doing a Full backup on the 14th...
>again followed immediately by a Differential backup on the 15th.
>
>Is there a way to avoid this problem and accomplish what I want to accomplish?
> The only thing that comes to mind is with unusual time math, such as schedul
>eing my Differential backups for Friday at 46:05; but I doubt that Bacula supp
>orts this.
>
>--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
>--
--
WhatsUp Gold - Download Free Network Management Software
The most intuitive, comprehensive, and cost-effective network
management toolset available today. Delivers lowest initial
acquisition cost and overall TCO of any competing solution.
http://p.sf.net/sfu/whatsupgold-sd
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] friday vs saturday
So I have four machines whose full backups take more than 24 hours.
As an additional problem, one of those 4 machines takes 12 hours just
to do an Incremental/Differential backup. (The full backup takes 43
hours.)
I had the idea that I would assign each machine its own Friday to do
a full backup, where no other backups would take place. Then on Saturday,
each of the machines that didn't just do a full backup would do a Differential
backup. Finally, incrementals the rest of the week.
I was just about to set up schedules for these boxes that look something
like this:
Schedule {
Name = "1stFridayFull"
Run = Full 1st fri at 22:05
Run = Differential 2nd-5th sat at 22:05
Run = Incremental sun-thu at 22:05
}
Schedule {
Name = "2ndFridayFull"
Run = Full 2nd fri at 22:05
Run = Differential 1st sat at 22:05
Run = Differential 3nd-5th sat at 22:05
Run = Incremental sun-thu at 22:05
}
But then I realized -- sometimes, the day after the 1st Friday is the
2nd Saturday.
(caution: monospaced font ahead)
October 2011
Su Mo Tu We Th Fr Sa
1
2 3 4 5 6 7 8
9 10 11 12 13 14 15
16 17 18 19 20 21 22
23 24 25 26 27 28 29
30 31
So it seems that, on Fri 7 October, my 1stFriFull machine will do a full
backup; on Sat 8 October, that same machine will do a Differential backup.
Meanwhile, my 2ndFriFull machine will do a Differential on Sat 1 October,
incrementals during the week, nothing at all on the 7th or 8th, more
incrementals, before finally doing a Full backup on the 14th...
again followed immediately by a Differential backup on the 15th.
Is there a way to avoid this problem and accomplish what I want to
accomplish? The only thing that comes to mind is with unusual time
math, such as scheduleing my Differential backups for Friday at 46:05;
but I doubt that Bacula supports this.
--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
---
--
WhatsUp Gold - Download Free Network Management Software
The most intuitive, comprehensive, and cost-effective network
management toolset available today. Delivers lowest initial
acquisition cost and overall TCO of any competing solution.
http://p.sf.net/sfu/whatsupgold-sd
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] speed up my backups
Maybe I can answer to follow-ups at once. Easy one first: Il 19/04/2011 15:37, hymie! ha scritto: >> So one of my machines has a few zillion tiny little files. >> >> My full backup took 44 hours. I can deal with that if I have to. >> My incremental backup has been running for 10 hours now. >> Files=71,560 Bytes=273,397,510 Bytes/sec=7,666 Errors=0 >> Files Examined=14,675,372 >> >> I know that bacula has to look at each file to determine if it's >> changed. And I am investigating whether or not we actually need to >> keep all of these little files, or if we can zip them up into archives. >> >> In the meantime, I'm just wondering if there is some why to speed up my >> backups. For example, Marcello Romani writes: >Maybe it's not relevant to your case, but have you tried to enable >spooling ? I don't think spooling will solve my problem. First off, I'm using disks as my storage, not tapes; spooling is not recommended. Second, the bottleneck clearly (well, clearly to me) is at the client side choosing files. Note that Bytes/sec is under 8,000. I don't have any currently- running backups to compare it to, but that seems like an *extremely* low number. Christian Manal wrote: >Hi, > >do you use accurate backups? If not, the signature isn't used anyway. >Regular incrementals and differentials are done by timestamp. No, I do not. At least, not on purpose, and not that I can see. Although I did just notice that it's VSS, if that matters. JobId 272 Job CEFiles01Backup.2011-04-18_23.05.00_41 is running. VSS Incremental Backup Job started: 18-Apr-11 22:36 Files=71,586 Bytes=273,451,803 Bytes/sec=7,131 Errors=0 Files Examined=15,267,990 But if it's already just using timestamp, then I may just be stuck with a 12-hour incremental. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] speed up my backups
So one of my machines has a few zillion tiny little files. My full backup took 44 hours. I can deal with that if I have to. My incremental backup has been running for 10 hours now. Files=71,560 Bytes=273,397,510 Bytes/sec=7,666 Errors=0 Files Examined=14,675,372 I know that bacula has to look at each file to determine if it's changed. And I am investigating whether or not we actually need to keep all of these little files, or if we can zip them up into archives. In the meantime, I'm just wondering if there is some why to speed up my backups. For example, signature=sizeonly or signature=stupid or some other undocumented and unrecommended (but needed) way to speed up the verification of file changes (or lack thereof). Thanks. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] FileSet -- default options?
Greetings.
Can I set "default options" for FileSets the way I can for Jobs? Or,
can I somehow include an external file into my bacula-dir.conf file
at a specific point?
I have a number of Windows machines that I back up, and I'm using
Russell Howe's extensive (but long) exclusion list.
However, my various machines are all different. Most nobaly, some of them
have multiple hard disks and hard disk partitions.
So right now I have
FileSet {
Name = "Windows-C"
Include {
(extremely long exclude list here)
File = "C:/"
}
}
Then I have
FileSet {
Name = "Windows-CD"
Include {
(same extremely long exclude list here)
File = "C:/"
File = "D:/"
}
}
FileSet {
Name = "Windows-CDE"
Include {
(same extremely long exclude list here)
File = "C:/"
File = "D:/"
File = "E:/"
}
}
FileSet {
Name = "Windows-CDEG"
Include {
(same extremely long exclude list here)
File = "C:/"
File = "D:/"
File = "E:/"
File = "G:/"
}
}
and I was hoping there was a more manageable way to maintain this.
Ideally, I could literally have
FileSet {
Name = "Windows-CDEG"
Include {
#include windows-fileset.conf
File = "C:/"
File = "D:/"
File = "E:/"
File = "G:/"
}
}
--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
---
--
Benefiting from Server Virtualization: Beyond Initial Workload
Consolidation -- Increasing the use of server virtualization is a top
priority.Virtualization can reduce costs, simplify management, and improve
application availability and disaster protection. Learn more about boosting
the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Pools and Volumes
I am by no means an expert, but I can hopefully give you my experience. A backup that I inherited was set up with 2 disks, a storage for each disk, and a pool for each storage. Apparantly, bacula can sometimes get confused when two storages use the same media. Because more than once, my backups would try to load a volume on the wrong storage. Even worse -- This backup system put the full backups in Pool A on Storage A and the associated incrementals in Pool B on Storage B. When I needed to do a restore, it found all of the jobs, and then asked me which Storage should it use to find the volumes -- Storage A or Storage B? Apparantly, "Both" was not an acceptable answer. So I believe the correct answer is: Disk A Storage A Pool A Machine 1 Machine 2 Machine 3 Disk B Storage B Pool B Machine 4 Machine 5 Machine 6 And hopefully, never the 'twain shall meet. Now, each of my disks is 2TB. If you've got a 16-bay JBOD and, say, 12 100GB disks, then you might be even better off setting up a striped logical volume at the OS level, and tell Bacula that it's a single disk. Mike Hobbs writes: > I'm still on my quest to get bacula to write data to more than one >disk drive.. I have a 16-bay JBOD unit. I was pointed to "vchanger" but >as bacula is a bit complicated already, I don't want to add a 3rd party >program into the mix as well (unless I have to). I also have to believe >that bacula can write to more than one disk without this software package. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- Don't anthropomorphize computers. They hate that. --overheard --- -- Xperia(TM) PLAY It's a major breakthrough. An authentic gaming smartphone on the nation's most reliable network. And it wants your games. http://p.sf.net/sfu/verizon-sfdev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Priority question
My bacula setup is improving, and I have you guys to thank for it, so thank you. I have two separate Storage resources, and each one has specific backup jobs assigned to it, and (I think) two jobs will run at a time, one to each Storage. I have a handful of jobs, and they have a handful of priorities -- 5, 7, and 10 -- because I would like specific machines to be backed up first. However, all of the jobs assigned to Storage2 have priority 10. Am I correct that **no** jobs with Priority 10 will run while my Priority 5 and Priority 7 jobs are running, even though Storage2 is sitting idly and *could* be running a job? Is there a way around this? Or do I need to drop the Priority system entirely and just let the machines get backed up in whatever order? Thanks. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net -- Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] contact? -- typo in documentation
Greetings. I could not find who the correct person to contact would be. http://bacula.org/5.0.x-manuals/en/main/main/Storage_Daemon_Configuratio.html#SECTION00203 "Maximum Concurent Jobs" "Concurrent" has 2 r's. I had quite a bit of trouble configuring my storage daemons before I figured out the problem. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net -- Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] pool vs storage
Greetings. A couple of questions so that I can hopefully better understand what I'm doing with my Bacula setup. Q1: Is this statment correct? "A Storage may contain several Pools, but a Pool lives on one and only one Storage" If this is correct, then why is the Storage selected within a Job specification and not within the Pool spec? Q2: If I have two Pools and two Storages, can my Volume names overlap? Or must my Volume names be unique across my various Storages and Pools? (Background -- somehwere in my Bacula config, I ended up with * Volume 100 on Storage A as a member of Pool A * a request to load Volume 100 on Storage B and this blocked all of my backups.) Thanks. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Storage -- 2 disks, no waiting
Greetings.
I have two 1TB disks that I'd like to use for my Bacula volumes.
My bacula-sd.conf says:
===
Device {
Name = FileStorage
Media Type = File
Archive Device = /storage
LabelMedia = yes; # lets Bacula label unlabeled media
Random Access = Yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = yes;
AlwaysOpen = no;
}
Device {
Name = FileStorage2
Media Type = File
Archive Device = /storage2
LabelMedia = yes; # lets Bacula label unlabeled media
Random Access = Yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = yes;
AlwaysOpen = no;
}
===
However, it appears that each Job in my bacula-dir.conf has a specific
Storage assigned to it.
How do I configure my Pools and/or my Clients and/or my Jobs to tell bacula
"I really don't care which one you use"?
Thanks.
--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
---
--
Enable your software for Intel(R) Active Management Technology to meet the
growing manageability and security demands of your customers. Businesses
are taking advantage of Intel(R) vPro (TM) technology - will your software
be a part of the solution? Download the Intel(R) Manageability Checker
today! http://p.sf.net/sfu/intel-dev2devmar
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] dump my configuration?
Kjetil Torgrim Homme writes:
>hymie! writes:
>> GreatPlains-Backup job:
>> (*) did not name the Volume correctly
>> GreatPlains-Backup.2011-01-29_23.05.00_08
>> instead of
>> GreatPlains-Backup.2011-01-29_23.05.00_08-Full
>I can't explain this (I don't use this kind of Label Format myself). I
>don't recommend doing it this way, since Bacula will *never* delete old
>files. check out "Action On Purge = truncate", though, it helps somewhat.
My home installation of Bacula uses generic Vol0001 - Vol0200. That has
the added benefit that my backups should never outgrow the disk. My boss
prefers this method; not sure exactly why. I will look into the
AOP. Thanks for the tip.
>> (*) failed to automatically create the Volume that it needed.
>> I had to go into the bacula-console and label a volume, after which
>> it immediately began processing the backup.
>you need to specify "Label Media = yes" in bacula-sd.conf.
It is:
Device {
Name = FileStorage
Device Type = File
Media Type = File
Archive Device = /storage
LabelMedia = yes; # lets Bacula label unlabeled media
Random Access = Yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = yes;
AlwaysOpen = yes;
}
That was part of my original confusion -- 5 other backups all auto-
labeled the volumes, but this one was stuck.
But it worked last night, so either it was "just a thing," or it's a
full-vs-incremental issue, or I somehow fixed it and don't know what I did.
>> Further, the "BackupCatalog" job appears to be using the names of random
>> jobs for its volumes, rather than its own name:
>
>you specified "Recycle", so Bacula will reuse old volumes.
Thank you! I thought "Maximum Volume Jobs = 1" would prevent that,
but once the job is purged, then there are no jobs in that volume, so it
becomes fair game.
--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
---
--
Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)!
Finally, a world-class log management solution at an even better price-free!
Download using promo code Free_Logger_4_Dev2Dev. Offer expires
February 28th, so secure your free ArcSight Logger TODAY!
http://p.sf.net/sfu/arcsight-sfd2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] dump my configuration?
Graham Keeling writes:
>On Mon, Jan 31, 2011 at 10:32:32AM -0500, hymie! wrote:
>> GreatPlains-Backup job:
>> (*) did not name the Volume correctly
>> GreatPlains-Backup.2011-01-29_23.05.00_08
>> instead of
>> GreatPlains-Backup.2011-01-29_23.05.00_08-Full
>So, my suggestion is to try looking at the output of this sql command:
>
>select PoolId, Name, LabelFormat from Pool;
Sadly, it looks correct.
mysql> select PoolId, Name, LabelFormat from Pool;
++--+-+
| PoolId | Name | LabelFormat |
++--+-+
| 1 | Default | * |
| 2 | File | * |
| 3 | Scratch | * |
| 4 | Trixbox-full | ${JobName}-${Level} |
| 5 | Trixbox-diff | ${JobName}-${Level} |
| 6 | Trixbox-inc | ${JobName}-${Level} |
| 7 | FPool| ${JobName}-${Level} |
| 8 | DiffPool | ${JobName}-${Level} |
| 9 | IncPool | ${JobName}-${Level} |
+----+--+-+
--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
--
Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)!
Finally, a world-class log management solution at an even better price-free!
Download using promo code Free_Logger_4_Dev2Dev. Offer expires
February 28th, so secure your free ArcSight Logger TODAY!
http://p.sf.net/sfu/arcsight-sfd2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] dump my configuration?
John Drescher writes:
>> /usr/sbin/bacula-dir -t shows no errors, so I need something more.
>
>Then there is no errors in the config file.
>
>/etc/bacula/bacula-dir.conf
>
>look at this. And also explain exactly what it is doing that you do
>not think it should be doing along with posting this file.
Hi, John.
At this point, I am not in a position to post my entire bacula-dir.conf
file. When my boss returns from sick leave, perhaps he will change his
mind.
I do, however, have these snippets from the file. I hope that's enough
at this time.
=== 8< === 8< ===
JobDefs {
Name = "DefaultJob"
Enabled = yes
Type = Backup
Level = Incremental
Client = BackupServer-fd
FileSet = "Unix Fileset"
Schedule = "SecondWeeklyCycle"
Storage = File
Messages = Standard
Pool = IncPool
Full Backup Pool = FPool
Differential Backup Pool = DiffPool
Incremental Backup Pool = IncPool
Priority = 10
}
Job {
Name = "GreatPlains-Backup"
Client = GreatPlains-fd
JobDefs = "DefaultJob"
FileSet = "GP Set"
Write Bootstrap = "/var/lib/bacula/GreatPlainsBackup.bsr"
}
Job {
Name = "BackupCatalog"
JobDefs = "DefaultJob"
Level = Full
FileSet="Catalog"
Schedule = "WeeklyCycleAfterBackup"
# This creates an ASCII copy of the catalog
# WARNING!
# Ubuntu uses make_catalog_backup_awk script for
# security reasons
# Replace with the real Catalog name
RunBeforeJob = "/usr/bin/awk -f /etc/bacula/scripts/make_catalog_backup_awk
-v cat1=MyCatalog /etc/bacula/bacula-dir.conf"
# This deletes the copy of the catalog
RunAfterJob = "/etc/bacula/scripts/delete_catalog_backup"
Write Bootstrap = "/var/lib/bacula/BackupCatalog.bsr"
Priority = 11 # run after main backup
}
Pool {
Name = FPool
Pool Type = Backup
Recycle = yes # Bacula can automatically recycle Volumes
Maximum Volume Jobs = 1
AutoPrune = yes # Prune expired volumes
Volume Retention = 90 days # one year
Label Format = "${JobName}-${Level}"
}
FileSet {
Name = "GP Set"
Enable VSS = yes
Include {
Options {
signature = MD5
compression = GZIP
}
File="C:/"
File="D:/"
}
}
=== 8< === 8< ===
What it is doing that is weird:
There are 6 other backup jobs in addition to the GreatPlains-Backup job
listed above. The other backups all work correctly. However, the
GreatPlains-Backup job:
(*) did not name the Volume correctly
GreatPlains-Backup.2011-01-29_23.05.00_08
instead of
GreatPlains-Backup.2011-01-29_23.05.00_08-Full
(*) failed to automatically create the Volume that it needed.
I had to go into the bacula-console and label a volume, after which
it immediately began processing the backup.
Further, the "BackupCatalog" job appears to be using the names of random
jobs for its volumes, rather than its own name:
GreatPlains-Backup.2011-01-29_23.05.00_08-Full
Files-Backup.2011-01-29_23.05.00_07-Full
instead of
BackupCatalog.2011-01-30_18.52.19_06-Full
--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
--
Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)!
Finally, a world-class log management solution at an even better price-free!
Download using promo code Free_Logger_4_Dev2Dev. Offer expires
February 28th, so secure your free ArcSight Logger TODAY!
http://p.sf.net/sfu/arcsight-sfd2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] dump my configuration?
John Drescher writes: >On Sun, Jan 30, 2011 at 12:59 PM, hymie! wrot= >e: >> >> Short question -- can a running Bacula Console dump out what it thinks >> my configuration is? >I am confused at the question. I mean you should have edited the >configuration. And it is a simple text file. If you do not know what >it is how on earth did you setup bacula? Since you bring it up, it was set up by a former co-worker. It apparantly worked for a while, stopped in December 2009, and now I have to get it running again. So no, I didn't edit the configuration. I currently have 3 instances of Bacula running on various machines / network / locations. I set one of them up myself and it is working correctly. The other 2 I inherited from a former co-worker; 1 works fine, the other is acting just a little strange. I'm guessing the most likely reason is that there is a mistake in the config file, perhaps a missing equal sign or mismatched curly-brackets. I've checked the config file and it looks fine to me, but it wouldn't be the first time I couldn't find my own mistake. /usr/sbin/bacula-dir -t shows no errors, so I need something more. So if Bacula can tell me, in full excruciating detail, "This is how I think the GP01-Backup job is configured" then I can compare it to how I wanted the backup to be configured, and hopefully find and fix the mistake. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] dump my configuration?
Short question -- can a running Bacula Console dump out what it thinks my configuration is? Long question -- my Bacula installation is acting a little weird. I'm using File Storage. A couple of bacups didn't have the right name, and one of those didn't auto-label the backup file. Most of my backups worked fine; just a couple acted weird. I don't see anything wrong with my setup, but clearly, there's a mistake. So I'm wondering if I can get Bacula to tell me what it thinks my configuration is, so I can compare it to my config file and find the discrepancy. Thanks. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- A man my age is very young, so I'm told; Why do I feel so old? --Billy Joel --- -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Base = ?
I should have included this other job definition for reference. It
uses "Level = Base" which I also cannot find in the documentation.
Job {
Name = "db01-base"
Type = Backup
Messages = Standard
Level = Base
FileSet="db01-Slash"
Storage = File
Client = db01-fd
Priority = 10
}
Job {
Name = "db01-full"
Base = db01-full, db01-base
JobDefs = "StandardJob"
Client = db01-fd
FileSet = "Slash"
}
Can somebody tell me where to find the documentation and/or what
this option does?
Thanks.
--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
--
Protect Your Site and Customers from Malware Attacks
Learn about various malware tactics and how to avoid them. Understand
malware threats, the impact they can have on your business, and how you
can protect your company and customers by using code signing.
http://p.sf.net/sfu/oracle-sfdevnl
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Base = ?
Greetings.
I'm taking over the bacula administration from an ex-co-worker.
He has some jobs configured with the "Base" option, such as:
Job {
Name = "db01-full"
Base = db01-full, db01-base
JobDefs = "StandardJob"
Client = db01-fd
FileSet = "Slash"
}
I cannot find any reference in the "Configuring the Director" manual
http://bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html
to this option. Am I looking in the wrong place?
The closest thing I can find is
basejob=options
The options letters specified are used when running a Backup
Level=Full with BaseJobs. The options letters are the same than in
the verify= option below.
But this is the only reference to BaseJobs that I can find, and the
options don't match.
Can somebody tell me where to find the documentation and/or what
this option does?
Thanks.
--hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net
---
--
Protect Your Site and Customers from Malware Attacks
Learn about various malware tactics and how to avoid them. Understand
malware threats, the impact they can have on your business, and how you
can protect your company and customers by using code signing.
http://p.sf.net/sfu/oracle-sfdevnl
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] keep a backup forever?
Greetings. I've been using bacula 3.0.2 (server) and 3.0.3 (clients) on my linux boxes for a while now, and I'm very happy. I'm using FileStorage with 200 volumes on an external USB disk drive. I had a machine die on me, and I had to replace it this week. Bacula has been of invaluable help. Before I put the new (replacement) machine into the backup system, I would like to know if there is a way that I can save the last bacukp(s) of the original (now-dead) machine for longer than my 3-month rotation schedule, just in case. I'm not afraid of diving into the database, if the answer is something like "find the job(s) in the database and update the expiration on those jobs", but I might need some pointers as to what specifically needs to be updated. Failing that, if I were to store the volume files that contain my last backup(s), is there a way that I can, in the future, get bacula to reload the information off those volumes and retrieve data from the backups they contain? Thank you very much. --hymie!http://lactose.homelinux.net/~hymiehy...@lactose.homelinux.net --- -- Lotusphere 2011 Register now for Lotusphere 2011 and learn how to connect the dots, take your collaborative environment to the next level, and enter the era of Social Business. http://p.sf.net/sfu/lotusphere-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
