Re: [Bacula-users] Jobs don't remain on schedule

[Craig Shiroma]

Hi Bill and Kern,

Yes, it looks like Bill was correct.  The jobs giving the problem were long
running jobs (12+ hours) so I think it just so happened that occasionally
(didn't happen every week), the full got pruned due to timing.

I increased "Max Full Interval" to 7 and things have been okay for 2 weeks
now.

Thank you for the help guys!

-craig


On Sat, Apr 1, 2017 at 5:21 AM, Kern Sibbald  wrote:

> Hello Craig,
>
> Given the first message below:
>
> No prior or suitable Full backup found in catalog. Doing FULL backup.
>
> I would agree with Bill's first point.  It appears that your Full backup
> was pruned, so Bacula had to do another one.
>
> Best regards,
>
> Kern
>
> On 03/31/2017 08:49 PM, Craig Shiroma wrote:
>
> Hello All,
>
> I have a few jobs that are on the below schedule:
>
> Schedule {
>   Name = "WeeklyFullOnFriRunFirst"
>   Run = Level=Full fri at 17:58
>   Run = Level=Incremental sat-thu at 18:00
> }
>
> The jobs followed the schedule until last night which was a Thursday.  An
> incremental was suppose to run, but a Full was run instead.  Would anyone
> know what could cause this to happen?  Previous full backup did run on a
> Friday at 17:58.
>
> The log for these jobs show similar text shown below:
> bacula-dir JobId 413490:
> bacula-dir JobId 413490: No prior or suitable Full backup found in
> catalog. Doing FULL backup.
> bacula-dir JobId 413490: Start Backup JobId 413490,
> Job=servername.2017-03-30_18.00.06_05
> bacula-dir JobId 413490: Max configured use duration=82,800 sec. exceeded.
> Marking Volume "servername-258519-vol" as Used.
> bacula-dir JobId 413490: Pruning oldest volume "servername-263826-vol"
> bacula-dir JobId 413490: There are no more Jobs associated with Volume
> "servername-263826-vol". Marking it purged.
> bacula-dir JobId 413490: All records pruned from Volume
> "servername-263826-vol"; marking it "Purged"
> bacula-dir JobId 413490: Using Device "servername" to write.
> bacula-sd JobId 413490: Recycled volume "servername-263826-vol" on file
> device "servername" (/backup01/servername/), all previous data lost.
>
> Seems like something is out of sync with the schedule that is causing the
> Full to run on the wrong day.
>
> Best regards,
> Craig
>
>
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>
>
>
> ___
> Bacula-users mailing 
> listBacula-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Jobs don't remain on schedule

[Craig Shiroma]

Hi Bill,

Hmmm, I know I didn't touch the fileset(s) and I have IgnoreFilesetChanges
set to "yes" on these filesets.  The FileSet date on one of the jobs is
"2015-10-10 18:00:12".

Here are some configs for one of the problem jobs:
Pool {
Name = server_shortname
Storage = server_shortname
Pool Type = Backup
Recycle = yes
Recycle Oldest Volume = yes
AutoPrune = no
Volume Retention = 15 days
Maximum Volumes = 16
Volume Use Duration = 23h
Label Format = "${Client}-${JobId}-vol"
}

Client {
Name = server_shortname
Address = server_fqdn
FD Port = 9102
Password = "some-password"
Catalog = MyCatalog
File Retention = 15 days
Job Retention =  15 days
AutoPrune = no
}

Job {
Name = server_shortname
Client = server_shortname
Enabled = yes
Type = Backup
Schedule = WeeklyFullOnFriRunFirst
FileSet = Windows_E_NoCompression_FileSet
Max Full Interval = 6 days
Pool = server_shortname
Messages = Standard
Write Bootstrap = "/var/spool/bacula/server_shortname.bsr"
Priority = 10
Reschedule On Error = yes
Reschedule Interval = 1 hour
Reschedule Times = 3
Cancel Lower Level Duplicates = yes
Allow Duplicate Jobs = no
Spool Attributes = yes
Accurate = yes
}

Thanks for the help!
Craig

On Fri, Mar 31, 2017 at 9:00 AM, Bill Arlofski 
wrote:

> On 03/31/2017 12:49 PM, Craig Shiroma wrote:
> > Hello All,
> >
> > I have a few jobs that are on the below schedule:
> >
> > Schedule {
> >   Name = "WeeklyFullOnFriRunFirst"
> >   Run = Level=Full fri at 17:58
> >   Run = Level=Incremental sat-thu at 18:00
> > }
> >
> > The jobs followed the schedule until last night which was a Thursday.  An
> > incremental was suppose to run, but a Full was run instead.  Would
> anyone know
> > what could cause this to happen?  Previous full backup did run on a
> Friday at
> > 17:58.
> >
> > The log for these jobs show similar text shown below:
> > bacula-dir JobId 413490:
> > bacula-dir JobId 413490: No prior or suitable Full backup found in
> catalog.
> > Doing FULL backup.
> > bacula-dir JobId 413490: Start Backup JobId 413490,
> > Job=servername.2017-03-30_18.00.06_05
> > bacula-dir JobId 413490: Max configured use duration=82,800 sec.
> exceeded.
> > Marking Volume "servername-258519-vol" as Used.
> > bacula-dir JobId 413490: Pruning oldest volume "servername-263826-vol"
> > bacula-dir JobId 413490: There are no more Jobs associated with Volume
> > "servername-263826-vol". Marking it purged.
> > bacula-dir JobId 413490: All records pruned from Volume
> > "servername-263826-vol"; marking it "Purged"
> > bacula-dir JobId 413490: Using Device "servername" to write.
> > bacula-sd JobId 413490: Recycled volume "servername-263826-vol" on file
> device
> > "servername" (/backup01/servername/), all previous data lost.
> >
> > Seems like something is out of sync with the schedule that is causing
> the Full
> > to run on the wrong day.
> >
> > Best regards,
> > Craig
>
> Hi Craig,
>
> I see a couple possibilities here.
>
> The first one might be that there is an issue with your retention period(s)
> for the Full backup.  Probably not the case though.
>
> The second, and I think more probable answer is that the fileset has been
> edited recently, and when that occurs, Bacula automatically upgrades the
> job
> to Full.
>
> Take a look at the job's summary.  If you have a semi-recent version there
> will be a date stamp in the summary next to the fileset.  This date is the
> time the Fileset was last edited.
>
> There is a Fileset setting called "IgnoreFilesetChanges = yes"  which can
> help
> mitigate this second case, but there are some warnings to think about when
> using this option.
>
> Also, I have a feature request that has been accepted in the Enterprise
> version that the reason why a job was upgraded to a Full is listed in the
> logs
> too.   I do not know when this will be ported to the community version
> though.
>
>
> Best regards,
>
> Bill
>
>
> --
> Bill Arlofski
> http://www.revpol.com/bacula
> -- Not responsible for anything below this line --
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Jobs don't remain on schedule

[Craig Shiroma]

Hello All,

I have a few jobs that are on the below schedule:

Schedule {
  Name = "WeeklyFullOnFriRunFirst"
  Run = Level=Full fri at 17:58
  Run = Level=Incremental sat-thu at 18:00
}

The jobs followed the schedule until last night which was a Thursday.  An
incremental was suppose to run, but a Full was run instead.  Would anyone
know what could cause this to happen?  Previous full backup did run on a
Friday at 17:58.

The log for these jobs show similar text shown below:
bacula-dir JobId 413490:
bacula-dir JobId 413490: No prior or suitable Full backup found in catalog.
Doing FULL backup.
bacula-dir JobId 413490: Start Backup JobId 413490,
Job=servername.2017-03-30_18.00.06_05
bacula-dir JobId 413490: Max configured use duration=82,800 sec. exceeded.
Marking Volume "servername-258519-vol" as Used.
bacula-dir JobId 413490: Pruning oldest volume "servername-263826-vol"
bacula-dir JobId 413490: There are no more Jobs associated with Volume
"servername-263826-vol". Marking it purged.
bacula-dir JobId 413490: All records pruned from Volume
"servername-263826-vol"; marking it "Purged"
bacula-dir JobId 413490: Using Device "servername" to write.
bacula-sd JobId 413490: Recycled volume "servername-263826-vol" on file
device "servername" (/backup01/servername/), all previous data lost.

Seems like something is out of sync with the schedule that is causing the
Full to run on the wrong day.

Best regards,
Craig
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] frequent segfaults

[Craig Shiroma]

Hello All,

My apologies for the late reply.  Been super busy with other work.

I haven't been able to run the memory test yet.  However, no segfaults have
occurred since moving the director VM to a different ESXi host.  So, it's
obviously something with the host machine.  The only odd thing is no other
VMs are experiencing problems, but still, moving the VM off seemed to have
fixed the problem.  Thank you all for the help!

If I ever get the chance to run the memory test, I will report back.

Craig

On Sat, Jan 28, 2017 at 4:43 AM, compdoc  wrote:

> On 01/27/2017 10:29 PM, Craig Shiroma wrote:
>
> The VM that bacula-dir is running on is configured exactly the same.
>
>
> In these discussions, I don't think Ive seen you mention checking SMART
> info.
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] frequent segfaults

[Craig Shiroma]

Hi Josh,

>Are the VM's configured exactly the same on both ESXi hosts? A difference
in VCPU, memory limit, etc. in the VM config could potentially reveal the
problem.

The VM that bacula-dir is running on is configured exactly the same.  No
changes were made to it before I vMotioned it to a different esxi host.

Thanks for the help!
-craig


On Fri, Jan 27, 2017 at 3:00 AM, Josh Fisher  wrote:

>
> On 1/27/2017 4:04 AM, Craig Shiroma wrote:
>
> Hi All,
>
> Thank you very much for all the help!
>
> Sorry for the delayed reply.  What I've done so far is move the Director
> VM to a different ESXi host.  So far, no segfaults although I'll give it a
> week before raising the all clear flag.
>
>
> Are the VM's configured exactly the same on both ESXi hosts? A difference
> in VCPU, memory limit, etc. in the VM config could potentially reveal the
> problem.
>
>
> There are normally many VMs on the ESXi host that the Director VM was
> running on that experienced the segfault.  Is it out of the ordinary that
> only Bacula has experienced problems so far?  Other apps on the host have
> not experienced any problems that I know of.  However, like I mentioned so
> far no segfaults since I v-motioned it to a different ESXi host, so it's
> probably something about the machine like many of you suggested.  I'll have
> to check with our VMware folks to see when the host can be put in
> maintenance mode so the memtest can be run.  BTW, as far as I know we did
> not compile from source although I'll have to check with the person who
> setup our Bacula installation to be positive (who now works for different
> company).
>
> I'll post back in a week...earlier if a segfault occurs.
>
> Again, much thanks for the help!
>
> Craig
>
>
> On Wed, Jan 25, 2017 at 5:58 AM, Dimitri Maziuk 
> wrote:
>
>> On 2017-01-25 07:19, Josh Fisher wrote:
>>
>> > If you compiled from source, then check your compiler flags
>>
>> If it ran fine before, that's not impossible, but rather unlikely to be
>> the cause. You'd expect at least a major libc update or something to
>> break it...
>>
>> One thing I forgot to mention is just re-seating the DIMMs *might* fix
>> it. That's the easiest thing to try, plus when you crack it open you
>> might see something. Like a gunked-up cpu fan.
>>
>> Dima
>>
>>
>> 
>> --
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>
>
>
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
>
>
>
> ___
> Bacula-users mailing 
> listBacula-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] frequent segfaults

[Craig Shiroma]

Hi All,

Thank you very much for all the help!

Sorry for the delayed reply.  What I've done so far is move the Director VM
to a different ESXi host.  So far, no segfaults although I'll give it a
week before raising the all clear flag.

There are normally many VMs on the ESXi host that the Director VM was
running on that experienced the segfault.  Is it out of the ordinary that
only Bacula has experienced problems so far?  Other apps on the host have
not experienced any problems that I know of.  However, like I mentioned so
far no segfaults since I v-motioned it to a different ESXi host, so it's
probably something about the machine like many of you suggested.  I'll have
to check with our VMware folks to see when the host can be put in
maintenance mode so the memtest can be run.  BTW, as far as I know we did
not compile from source although I'll have to check with the person who
setup our Bacula installation to be positive (who now works for different
company).

I'll post back in a week...earlier if a segfault occurs.

Again, much thanks for the help!

Craig


On Wed, Jan 25, 2017 at 5:58 AM, Dimitri Maziuk 
wrote:

> On 2017-01-25 07:19, Josh Fisher wrote:
>
> > If you compiled from source, then check your compiler flags
>
> If it ran fine before, that's not impossible, but rather unlikely to be
> the cause. You'd expect at least a major libc update or something to
> break it...
>
> One thing I forgot to mention is just re-seating the DIMMs *might* fix
> it. That's the easiest thing to try, plus when you crack it open you
> might see something. Like a gunked-up cpu fan.
>
> Dima
>
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] frequent segfaults

[Craig Shiroma]

Thanks, Dimitri!

I checked the hardware server logs (not /var/log/messages) and don't see
any memory alerts.

-craig

On Tue, Jan 24, 2017 at 9:09 AM, Dimitri Maziuk 
wrote:

> On 01/24/2017 12:57 PM, Craig Shiroma wrote:
> > This is what appears in /var/log/messages:
> >
> > Jan 23 22:42:39 bup05 bacula-dir: Bacula interrupted by signal 11:
> > Segmentation violation
>
> Try googling for sig11?
>
> You may have a DIMM or some other hardware going bad.
>
> --
> Dimitri Maziuk
> Programmer/sysadmin
> BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu
>
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] frequent segfaults

[Craig Shiroma]

This is what appears in /var/log/messages:

Jan 23 22:42:39 bup05 bacula-dir: Bacula interrupted by signal 11:
Segmentation violation


On Tue, Jan 24, 2017 at 8:44 AM, Craig Shiroma 
wrote:

> Hello All,
>
> Within the last 3-4 weeks, our Bacula 7.0.5 on RHEL 6 has experienced
> bacula-dir segfaults once or twice a week.  Before that everything ran fine.
>
> Memory and CPU look fine on our Director server.  Nothing has changed on
> the server before the segfaults started happening as far as I can remember
> other than possibly a few more jobs being added.
>
> What is the best way to troubleshoot the cause of these segfaults?
>
> Best regards,
> Craig
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] frequent segfaults

[Craig Shiroma]

Hello All,

Within the last 3-4 weeks, our Bacula 7.0.5 on RHEL 6 has experienced
bacula-dir segfaults once or twice a week.  Before that everything ran fine.

Memory and CPU look fine on our Director server.  Nothing has changed on
the server before the segfaults started happening as far as I can remember
other than possibly a few more jobs being added.

What is the best way to troubleshoot the cause of these segfaults?

Best regards,
Craig
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] 1 second Network glitch kills Windows backups

[Craig Shiroma]

Thank you Wanderlei, Josh and Kern!  Judging from Kern's and Josh's
replies, the solution is to try and find a fix on Windows and the possibly
the switches.  I guess it's best just to live with the canceled jobs and
re-run them.  I'd rather have good backups than incomplete ones since as
Kern indicated if the connection drops Bacula has no idea what reached and
did not reached the other side.

The reason for the drops appears to be related to our firewall.  For some
reason, the secure tunnel goes down around the same time every day for a
second or two.

On Fri, Jul 1, 2016 at 10:30 AM, Kern Sibbald  wrote:

> Hello,
>
> In general, the TCP/IP protocol that Bacula uses is extremely tolerant,
> and should retry sending packets quite a number of times before finally
> giving up.  It is designed to tolerate a significant number of dropped
> packets.  However, then there are two things that enter to screw this
> up: 1. network switches which do not follow internet rules at all (i.e.
> they are very fast to drop idle connections, even if you have explicitly
> set the network to survive idle periods as Bacula does); 2. Windows
> which does not seem to follow quite a few Internet rules.  The two put
> together mean that especially with on Windows machines, network
> disruptions are annoyingly frequent.
>
> Bacula was designed with the concept that the Internet never loses
> packets and that it is highly tolerant -- given the above two problems,
> maybe this was a bad choice.  However, the result of that decision is
> that if the line drops, Bacula has no idea what reached and what did not
> reach the other side, and so it is not currently possible for it to
> reconnect and resume where it left off.
>
> Best regards,
> Kern
>
> On 07/01/2016 03:43 PM, Josh Fisher wrote:
> > On 7/1/2016 1:26 AM, Craig Shiroma wrote:
> >> Hello All,
> >>
> >> Is there a way in Bacula to prevent something like a 1 or 2 second
> >> network glitch from cancelling Window Server backups? RHEL backups
> >> seem to survive these episodes with no problems.
> >>
> > Bacula expects DIR-to-FD and FD-to-SD TCP connections to persist for the
> > duration of a job. If either is dropped it will cause the job to cancel.
> > As a result, Bacula is not very tolerant of network problems. Since it
> > appears to be the Windows Server machines dropping the connection due to
> > the glitch, if there is a solution it will be in the Windows networking
> > config, possibly in the NIC's driver settings. Perhaps RHEL is more
> > tolerant of the glitch or perhaps it is a hardware difference in the
> > NICs. Nevertheless, in general such network glitches cause problems for
> > Bacula regardless of OS.
> >
> >
> >
> >> Respectfully,
> >> Craig
> >>
> >
> >
> --
> > Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
> > Francisco, CA to explore cutting-edge tech and listen to tech luminaries
> > present their vision of the future. This family event has something for
> > everyone, including kids. Get more information and register today.
> > http://sdm.link/attshape
> > ___
> > Bacula-users mailing list
> > Bacula-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
> >
>
>
>
> --
> Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
> Francisco, CA to explore cutting-edge tech and listen to tech luminaries
> present their vision of the future. This family event has something for
> everyone, including kids. Get more information and register today.
> http://sdm.link/attshape
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
Francisco, CA to explore cutting-edge tech and listen to tech luminaries
present their vision of the future. This family event has something for
everyone, including kids. Get more information and register today.
http://sdm.link/attshape___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] 1 second Network glitch kills Windows backups

[Craig Shiroma]

Hello All,

Is there a way in Bacula to prevent something like a 1 or 2 second network
glitch from cancelling Window Server backups?  RHEL backups seem to survive
these episodes with no problems.

Respectfully,
Craig
--
Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
Francisco, CA to explore cutting-edge tech and listen to tech luminaries
present their vision of the future. This family event has something for
everyone, including kids. Get more information and register today.
http://sdm.link/attshape___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula 7.0.5 and RHEL 7

[Craig Shiroma]

Thank you, Thing and Patti!  That is good to know.

I appreciate the help.

-craig

On Wed, Apr 20, 2016 at 2:38 AM, Clark, Patti  wrote:

> No, there are no issues backing up RHEL 7 clients with RHEL 6 server as
> long as the bacula client software version is at the same version level or
> older.  This is true for any bacula client regardless of their OS.
>
> *Patti*
>
>
>
> From: Craig Shiroma 
> Date: Tuesday, April 19, 2016 at 4:34 PM
> To: Bacula Users 
> Subject: [Bacula-users] Bacula 7.0.5 and RHEL 7
>
> Hello,
>
> I have a few RHEL 7 servers slated to be backed up soon.  Will Bacula
> 7.0.5 (on RHEL 6) have any problems backing up these servers?  Anything
> special I need to do or be aware of?
>
> Best regards,
> Craig
>
--
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Bacula 7.0.5 and RHEL 7

[Craig Shiroma]

Hello,

I have a few RHEL 7 servers slated to be backed up soon.  Will Bacula 7.0.5
(on RHEL 6) have any problems backing up these servers?  Anything special I
need to do or be aware of?

Best regards,
Craig
--
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Windows Restore

[Craig Shiroma]

Hi All,

The solution is probably obvious to many of you, so I apologize in advance
for this question.  However, I am having the hardest time trying to restore
files from a Windows server to another Windows server without the files
being hidden.  Say I have this scenario:

I want to restore this file on Windows server A:
E:/test/a.txt

To Windows server B at this location:
F:/Restore

In the above case, when the file gets restored the E folder is always
hidden.  Here are the things I've tried:
- creating the F:/Restore folder on server B before doing the restore - no
luck
- creating the F:/Restore/E folder on server B before doing the restore -
no luck
- not creating F:/Restore folder on server B before doing the restore - no
luck
- reset Where from /tmp to F:/Restore - no luck
- used File Relocation - no luck
 - strip E:/
 - add F:/Restore/

How can I restore without getting objects hidden?  I've been using "attrib
-s -h " to unhide it, but I shouldn't have to do this.  What am I
doing wrong?  In all of the above cases, the encompassing folder (either E
or Restore) is hidden and I have to unhide it to see the file.

If I use / for Where, the file gets restored and is visible.  But, I cannot
do this all the time.  Often I have to restore to a different folder on
 either the same drive or a different drive.

Thanks in advance.

Craig
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] JobBytes

[Craig Shiroma]

Hello,

Is the value of JobBytes the number of compressed or un-compressed bytes
backed up?  Also, what is ReadBytes?  I can't seem to find a reference in
the manual.  If it's there, could someone point me to the page in the 7.0.5
pdf manual.

Warmest regards,
-craig
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] stat problems

[Craig Shiroma]

Sorry, this is totally confusing.
Are the paths suppose to be convert defined configuration paths that use
"/" to "\" when outputting to the log?

Should be:
Are the paths using unix style "/" in the configs suppose to be converted
to "\" when outputting to the log?


On Fri, Nov 20, 2015 at 3:39 PM, Craig Shiroma 
wrote:

> Hi Bryn,
>
> Thank you for the help!
>
> I apologize, but I'm not sure what you mean.  Are the paths suppose to be
> convert defined configuration paths that use "/" to "\" when outputting to
> the log?
>
> If you mean I have defined my paths incorrectly in the configs, see
> below.  If not, could you explain...my apologies.
> My impression is I'm suppose to use unix style notation even for Windows.
> The below text is from the manual in the Fileset Resource section.
> Although it's from the Exclude directive section, I assumed I'm suppose to
> use unix style separators when defining paths in Bacula.  Please correct me
> if I'm wrong.
>
> "Windows users, please take note to specify directories (even c:/...) in
> Unix path notation. If you use Windows conventions, you will most likely
> not be able to restore your files due to the fact that the Windows path
> separator was defined as an escape character long before Windows existed,
> and Bacula adheres to that convention (i.e.means the next character
> appears as itself).
>
> You should always specify a full path for every directory and file that
> you list in the FileSet. In addition, on Windows machines, you should always
> prefix the directory or filename with the drive specification (e.g. c:/xxx)
> using Unix directory name separators (forward slash). The drive letter
> itself can be upper or lower case (e.g. c:/xxx or C:/xxx)."
>
> Please note that this is the first time I've noticed this happening.  This
> host has been backing up okay.  I just can't figure out why Bacula couldn't
> find the paths (i.e. drives) for one run and then could find them in
> another re-run 5 minutes later.  Nothing was done to the client host.
>
> Best regards,
>
> -craig
>
>
>
>
> On Fri, Nov 20, 2015 at 6:28 AM, Bryn Hughes  wrote:
>
>> Is it just me or are all your slashes backwards for Windows?  Shouldn't
>> it be C:\ not C:/ ?
>>
>> Bryn
>>
>> On 2015-11-19 10:25 AM, Craig Shiroma wrote:
>> > Hello,
>> >
>> > I came across a problem with a Windows 2012R2 server that generated
>> > the below error messages in the log.  The full backed up only a few
>> > megabytes when it should've backed up 10G obviously because of the
>> > below problems.  However, I ran another full right after noticing the
>> > problem without doing anything to the server and it completed with no
>> > problem.  Has any experience this?  Know the cause?
>> >
>> > My concern is the backup ended with a "Backup OK with warnings"
>> > (status = T), so I never got an email indicating a problem.
>> >
>> > Regards,
>> > -craig
>> >
>> > 17-Nov 14:44  JobId 208:  Could not stat
>> > "C:/Documents and Settings": ERR=The system cannot find the file
>> > specified.
>> > 17-Nov 14:44  JobId 208:  Could not stat
>> > "C:/inetpub": ERR=The system cannot find the file specified.
>> > 17-Nov 14:44  JobId 208:  Could not stat
>> > "C:/PerfLogs": ERR=The system cannot find the file specified.
>> > 17-Nov 14:44  JobId 208:  Could not stat "C:/Perl64":
>> > ERR=The system cannot find the file specified.
>> > 17-Nov 14:44  JobId 208:  Could not stat "C:/Program
>> > Files": ERR=The system cannot find the file specified.
>> > 17-Nov 14:44  JobId 208:  Could not stat "C:/Program
>> > Files (x86)": ERR=The system cannot find the file specified.
>> > 17-Nov 14:44  JobId 208:  Could not stat
>> > "C:/ProgramData": ERR=The system cannot find the file specified.
>> > 17-Nov 14:44  JobId 208:  Could not stat
>> > "C:/Python32": ERR=The system cannot find the file specified.
>> > 17-Nov 14:44  JobId 208:  Could not stat "C:/Users":
>> > ERR=The system cannot find the file specified.
>> > 17-Nov 14:44  JobId 208:  Could not stat
>> > "C:/Windows": ERR=The system cannot find the file specified.
>> > 17-Nov 14:44  JobId 2

Re: [Bacula-users] stat problems

[Craig Shiroma]

Hi Bryn,

Thank you for the help!

I apologize, but I'm not sure what you mean.  Are the paths suppose to be
convert defined configuration paths that use "/" to "\" when outputting to
the log?

If you mean I have defined my paths incorrectly in the configs, see below.
If not, could you explain...my apologies.
My impression is I'm suppose to use unix style notation even for Windows.
The below text is from the manual in the Fileset Resource section.
Although it's from the Exclude directive section, I assumed I'm suppose to
use unix style separators when defining paths in Bacula.  Please correct me
if I'm wrong.

"Windows users, please take note to specify directories (even c:/...) in
Unix path notation. If you use Windows conventions, you will most likely
not be able to restore your files due to the fact that the Windows path
separator was defined as an escape character long before Windows existed,
and Bacula adheres to that convention (i.e.means the next character appears
as itself).

You should always specify a full path for every directory and file that you
list in the FileSet. In addition, on Windows machines, you should always prefix
the directory or filename with the drive specification (e.g. c:/xxx) using
Unix directory name separators (forward slash). The drive letter itself can
be upper or lower case (e.g. c:/xxx or C:/xxx)."

Please note that this is the first time I've noticed this happening.  This
host has been backing up okay.  I just can't figure out why Bacula couldn't
find the paths (i.e. drives) for one run and then could find them in
another re-run 5 minutes later.  Nothing was done to the client host.

Best regards,

-craig




On Fri, Nov 20, 2015 at 6:28 AM, Bryn Hughes  wrote:

> Is it just me or are all your slashes backwards for Windows?  Shouldn't
> it be C:\ not C:/ ?
>
> Bryn
>
> On 2015-11-19 10:25 AM, Craig Shiroma wrote:
> > Hello,
> >
> > I came across a problem with a Windows 2012R2 server that generated
> > the below error messages in the log.  The full backed up only a few
> > megabytes when it should've backed up 10G obviously because of the
> > below problems.  However, I ran another full right after noticing the
> > problem without doing anything to the server and it completed with no
> > problem.  Has any experience this?  Know the cause?
> >
> > My concern is the backup ended with a "Backup OK with warnings"
> > (status = T), so I never got an email indicating a problem.
> >
> > Regards,
> > -craig
> >
> > 17-Nov 14:44  JobId 208:  Could not stat
> > "C:/Documents and Settings": ERR=The system cannot find the file
> > specified.
> > 17-Nov 14:44  JobId 208:  Could not stat
> > "C:/inetpub": ERR=The system cannot find the file specified.
> > 17-Nov 14:44  JobId 208:  Could not stat
> > "C:/PerfLogs": ERR=The system cannot find the file specified.
> > 17-Nov 14:44  JobId 208:  Could not stat "C:/Perl64":
> > ERR=The system cannot find the file specified.
> > 17-Nov 14:44  JobId 208:  Could not stat "C:/Program
> > Files": ERR=The system cannot find the file specified.
> > 17-Nov 14:44  JobId 208:  Could not stat "C:/Program
> > Files (x86)": ERR=The system cannot find the file specified.
> > 17-Nov 14:44  JobId 208:  Could not stat
> > "C:/ProgramData": ERR=The system cannot find the file specified.
> > 17-Nov 14:44  JobId 208:  Could not stat
> > "C:/Python32": ERR=The system cannot find the file specified.
> > 17-Nov 14:44  JobId 208:  Could not stat "C:/Users":
> > ERR=The system cannot find the file specified.
> > 17-Nov 14:44  JobId 208:  Could not stat
> > "C:/Windows": ERR=The system cannot find the file specified.
> > 17-Nov 14:44  JobId 208: Error: findlib/attribs.c:923
> > Error in GetFileAttributesExW: file
> > \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\: ERR=The system
> > cannot find the file specified.
> > 17-Nov 14:44  JobId 208:  Cannot open "C:/": ERR=The
> > system cannot find the file specified.
> > .
> > 17-Nov 14:44  JobId 208:  Could not stat "E:/":
> > ERR=The system cannot find the path specified.
> > 17-Nov 14:44  JobId 208:  Could not stat "F:/":
> > ERR=The system cannot find the path specified.
> > 17-Nov 14:44  JobId 208:  Could not stat "G:/":
> > ERR=The system cannot find the path specified.
> > 17-Nov 14:44  JobId 208:  Could not stat "H:/":
> > ERR=The system cannot find the path specified.
> >
> >
>
>
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] stat problems

[Craig Shiroma]

Hello,

I came across a problem with a Windows 2012R2 server that generated the
below error messages in the log.  The full backed up only a few megabytes
when it should've backed up 10G obviously because of the below problems.
However, I ran another full right after noticing the problem without doing
anything to the server and it completed with no problem.  Has any
experience this?  Know the cause?

My concern is the backup ended with a "Backup OK with warnings" (status =
T), so I never got an email indicating a problem.

Regards,
-craig

17-Nov 14:44  JobId 208:  Could not stat "C:/Documents and
Settings": ERR=The system cannot find the file specified.
17-Nov 14:44  JobId 208:  Could not stat "C:/inetpub":
ERR=The system cannot find the file specified.
17-Nov 14:44  JobId 208:  Could not stat "C:/PerfLogs":
ERR=The system cannot find the file specified.
17-Nov 14:44  JobId 208:  Could not stat "C:/Perl64":
ERR=The system cannot find the file specified.
17-Nov 14:44  JobId 208:  Could not stat "C:/Program
Files": ERR=The system cannot find the file specified.
17-Nov 14:44  JobId 208:  Could not stat "C:/Program Files
(x86)": ERR=The system cannot find the file specified.
17-Nov 14:44  JobId 208:  Could not stat "C:/ProgramData":
ERR=The system cannot find the file specified.
17-Nov 14:44  JobId 208:  Could not stat "C:/Python32":
ERR=The system cannot find the file specified.
17-Nov 14:44  JobId 208:  Could not stat "C:/Users":
ERR=The system cannot find the file specified.
17-Nov 14:44  JobId 208:  Could not stat "C:/Windows":
ERR=The system cannot find the file specified.
17-Nov 14:44  JobId 208: Error: findlib/attribs.c:923 Error in
GetFileAttributesExW: file
\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\: ERR=The system cannot
find the file specified.
17-Nov 14:44  JobId 208:  Cannot open "C:/": ERR=The
system cannot find the file specified.
.
17-Nov 14:44  JobId 208:  Could not stat "E:/": ERR=The
system cannot find the path specified.
17-Nov 14:44  JobId 208:  Could not stat "F:/": ERR=The
system cannot find the path specified.
17-Nov 14:44  JobId 208:  Could not stat "G:/": ERR=The
system cannot find the path specified.
17-Nov 14:44  JobId 208:  Could not stat "H:/": ERR=The
system cannot find the path specified.
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Change order of when a backup is run

[Craig Shiroma]

Hi Heitor,

>Other way to prioritize jobs without creating a critical path between them
is reorganizing their order like they appear in the bacula-dir.conf, I
think even if they are in included split files.

I'll try the above.

Thanks!
-craig

On Fri, Nov 6, 2015 at 1:17 PM, Heitor Faria  wrote:

> >
> > I like that this thread appeared.  It is something I have been thinking
> about
> > for a week or two.
> >
> > I have three categories of jobs:
> >
> > - backups
> > - catalog backup
> > - initiate copy jobs
> >
> > Those groups need to run in that order and concurrent backup jobs are
> allowed.
> > This is achieved by
> > setting a different priority on each of those groups.
> >
> > However, within the backups, I would prefer the longer running jobs to
> start
> > first.  This is to
> > minimize the total elapsed time.
> >
> > "Allow Mixed Priority" is not an option for me because backing up the
> catalog
> > cannot start
> > until everything is backed up.
> >
> > An interesting point about:  "Allow Mixed Priority" - "The scheduler
> will only
> > mix priorities when all running jobs have this set to true"
> >
> > This is what most jobs use now:
> >
> > Schedule {
> >  Name = "WeeklyCycle"
> >  Run = Level=Full 1st sun at 03:05
> >  Run = Level=Differential 2nd-5th sun at 03:05
> >  Run = Level=Incremental  mon-sat at 03:05
> > }
> >
> > If I wanted my longer running jobs to start first, I could add this and
> alter
> > the jobs accordingly:
> >
> > Schedule {
> >  Name = "WeeklyCycleFirst"
> >  Run = Level=Full 1st sun at 03:04
> >  Run = Level=Differential 2nd-5th sun at 03:04
> >  Run = Level=Incremental  mon-sat at 03:04
> > }
> >
> > Am I correct here? all jobs scheduled for 3:04 will be started before
> any jobs
> > scheduled for 3:05
>
> Hello Dan, nice to see you.
> Yes, 3:04 jobs will all start before any 3:05 jobs regardless of their
> priority.
> It seems AllowMixedPriority only works when higher priority jobs are
> submitted after lower jobs are already running, and never the opposite. At
> least it's what I understand from (Kern's ?) comment in the the source code:
> "bool allow_mixed_priority; /* Allow jobs with higher priority
> concurrently with this */"
> Other way to prioritize jobs without creating a critical path between them
> is reorganizing their order like they appear in the bacula-dir.conf, I
> think even if they are in included split files.
>
> > —
> > Dan Langille
> > http://langille.org/
>
> Best Regards,
> ===
> Heitor Medrado de Faria - LPIC-III | ITIL-F |  Bacula Systems Certified
> Administrator II
> Do you need Bacula training? http://bacula.us/video-classes/
> I do Bacula training and deploy in any city of the world. More
> information: http://bacula.us/
> +55 61 8268-4220
> Site: http://bacula.us FB: heitor.faria
> ===
> >
> >
> >
> >
> >
> >
> >
> --
> > ___
> > Bacula-users mailing list
> > Bacula-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Change order of when a backup is run

[Craig Shiroma]

I am only using one schedule and tried setting "Allow Mixed Priority = yes"
in all my jobs, but could not get things to work.  At the start time for
the schedule, all jobs would get queued.  However, the priority 10 and 11
jobs would wait until the priority 9 job finished before beginning to
backup, and then the priority 11 jobs would wait until the priority 10 jobs
finished before backing up.  I did restart bacula directory after making
the setting.

-craig

On Fri, Nov 6, 2015 at 12:52 PM, Dan Langille  wrote:

>
> On Nov 6, 2015, at 5:12 PM, Bill Shirley  > wrote:
>
> With the time wise assumption that Full > Differential > Increment and me
> wanting to get the
> shorter jobs out of the way, I use:
> Schedule {
> Name = "MonthlySundayFull1"
> Run = Full  1st sun at 5:05
> Run = Differential  2nd-5th sun at 4:05
> Run = Incremental   mon-sat at 3:05
> }
>
>
> I don't see how this helps.  Full/Diff/Inc run on different days.
>
> Why not run them all at 3:05?
>
> —
> Dan Langille
> http://langille.org/
>
>
>
>
>
>
>
> --
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Change order of when a backup is run

[Craig Shiroma]

Thank you, Phil and Dimitri!

I think Bill's suggestion about AllowMixedPriority will work for me.

Dimitri, I run a lot of backups with the same schedule of which I cannot
change at the moment.  In the beginning it worked out okay, but some long
jobs were added on, and since the jobs run alphabetically I'm faced with
the problem of the long jobs starting late because of their name.  I am
spooling and running 15 jobs concurrently with Accurate turned On on my
backups.

Again, thank you for the help!
-craig

On Thu, Oct 29, 2015 at 4:38 AM, Dimitri Maziuk 
wrote:

> On 2015-10-28 18:23, Craig Shiroma wrote:
> > Hello,
> >
> > Currently, all my backups start at a certain time of the day.  The order
> > in which Bacula runs them appears to be alphabetically.  I have some
> > long running backups.  I was wondering if there is a way to start these
> > jobs first instead of wait until it's their turn alphabetically without
> > having to put them on a different schedule?
>
> What are you trying to achieve? If you spool them and allow concurrent
> jobs, you may be able to get the short-running ones done while
> long-running ones are running.
>
> Dima
>
>
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Change order of when a backup is run

[Craig Shiroma]

Thank you, Wanderlei and Bill !  I appreciate the help.

I thought about changing the job priority.  However, Bill as you mentioned,
I read the caveat in the manual about the lower priority jobs having to
wait until the higher priority ones finish.  This won't work for my
situation because some of these jobs run for 12 hours.  At the moment,
changing the job schedule is difficult because of the way we are set up.
But, I guess I'm going to have to figure out way around this.

Thanks again!
-craig

On Wed, Oct 28, 2015 at 4:28 PM, Bill Arlofski 
wrote:

> On 10/28/2015 07:23 PM, Craig Shiroma wrote:
> > Hello,
> >
> > Currently, all my backups start at a certain time of the day.  The order
> in
> > which Bacula runs them appears to be alphabetically.  I have some long
> running
> > backups.  I was wondering if there is a way to start these jobs first
> instead
> > of wait until it's their turn alphabetically without having to put them
> on a
> > different schedule?
> >
> > Best regards,
> > Craig
>
> Hi Craig,
>
> You can set the priority of the jobs to a lower number, making them a
> higher
> priority (default Priority is 10). If they are using the same schedule and
> start at the same time as the other jobs, the jobs with a higher priority
> will
> run first.
>
> But, the caveat is that all other jobs of a lower priority (or different
> priority even) will wait until these jobs with a higher priority finish.
>
> Take a look at the "Priority" and the "AllowMixedPriority" Job options to
> see
> why you may (or may not) want to use priorities in your jobs.
>
> Another option is to create different schedules and assign the jobs you
> want
> to start first to a schedule that runs earlier.
>
> Hope this helps.
>
> Bill
>
>
> --
> Bill Arlofski
> http://www.revpol.com/bacula
> -- Not responsible for anything below this line --
>
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Change order of when a backup is run

[Craig Shiroma]

Hello,

Currently, all my backups start at a certain time of the day.  The order in
which Bacula runs them appears to be alphabetically.  I have some long
running backups.  I was wondering if there is a way to start these jobs
first instead of wait until it's their turn alphabetically without having
to put them on a different schedule?

Best regards,
Craig
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] innodb_autoinc_lock_mode

[Craig Shiroma]

Thank you, Phil !  I appreciate you taking the time to reply and for the
information.  That is good news!

-craig

On Fri, Oct 23, 2015 at 12:09 PM, Phil Stracchino 
wrote:

> On 10/23/15 14:47, Craig Shiroma wrote:
> > Hello,
> >
> > We are experiencing database performance problems with locks occurring.
> > We think it is because jobs that require a huge amount of inserts is
> > holding on to innodb_autoinc.  We are thinking of changing the following
> > to see if it helps.
> >
> > innodb_autoinc_lock_mode = 1
> >
> > to:
> >
> > innodb_autoinc_lock_mode = 2
> >
> > I think the change causes a problem with database replication.  However,
> > we currently are not doing DB replication so we don't think that will be
> > a problem.  Does anyone know if this change will cause other problems?
>
> In my professional capacity, I recommend this tuning change to all of
> our customers by default.  It can make a big difference.
>
> There is basically one caveat:  If you use innodb_autoinc_lock_mode = 2
> in a replicated environment, you MUST set binlog_format to either ROW or
> MIXED, because it is unsafe in STATEMENT mode.  (If set to MIXED, MySQL
> will know that it is an unsafe operation and automatically record it as
> ROW.)  Provided that is done, this is 100% safe unless you are using an
> application which can insert multiple rows in a single transaction and
> expects them to have strictly consecutive auto-increment IDs, but does
> not actually check that they do.  (In which case, the application
> developer is doing it wrong.)
>
>
> --
>   Phil Stracchino
>   Babylon Communications
>   ph...@caerllewys.net
>   p...@co.ordinate.org
>   Landline: 603.293.8485
>
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] innodb_autoinc_lock_mode

[Craig Shiroma]

Hello,

We are experiencing database performance problems with locks occurring.  We
think it is because jobs that require a huge amount of inserts is holding
on to innodb_autoinc.  We are thinking of changing the following to see if
it helps.

innodb_autoinc_lock_mode = 1

to:

innodb_autoinc_lock_mode = 2

I think the change causes a problem with database replication.  However, we
currently are not doing DB replication so we don't think that will be a
problem.  Does anyone know if this change will cause other problems?

Thanks,
-craig
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Capabilities of Bacula 7.0.5

[Craig Shiroma]

Thank you Kern and others!  I appreciate the information which will be
useful in our decision on which way to go (stay with open source or sign-up
for BE).

-craig

On Mon, Oct 19, 2015 at 4:12 AM, Kern Sibbald  wrote:

> On 10/19/2015 05:15 AM, Compdoc wrote:
>
> >Well, did you try to find prices at IBM webpage for its products?
>
> I used to work for IBM. I know i cant afford them. Now I service computers
> for small and medium size businesses, and I look for alternatives to yearly
> support subscriptions because in the end, I find the answers to their
> problems. It's been many years since I've needed paid support. Many years.
>
> Really, who doesn't want clear, concise pricing while avoiding salesmen
> who can set prices based on what they think you can afford to pay? And who
> doesn't want anonymity? I spend a lot money with Amazon because i can see
> their prices and there's no waiting...
>
> Anyway, everyone wants to see bacula do well, including me, but adopting
> the business models of huge corporations seems like the antithesis of open
> source, and possibly marks the end of a great open source project. It's
> sad, is all.
>
>
> Your point of view seems to me to be a bit too pessimistic.  Bacula
> Systems is a company that (for the moment) is competing with big companies
> in the enterprise market such as EMC, Symantec, IBM, HP, and ...  Bacula
> Systems is doing quite well in that market and has been consistently
> growing at about 65% in revenues each year since its creation, consequently
> the future of Bacula Systems looks quite bright. The rather standard way of
> dealing with pricing seems to be more an advantage rather than a hindrance
> at least in the Enterprise market.
>
> Then to extrapolate a positive Bacula Systems corporate financial future
> to the "end of a great open source project" is a pretty big leap that does
> not appear to me to be reasonable.  In addition, as long a Bacula Systems
> continues to create new code for the Bacula Enterprise version, the
> community version will continue to grow and evolve with the migration of
> Enterprise code to the community.  Even without Bacula Systems, though it
> would be harder, Bacula community can do quite well.
>
> Best regards,
> Kern
>
> --
> Sent from my Android device with K-9 Mail. Please excuse my brevity.
>
> --
>
>
>
> ___
> Bacula-users mailing 
> listBacula-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
>
>
> --
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Capabilities of Bacula 7.0.5

[Craig Shiroma]

Thank you, Heitor!  I really appreciate the info.

-craig

On Sun, Oct 18, 2015 at 5:26 AM, Heitor Faria  wrote:

> Thank you, Heitor!  The information is much appreciated.
> Re:
>
> - Bare Metal Restores - however, I'm not sure if this is still in
> development
>
> I had no news from BMR in Bacula community version for such a long time,
> probably because virtualization is increasingly popular and it's much
> easier to backup a full VM for disaster recovery purposes. I know BE has a
> improved and easier version of BMR for Windows and Linux however.
>
> Does this mean that Bacula Enterprise can backup a VM, meaning the actual
> vmdks that make it up (all filesystems) and restore the VM?
>
> If you buy the specific VM backup plugin yes. Including block level
> incremental backups of the VM.
> However for file level restores it is still advisable to install Bacula
> Clients in each one of the VM (threat them as physical machines).
>
> Or, do you mean it can backup all the data on the VM and to restore the
> host if it was destroyed, the VM has to be re-created and then BE restores
> the data?  If the former, that would be great!
>
> The plugin can recreate the machines automatically when restoring.
>
> Thanks again!
>
> You are welcome.
>
> -craig
>
> ===
> Heitor Medrado de Faria - LPIC-III | ITIL-F |  Bacula Systems Certified
> Administrator II
> Do you need Bacula training?
> https://www.udemy.com/bacula-backup-software/?couponCode=bacula-list
> I do Bacula training and deploy in any city of the world. More
> information: http://bacula.us/
> +55 61 <%2B55%2061%202021-8260>8268-4220 <%2B55%2061%208268-4220>
> Site: http://bacula.us FB: heitor.faria
> 
> ===
>
>
>
>
> On Sat, Oct 17, 2015 at 8:56 AM, Heitor Faria 
> wrote:
>
>> Hello,
>> Looking over the manual, it appears open source Bacula 7.0.5 can do the
>> following. However,  I'd like to confirm via this list if possible just to
>> make sure I didn't misunderstand something.  Also, are they easy to setup
>> and is performance good?
>>
>> What is your easy definition? =)
>> I recorded some video classes that may help you if you go with the
>> community version: http://bacula.us/video-classes/
>>
>> - Synthetic Backups which I assume is Virtual Backups in Bacula
>>
>> Yes. But on BE it is a improved feature:
>> http://www.baculasystems.com/products/bacula-enterprise/features/progressive-virtual-full
>>
>> - Encryption at rest and in transit
>>
>> I think they are the same in both versions and it takes some time and
>> understanding, configuring and generating the keys. I think it's slightly
>> easier with Enterprise BE Bweb interface.
>>
>> - Bare Metal Restores - however, I'm not sure if this is still in
>> development
>>
>> I had no news from BMR in Bacula community version for such a long time,
>> probably because virtualization is increasingly popular and it's much
>> easier to backup a full VM for disaster recovery purposes. I know BE has a
>> improved and easier version of BMR for Windows and Linux however.
>>
>> - Deduplication
>>
>> BE global deduplication goes further than the Community one because of
>> block level instead of file level dedup, good for large files that always
>> changes [E.g.: database dumps, VM images etc. -
>> http://www.baculasystems.com/wp-content/uploads/bacula-enterprise-v8-global-endpoint-deduplication4.pdf].
>> I think it is also possible to replicate Bacula storage data and only sync
>> modified blocks.
>>
>> Last, is setup of the above easier and performance more robust in Bacula
>> Enterprise?
>>
>> They are basically different features. It always depend of the size of
>> your data center, business needs, service and operational agreements.
>> Probably a BE consultant can help you better at your decision.
>>
>> Best regards,
>> -craig
>>
>> Regards,
>>
>> ===
>> Heitor Medrado de Faria - LPIC-III | ITIL-F |  Bacula Systems Certified
>> Administrator II
>> Do you need Bacula training?
>> https://www.udemy.com/bacula-backup-software/?couponCode=bacula-list
>> I do Bacula training and deploy in any city of the world. More
>> information: http://bacula.us/
>> +55 61 <%2B55%2061%202021-8260>8268-4220 <%2B55%2061%208268-4220>
>> Site: http://bacula.us FB: heitor.faria
>> 
>>
>> ===
>>
>>
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Capabilities of Bacula 7.0.5

[Craig Shiroma]

Thank you, Guido!  Much appreciated.  Good information to know.

-craig

On Sat, Oct 17, 2015 at 9:52 PM, Guido Falsi  wrote:

> On 10/18/15 07:31, Craig Shiroma wrote:
> > Thank you, Heitor!  The information is much appreciated.
> >
> > Re:
> >
> > - Bare Metal Restores - however, I'm not sure if this is still in
> > development
> >
> > I had no news from BMR in Bacula community version for such a long time,
> > probably because virtualization is increasingly popular and it's much
> > easier to backup a full VM for disaster recovery purposes. I know BE has
> > a improved and easier version of BMR for Windows and Linux however.
> >
> > Does this mean that Bacula Enterprise can backup a VM, meaning the
> > actual vmdks that make it up (all filesystems) and restore the VM?  Or,
> > do you mean it can backup all the data on the VM and to restore the host
> > if it was destroyed, the VM has to be re-created and then BE restores
> > the data?  If the former, that would be great!
>
> At previous work I was able to backup vmware VMs snapshots and could
> just restore the files and connect those to newly created VMs.
>
> I was using this to copy snapshots to an NFS volume:
>
> https://github.com/lamw/ghettoVCB
>
> After getting the snapshots to NFS I just made bacula backup that to the
> tape library. Backups done in this way tend to be big, and no
> incremental strategy applies, since they always are new files.
>
> Similar strategies can be applied to other visualization technologies.
>
> --
> Guido Falsi 
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Capabilities of Bacula 7.0.5

[Craig Shiroma]

Thank you, Heitor!  The information is much appreciated.

Re:

- Bare Metal Restores - however, I'm not sure if this is still in
development

I had no news from BMR in Bacula community version for such a long time,
probably because virtualization is increasingly popular and it's much
easier to backup a full VM for disaster recovery purposes. I know BE has a
improved and easier version of BMR for Windows and Linux however.

Does this mean that Bacula Enterprise can backup a VM, meaning the actual
vmdks that make it up (all filesystems) and restore the VM?  Or, do you
mean it can backup all the data on the VM and to restore the host if it was
destroyed, the VM has to be re-created and then BE restores the data?  If
the former, that would be great!

Thanks again!
-craig



On Sat, Oct 17, 2015 at 8:56 AM, Heitor Faria  wrote:

> Hello,
> Looking over the manual, it appears open source Bacula 7.0.5 can do the
> following. However,  I'd like to confirm via this list if possible just to
> make sure I didn't misunderstand something.  Also, are they easy to setup
> and is performance good?
>
> What is your easy definition? =)
> I recorded some video classes that may help you if you go with the
> community version: http://bacula.us/video-classes/
>
> - Synthetic Backups which I assume is Virtual Backups in Bacula
>
> Yes. But on BE it is a improved feature:
> http://www.baculasystems.com/products/bacula-enterprise/features/progressive-virtual-full
>
> - Encryption at rest and in transit
>
> I think they are the same in both versions and it takes some time and
> understanding, configuring and generating the keys. I think it's slightly
> easier with Enterprise BE Bweb interface.
>
> - Bare Metal Restores - however, I'm not sure if this is still in
> development
>
> I had no news from BMR in Bacula community version for such a long time,
> probably because virtualization is increasingly popular and it's much
> easier to backup a full VM for disaster recovery purposes. I know BE has a
> improved and easier version of BMR for Windows and Linux however.
>
> - Deduplication
>
> BE global deduplication goes further than the Community one because of
> block level instead of file level dedup, good for large files that always
> changes [E.g.: database dumps, VM images etc. -
> http://www.baculasystems.com/wp-content/uploads/bacula-enterprise-v8-global-endpoint-deduplication4.pdf].
> I think it is also possible to replicate Bacula storage data and only sync
> modified blocks.
>
> Last, is setup of the above easier and performance more robust in Bacula
> Enterprise?
>
> They are basically different features. It always depend of the size of
> your data center, business needs, service and operational agreements.
> Probably a BE consultant can help you better at your decision.
>
> Best regards,
> -craig
>
> Regards,
> ===
> Heitor Medrado de Faria - LPIC-III | ITIL-F |  Bacula Systems Certified
> Administrator II
> Do you need Bacula training?
> https://www.udemy.com/bacula-backup-software/?couponCode=bacula-list
> I do Bacula training and deploy in any city of the world. More
> information: http://bacula.us/
> +55 61 <%2B55%2061%202021-8260>8268-4220 <%2B55%2061%208268-4220>
> Site: http://bacula.us FB: heitor.faria
> 
> ===
>
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Capabilities of Bacula 7.0.5

[Craig Shiroma]

Hello,

Looking over the manual, it appears open source Bacula 7.0.5 can do the
following. However,  I'd like to confirm via this list if possible just to
make sure I didn't misunderstand something.  Also, are they easy to setup
and is performance good?

- Synthetic Backups which I assume is Virtual Backups in Bacula
- Encryption at rest and in transit
- Bare Metal Restores - however, I'm not sure if this is still in
development
- Deduplication

Last, is setup of the above easier and performance more robust in Bacula
Enterprise?

Best regards,
-craig
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] (no subject)

[Craig Shiroma]

Thank you, Phil!  I'll ask our DBA to verify that these setting are set to
what they should be.

I appreciate the help!

-craig

On Fri, Sep 25, 2015 at 8:37 AM, Phil Stracchino 
wrote:

> On 09/25/15 14:00, Craig Shiroma wrote:
> > Hi Phil,
> >
> > I apologize for such a tardy reply.
> >
> > Yes, we are using InnoDB.  As far as I know we are configured
> > correctly.  However, what do you recommend are the most important
> > configuration items to look at?
>
> Principal items I would check:
>
> - Make sure innodb_buffer_pool_size is adequate
> - Make sure innodb_buffer-pool_instances is set appropriately
> - Make sure innodb_io_capacity is set appropriately for your storage
> device(s)
> - Set innodb_autoinc_lock_mode = 2
> - Set innodb_flush_log_at_trx_commit = 2
> - Set innodb_stats_on_metadata = 0
> - innodb_log_file_size should be set to at least 50M
>
>
>
> --
>   Phil Stracchino
>   Babylon Communications
>   ph...@caerllewys.net
>   p...@co.ordinate.org
>   Landline: 603.293.8485
>
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] (no subject)

[Craig Shiroma]

Hi Phil,

I apologize for such a tardy reply.

Yes, we are using InnoDB.  As far as I know we are configured correctly.
However, what do you recommend are the most important configuration items
to look at?

Thank you for the help!
-craig

On Tue, Sep 15, 2015 at 4:19 AM, Phil Stracchino 
wrote:

> On 09/15/15 04:24, Craig Shiroma wrote:
> > Yes, the database is large.  The File table has 370+ million records and
> > Bacula is pruning.  I'll see what we can do with mysqltuner.  I have a
> > feeling I'm occasionally getting the timeout error because there are so
> > many records.  If I can't find a cure for the situation, I'm thinking of
> > splitting up our backups using two catalog servers -- one for production
> > and one for test/dev.  Do you think this is wise?
>
>
> Are you using InnoDB?  Are you properly configured for InnoDB?  If not,
> you should be.  MyISAM tables really should not be used in production
> any more, and Oracle is moving towards deprecating the MyISAM engine.
>
> I've also occasionally pondered whether partitioning certain tables -
> notably the File table - would benefit Bacula.
>
>
> --
>   Phil Stracchino
>   Babylon Communications
>   ph...@caerllewys.net
>   p...@co.ordinate.org
>   Landline: 603.293.8485
>
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] (no subject)

[Craig Shiroma]

Hi Ana and Phil,

I'm a bit tied up with some important tasks right now and have not been
able to get the info you're asking for.  I apologize for the delay.  I will
reply soon.

Thanks for the help,
-craig

On Tue, Sep 15, 2015 at 4:19 AM, Phil Stracchino 
wrote:

> On 09/15/15 04:24, Craig Shiroma wrote:
> > Yes, the database is large.  The File table has 370+ million records and
> > Bacula is pruning.  I'll see what we can do with mysqltuner.  I have a
> > feeling I'm occasionally getting the timeout error because there are so
> > many records.  If I can't find a cure for the situation, I'm thinking of
> > splitting up our backups using two catalog servers -- one for production
> > and one for test/dev.  Do you think this is wise?
>
>
> Are you using InnoDB?  Are you properly configured for InnoDB?  If not,
> you should be.  MyISAM tables really should not be used in production
> any more, and Oracle is moving towards deprecating the MyISAM engine.
>
> I've also occasionally pondered whether partitioning certain tables -
> notably the File table - would benefit Bacula.
>
>
> --
>   Phil Stracchino
>   Babylon Communications
>   ph...@caerllewys.net
>   p...@co.ordinate.org
>   Landline: 603.293.8485
>
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] (no subject)

[Craig Shiroma]

Hi Ana,

Thanks again for the help!

Yes, the database is large.  The File table has 370+ million records and
Bacula is pruning.  I'll see what we can do with mysqltuner.  I have a
feeling I'm occasionally getting the timeout error because there are so
many records.  If I can't find a cure for the situation, I'm thinking of
splitting up our backups using two catalog servers -- one for production
and one for test/dev.  Do you think this is wise?  Currently, our DBAs
don't support Postgres so it may not be an option.  Would Oracle be an
option instead?

I'll have to check on the "--enable-batch-insert" option.  Is there a
Bacula command to see what options Bacula was built with?  I did not set up
our installation and am new to Bacula.

Would you have any idea why a new duplicate job is starting when one was
rescheduled?  I looked over the configs I know about, but could not find an
option that starts a new job given any situation.  At least the job will
have two more chances to run if I can prevent the new dup. job from
starting when the lock is detected.  I know that won't cure the database
problem, but I have a feeling the jobs might complete successfully on the
rescheduled tries (thinking the lock will be gone by then) until the DB can
be tuned.

Warmest regards,
-craig

On Mon, Sep 14, 2015 at 4:54 PM, Ana Emília M. Arruda <
emiliaarr...@gmail.com> wrote:

> Hello Craig,
>
> You're welcome! I hope give you some tips here. It seems you have a
> database tunning issue because of "Lock wait timeout exceeded; try
> restarting transaction". I'm not sure about your database size, but based
> on your JobIds, it seems large. You can try http://mysqltuner.com/  if
> you're using MySQL. If you have a really large database, you can think
> about migrating to PostgreSQL if tunning of MySQL do not solve this problem.
>
> Have you build your bacula with "--enable-batch-insert" option? This is a
> good idea when dealing with large number of files.
>
> Best regards,
> Ana
>
> On Mon, Sep 14, 2015 at 12:40 AM, Craig Shiroma  > wrote:
>
>> Hi Ana,
>>
>> I'm using 7.0.5.  Thanks for the help!
>>
>> -craig
>>
>> On Sat, Sep 12, 2015 at 2:10 PM, Ana Emília M. Arruda <
>> emiliaarr...@gmail.com> wrote:
>>
>>> Hello Craig,
>>>
>>> Which Bacula version are you using?
>>>
>>> Best regards,
>>> Ana
>>>
>>> On Fri, Sep 11, 2015 at 4:14 PM, Craig Shiroma <
>>> shiroma.crai...@gmail.com> wrote:
>>>
>>>> My apologies.  I hit the send button before entering a subject.
>>>>
>>>> On Fri, Sep 11, 2015 at 9:13 AM, Craig Shiroma <
>>>> shiroma.crai...@gmail.com> wrote:
>>>>
>>>>> Hello All,
>>>>>
>>>>> I'm getting the following problem occasionally:
>>>>> 2015-09-10 23:47:24bacula-dir JobId 140080: Fatal error: JobId 139901
>>>>> already running. Duplicate job not allowed.
>>>>>
>>>>> Due to this type of error:
>>>>> 2015-09-10 23:47:22bacula-dir JobId 139901: Fatal error:
>>>>> sql_create.c:870 Fill File table Query failed: INSERT INTO File 
>>>>> (FileIndex,
>>>>> JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex,
>>>>> batch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5,
>>>>> batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN
>>>>> Filename ON (batch.Name = Filename.Name): ERR=Lock wait timeout exceeded;
>>>>> try restarting transaction
>>>>>
>>>>> This happens when a database lock has timed out on a backup and the
>>>>> job is rescheduled.  For some reason, it seems a new job is starting up as
>>>>> soon as the error is detected.  I posted about this issue earlier and
>>>>> someone mentioned it is happening because I configured Bacula to do that
>>>>> (or at least that's the impression I got from the post).  Would anyone 
>>>>> know
>>>>> which config would have the setting to start up a new job for the client
>>>>> backup when an error like a lock is detected?  So far, I've only found
>>>>> settings for rescheduling, not restarting such as below:
>>>>>
>>>>>Reschedule Interval = 1 hour
>>>>> Reschedule Times = 3
>>>>> Cancel Lower Level Duplicates = yes
>>&

Re: [Bacula-users] (no subject)

[Craig Shiroma]

Hi Ana,

I'm using 7.0.5.  Thanks for the help!

-craig

On Sat, Sep 12, 2015 at 2:10 PM, Ana Emília M. Arruda <
emiliaarr...@gmail.com> wrote:

> Hello Craig,
>
> Which Bacula version are you using?
>
> Best regards,
> Ana
>
> On Fri, Sep 11, 2015 at 4:14 PM, Craig Shiroma 
> wrote:
>
>> My apologies.  I hit the send button before entering a subject.
>>
>> On Fri, Sep 11, 2015 at 9:13 AM, Craig Shiroma > > wrote:
>>
>>> Hello All,
>>>
>>> I'm getting the following problem occasionally:
>>> 2015-09-10 23:47:24bacula-dir JobId 140080: Fatal error: JobId 139901
>>> already running. Duplicate job not allowed.
>>>
>>> Due to this type of error:
>>> 2015-09-10 23:47:22bacula-dir JobId 139901: Fatal error:
>>> sql_create.c:870 Fill File table Query failed: INSERT INTO File (FileIndex,
>>> JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex,
>>> batch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5,
>>> batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN
>>> Filename ON (batch.Name = Filename.Name): ERR=Lock wait timeout exceeded;
>>> try restarting transaction
>>>
>>> This happens when a database lock has timed out on a backup and the job
>>> is rescheduled.  For some reason, it seems a new job is starting up as soon
>>> as the error is detected.  I posted about this issue earlier and someone
>>> mentioned it is happening because I configured Bacula to do that (or at
>>> least that's the impression I got from the post).  Would anyone know which
>>> config would have the setting to start up a new job for the client backup
>>> when an error like a lock is detected?  So far, I've only found settings
>>> for rescheduling, not restarting such as below:
>>>
>>>Reschedule Interval = 1 hour
>>> Reschedule Times = 3
>>> Cancel Lower Level Duplicates = yes
>>> Allow Duplicate Jobs = no
>>>
>>> Obviously, the backup is getting canceled because of the last two
>>> settings above.  But, what setting is causing a new job to be created when
>>> I get a lock timeout error is detected that says it has rescheduled the job
>>> for 3600 minutes later?
>>>
>>> I realize it appears I may need to do some database fixing/turning.
>>> But, my immediate wonder is why a new job is being created when one has
>>> been rescheduled?
>>>
>>> Regards,
>>> -craig
>>>
>>
>>
>>
>> --
>>
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>>
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] (no subject)

[Craig Shiroma]

My apologies.  I hit the send button before entering a subject.

On Fri, Sep 11, 2015 at 9:13 AM, Craig Shiroma 
wrote:

> Hello All,
>
> I'm getting the following problem occasionally:
> 2015-09-10 23:47:24bacula-dir JobId 140080: Fatal error: JobId 139901
> already running. Duplicate job not allowed.
>
> Due to this type of error:
> 2015-09-10 23:47:22bacula-dir JobId 139901: Fatal error: sql_create.c:870
> Fill File table Query failed: INSERT INTO File (FileIndex, JobId, PathId,
> FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex, batch.JobId,
> Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5, batch.DeltaSeq
> FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN Filename ON
> (batch.Name = Filename.Name): ERR=Lock wait timeout exceeded; try
> restarting transaction
>
> This happens when a database lock has timed out on a backup and the job is
> rescheduled.  For some reason, it seems a new job is starting up as soon as
> the error is detected.  I posted about this issue earlier and someone
> mentioned it is happening because I configured Bacula to do that (or at
> least that's the impression I got from the post).  Would anyone know which
> config would have the setting to start up a new job for the client backup
> when an error like a lock is detected?  So far, I've only found settings
> for rescheduling, not restarting such as below:
>
>Reschedule Interval = 1 hour
> Reschedule Times = 3
> Cancel Lower Level Duplicates = yes
> Allow Duplicate Jobs = no
>
> Obviously, the backup is getting canceled because of the last two settings
> above.  But, what setting is causing a new job to be created when I get a
> lock timeout error is detected that says it has rescheduled the job for
> 3600 minutes later?
>
> I realize it appears I may need to do some database fixing/turning.  But,
> my immediate wonder is why a new job is being created when one has been
> rescheduled?
>
> Regards,
> -craig
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] (no subject)

[Craig Shiroma]

Hello All,

I'm getting the following problem occasionally:
2015-09-10 23:47:24bacula-dir JobId 140080: Fatal error: JobId 139901
already running. Duplicate job not allowed.

Due to this type of error:
2015-09-10 23:47:22bacula-dir JobId 139901: Fatal error: sql_create.c:870
Fill File table Query failed: INSERT INTO File (FileIndex, JobId, PathId,
FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex, batch.JobId,
Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5, batch.DeltaSeq
FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN Filename ON
(batch.Name = Filename.Name): ERR=Lock wait timeout exceeded; try
restarting transaction

This happens when a database lock has timed out on a backup and the job is
rescheduled.  For some reason, it seems a new job is starting up as soon as
the error is detected.  I posted about this issue earlier and someone
mentioned it is happening because I configured Bacula to do that (or at
least that's the impression I got from the post).  Would anyone know which
config would have the setting to start up a new job for the client backup
when an error like a lock is detected?  So far, I've only found settings
for rescheduling, not restarting such as below:

   Reschedule Interval = 1 hour
Reschedule Times = 3
Cancel Lower Level Duplicates = yes
Allow Duplicate Jobs = no

Obviously, the backup is getting canceled because of the last two settings
above.  But, what setting is causing a new job to be created when I get a
lock timeout error is detected that says it has rescheduled the job for
3600 minutes later?

I realize it appears I may need to do some database fixing/turning.  But,
my immediate wonder is why a new job is being created when one has been
rescheduled?

Regards,
-craig
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restoring Windows Files Problem

[Craig Shiroma]

Hi Luc,

My apologies for such a late reply.

Thank you for the tip.  Would you know why the hidden attribute gets
assigned to the outermost folder holding the backup?  There may be times
when I want to restore some files like I did in the description.

Thanks!
-craig

On Wed, Aug 19, 2015 at 8:39 AM, E.L.L. Assoua  wrote:

> I had this issue.
>
> Place the following option in your restore Job
>
> Where = /
>
> With this option the files will be restore to the root of the drive
>
> Best regards,
>
> Luc Assoua
>
> Craig Shiroma 
> Wednesday, August 19, 2015 8:16 PM via Postbox
> <https://www.postbox-inc.com/?utm_source=email&utm_medium=sumlink&utm_campaign=reach>
> Hello All,
>
> I notice when I restore files to the root of a Windows drive, the restore
> goes okay.  However, the T folder gets assigned the system hidden
> attribute.  For example, if I restore T:/folderA to an initialized T:
> drive, the files get restored to T:\T\folderA.  T:\T is hidden and I have
> to unhide it.  Is this a known "problem" or am I doing something wrong?
> Any way around it?
>
> I know I can just restore the folderA to the T: drive without having the
> full path folders, but was wondering why the T folder is getting set to be
> hidden.  Is this some kind of inheritance thing?
>
> Thanks in advance,
> -craig
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
> --
> Sent from Postbox
> <https://www.postbox-inc.com/?utm_source=email&utm_medium=siglink&utm_campaign=reach>
>
>
> --
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Restoring Windows Files Problem

[Craig Shiroma]

Hello All,

I notice when I restore files to the root of a Windows drive, the restore
goes okay.  However, the T folder gets assigned the system hidden
attribute.  For example, if I restore T:/folderA to an initialized T:
drive, the files get restored to T:\T\folderA.  T:\T is hidden and I have
to unhide it.  Is this a known "problem" or am I doing something wrong?
Any way around it?

I know I can just restore the folderA to the T: drive without having the
full path folders, but was wondering why the T folder is getting set to be
hidden.  Is this some kind of inheritance thing?

Thanks in advance,
-craig
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

Hi Kelvin,

Thank you for the info and help!  Good information to keep in mind.

I think I found the root of the problem thanks to everyone.  See my reply
to Ana.

Thanks again for the post.  It's much appreciated.

-craig


On Fri, Aug 7, 2015 at 10:46 AM, Kelvin Minter  wrote:

> MyISAM is terrible for transactions. If the deadlock is happening because
> of table locking then switching the engine to InnoDB might help your
> problem.
> MyISAM locks the entire table while InnoDB only locks the rows it is
> updating.
>
> Check out the link below.
>
> http://stackoverflow.com/questions/20148/myisam-versus-innodb
>
> On Thu, Aug 6, 2015 at 8:37 PM, Ana Emília M. Arruda <
> emiliaarr...@gmail.com> wrote:
>
>> Hello Craig,
>>
>> In one of your posts you mentioned Segmentation violation in the
>> director host. Accurate backups requires more resources than normal ones.
>> Have you checked if CPU and memory resources are enough in director and the
>> clients that are configured for using accurate mode?
>>
>> Best regards,
>> Ana
>>
>> On Thu, Aug 6, 2015 at 5:36 PM, Craig Shiroma 
>> wrote:
>>
>>> Thanks Kern!  I'll bring in a DBA on our side to have a look.
>>>
>>> Would you have any thoughts on this question posed earlier?
>>>
>>> 3. Why is Bacula spinning off a new job right away after it detects the
>>> deadlock for each affected job instead of waiting until the rescheduled job
>>> runs?  I verified that there were no duplicate jobs in the queue before the
>>> backups started running, no jobs were running before the start of the
>>> backups, and I did not start any of these backups manually to cause a
>>> second job to appear.
>>>
>>> This happened on both nights I ran with Accurate turned On on the hosts
>>> that had failed backups because of the deadlock.
>>>
>>> Regards,
>>> -craig
>>>
>>> On Thu, Aug 6, 2015 at 9:48 AM, Kern Sibbald  wrote:
>>>
>>>> On 06.08.2015 21:44, Craig Shiroma wrote:
>>>>
>>>> Hi Kern,
>>>>
>>>> Thank you for the info!  We're using MySQL 5.6 Percona Server, Release
>>>> 68.0, Revision 656.
>>>>
>>>> Would this setting cause the problem?
>>>> innodb_lock_wait_timeout = 100
>>>>
>>>> Is it too high or too low or has no bearing on the problem?
>>>>
>>>>
>>>> Sorry, I am a Bacula programmer, and I do not know much about databases
>>>> -- especially MySQL since I use PostgreSQL.  PostgreSQL is harder to
>>>> install and a bit harder to configure than MySQL, but it performs much
>>>> better.
>>>>
>>>>
>>>>
>>>> Thanks again,
>>>> -craig
>>>>
>>>>
>>>> On Thu, Aug 6, 2015 at 9:26 AM, Kern Sibbald  wrote:
>>>>
>>>>> On 06.08.2015 18:46, Bryn Hughes wrote:
>>>>>
>>>>> I think what Kern is getting at is that your database is what threw
>>>>> the error, not Bacula.  Whatever DB you are using is what is having the
>>>>> issue.
>>>>>
>>>>>
>>>>> Yes.  That is exactly what I was implying.
>>>>>
>>>>> The rest of this is directed to Craig:
>>>>> If you are using MariaDB (I have no indication that you are), please
>>>>> be aware that it may be a very good database, maybe even better than 
>>>>> MySQL,
>>>>> but Bacula is built and tested against MySQL, and if you use binaries that
>>>>> were built for MySQL, you could run into problems by using MariaDB.  Even
>>>>> if your binaries were explicitly built with MariaDB, it may not be
>>>>> compatible with the way Bacula works.  Bacula has a tendency to push
>>>>> databases to the extreme, and it works well with MySQL and PostgreSQL, but
>>>>> possibly not with other databases.  I bring up MariaDB because it has been
>>>>> mentioned in another posting to this list.
>>>>>
>>>>> I would be very surprised if your problem has anything to do with
>>>>> Accurate -- the database routines know nothing about accurate and none of
>>>>> the data is different.  It is more likely due to the VM environment or to
>>>>> some build or version problem with MySQL (or MariaDB).
>>>>>
>>>>> Best regards,
>>>>> Kern
>>>>>
>>

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

Hi Josip,

Thank you for the advice and for looking that up in the mysql docs.  That
was pretty much the error I was getting.

See my reply to Ana.

Again, thank you for the help.  I really appreciate it.

-craig

On Thu, Aug 6, 2015 at 9:26 PM, Josip Deanovic 
wrote:

> On Thursday 2015-08-06 09:44:06 Craig Shiroma wrote:
> > Hi Kern,
> >
> > Thank you for the info!  We're using MySQL 5.6 Percona Server, Release
> > 68.0, Revision 656.
> >
> > Would this setting cause the problem?
> > innodb_lock_wait_timeout = 100
> >
> > Is it too high or too low or has no bearing on the problem?
>
> Hi!
>
>
> http://dev.mysql.com/doc/refman/5.0/en/innodb-parameters.html#sysvar_innodb_lock_wait_timeout
>
> Documentation says:
>
> -BEGIN-
>  The timeout in seconds an InnoDB transaction may wait for a row lock
> before giving up. The default value is 50 seconds. A transaction that
> tries to access a row that is locked by another InnoDB transaction will
> hang for at most this many seconds before issuing the following error:
>
> ERROR 1205 (HY000): Lock wait timeout exceeded; try restarting transaction
> When a lock wait timeout occurs, the current statement is not executed.
> The current transaction is not rolled back.
> -END-
>
>
> So I wouldn't say that decreasing this value would change anything in
> your case.
>
>
> --
> Josip Deanovic
>
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

Hi Ana,

>Did you monitor resource usage during the backups? The list of files
generated for accurate backups are
>kept in memory (by both director and client), so this should cause
resource use (CPU, memory, etc.) to increase in both hosts.

I did monitor these items earlier, but did not notice a huge drop in usage
in these items.  However, I was using Zabbix to monitor which takes a
reading every so many minutes.  It's possible it didn't take a reading when
the problem occurred.  I should've used something like top instead or
VMware's performance tools.  I'll take a look at the graphs again...I may
have missed it.

However, as usual your suggestions helped!  I increased the amount of
memory on Director and added more CPUs.  I also reduced the number of
concurrent jobs from 50 to 25.  So far, two days of incremental backups
have not produced any deadlock errors.  All my backups finished
successfully.

Thank you so much for the help!  (again)  :-)   Your advice is always,
always so helpful.

-craig


On Sat, Aug 8, 2015 at 4:11 PM, Ana Emília M. Arruda  wrote:

> Hi Craig,
>
> On Fri, Aug 7, 2015 at 3:49 PM, Craig Shiroma 
> wrote:
>
>> Hi Ana,
>>
>> Thank you for the suggestion!
>>
>
> ​You're welcome!​
>
>
>>
>> I'll look into adding more CPU and memory to director, although I didn't
>> see much of an impact on either between a non-accurate run and an accurate
>> run.  For example, there was large depletion of available memory, no
>> swapping, or high load.
>>
>
> ​Did you monitor resource usage during the backups? The list of files
> generated for accurate backups are kept in memory (by both director and
> client), so this should cause resource use (CPU, memory, etc.) to increase
> in both hosts.
>
>
>>
>> I did add more memory to the catalog server and turned Accurate back on
>> for the same hosts.  I had no deadlocks.  Last night was mostly Fulls,
>> though.  Not sure if that makes a difference.  Would you know if Bacula
>> would uses less resources when fulls are run because it is going to back up
>> everything anyway and no comparison of files needs to be made (I'm
>> guessing)?  When a full is done, does Bacula still need to keep a list of
>> the files in memory for hosts using Accurate backups?  My first thought is
>> no.
>>
>
> ​Mine too. When using accurate backups, the amount of resources used
> should be noticed when running incremental, differential and full+basejobs
> backups.
>
>
>>
>> Thanks again for the help!  Your posts are always so helpful.
>>
>
> ​Thank you too!
> Best regards,
> Ana​
>
>
>>
>> -craig
>>
>>
>> On Thu, Aug 6, 2015 at 3:37 PM, Ana Emília M. Arruda <
>> emiliaarr...@gmail.com> wrote:
>>
>>> Hello Craig,
>>>
>>> In one of your posts you mentioned Segmentation violation in the
>>> director host. Accurate backups requires more resources than normal ones.
>>> Have you checked if CPU and memory resources are enough in director and the
>>> clients that are configured for using accurate mode?
>>>
>>> Best regards,
>>> Ana
>>>
>>> On Thu, Aug 6, 2015 at 5:36 PM, Craig Shiroma >> > wrote:
>>>
>>>> Thanks Kern!  I'll bring in a DBA on our side to have a look.
>>>>
>>>> Would you have any thoughts on this question posed earlier?
>>>>
>>>> 3. Why is Bacula spinning off a new job right away after it detects the
>>>> deadlock for each affected job instead of waiting until the rescheduled job
>>>> runs?  I verified that there were no duplicate jobs in the queue before the
>>>> backups started running, no jobs were running before the start of the
>>>> backups, and I did not start any of these backups manually to cause a
>>>> second job to appear.
>>>>
>>>> This happened on both nights I ran with Accurate turned On on the hosts
>>>> that had failed backups because of the deadlock.
>>>>
>>>> Regards,
>>>> -craig
>>>>
>>>> On Thu, Aug 6, 2015 at 9:48 AM, Kern Sibbald  wrote:
>>>>
>>>>> On 06.08.2015 21:44, Craig Shiroma wrote:
>>>>>
>>>>> Hi Kern,
>>>>>
>>>>> Thank you for the info!  We're using MySQL 5.6 Percona Server, Release
>>>>> 68.0, Revision 656.
>>>>>
>>>>> Would this setting cause the problem?
>>>>> innodb_lock_wait_timeout = 100
>>>>>
>>>>> Is it too h

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

Hi Ana,

Thank you for the suggestion!

I'll look into adding more CPU and memory to director, although I didn't
see much of an impact on either between a non-accurate run and an accurate
run.  For example, there was large depletion of available memory, no
swapping, or high load.

I did add more memory to the catalog server and turned Accurate back on for
the same hosts.  I had no deadlocks.  Last night was mostly Fulls, though.
Not sure if that makes a difference.  Would you know if Bacula would uses
less resources when fulls are run because it is going to back up everything
anyway and no comparison of files needs to be made (I'm guessing)?  When a
full is done, does Bacula still need to keep a list of the files in memory
for hosts using Accurate backups?  My first thought is no.

Thanks again for the help!  Your posts are always so helpful.

-craig


On Thu, Aug 6, 2015 at 3:37 PM, Ana Emília M. Arruda  wrote:

> Hello Craig,
>
> In one of your posts you mentioned Segmentation violation in the director
> host. Accurate backups requires more resources than normal ones. Have you
> checked if CPU and memory resources are enough in director and the clients
> that are configured for using accurate mode?
>
> Best regards,
> Ana
>
> On Thu, Aug 6, 2015 at 5:36 PM, Craig Shiroma 
> wrote:
>
>> Thanks Kern!  I'll bring in a DBA on our side to have a look.
>>
>> Would you have any thoughts on this question posed earlier?
>>
>> 3. Why is Bacula spinning off a new job right away after it detects the
>> deadlock for each affected job instead of waiting until the rescheduled job
>> runs?  I verified that there were no duplicate jobs in the queue before the
>> backups started running, no jobs were running before the start of the
>> backups, and I did not start any of these backups manually to cause a
>> second job to appear.
>>
>> This happened on both nights I ran with Accurate turned On on the hosts
>> that had failed backups because of the deadlock.
>>
>> Regards,
>> -craig
>>
>> On Thu, Aug 6, 2015 at 9:48 AM, Kern Sibbald  wrote:
>>
>>> On 06.08.2015 21:44, Craig Shiroma wrote:
>>>
>>> Hi Kern,
>>>
>>> Thank you for the info!  We're using MySQL 5.6 Percona Server, Release
>>> 68.0, Revision 656.
>>>
>>> Would this setting cause the problem?
>>> innodb_lock_wait_timeout = 100
>>>
>>> Is it too high or too low or has no bearing on the problem?
>>>
>>>
>>> Sorry, I am a Bacula programmer, and I do not know much about databases
>>> -- especially MySQL since I use PostgreSQL.  PostgreSQL is harder to
>>> install and a bit harder to configure than MySQL, but it performs much
>>> better.
>>>
>>>
>>>
>>> Thanks again,
>>> -craig
>>>
>>>
>>> On Thu, Aug 6, 2015 at 9:26 AM, Kern Sibbald  wrote:
>>>
>>>> On 06.08.2015 18:46, Bryn Hughes wrote:
>>>>
>>>> I think what Kern is getting at is that your database is what threw the
>>>> error, not Bacula.  Whatever DB you are using is what is having the issue.
>>>>
>>>>
>>>> Yes.  That is exactly what I was implying.
>>>>
>>>> The rest of this is directed to Craig:
>>>> If you are using MariaDB (I have no indication that you are), please be
>>>> aware that it may be a very good database, maybe even better than MySQL,
>>>> but Bacula is built and tested against MySQL, and if you use binaries that
>>>> were built for MySQL, you could run into problems by using MariaDB.  Even
>>>> if your binaries were explicitly built with MariaDB, it may not be
>>>> compatible with the way Bacula works.  Bacula has a tendency to push
>>>> databases to the extreme, and it works well with MySQL and PostgreSQL, but
>>>> possibly not with other databases.  I bring up MariaDB because it has been
>>>> mentioned in another posting to this list.
>>>>
>>>> I would be very surprised if your problem has anything to do with
>>>> Accurate -- the database routines know nothing about accurate and none of
>>>> the data is different.  It is more likely due to the VM environment or to
>>>> some build or version problem with MySQL (or MariaDB).
>>>>
>>>> Best regards,
>>>> Kern
>>>>
>>>>
>>>> Bryn
>>>>
>>>> On 2015-08-06 09:11 AM, Craig Shiroma wrote:
>>>>
>>>> Hi Kern,
>>>>
>>>> Thank you very mu

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

Thanks Kern!  I'll bring in a DBA on our side to have a look.

Would you have any thoughts on this question posed earlier?

3. Why is Bacula spinning off a new job right away after it detects the
deadlock for each affected job instead of waiting until the rescheduled job
runs?  I verified that there were no duplicate jobs in the queue before the
backups started running, no jobs were running before the start of the
backups, and I did not start any of these backups manually to cause a
second job to appear.

This happened on both nights I ran with Accurate turned On on the hosts
that had failed backups because of the deadlock.

Regards,
-craig

On Thu, Aug 6, 2015 at 9:48 AM, Kern Sibbald  wrote:

> On 06.08.2015 21:44, Craig Shiroma wrote:
>
> Hi Kern,
>
> Thank you for the info!  We're using MySQL 5.6 Percona Server, Release
> 68.0, Revision 656.
>
> Would this setting cause the problem?
> innodb_lock_wait_timeout = 100
>
> Is it too high or too low or has no bearing on the problem?
>
>
> Sorry, I am a Bacula programmer, and I do not know much about databases --
> especially MySQL since I use PostgreSQL.  PostgreSQL is harder to install
> and a bit harder to configure than MySQL, but it performs much better.
>
>
>
> Thanks again,
> -craig
>
>
> On Thu, Aug 6, 2015 at 9:26 AM, Kern Sibbald  wrote:
>
>> On 06.08.2015 18:46, Bryn Hughes wrote:
>>
>> I think what Kern is getting at is that your database is what threw the
>> error, not Bacula.  Whatever DB you are using is what is having the issue.
>>
>>
>> Yes.  That is exactly what I was implying.
>>
>> The rest of this is directed to Craig:
>> If you are using MariaDB (I have no indication that you are), please be
>> aware that it may be a very good database, maybe even better than MySQL,
>> but Bacula is built and tested against MySQL, and if you use binaries that
>> were built for MySQL, you could run into problems by using MariaDB.  Even
>> if your binaries were explicitly built with MariaDB, it may not be
>> compatible with the way Bacula works.  Bacula has a tendency to push
>> databases to the extreme, and it works well with MySQL and PostgreSQL, but
>> possibly not with other databases.  I bring up MariaDB because it has been
>> mentioned in another posting to this list.
>>
>> I would be very surprised if your problem has anything to do with
>> Accurate -- the database routines know nothing about accurate and none of
>> the data is different.  It is more likely due to the VM environment or to
>> some build or version problem with MySQL (or MariaDB).
>>
>> Best regards,
>> Kern
>>
>>
>> Bryn
>>
>> On 2015-08-06 09:11 AM, Craig Shiroma wrote:
>>
>> Hi Kern,
>>
>> Thank you very much for the reply!  Would you have any suggestions on
>> what may be causing this problem or how I can debug it?  Obviously, I'm
>> encountering deadlocks when accurate backup runs on some of our hosts and
>> we want to use accurate backup on all of our hosts if possible.
>>
>> Warmest regards,
>> -craig
>>
>> On Thu, Aug 6, 2015 at 12:11 AM, Kern Sibbald  wrote:
>>
>>> On 06.08.2015 10:15, Craig Shiroma wrote:
>>>
>>> Hello again,
>>>
>>> I just thought I'd update this post with more information in hopes of
>>> getting some explanation for the deadlocks.
>>>
>>> I ran with Accurate backup on our test VMs (RHEL) for a couple of days
>>> and got the same errors on some VMs that were running accurate and some
>>> that were not.  These hosts were running concurrently.  I would say 90% of
>>> the hosts that were configured to use Accurate finished successfully.
>>> However, there were a few that failed with the deadlock error -- some that
>>> were configured to use accurate and some that were not configured to use
>>> accurate.  Also, on all of these, a second job started for each of the
>>> affected hosts right after Bacula detected the deadlock even though it said
>>> a reschedule would happen 3600 seconds later (the 3600 seconds is correct).
>>>
>>> Tonight, I disabled accurate on all hosts and the deadlocks did not
>>> happen.  No errors were detected and all the backups finished successfully.
>>>
>>> Some questions...
>>> 1.  Can I back up multiple hosts concurrently with some hosts configured
>>> to use accurate and some configured not to use accurate?  Or, is it an all
>>> or none thing, meaning all hosts that run concurrently must either be using
>>> accurate backup or not using accurate backup (can

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

Hi Kern,

Thank you for the info!  We're using MySQL 5.6 Percona Server, Release
68.0, Revision 656.

Would this setting cause the problem?
innodb_lock_wait_timeout = 100

Is it too high or too low or has no bearing on the problem?

Thanks again,
-craig


On Thu, Aug 6, 2015 at 9:26 AM, Kern Sibbald  wrote:

> On 06.08.2015 18:46, Bryn Hughes wrote:
>
> I think what Kern is getting at is that your database is what threw the
> error, not Bacula.  Whatever DB you are using is what is having the issue.
>
>
> Yes.  That is exactly what I was implying.
>
> The rest of this is directed to Craig:
> If you are using MariaDB (I have no indication that you are), please be
> aware that it may be a very good database, maybe even better than MySQL,
> but Bacula is built and tested against MySQL, and if you use binaries that
> were built for MySQL, you could run into problems by using MariaDB.  Even
> if your binaries were explicitly built with MariaDB, it may not be
> compatible with the way Bacula works.  Bacula has a tendency to push
> databases to the extreme, and it works well with MySQL and PostgreSQL, but
> possibly not with other databases.  I bring up MariaDB because it has been
> mentioned in another posting to this list.
>
> I would be very surprised if your problem has anything to do with Accurate
> -- the database routines know nothing about accurate and none of the data
> is different.  It is more likely due to the VM environment or to some build
> or version problem with MySQL (or MariaDB).
>
> Best regards,
> Kern
>
>
> Bryn
>
> On 2015-08-06 09:11 AM, Craig Shiroma wrote:
>
> Hi Kern,
>
> Thank you very much for the reply!  Would you have any suggestions on what
> may be causing this problem or how I can debug it?  Obviously, I'm
> encountering deadlocks when accurate backup runs on some of our hosts and
> we want to use accurate backup on all of our hosts if possible.
>
> Warmest regards,
> -craig
>
> On Thu, Aug 6, 2015 at 12:11 AM, Kern Sibbald  wrote:
>
>> On 06.08.2015 10:15, Craig Shiroma wrote:
>>
>> Hello again,
>>
>> I just thought I'd update this post with more information in hopes of
>> getting some explanation for the deadlocks.
>>
>> I ran with Accurate backup on our test VMs (RHEL) for a couple of days
>> and got the same errors on some VMs that were running accurate and some
>> that were not.  These hosts were running concurrently.  I would say 90% of
>> the hosts that were configured to use Accurate finished successfully.
>> However, there were a few that failed with the deadlock error -- some that
>> were configured to use accurate and some that were not configured to use
>> accurate.  Also, on all of these, a second job started for each of the
>> affected hosts right after Bacula detected the deadlock even though it said
>> a reschedule would happen 3600 seconds later (the 3600 seconds is correct).
>>
>> Tonight, I disabled accurate on all hosts and the deadlocks did not
>> happen.  No errors were detected and all the backups finished successfully.
>>
>> Some questions...
>> 1.  Can I back up multiple hosts concurrently with some hosts configured
>> to use accurate and some configured not to use accurate?  Or, is it an all
>> or none thing, meaning all hosts that run concurrently must either be using
>> accurate backup or not using accurate backup (cannot mix the two)?
>>
>> 2. It seems like the hosts that get out of the starting gate first are
>> the ones affected.  I am configured to run 50 jobs concurrently.  Again, no
>> problems with accurate turned off on all hosts for months now.
>>
>> 3. Why is Bacula spinning off a new job right away after it detects the
>> deadlock for each affected job instead of waiting until the rescheduled job
>> runs?  I verified that there were no duplicate jobs in the queue before the
>> backups started running, no jobs were running before the start of the
>> backups, and I did not start any of these backups manually to cause a
>> second job to appear.
>>
>>
>> Bacula is not aware of any SQL internal deadlocks.
>>
>>
>> From the INNODB Monitor output:
>>
>> TRANSACTION:
>> TRANSACTION 208788977, ACTIVE 1 sec setting auto-inc lock
>> mysql tables in use 4, locked 4
>> 9 lock struct(s), heap size 1184, 5 row lock(s)
>> MySQL thread id 50808, OS thread handle 0x7f8f2c3b4700, query id 29558637
>>  192.168.10.99 bacula Sending data
>> INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5,
>> DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId,
>> Filename.FilenameId,batch.LStat, batch.M

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

Hi Bryn,

Thank you for the translation!  :-)  Much appreciated.  I'll ask our DBA to
take a look at the DB (mysql).  Maybe it needs some tuning for Accurate.
Do you know of any documentation for this?  I only saw a couple of small
sections for Accurate in the manual, mainly how to turn it on and that it
uses more resources.  I haven't had a chance to read the whole manual yet
so I might have missed the section.

-craig

On Thu, Aug 6, 2015 at 6:46 AM, Bryn Hughes  wrote:

> I think what Kern is getting at is that your database is what threw the
> error, not Bacula.  Whatever DB you are using is what is having the issue.
>
> Bryn
>
>
> On 2015-08-06 09:11 AM, Craig Shiroma wrote:
>
> Hi Kern,
>
> Thank you very much for the reply!  Would you have any suggestions on what
> may be causing this problem or how I can debug it?  Obviously, I'm
> encountering deadlocks when accurate backup runs on some of our hosts and
> we want to use accurate backup on all of our hosts if possible.
>
> Warmest regards,
> -craig
>
> On Thu, Aug 6, 2015 at 12:11 AM, Kern Sibbald  wrote:
>
>> On 06.08.2015 10:15, Craig Shiroma wrote:
>>
>> Hello again,
>>
>> I just thought I'd update this post with more information in hopes of
>> getting some explanation for the deadlocks.
>>
>> I ran with Accurate backup on our test VMs (RHEL) for a couple of days
>> and got the same errors on some VMs that were running accurate and some
>> that were not.  These hosts were running concurrently.  I would say 90% of
>> the hosts that were configured to use Accurate finished successfully.
>> However, there were a few that failed with the deadlock error -- some that
>> were configured to use accurate and some that were not configured to use
>> accurate.  Also, on all of these, a second job started for each of the
>> affected hosts right after Bacula detected the deadlock even though it said
>> a reschedule would happen 3600 seconds later (the 3600 seconds is correct).
>>
>> Tonight, I disabled accurate on all hosts and the deadlocks did not
>> happen.  No errors were detected and all the backups finished successfully.
>>
>> Some questions...
>> 1.  Can I back up multiple hosts concurrently with some hosts configured
>> to use accurate and some configured not to use accurate?  Or, is it an all
>> or none thing, meaning all hosts that run concurrently must either be using
>> accurate backup or not using accurate backup (cannot mix the two)?
>>
>> 2. It seems like the hosts that get out of the starting gate first are
>> the ones affected.  I am configured to run 50 jobs concurrently.  Again, no
>> problems with accurate turned off on all hosts for months now.
>>
>> 3. Why is Bacula spinning off a new job right away after it detects the
>> deadlock for each affected job instead of waiting until the rescheduled job
>> runs?  I verified that there were no duplicate jobs in the queue before the
>> backups started running, no jobs were running before the start of the
>> backups, and I did not start any of these backups manually to cause a
>> second job to appear.
>>
>>
>> Bacula is not aware of any SQL internal deadlocks.
>>
>>
>> From the INNODB Monitor output:
>>
>> TRANSACTION:
>> TRANSACTION 208788977, ACTIVE 1 sec setting auto-inc lock
>> mysql tables in use 4, locked 4
>> 9 lock struct(s), heap size 1184, 5 row lock(s)
>> MySQL thread id 50808, OS thread handle 0x7f8f2c3b4700, query id 29558637
>>  192.168.10.99 bacula Sending data
>> INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5,
>> DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId,
>> Filename.FilenameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN
>> Path ON (batch.Path = Path.Path) JOIN Filename ON (batch.Name =
>> Filename.Name)
>> WAITING FOR THIS LOCK TO BE GRANTED:
>> TABLE LOCK table `bacula`.`File` trx id 208788977 lock mode AUTO-INC
>> waiting
>> WE ROLL BACK TRANSACTION (2)
>>
>> I am running Bacula 7.0.5 on RHEL 6.6 x64 with Director, Storage and
>> Catalog running on separate RHEL 6.6 hosts.  Our clients are RHEL 6's, 5's
>> and Windows Servers 2008 and 2012R2.
>>
>> Any help would be much appreciated.
>>
>> Warmest regards,
>> -craig
>>
>> On Tue, Aug 4, 2015 at 1:56 PM, Craig Shiroma 
>> wrote:
>>
>>> BTW, I suppose there could've been two jobs for the host(s) in
>>> scheduling queue.  If this was the case, is there a way to find out after
>>> the fact?  If this did actually happen, what could cause duplicate

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

Hi Kern,

Thank you very much for the reply!  Would you have any suggestions on what
may be causing this problem or how I can debug it?  Obviously, I'm
encountering deadlocks when accurate backup runs on some of our hosts and
we want to use accurate backup on all of our hosts if possible.

Warmest regards,
-craig

On Thu, Aug 6, 2015 at 12:11 AM, Kern Sibbald  wrote:

> On 06.08.2015 10:15, Craig Shiroma wrote:
>
> Hello again,
>
> I just thought I'd update this post with more information in hopes of
> getting some explanation for the deadlocks.
>
> I ran with Accurate backup on our test VMs (RHEL) for a couple of days and
> got the same errors on some VMs that were running accurate and some that
> were not.  These hosts were running concurrently.  I would say 90% of the
> hosts that were configured to use Accurate finished successfully.  However,
> there were a few that failed with the deadlock error -- some that were
> configured to use accurate and some that were not configured to use
> accurate.  Also, on all of these, a second job started for each of the
> affected hosts right after Bacula detected the deadlock even though it said
> a reschedule would happen 3600 seconds later (the 3600 seconds is correct).
>
> Tonight, I disabled accurate on all hosts and the deadlocks did not
> happen.  No errors were detected and all the backups finished successfully.
>
> Some questions...
> 1.  Can I back up multiple hosts concurrently with some hosts configured
> to use accurate and some configured not to use accurate?  Or, is it an all
> or none thing, meaning all hosts that run concurrently must either be using
> accurate backup or not using accurate backup (cannot mix the two)?
>
> 2. It seems like the hosts that get out of the starting gate first are the
> ones affected.  I am configured to run 50 jobs concurrently.  Again, no
> problems with accurate turned off on all hosts for months now.
>
> 3. Why is Bacula spinning off a new job right away after it detects the
> deadlock for each affected job instead of waiting until the rescheduled job
> runs?  I verified that there were no duplicate jobs in the queue before the
> backups started running, no jobs were running before the start of the
> backups, and I did not start any of these backups manually to cause a
> second job to appear.
>
>
> Bacula is not aware of any SQL internal deadlocks.
>
>
> From the INNODB Monitor output:
>
> TRANSACTION:
> TRANSACTION 208788977, ACTIVE 1 sec setting auto-inc lock
> mysql tables in use 4, locked 4
> 9 lock struct(s), heap size 1184, 5 row lock(s)
> MySQL thread id 50808, OS thread handle 0x7f8f2c3b4700, query id 29558637
>  192.168.10.99 bacula Sending data
> INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5,
> DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId,
> Filename.FilenameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN
> Path ON (batch.Path = Path.Path) JOIN Filename ON (batch.Name =
> Filename.Name)
> WAITING FOR THIS LOCK TO BE GRANTED:
> TABLE LOCK table `bacula`.`File` trx id 208788977 lock mode AUTO-INC
> waiting
> WE ROLL BACK TRANSACTION (2)
>
> I am running Bacula 7.0.5 on RHEL 6.6 x64 with Director, Storage and
> Catalog running on separate RHEL 6.6 hosts.  Our clients are RHEL 6's, 5's
> and Windows Servers 2008 and 2012R2.
>
> Any help would be much appreciated.
>
> Warmest regards,
> -craig
>
> On Tue, Aug 4, 2015 at 1:56 PM, Craig Shiroma 
> wrote:
>
>> BTW, I suppose there could've been two jobs for the host(s) in scheduling
>> queue.  If this was the case, is there a way to find out after the fact?
>> If this did actually happen, what could cause duplicate jobs to be
>> scheduled on the same day at the same time?  I know no one manually ran the
>> jobs in question.  Again, this only was a problem for a few of the jobs
>> that ran last night, not all of them and some to do accurate backup and
>> some not.
>>
>> Regards,
>> -craig
>>
>> On Tue, Aug 4, 2015 at 9:27 AM, Craig Shiroma 
>> wrote:
>>
>>> Hello,
>>>
>>> I had a few backups fail last night with the following error:
>>>
>>> 2015-08-03 18:02:46bacula-dir JobId 123984: b INTO File (FileIndex,
>>> JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex,
>>> batch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5,
>>> batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN
>>> Filename ON (batch.Name = Filename.Name): ERR=Deadlock found when trying to
>>> get lock; try restarting transaction
>>>
>>> The only thing I did yesterday was switch a bunc

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

One thing I missed mentioning was on the second night accurate backup was
used, the director died about 45 minutes into the backup with the following
error.  This did not happen on the first run with accurate enabled.

Aug  4 19:02:27  bacula-dir: Bacula interrupted by signal 11:
Segmentation violation

Also, as many of you know, since a duplicate job was spinned off for each
job with a deadlock, the backup was cancelled.

On Wed, Aug 5, 2015 at 10:15 PM, Craig Shiroma 
wrote:

> Hello again,
>
> I just thought I'd update this post with more information in hopes of
> getting some explanation for the deadlocks.
>
> I ran with Accurate backup on our test VMs (RHEL) for a couple of days and
> got the same errors on some VMs that were running accurate and some that
> were not.  These hosts were running concurrently.  I would say 90% of the
> hosts that were configured to use Accurate finished successfully.  However,
> there were a few that failed with the deadlock error -- some that were
> configured to use accurate and some that were not configured to use
> accurate.  Also, on all of these, a second job started for each of the
> affected hosts right after Bacula detected the deadlock even though it said
> a reschedule would happen 3600 seconds later (the 3600 seconds is correct).
>
> Tonight, I disabled accurate on all hosts and the deadlocks did not
> happen.  No errors were detected and all the backups finished successfully.
>
> Some questions...
> 1.  Can I back up multiple hosts concurrently with some hosts configured
> to use accurate and some configured not to use accurate?  Or, is it an all
> or none thing, meaning all hosts that run concurrently must either be using
> accurate backup or not using accurate backup (cannot mix the two)?
>
> 2. It seems like the hosts that get out of the starting gate first are the
> ones affected.  I am configured to run 50 jobs concurrently.  Again, no
> problems with accurate turned off on all hosts for months now.
>
> 3. Why is Bacula spinning off a new job right away after it detects the
> deadlock for each affected job instead of waiting until the rescheduled job
> runs?  I verified that there were no duplicate jobs in the queue before the
> backups started running, no jobs were running before the start of the
> backups, and I did not start any of these backups manually to cause a
> second job to appear.
>
> From the INNODB Monitor output:
>
> TRANSACTION:
> TRANSACTION 208788977, ACTIVE 1 sec setting auto-inc lock
> mysql tables in use 4, locked 4
> 9 lock struct(s), heap size 1184, 5 row lock(s)
> MySQL thread id 50808, OS thread handle 0x7f8f2c3b4700, query id 29558637
>  192.168.10.99 bacula Sending data
> INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5,
> DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId,
> Filename.FilenameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN
> Path ON (batch.Path = Path.Path) JOIN Filename ON (batch.Name =
> Filename.Name)
> WAITING FOR THIS LOCK TO BE GRANTED:
> TABLE LOCK table `bacula`.`File` trx id 208788977 lock mode AUTO-INC
> waiting
> WE ROLL BACK TRANSACTION (2)
>
> I am running Bacula 7.0.5 on RHEL 6.6 x64 with Director, Storage and
> Catalog running on separate RHEL 6.6 hosts.  Our clients are RHEL 6's, 5's
> and Windows Servers 2008 and 2012R2.
>
> Any help would be much appreciated.
>
> Warmest regards,
> -craig
>
> On Tue, Aug 4, 2015 at 1:56 PM, Craig Shiroma 
> wrote:
>
>> BTW, I suppose there could've been two jobs for the host(s) in scheduling
>> queue.  If this was the case, is there a way to find out after the fact?
>> If this did actually happen, what could cause duplicate jobs to be
>> scheduled on the same day at the same time?  I know no one manually ran the
>> jobs in question.  Again, this only was a problem for a few of the jobs
>> that ran last night, not all of them and some to do accurate backup and
>> some not.
>>
>> Regards,
>> -craig
>>
>> On Tue, Aug 4, 2015 at 9:27 AM, Craig Shiroma 
>> wrote:
>>
>>> Hello,
>>>
>>> I had a few backups fail last night with the following error:
>>>
>>> 2015-08-03 18:02:46bacula-dir JobId 123984: b INTO File (FileIndex,
>>> JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex,
>>> batch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5,
>>> batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN
>>> Filename ON (batch.Name = Filename.Name): ERR=Deadlock found when trying to
>>> get lock; try restarting transaction
>>>
>>> The only thing I did yesterday was switch a bunch of backu

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

Hello again,

I just thought I'd update this post with more information in hopes of
getting some explanation for the deadlocks.

I ran with Accurate backup on our test VMs (RHEL) for a couple of days and
got the same errors on some VMs that were running accurate and some that
were not.  These hosts were running concurrently.  I would say 90% of the
hosts that were configured to use Accurate finished successfully.  However,
there were a few that failed with the deadlock error -- some that were
configured to use accurate and some that were not configured to use
accurate.  Also, on all of these, a second job started for each of the
affected hosts right after Bacula detected the deadlock even though it said
a reschedule would happen 3600 seconds later (the 3600 seconds is correct).

Tonight, I disabled accurate on all hosts and the deadlocks did not
happen.  No errors were detected and all the backups finished successfully.

Some questions...
1.  Can I back up multiple hosts concurrently with some hosts configured to
use accurate and some configured not to use accurate?  Or, is it an all or
none thing, meaning all hosts that run concurrently must either be using
accurate backup or not using accurate backup (cannot mix the two)?

2. It seems like the hosts that get out of the starting gate first are the
ones affected.  I am configured to run 50 jobs concurrently.  Again, no
problems with accurate turned off on all hosts for months now.

3. Why is Bacula spinning off a new job right away after it detects the
deadlock for each affected job instead of waiting until the rescheduled job
runs?  I verified that there were no duplicate jobs in the queue before the
backups started running, no jobs were running before the start of the
backups, and I did not start any of these backups manually to cause a
second job to appear.

>From the INNODB Monitor output:

TRANSACTION:
TRANSACTION 208788977, ACTIVE 1 sec setting auto-inc lock
mysql tables in use 4, locked 4
9 lock struct(s), heap size 1184, 5 row lock(s)
MySQL thread id 50808, OS thread handle 0x7f8f2c3b4700, query id 29558637
 192.168.10.99 bacula Sending data
INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5,
DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId,
Filename.FilenameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN
Path ON (batch.Path = Path.Path) JOIN Filename ON (batch.Name =
Filename.Name)
WAITING FOR THIS LOCK TO BE GRANTED:
TABLE LOCK table `bacula`.`File` trx id 208788977 lock mode AUTO-INC waiting
WE ROLL BACK TRANSACTION (2)

I am running Bacula 7.0.5 on RHEL 6.6 x64 with Director, Storage and
Catalog running on separate RHEL 6.6 hosts.  Our clients are RHEL 6's, 5's
and Windows Servers 2008 and 2012R2.

Any help would be much appreciated.

Warmest regards,
-craig

On Tue, Aug 4, 2015 at 1:56 PM, Craig Shiroma 
wrote:

> BTW, I suppose there could've been two jobs for the host(s) in scheduling
> queue.  If this was the case, is there a way to find out after the fact?
> If this did actually happen, what could cause duplicate jobs to be
> scheduled on the same day at the same time?  I know no one manually ran the
> jobs in question.  Again, this only was a problem for a few of the jobs
> that ran last night, not all of them and some to do accurate backup and
> some not.
>
> Regards,
> -craig
>
> On Tue, Aug 4, 2015 at 9:27 AM, Craig Shiroma 
> wrote:
>
>> Hello,
>>
>> I had a few backups fail last night with the following error:
>>
>> 2015-08-03 18:02:46bacula-dir JobId 123984: b INTO File (FileIndex,
>> JobId, PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex,
>> batch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5,
>> batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN
>> Filename ON (batch.Name = Filename.Name): ERR=Deadlock found when trying to
>> get lock; try restarting transaction
>>
>> The only thing I did yesterday was switch a bunch of backups to use
>> Accurate backup and restart bacula-dir and bacula-sd after that.  However,
>> the above problem also occurred on some hosts that was not set to use
>> Accurate backup.  From the log, it seems like two jobs for this host was
>> scheduled to run at 18:00 because the second job started and found a
>> duplicate job (job 123984) and canceled the backup.  I know there were no
>> jobs running before 18:00 so 123984 was not an old job still running.  Same
>> with the other jobs that were canceled because of the above situation.
>>
>> Anyway, does anyone have an idea what would cause this, especially how
>> the second job got shot into the system.  After the deadlock error, Bacula
>> said it would reschedule the job.  However the sec

Re: [Bacula-users] Deadlock error

[Craig Shiroma]

BTW, I suppose there could've been two jobs for the host(s) in scheduling
queue.  If this was the case, is there a way to find out after the fact?
If this did actually happen, what could cause duplicate jobs to be
scheduled on the same day at the same time?  I know no one manually ran the
jobs in question.  Again, this only was a problem for a few of the jobs
that ran last night, not all of them and some to do accurate backup and
some not.

Regards,
-craig

On Tue, Aug 4, 2015 at 9:27 AM, Craig Shiroma 
wrote:

> Hello,
>
> I had a few backups fail last night with the following error:
>
> 2015-08-03 18:02:46bacula-dir JobId 123984: b INTO File (FileIndex, JobId,
> PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex,
> batch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5,
> batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN
> Filename ON (batch.Name = Filename.Name): ERR=Deadlock found when trying to
> get lock; try restarting transaction
>
> The only thing I did yesterday was switch a bunch of backups to use
> Accurate backup and restart bacula-dir and bacula-sd after that.  However,
> the above problem also occurred on some hosts that was not set to use
> Accurate backup.  From the log, it seems like two jobs for this host was
> scheduled to run at 18:00 because the second job started and found a
> duplicate job (job 123984) and canceled the backup.  I know there were no
> jobs running before 18:00 so 123984 was not an old job still running.  Same
> with the other jobs that were canceled because of the above situation.
>
> Anyway, does anyone have an idea what would cause this, especially how the
> second job got shot into the system.  After the deadlock error, Bacula said
> it would reschedule the job.  However the second job started right after
> the deadlock error instead of one hour later which makes me think that
> there were two jobs for this host scheduled to run at 18:00.
>
> Thank you in advance,
> -craig
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Deadlock error

[Craig Shiroma]

Hello,

I had a few backups fail last night with the following error:

2015-08-03 18:02:46bacula-dir JobId 123984: b INTO File (FileIndex, JobId,
PathId, FilenameId, LStat, MD5, DeltaSeq) SELECT batch.FileIndex,
batch.JobId, Path.PathId, Filename.FilenameId,batch.LStat, batch.MD5,
batch.DeltaSeq FROM batch JOIN Path ON (batch.Path = Path.Path) JOIN
Filename ON (batch.Name = Filename.Name): ERR=Deadlock found when trying to
get lock; try restarting transaction

The only thing I did yesterday was switch a bunch of backups to use
Accurate backup and restart bacula-dir and bacula-sd after that.  However,
the above problem also occurred on some hosts that was not set to use
Accurate backup.  From the log, it seems like two jobs for this host was
scheduled to run at 18:00 because the second job started and found a
duplicate job (job 123984) and canceled the backup.  I know there were no
jobs running before 18:00 so 123984 was not an old job still running.  Same
with the other jobs that were canceled because of the above situation.

Anyway, does anyone have an idea what would cause this, especially how the
second job got shot into the system.  After the deadlock error, Bacula said
it would reschedule the job.  However the second job started right after
the deadlock error instead of one hour later which makes me think that
there were two jobs for this host scheduled to run at 18:00.

Thank you in advance,
-craig
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] bacula_t selinux problem

[Craig Shiroma]

Hi Simone,

Thank you for the info!  That's great!

-craig

On Mon, Aug 3, 2015 at 10:33 PM, Simone Caronni 
wrote:

> Hello,
>
> On 4 August 2015 at 03:37, Craig Shiroma 
> wrote:
>
>> Many (if not all) have the permissions srw-rw-rw- on the object.  With
>> bacula_t set to permissive, the errors don't seem to occur.  Besides the
>> restore problem which I can get around and the one above, are there any
>> other problems with leaving bacula_t enforced?  Is the problem above
>> something to be worried about?  I rather leave bacula_t enforced if
>> possible (unless it is not recommended).
>>
>
> I've been running Bacula with SELinux in enforcing mode for a few years
> now and did not have any issue. Error on sockets are not a problem, you can
> ignore those. They are created when the program starts.
>
> Regards,
> --Simone
>
>
>
>
> --
> You cannot discover new oceans unless you have the courage to lose sight
> of the shore (R. W. Emerson).
>
> http://xkcd.com/229/
> http://negativo17.org/
>
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] bacula_t selinux problem

[Craig Shiroma]

Hello,

It realize later versions of selinux causes problems with restoring from
Bacula, and that there are various methods to get around the problem.
However, I notice there are also stat messages like those shown below:

03-Aug 14:06  JobId 123952:  Could not stat
"/var/spool/postfix/public/showq": ERR=Permission denied
03-Aug 14:06  JobId 123952:  Could not stat
"/var/spool/postfix/public/cleanup": ERR=Permission denied
0
03-Aug 14:06  JobId 123952:  Could not stat
"/var/run/rpcbind.sock": ERR=Permission denied
03-Aug 14:06  JobId 123952:  Could not stat
"/var/run/acpid.socket": ERR=Permission denied
03-Aug 14:06  JobId 123952:  Could not stat
"/var/run/dbus/system_bus_socket": ERR=Permission denied

Many (if not all) have the permissions srw-rw-rw- on the object.  With
bacula_t set to permissive, the errors don't seem to occur.  Besides the
restore problem which I can get around and the one above, are there any
other problems with leaving bacula_t enforced?  Is the problem above
something to be worried about?  I rather leave bacula_t enforced if
possible (unless it is not recommended).

Thanks in advance,
-craig
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] alldrives plugin and Accurate backup

[Craig Shiroma]

Hello,

I noticed in the documentation that to use a Bacula plugin with Accurate
backup, the plugin must be compatible with this type of backup.  Anyone
know if the alldrives Windows plugin is compatible or not with Accurate
backup?

>From the docs:
"Accurate must not be enabled when backing up with a plugin that is not
specially designed to work with Accurate. If you enable it, your restores
will probably not work correctly."

Thanks in advance,
-craig
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Backup Retry

[Craig Shiroma]

Hi Ana,

You are absolutely correct!  I didn't even notice that.  Looking at the
log, that appears to be the case.

Thank you so much!
-craig


On Fri, Jul 24, 2015 at 3:23 AM, Ana Emília M. Arruda <
emiliaarr...@gmail.com> wrote:

> Hello Craig,
>
> It seems you have this job scheduled every day at about 18 pm. Am I
> correct? If this is the case, I think that your job scheduled to run at 
> 2015-07-20
> (maybe at 18 pm), started at 18:01:39 but did not finished until 2015-07-21
> 04:49:42. So the JobId 118594 is the same job that was scheduled for the
> next day, 2015-07-21 at 18 pm, and this job had been waiting for the
> jobid 118277 to finish (since you do not have allowed duplicate jobs).
> Since the job 11827 was canceled, no more retries would be carried out.
>
> Best regards,
> Ana
>
> On Fri, Jul 24, 2015 at 1:41 AM, Craig Shiroma 
> wrote:
>
>> Hi Ana,
>>
>> >Sorry for the delay.
>>
>> No apologizes necessary!  Thank you for the help.  I appreciate it.
>>
>> >Don't you have log lines for the retry that should occur at 21-Jul-2015
>> 05:49?
>>
>> I see no entry in the log file indicating job 118277 was restarted.
>>
>> >Have you manually canceled the JobId 118277?
>>
>> No, no one manually cancelled job 118277.  I'm guessing Bacula did
>> somehow.
>>
>> Would you have any idea what would cause job 118594 to be started?  Up
>> to now, I thought it was the restarted job under a new jobId.
>>
>> The above situation occurs occasionally (not frequently) for other host
>> backups.  I have not been able to figure why.
>>
>> This is what shows up if I do a 'list files job=:
>>
>> 
>> | 117,865 |  | 2015-07-19 18:01:35 | B| I |70 |
>>  13,864,818 | T |
>> | 118,277 |  | 2015-07-20 18:01:39 | B| F | 1,631,292 |
>> 311,164,701,221 | f |
>> | 118,594 |  | 2015-07-21 04:49:57 | B| F | 0 |
>> 0 | A |
>> 
>>
>> I did run a test to simulate what happened on our test Bacula
>> environment.  I run a backup, then while it is running I shutdown the
>> bacula-sd daemon on the storage host.  The exact same thing happened.  I
>> get the same (or similar) network error, the same 'job will be restarted in
>> 3600 seconds' message, another job starts right away with a different jobId
>> and the original job is cancelled.  No job restart with the same jobId
>> occurs 1 hour later.
>>
>> Many thanks,
>> -craig
>>
>> On Thu, Jul 23, 2015 at 5:21 PM, Ana Emília M. Arruda <
>> emiliaarr...@gmail.com> wrote:
>>
>>> Hello Craig,
>>>
>>> Sorry for the delay.
>>>
>>> The second email does not seems to be a retry. All the retries for a job
>>> have the same JobId. That is the same JobId will be retryed the "reschedule
>>> times" you had configured for the Job.
>>>
>>> On Wed, Jul 22, 2015 at 4:49 AM, Craig Shiroma <
>>> shiroma.crai...@gmail.com> wrote:
>>>
>>>> Hi Ana,
>>>>
>>>> Thank you for the reply.
>>>>
>>>> Sorry, yes that is what I meant.
>>>>
>>>> I'm wondering if Bacula canceled the job due to the Fatal error and the
>>>> below line included in the first "bacula error" email actually shouldn't be
>>>> there (i.e. erroneous) because no retry was made at 05:49 (3600 seconds
>>>> later).  However, the second "bacula error" email seems to indicate a retry
>>>> was actually attempted although at the wrong time (2015-07-21 04:49:57).
>>>>
>>>>
>>>> 2015-07-21 04:49:57bacula-dir JobId 118277: Rescheduled Job
>>>> .2015-07-20_18.00.03_31 at 21-Jul-2015 04:49 to re-run in 3600
>>>> seconds (21-Jul-2015 05:49).
>>>>
>>>> Thanks again!
>>>> -craig
>>>>
>>>>
>>>>
>>>> On Tue, Jul 21, 2015 at 4:55 PM, Ana Emília M. Arruda <
>>>> emiliaarr...@gmail.com> wrote:
>>>>
>>>>> Hello Craig,
>>>>>
>>>>> Do you mean reschedule interval = 1 hour and reschedule times = 3?
>>>>>
>>>>> Best regards,
>>>>> Ana
>>>>> Em ter, 21 de jul de 2015 às 19:29, Craig Shiroma <
>>>>> shiroma.crai...@gmail.com> escreveu:
>>>>>
>>>>>> Hello,
>>>>>>
>>>>>> I had a backup th

Re: [Bacula-users] Backup Retry

[Craig Shiroma]

Hi Ana,

>Sorry for the delay.

No apologizes necessary!  Thank you for the help.  I appreciate it.

>Don't you have log lines for the retry that should occur at 21-Jul-2015
05:49?

I see no entry in the log file indicating job 118277 was restarted.

>Have you manually canceled the JobId 118277?

No, no one manually cancelled job 118277.  I'm guessing Bacula did somehow.

Would you have any idea what would cause job 118594 to be started?  Up to
now, I thought it was the restarted job under a new jobId.

The above situation occurs occasionally (not frequently) for other host
backups.  I have not been able to figure why.

This is what shows up if I do a 'list files job=:


| 117,865 |  | 2015-07-19 18:01:35 | B| I |70 |
 13,864,818 | T |
| 118,277 |  | 2015-07-20 18:01:39 | B| F | 1,631,292 |
311,164,701,221 | f |
| 118,594 |  | 2015-07-21 04:49:57 | B| F | 0 |
0 | A |


I did run a test to simulate what happened on our test Bacula environment.
I run a backup, then while it is running I shutdown the bacula-sd daemon on
the storage host.  The exact same thing happened.  I get the same (or
similar) network error, the same 'job will be restarted in 3600 seconds'
message, another job starts right away with a different jobId and the
original job is cancelled.  No job restart with the same jobId occurs 1
hour later.

Many thanks,
-craig

On Thu, Jul 23, 2015 at 5:21 PM, Ana Emília M. Arruda <
emiliaarr...@gmail.com> wrote:

> Hello Craig,
>
> Sorry for the delay.
>
> The second email does not seems to be a retry. All the retries for a job
> have the same JobId. That is the same JobId will be retryed the "reschedule
> times" you had configured for the Job.
>
> On Wed, Jul 22, 2015 at 4:49 AM, Craig Shiroma 
> wrote:
>
>> Hi Ana,
>>
>> Thank you for the reply.
>>
>> Sorry, yes that is what I meant.
>>
>> I'm wondering if Bacula canceled the job due to the Fatal error and the
>> below line included in the first "bacula error" email actually shouldn't be
>> there (i.e. erroneous) because no retry was made at 05:49 (3600 seconds
>> later).  However, the second "bacula error" email seems to indicate a retry
>> was actually attempted although at the wrong time (2015-07-21 04:49:57).
>>
>>
>> 2015-07-21 04:49:57bacula-dir JobId 118277: Rescheduled Job
>> .2015-07-20_18.00.03_31 at 21-Jul-2015 04:49 to re-run in 3600
>> seconds (21-Jul-2015 05:49).
>>
>> Thanks again!
>> -craig
>>
>>
>>
>> On Tue, Jul 21, 2015 at 4:55 PM, Ana Emília M. Arruda <
>> emiliaarr...@gmail.com> wrote:
>>
>>> Hello Craig,
>>>
>>> Do you mean reschedule interval = 1 hour and reschedule times = 3?
>>>
>>> Best regards,
>>> Ana
>>> Em ter, 21 de jul de 2015 às 19:29, Craig Shiroma <
>>> shiroma.crai...@gmail.com> escreveu:
>>>
>>>> Hello,
>>>>
>>>> I had a backup that failed this morning due to what looks like a
>>>> network problem.
>>>>
>>>> First error email:
>>>> 2015-07-21 04:49:42 JobId 118277: Error: lib/bsock.c:693 Write
>>>> error sending 65813 bytes to Storage daemon::9103:
>>>> ERR=Input/output error
>>>> 2015-07-21 04:49:42 JobId 118277: Fatal error:
>>>> filed/backup.c:1282 Network send error to SD. ERR=Input/output error
>>>> ...
>>>> FD termination status:  Error
>>>> SD termination status:  Error
>>>> Termination:*** Backup Error ***
>>>>
>>>> 2015-07-21 04:49:57bacula-dir JobId 118277: Rescheduled Job
>>>> .2015-07-20_18.00.03_31 at 21-Jul-2015 04:49 to re-run in 3600
>>>> seconds (21-Jul-2015 05:49).
>>>>
>>>
> ​This means that your Job (scheduled to run at 18:00 2015-07-20) was
> rescheduled to run at 21-Jul-2015 05:49 (1 hour passed 21-Jul-2015 04:49,
> the time it started).
>
>
>>
>>>>
>>>> I have Retry set to 3 and retry interval set to 1 hour.  However, the
>>>> retry was canceled as seen below.  I'm wondering how I should interpret the
>>>> below messages.  Did Bacula notice the job was still running when it tried
>>>> to reschedule the job and then cancel it right then (practically at the
>>>> same time the above error occurred)?  Or, did it actually try to re-run the
>>>> job right after the error instead of one hour later (5:49) and cancel the
>>>> job?  If so, why did it try to re-run the job right after the error i

Re: [Bacula-users] Backup Retry

[Craig Shiroma]

Hi Ana,

Thank you for the reply.

Sorry, yes that is what I meant.

I'm wondering if Bacula canceled the job due to the Fatal error and the
below line included in the first "bacula error" email actually shouldn't be
there (i.e. erroneous) because no retry was made at 05:49 (3600 seconds
later).  However, the second "bacula error" email seems to indicate a retry
was actually attempted although at the wrong time (2015-07-21 04:49:57).

2015-07-21 04:49:57bacula-dir JobId 118277: Rescheduled Job
.2015-07-20_18.00.03_31 at 21-Jul-2015 04:49 to re-run in 3600
seconds (21-Jul-2015 05:49).

Thanks again!
-craig



On Tue, Jul 21, 2015 at 4:55 PM, Ana Emília M. Arruda <
emiliaarr...@gmail.com> wrote:

> Hello Craig,
>
> Do you mean reschedule interval = 1 hour and reschedule times = 3?
>
> Best regards,
> Ana
> Em ter, 21 de jul de 2015 às 19:29, Craig Shiroma <
> shiroma.crai...@gmail.com> escreveu:
>
>> Hello,
>>
>> I had a backup that failed this morning due to what looks like a network
>> problem.
>>
>> First error email:
>> 2015-07-21 04:49:42 JobId 118277: Error: lib/bsock.c:693 Write
>> error sending 65813 bytes to Storage daemon::9103:
>> ERR=Input/output error
>> 2015-07-21 04:49:42 JobId 118277: Fatal error: filed/backup.c:1282
>> Network send error to SD. ERR=Input/output error
>> ...
>> FD termination status:  Error
>> SD termination status:  Error
>> Termination:*** Backup Error ***
>>
>> 2015-07-21 04:49:57bacula-dir JobId 118277: Rescheduled Job
>> .2015-07-20_18.00.03_31 at 21-Jul-2015 04:49 to re-run in 3600
>> seconds (21-Jul-2015 05:49).
>>
>> I have Retry set to 3 and retry interval set to 1 hour.  However, the
>> retry was canceled as seen below.  I'm wondering how I should interpret the
>> below messages.  Did Bacula notice the job was still running when it tried
>> to reschedule the job and then cancel it right then (practically at the
>> same time the above error occurred)?  Or, did it actually try to re-run the
>> job right after the error instead of one hour later (5:49) and cancel the
>> job?  If so, why did it try to re-run the job right after the error instead
>> of one hour later?
>>
>> Second error email:
>> 2015-07-21 04:49:57bacula-dir JobId 118594: Fatal error: JobId 118277
>> already running. Duplicate job not allowed.
>> 2015-07-21 04:49:57bacula-dir JobId 118594: Bacula bacula-dir 7.0.5
>> (28Jul14):
>>
>> FD termination status:
>> SD termination status:
>> Termination:Backup Canceled
>>
>>
>>
>> Best regards,
>> Craig
>>
>> --
>> Don't Limit Your Business. Reach for the Cloud.
>> GigeNET's Cloud Solutions provide you with the tools and support that
>> you need to offload your IT needs and focus on growing your business.
>> Configured For All Businesses. Start Your Cloud Today.
>> https://www.gigenetcloud.com/
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>
--
Don't Limit Your Business. Reach for the Cloud.
GigeNET's Cloud Solutions provide you with the tools and support that
you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Backup Retry

[Craig Shiroma]

Hello,

I had a backup that failed this morning due to what looks like a network
problem.

First error email:
2015-07-21 04:49:42 JobId 118277: Error: lib/bsock.c:693 Write error
sending 65813 bytes to Storage daemon::9103: ERR=Input/output error
2015-07-21 04:49:42 JobId 118277: Fatal error: filed/backup.c:1282
Network send error to SD. ERR=Input/output error
...
FD termination status:  Error
SD termination status:  Error
Termination:*** Backup Error ***

2015-07-21 04:49:57bacula-dir JobId 118277: Rescheduled Job
.2015-07-20_18.00.03_31 at 21-Jul-2015 04:49 to re-run in 3600
seconds (21-Jul-2015 05:49).

I have Retry set to 3 and retry interval set to 1 hour.  However, the retry
was canceled as seen below.  I'm wondering how I should interpret the below
messages.  Did Bacula notice the job was still running when it tried to
reschedule the job and then cancel it right then (practically at the same
time the above error occurred)?  Or, did it actually try to re-run the job
right after the error instead of one hour later (5:49) and cancel the job?
If so, why did it try to re-run the job right after the error instead of
one hour later?

Second error email:
2015-07-21 04:49:57bacula-dir JobId 118594: Fatal error: JobId 118277
already running. Duplicate job not allowed.
2015-07-21 04:49:57bacula-dir JobId 118594: Bacula bacula-dir 7.0.5
(28Jul14):

FD termination status:
SD termination status:
Termination:Backup Canceled



Best regards,
Craig
--
Don't Limit Your Business. Reach for the Cloud.
GigeNET's Cloud Solutions provide you with the tools and support that
you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Incremental backups

[Craig Shiroma]

Hello,

I was wondering what incremental does the next incremental after a failed
one use to decide which files to back up?  Also, what happens in the below
situation (case 2) if the failed incremental backed up some data?

Case 1:

Sun  Full OK
Mon Incremental OK
Tue Incremental OK
Wed Incremental Failed, 0 bytes backed up
Thu Incremental OK
Fri Incremental OK
Sat Incremental OK

Case 2:
Sun  Full OK
Mon Incremental OK
Tue Incremental OK
Wed Incremental Failed, 800 MB backed up
Thu Incremental OK
Fri Incremental OK
Sat Incremental OK

My apologies if this is documented in the Bacula Manual (I would appreciate
the page number).

Thank you in advance,
Craig Shiroma
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] client/server passwords

[Craig Shiroma]

Thanks Bill!  I appreciate the help and information.  Looks like I have
some reading to do.

-craig

On Wed, May 6, 2015 at 3:07 PM, Bill Arlofski  wrote:

> On 05/05/2015 10:18 PM, Craig Shiroma wrote:
> > Hi Romeo,
> >
> > Thanks!  Just so I understand correctly...
> > The bacula-fd running on the clients communicate with the bacula server
> using
> > the password in client's bacula-fd.conf.  This authentication on the
> "wire" is
> > actually encrypted.  Is this correct?
> >
> > -craig
>
> Hi Craig,
>
> Keep in mind that all of the actual backup data and other communications is
> unencrypted unless TLS between daemons is configured in Bacula: DIR->SD,
> DIR->FD, FD->SD, bconsole->DIR, (and SD->FD in the case of SD calls Client)
>
> One simple method to encrypt communications between daemons is to use an
> excellent open-source tool called "stunnel" (documented in the Bacula
> misc.pdf
> manual)
>
> Depending on your requirements, stunnel, a VPN (IPsec, OpenVPN or other),
> ssh
> tunnels, or a full-blown TLS deployment are all possible options to secure
> Bacula's daemon<-->daemon communications.
>
> Some are more complex and time consuming to implement than others, but may
> be
> more (verifiably) secure, so these considerations need to be a part of the
> requirements discussion. :)
>
> Bill
>
>
>
> --
> Bill Arlofski
> Reverse Polarity, LLC
> http://www.revpol.com/
> -- Not responsible for anything below this line --
>
>
> --
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] client/server passwords

[Craig Shiroma]

Hi Romeo,

Thanks!  Just so I understand correctly...
The bacula-fd running on the clients communicate with the bacula server
using the password in client's bacula-fd.conf.  This authentication on the
"wire" is actually encrypted.  Is this correct?

-craig


On Tue, May 5, 2015 at 3:43 PM, Romeo Theriault  wrote:

> Hi Craig,
>
> See [1]:
>
> You should restrict access to the Bacula configuration files, so that the
>> passwords are not world-readable. The Bacula daemons are password protected
>> using CRAM-MD5 (i.e. the password is not sent across the network). This
>> will ensure that not everyone can access the daemons. It is a reasonably
>> good protection, but can be cracked by experts.
>
>
>
> [1]
> http://www.bacula.org/5.1.x-manuals/en/main/main/Bacula_Security_Issues.html
>
> On Tue, May 5, 2015 at 8:35 PM, Craig Shiroma 
> wrote:
>
>> Hello,
>>
>> I was wondering...
>> Are all of the passwords exchanges used by Bacula (both server and client
>> daemons) encrypted when going over the "wire"?
>>
>> Thanks in advance,
>> Craig Shiroma
>>
>>
>> --
>> One dashboard for servers and applications across Physical-Virtual-Cloud
>> Widest out-of-the-box monitoring support with 50+ applications
>> Performance metrics, stats and reports that give you Actionable Insights
>> Deep dive visibility with transaction tracing using APM Insight.
>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>>
>
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] client/server passwords

[Craig Shiroma]

Hello,

I was wondering...
Are all of the passwords exchanges used by Bacula (both server and client
daemons) encrypted when going over the "wire"?

Thanks in advance,
Craig Shiroma
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restoring to different host

[Craig Shiroma]

Thank you everyone for the information and advice!  I appreciate it.

-craig

On Fri, May 1, 2015 at 4:38 AM, Dimitri Maziuk 
wrote:

> On 2015-05-01 08:14, Josh Fisher wrote:
> >
> ... The
> > crux of the issue is that a backup app like Bacula is anti-SELinux by
> > nature, since it must have read/write access to every single file on the
> > system.
>
> The crux of the issue is that selinux is based on "everything is
> forbidden except what's explicitly permitted" security model. Which is
> only acceptable if you like living in a straightjacket.
>
> Dan Walsh must be a sobbing wreck by now just from the number of times I
> typed "yum rm selinux-policy". (And I bet he has a seizure every time
> someone installs a debian-derived distro.)
>
> Dimitri
>
>
>
> --
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restoring to different host

[Craig Shiroma]

Sorry, I meant to say, I know I can do various things to selinux to get
things to work.  But, I was wondering if there is a "best practice"
solution for dealing with this problem?

Thanks!

On Thu, Apr 30, 2015 at 12:25 PM, Craig Shiroma 
wrote:

> Hi Frank,
>
> Thank you very much for the info!  Yes, this is a RHEL 6.6 box that I'm
> trying to restore to.  After using Romeo's check, it seems selinux is
> blocking the restore.
>
> Is there a best practice for dealing with this situation?
>
> Thanks again,
> -craig
>
>
> On Thu, Apr 30, 2015 at 4:06 AM, Frank Sweetser  wrote:
>
>>
>> Is this a RedHat/CentOS box?  They've recently made some changes to the
>> selinux configuration around bacula which prevents it from taking pretty
>> much
>> any action other thank backups, including running scripts or creating
>> files.
>>
>> Frank Sweetser fs at wpi.edu|  For every problem, there is a
>> solution that
>> Manager of Network Operations   |  is simple, elegant, and wrong.
>> Worcester Polytechnic Institute |   - HL Mencken
>>
>> On 4/29/2015 9:01 PM, Craig Shiroma wrote:
>> > Hello,
>> >
>> > I'm trying to a restore file to a different host's /tmp.  I've select
>> the
>> > target host by changing the value of Restore Client during the restore
>> > process, selecting the desired target host to restore to from the hosts
>> list
>> > presented.  However, when I attempt the restore, I get the following
>> error
>> > message:
>> >
>> > 2015-04-29 14:30:09 JobId 83765: Error: makepath.c:142
>> Cannot
>> > create directory /tmp/etc: ERR=Permission denied
>> >
>> > Any idea what could be causing the problem?  Restoring to the source
>> host is
>> > no problem.
>> >
>> > Note: I replaced the actual hostname with "" in the
>> above
>> > error message.
>> >
>> > Thanks in advance,
>> >
>> > -Craig
>> >
>> >
>> >
>> >
>> --
>> > One dashboard for servers and applications across Physical-Virtual-Cloud
>> > Widest out-of-the-box monitoring support with 50+ applications
>> > Performance metrics, stats and reports that give you Actionable Insights
>> > Deep dive visibility with transaction tracing using APM Insight.
>> > http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>> >
>> >
>> >
>> > ___
>> > Bacula-users mailing list
>> > Bacula-users@lists.sourceforge.net
>> > https://lists.sourceforge.net/lists/listinfo/bacula-users
>> >
>>
>>
>> --
>> One dashboard for servers and applications across Physical-Virtual-Cloud
>> Widest out-of-the-box monitoring support with 50+ applications
>> Performance metrics, stats and reports that give you Actionable Insights
>> Deep dive visibility with transaction tracing using APM Insight.
>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>
>
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restoring to different host

[Craig Shiroma]

Hi Frank,

Thank you very much for the info!  Yes, this is a RHEL 6.6 box that I'm
trying to restore to.  After using Romeo's check, it seems selinux is
blocking the restore.

Is there a best practice for dealing with this situation?

Thanks again,
-craig


On Thu, Apr 30, 2015 at 4:06 AM, Frank Sweetser  wrote:

>
> Is this a RedHat/CentOS box?  They've recently made some changes to the
> selinux configuration around bacula which prevents it from taking pretty
> much
> any action other thank backups, including running scripts or creating
> files.
>
> Frank Sweetser fs at wpi.edu|  For every problem, there is a solution
> that
> Manager of Network Operations   |  is simple, elegant, and wrong.
> Worcester Polytechnic Institute |       - HL Mencken
>
> On 4/29/2015 9:01 PM, Craig Shiroma wrote:
> > Hello,
> >
> > I'm trying to a restore file to a different host's /tmp.  I've select the
> > target host by changing the value of Restore Client during the restore
> > process, selecting the desired target host to restore to from the hosts
> list
> > presented.  However, when I attempt the restore, I get the following
> error
> > message:
> >
> > 2015-04-29 14:30:09 JobId 83765: Error: makepath.c:142
> Cannot
> > create directory /tmp/etc: ERR=Permission denied
> >
> > Any idea what could be causing the problem?  Restoring to the source
> host is
> > no problem.
> >
> > Note: I replaced the actual hostname with "" in the
> above
> > error message.
> >
> > Thanks in advance,
> >
> > -Craig
> >
> >
> >
> >
> --
> > One dashboard for servers and applications across Physical-Virtual-Cloud
> > Widest out-of-the-box monitoring support with 50+ applications
> > Performance metrics, stats and reports that give you Actionable Insights
> > Deep dive visibility with transaction tracing using APM Insight.
> > http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> >
> >
> >
> > ___
> > Bacula-users mailing list
> > Bacula-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
> >
>
>
> --
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restoring to different host

[Craig Shiroma]

Hi Romeo,

Yes, as root on the target host, I can create /tmp/etc.  Kind of strange.

Thanks,
-craig

On Wed, Apr 29, 2015 at 3:53 PM, Romeo Theriault  wrote:

> If you go onto the host yourself, as root can you create "etc" in /tmp?
>
> On Wed, Apr 29, 2015 at 9:01 PM, Craig Shiroma 
> wrote:
>
>> Hello,
>>
>> I'm trying to a restore file to a different host's /tmp.  I've select the
>> target host by changing the value of Restore Client during the restore
>> process, selecting the desired target host to restore to from the hosts
>> list presented.  However, when I attempt the restore, I get the following
>> error message:
>>
>> 2015-04-29 14:30:09 JobId 83765: Error: makepath.c:142
>> Cannot create directory /tmp/etc: ERR=Permission denied
>>
>> Any idea what could be causing the problem?  Restoring to the source host
>> is no problem.
>>
>> Note: I replaced the actual hostname with "" in the
>> above error message.
>>
>> Thanks in advance,
>>
>> -Craig
>>
>>
>> --
>> One dashboard for servers and applications across Physical-Virtual-Cloud
>> Widest out-of-the-box monitoring support with 50+ applications
>> Performance metrics, stats and reports that give you Actionable Insights
>> Deep dive visibility with transaction tracing using APM Insight.
>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>>
>
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Restoring to different host

[Craig Shiroma]

Hello,

I'm trying to a restore file to a different host's /tmp.  I've select the
target host by changing the value of Restore Client during the restore
process, selecting the desired target host to restore to from the hosts
list presented.  However, when I attempt the restore, I get the following
error message:

2015-04-29 14:30:09 JobId 83765: Error: makepath.c:142
Cannot create directory /tmp/etc: ERR=Permission denied

Any idea what could be causing the problem?  Restoring to the source host
is no problem.

Note: I replaced the actual hostname with "" in the above
error message.

Thanks in advance,

-Craig
--
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Newbie Bacula Questions

[Craig Shiroma]

Hi Ana, Josip,

Thank you for the info!  It's much appreciated.

Ana, thanks for the tip on the compression, but I'm backing up to disk.

-craig

On Thu, Apr 16, 2015 at 10:16 AM, Ana Emília M. Arruda <
emiliaarr...@gmail.com> wrote:

> I was talking about tape drives hardware compression if this is your case.
>
> On Thu, Apr 16, 2015 at 5:14 PM, Ana Emília M. Arruda <
> emiliaarr...@gmail.com> wrote:
>
>> Hi Craig,
>>
>> If you are using tape drives (standalone or autochangers) it is almost
>> always a better option than software compression.
>>
>> Best regards,
>> Ana
>>
>> On Thu, Apr 16, 2015 at 5:05 PM, Craig Shiroma > > wrote:
>>
>>> Hi John,
>>>
>>> Thank you very much!  I appreciate the help!
>>>
>>> Have a great day,
>>> -craig
>>>
>>> On Thu, Apr 16, 2015 at 10:02 AM, John Drescher 
>>> wrote:
>>>
>>>> On Thu, Apr 16, 2015 at 3:44 PM, Craig Shiroma
>>>>  wrote:
>>>> > Hello,
>>>> >
>>>> > I just started using Bacula.  I apologize if the below questions have
>>>> been
>>>> > asked and answered before.
>>>> >
>>>> > If a backup job is canceled, when the job starts the next day, does it
>>>> > continue where it left off or does Bacula start the backup from the
>>>> > beginning?
>>>> >
>>>> From the beginning.
>>>> >
>>>> > When compression is used, is the compression done on the client side
>>>> or the
>>>> > server side?
>>>>
>>>> Client side
>>>>
>>>> John
>>>>
>>>
>>>
>>>
>>> --
>>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
>>> Develop your own process in accordance with the BPMN 2 standard
>>> Learn Process modeling best practices with Bonita BPM through live
>>> exercises
>>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
>>> event?utm_
>>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
>>> ___
>>> Bacula-users mailing list
>>> Bacula-users@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>>
>>>
>>
>
--
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Newbie Bacula Questions

[Craig Shiroma]

Hi John,

Thank you very much!  I appreciate the help!

Have a great day,
-craig

On Thu, Apr 16, 2015 at 10:02 AM, John Drescher 
wrote:

> On Thu, Apr 16, 2015 at 3:44 PM, Craig Shiroma
>  wrote:
> > Hello,
> >
> > I just started using Bacula.  I apologize if the below questions have
> been
> > asked and answered before.
> >
> > If a backup job is canceled, when the job starts the next day, does it
> > continue where it left off or does Bacula start the backup from the
> > beginning?
> >
> From the beginning.
> >
> > When compression is used, is the compression done on the client side or
> the
> > server side?
>
> Client side
>
> John
>
--
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Newbie Bacula Questions

[Craig Shiroma]

Hello,

I just started using Bacula.  I apologize if the below questions have been
asked and answered before.

If a backup job is canceled, when the job starts the next day, does it
continue where it left off or does Bacula start the backup from the
beginning?

When compression is used, is the compression done on the client side or the
server side?

Thanks in advance,
-Craig
--
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users