Hi,
(back from Barcelona :-)
04.04.2009 10:58, Kern Sibbald wrote:
> I believe that this behavior is because Bacula has two "schedulers": 1. is
> the job scheduling function that starts jobs at the scheduled hour (as
> determined in the Run directive). 2. is the jobq, which is a sort of
> scheduler, which comes into play after the job is started but before it is
> run. The jobq -- short for Job queue -- is responsible for allocating
> resources (tape drives) for the job, rescheduling it if it failed, holding it
> if the priority is not right, ...
>
> Currently the status command only shows jobs that will be scheduled within a
> period of time (48 hours by default if I remember right) or jobs that are
> running. Jobs that are being held in the job queue are not listed.
Hmm... might be. I'll try to recreate the issue to further investigate
- unfortunately, from an issue-fixing point of view, the original
problem vanished all by itself :-)
If it's related to the "Allow Duplicate Jobs" together with the Max
time settings I guess I can easily create a situation where the thing
might happen again, and then I'll be running with debug output... if I
can't recreate it, I'll assume it's been magically fixed by some
intermediate update :-)
Cheers,
Arno
> Regards,
>
> Kern
>
> On Sunday 29 March 2009 22:44:38 Arno Lehmann wrote:
>> Hi,
>>
>> 29.03.2009 22:21, Kern Sibbald wrote:
>>> On Sunday 29 March 2009 21:38:29 Arno Lehmann wrote:
>>>> Hi,
>>>>
>>>> I'm currently testing 2.5.42 (svn as of Mar 24, I believe) and have
>>>> the following set in the defaults for all jobs:
>>>>
>>>> Allow Duplicate Jobs = No
>>>> Allow Mixed Priority = Yes # doesn't apply as of now...
>>>> Max Run Sched Time = 3600 # 1 hour
>>>> Max Run Time = 1800 # 1/2 hour
>>>> Max Wait Time = 1200 # 20 min
>>>>
>>>> All jobs are run every 15 minutes with different levels.
>>> You talk about scheduling problems, but show only a JobDefs. I don't see
>>> the connection, and thus without a schedule resource and a Job resource,
>>> I cannot confirm anything.
>> Well, as stated, the schedules *work* correctly, they just aren't
>> displayed. But ok:
>>
>> JobDefs {
>> Name = DefaultDemo
>> Type = Backup
>> Level = Incremental
>> Client = gnom-fd
>> FileSet = Demo1Set
>> Storage = File
>> Messages = Standard
>> Pool = Default
>> Priority = 10
>> Accurate = Yes
>> Spool Data = Yes
>> Spool Attributes = Yes
>> Allow Duplicate Jobs = No
>> Allow Mixed Priority = Yes
>> Max Run Sched Time = 3600
>> Max Run Time = 1800
>> Max Wait Time = 1200
>> }
>>
>> Job {
>> Name = Demo1
>> JobDefs = DefaultDemo
>> Write Bootstrap = /var/demo-bacula/Demo1.bsr
>> Schedule = Demo
>> }
>>
>> Job {
>> Name = Demo2
>> JobDefs = DefaultDemo
>> Client = neuelf-fd
>> FileSet = Demo2Set
>> Write Bootstrap = /var/demo-bacula/Demo2.bsr
>> Schedule = Demo
>> }
>>
>> Job {
>> Name = Demo3
>> JobDefs = DefaultDemo
>> Client = balrog-fd
>> FileSet = Demo2Set
>> Write Bootstrap = /var/demo-bacula/Demo3.bsr
>> Schedule = Demo
>> }
>>
>> Job {
>> Name = DemoWin
>> JobDefs = DefaultDemo
>> Client = phoenix-fd
>> FileSet = DemoWinSet
>> Write Bootstrap = /var/demo-bacula/DemoWin.bsr
>> Schedule = Demo
>> Accurate = No
>> Pool = Tier1
>> }
>>
>> Job {
>> Name = "BackupCatalog"
>> JobDefs = "DefaultJob"
>> Level = Full
>> FileSet="Catalog"
>> Schedule = "WeeklyCycleAfterBackup"
>> RunBeforeJob = "/usr/local/demo-bacula/etc/make_catalog_backup
>> demobacula demobacula '' neuelf"
>> RunAfterJob = "/usr/local/demo-bacula/etc/delete_catalog_backup"
>> Write Bootstrap = "/var/demo-bacula/BackupCatalog.bsr"
>> Priority = 11 # run after main backup
>> }
>>
>> Job {
>> Name = "MigratePhoenix"
>> Pool = Tier1
>> Type = Migrate
>> Selection Type = SQLQuery
>> Selection Pattern = "SELECT Job.JobId FROM Job,Client,Pool WHERE
>> (Job.ClientId=Client.ClientId AND Client.Name='phoen
>> ix-fd' AND EndTime<DATE_SUB(NOW(), interval 1 day) AND
>> Job.JobStatus='T' AND Job.Type='B' AND Job.Level='F' AND Job.Poo
>> lId=Pool.PoolId AND Pool.Name='Tier1' AND Job.PriorJobId=0) ORDER BY
>> Job.EndTime ASC LIMIT 1;"
>> Messages = Standard
>> Client = phoenix-fd
>> FileSet = "Full Set"
>> Schedule = MigrationDemo
>> }
>>
>> Job {
>> Name = "CopyDemo3"
>> Pool = Default
>> Type = Copy
>> Selection Type = SQLQuery
>> Selection Pattern ="SELECT Job.JobId FROM Job,Client,Pool WHERE
>> (Job.ClientId=Client.ClientId AND Client.Name='balrog
>> -fd' AND EndTime>DATE_SUB(NOW(), interval 1 day) AND Job.JobStatus='T'
>> AND Job.Type='B' AND Job.Level='F' AND Job.PoolI
>> d=Pool.PoolId AND Pool.Name='Default') ORDER BY Job.EndTime DESC LIMIT 1;"
>> Messages = Standard
>> Client = balrog-fd
>> FileSet = "Full Set"
>> }
>>
>> FileSet {
>> Name = DemoWinSet
>> Include {
>> Options {
>> signature = SHA1
>> }
>> File = "c:/testbackups/"
>> }
>> }
>>
>> FileSet {
>> Name = Demo1Set
>> Include {
>> Options {
>> signature = SHA1
>> }
>> File = /usr/local/demo-bacula/stuff
>> }
>> }
>>
>> FileSet {
>> Name = Demo2Set
>> Include {
>> Options {
>> signature = SHA1
>> }
>> File = /var/adm/backup
>> }
>> }
>>
>> FileSet {
>> Name = "Full Set"
>> Include {
>> Options {
>> signature = MD5
>> }
>> File = /
>> }
>> Exclude {
>> File = /proc
>> File = /tmp
>> File = /.journal
>> File = /.fsck
>> }
>> }
>>
>> Schedule {
>> Name = "WeeklyCycle"
>> Run = Full 1st sun at 23:05
>> Run = Differential 2nd-5th sun at 23:05
>> Run = Incremental mon-sat at 23:05
>> }
>>
>> Schedule {
>> Name = Demo
>> Run = Level=Full hourly at 0:30
>> Run = Level=Differential hourly at 0:00
>> Run = Level=Incremental hourly at 0:15
>> Run = Level=Incremental hourly at 0:45
>> }
>>
>> Schedule {
>> Name = MigrationDemo
>> Run = daily at 23:25
>> Run = daily at 5:23
>> Run = daily at 11:23
>> Run = daily at 17:23
>> }
>> Schedule {
>> Name = "WeeklyCycleAfterBackup"
>> Run = Full sun-sat at 23:10
>> }
>>
>> FileSet {
>> Name = "Catalog"
>> Include {
>> Options {
>> signature = MD5
>> }
>> File = /var/demo-bacula/demobacula.sql
>> }
>> }
>>
>> Client {
>> Name = gnom-fd
>> Address = gnom
>> FDPort = 59001
>> Catalog = MyCatalog
>> Password = "it's"
>> File Retention = 5 days
>> Job Retention = 10 days
>> AutoPrune = yes
>> }
>>
>> Client {
>> Name = phoenix-fd
>> Address = phoenix
>> FDPort = 9102
>> Catalog = MyCatalog
>> Password = "very"
>> File Retention = 5 days
>> Job Retention = 10 days
>> AutoPrune = Yes
>> }
>>
>> Client {
>> Name = neuelf-fd
>> Address = neuelf
>> FDPort = 9102
>> Catalog = MyCatalog
>> Password = "secret"
>> File Retention = 5 days
>> Job Retention = 10 days
>> AutoPrune = Yes
>> }
>>
>> Client {
>> Name = balrog-fd
>> Address = balrog
>> Catalog = MyCatalog
>> Password = "indeed"
>> File Retention = 5 days
>> Job Retention = 10 days
>> AutoPrune = Yes
>> }
>>
>> Arno
>>
>>> Kern
>>>
>>>> DIR config excerpts:
>>>>
>>>> JobDefs {
>>>> Name = "DefaultJob"
>>>> Type = Backup
>>>> Level = Incremental
>>>> Client = gnom-fd
>>>> FileSet = "Full Set"
>>>> Schedule = "WeeklyCycle"
>>>> Storage = File
>>>> Messages = Standard
>>>> Pool = Default
>>>> Priority = 10
>>>> Allow Duplicate Jobs = No
>>>> Allow Mixed Priority = Yes
>>>> Max Run Sched Time = 3600
>>>> Max Run Time = 1800
>>>> Max Wait Time = 1200
>>>> }
>>>>
>>>> With these settings, the scheduler queue display is incorrect. See here:
>>>>> *autom
>>>>> Turn on or off? off
>>>>> *time
>>>>> 29-Mär-2009 21:29:03
>>>>> *sta dir
>>>>> demo-dir Version: 2.5.42-b2 (16 March 2009) i686-pc-linux-gnu suse 11.1
>>>>> Daemon started 29-Mär009 21:28, 0 Jobs run since started.
>>>> DIR freshly started to make sure I didn't mess up anything earlier...
>>>>
>>>>> Heap: heap=270,336 smbytes=64,080 max_bytes=64,633 bufs=356
>>>>> max_bufs=358
>>>>>
>>>>> Scheduled Jobs:
>>>>> Level Type Pri Scheduled Name
>>>>> Volume
>>>>> =======================================================================
>>>>> == ==========
>>>> No jobs scheduled before the BackupCatalog, i.e. at 21:30, 21:45,
>>>> 22:00, etc.?!
>>>>
>>>>> Full Backup 11 29-Mär009 23:10 BackupCatalog
>>>>> FIL0537 Migrate 10 29-Mär009 23:25 MigratePhoenix
>>>>> Differential Backup 10 30-Mär009 00:00 Demo1
>>>>> FIL0537 Differential Backup 10 30-Mär009 00:00 DemoWin
>>>>> FIL0258 Differential Backup 10 30-Mär009 00:00 Demo3
>>>>> FIL0537 Differential Backup 10 30-Mär009 00:00 Demo2
>>>>> FIL0537 Incremental Backup 10 30-Mär009 00:15 Demo1
>>>>> FIL0537 Incremental Backup 10 30-Mär009 00:15 Demo2
>>>>> FIL0537 Incremental Backup 10 30-Mär009 00:15 Demo3
>>>>> FIL0537 Incremental Backup 10 30-Mär009 00:15
>>>>> DemoWin FIL0258 Full Backup 10 30-Mär009 00:30
>>>>> Demo1 FIL0537 Full Backup 10 30-Mär009
>>>>> 00:30 Demo2 FIL0537 Full Backup 10
>>>>> 30-Mär009 00:30 Demo3 FIL0537 Full Backup
>>>>> 10 30-Mär009 00:30 DemoWin FIL0258 Incremental Backup
>>>>> 10 30-Mär009 00:45 Demo1 FIL0537 Incremental
>>>>> Backup 10 30-Mär009 00:45 Demo2 FIL0537 Incremental
>>>>> Backup 10 30-Mär009 00:45 Demo3 FIL0537
>>>>> Incremental Backup 10 30-Mär009 00:45 DemoWin
>>>>> FIL0258 Migrate 10 30-Mär009 05:23 MigratePhoenix
>>>>> Migrate 10 30-Mär009 11:23 MigratePhoenix
>>>>> Migrate 10 30-Mär009 17:23 MigratePhoenix
>>>>> ====
>>>>>
>>>>> Running Jobs:
>>>>> Console connected at 29-Mär009 21:28
>>>>> Console connected at 29-Mär009 21:28
>>>>> No Jobs running.
>>>>> ====
>>>>>
>>>>> Terminated Jobs:
>>>>> JobId Level Files Bytes Status Finished Name
>>>>> ====================================================================
>>>>> 2596 Incr 10 255.5 K OK 29-Mär009 21:20
>>>>> DemoWin.2009-03-29_17 2595 Full 10 255.5 K OK
>>>>> 29-Mär009 21:20 MigratePhoenix.2009-03-29_17 2659 Incr 0
>>>>> 0 OK 29-Mär009 21:20 Demo3.2009-03-29_21 2658 Incr 0
>>>>> 0 OK 29-Mär009 21:20 Demo2.2009-03-29_21 2656 Diff
>>>>> 0 0 Error 29-Mär009 21:20 DemoWin.2009-03-29_21 2657
>>>>> Incr 64 2.447 K OK 29-Mär009 21:20 Demo1.2009-03-29_21 2660
>>>>> Incr 0 0 OK 29-Mär009 21:21
>>>>> DemoWin.2009-03-29_21 2600 Full 18 262.5 K OK
>>>>> 29-Mär009 21:21 DemoWin.2009-03-29_17 2604 Incr 0 0
>>>>> OK 29-Mär009 21:22 DemoWin.2009-03-29_17 2608 Diff 0
>>>>> 0 OK 29-Mär009 21:22 DemoWin.2009-03-29_18
>>>>>
>>>>> ====
>>>> Wait a bit...
>>>>
>>>>> *time
>>>>> 29-Mär-2009 21:30:40
>>>>> You have messages.
>>>>> *sta dir
>>>>> demo-dir Version: 2.5.42-b2 (16 March 2009) i686-pc-linux-gnu suse 11.1
>>>>> Daemon started 29-Mär009 21:28, 1 Job run since started.
>>>>> Heap: heap=389,120 smbytes=113,893 max_bytes=124,942 bufs=514
>>>>> max_bufs=549
>>>>>
>>>>> Scheduled Jobs:
>>>>> Level Type Pri Scheduled Name
>>>>> Volume
>>>>> =======================================================================
>>>>> == ==========
>>>> Still nothing new scheduled.
>>>>
>>>>> Full Backup 11 29-Mär009 23:10 BackupCatalog
>>>>> FIL0537 Migrate 10 29-Mär009 23:25 MigratePhoenix
>>>>> Differential Backup 10 30-Mär009 00:00 Demo1
>>>>> FIL0537 Differential Backup 10 30-Mär009 00:00 DemoWin
>>>>> FIL0258 Differential Backup 10 30-Mär009 00:00 Demo3
>>>>> FIL0537 Differential Backup 10 30-Mär009 00:00 Demo2
>>>>> FIL0537 Incremental Backup 10 30-Mär009 00:15 Demo1
>>>>> FIL0537 Incremental Backup 10 30-Mär009 00:15 Demo2
>>>>> FIL0537 Incremental Backup 10 30-Mär009 00:15 Demo3
>>>>> FIL0537 Incremental Backup 10 30-Mär009 00:15
>>>>> DemoWin FIL0258 Full Backup 10 30-Mär009 00:30
>>>>> Demo1 FIL0537 Full Backup 10 30-Mär009
>>>>> 00:30 Demo2 FIL0537 Full Backup 10
>>>>> 30-Mär009 00:30 Demo3 FIL0537 Full Backup
>>>>> 10 30-Mär009 00:30 DemoWin FIL0258 Incremental Backup
>>>>> 10 30-Mär009 00:45 Demo1 FIL0537 Incremental
>>>>> Backup 10 30-Mär009 00:45 Demo2 FIL0537 Incremental
>>>>> Backup 10 30-Mär009 00:45 Demo3 FIL0537
>>>>> Incremental Backup 10 30-Mär009 00:45 DemoWin
>>>>> FIL0258 Migrate 10 30-Mär009 05:23 MigratePhoenix
>>>>> Migrate 10 30-Mär009 11:23 MigratePhoenix
>>>>> Migrate 10 30-Mär009 17:23 MigratePhoenix
>>>>> ====
>>>> But:
>>>>> Running Jobs:
>>>>> Console connected at 29-Mär009 21:28
>>>>> Console connected at 29-Mär009 21:28
>>>>> JobId Level Name Status
>>>>> ======================================================================
>>>>> 2662 Full Demo2.2009-03-29_21.30.00.05 is running
>>>>> 2663 Full Demo3.2009-03-29_21.30.00.06 is running
>>>>> 2664 Full DemoWin.2009-03-29_21.30.00.07 is waiting on Storage
>>>>> File ====
>>>>>
>>>>> Terminated Jobs:
>>>>> JobId Level Files Bytes Status Finished Name
>>>>> ====================================================================
>>>>> 2595 Full 10 255.5 K OK 29-Mär009 21:20
>>>>> MigratePhoenix.2009-03-29_17 2659 Incr 0 0 OK
>>>>> 29-Mär009 21:20 Demo3.2009-03-29_21 2658 Incr 0 0
>>>>> OK 29-Mär009 21:20 Demo2.2009-03-29_21 2656 Diff 0 0
>>>>> Error 29-Mär009 21:20 DemoWin.2009-03-29_21 2657 Incr 64
>>>>> 2.447 K OK 29-Mär009 21:20 Demo1.2009-03-29_21 2660 Incr 0
>>>>> 0 OK 29-Mär009 21:21 DemoWin.2009-03-29_21 2600 Full 18
>>>>> 262.5 K OK 29-Mär009 21:21 DemoWin.2009-03-29_17 2604 Incr
>>>>> 0 0 OK 29-Mär009 21:22
>>>>> DemoWin.2009-03-29_17 2608 Diff 0 0 OK
>>>>> 29-Mär009 21:22 DemoWin.2009-03-29_18 2661 Full 1,017 65.49 K
>>>>> OK 29-Mär009 21:30 Demo1.2009-03-29_21
>>>> And this one is already finished...
>>>>
>>>> And I did not start any jobs manually, by the way :-)
>>>>
>>>> So, for some reason, something breaks the scheduler display, but the
>>>> scheduler itself works correctly.
>>>>
>>>> This might be related to the above mentioned settings as I did not
>>>> observe this behaviour before I inserted that to the job defaults.
>>>>
>>>> Can anybody confirm this?
>>>>
>>>> Arno
>>>>
>>>>> ====
>>>>> *quit
>
>
>
--
Arno Lehmann
IT-Service Lehmann
Sandstr. 6, 49080 Osnabrück
www.its-lehmann.de
------------------------------------------------------------------------------
_______________________________________________
Bacula-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/bacula-devel
