Hello,
I try to migrate a bigger job from three tapes to two disks.
I use a USB3-SATA Disk swapping station which have at all the same SCSI-ID
so I can use same /dev-node.
I use a mountpoint /median/baculadisk2
Each Disk has only write rights by root user so the bacula user can only
write on files which allready exists.
The Labeled file instead has write/read rights for bacula:tape so
bacula can write, clear and read the file, but cannot create new
files in this mount point.
To label a new disk I create a fs, mount it in /baculadisk2
and create a empty file like DISK018 and set the permissions
-rw-rw---- for bacula:tape.
A label command for the diskstorage2 device with name DISK018
will be then finished successfully and the file can be filled up
as long enough space is available on the disk.
If a job will needs more space than is available, the job will be
fill up the disk and then request for a new volume. So I unmount
the volume in bacula by unmounting the configured storage device.
Than I put out the USB-3 plug, switch of the bay, replace the
disk by another one (e.g. a labeled disk), switch on the bay and
plug in the USB connector.
Then the disk inode is created so a bacula mount command will
mount the filesystem and the labeled file is available in
/media/baculadisk2. The backup/migrate job will continue in
this volume (file) as long the backup/migration is finished.
Problem:
I want to migrate the job now back from the two disks to tapes,
so I configured a job which should do it by selecting jobid.
For first all looks fine: The jobs starts and bacula asks for
the first of the two disks. I mount the requested disks and
the migration starts.
After a couple of ours the job arrives the end of the file
(volume) and asks for the next disk.
I umount the 1st and mount the 2nd disk and the job continues.
By the way the migration job ends with an error which looks like
identified by a problem which was produced at the end of
the first disk, because the last block was truncated?
If so I wonder me that the migration to the disk has been
worked without problems.
Here the jobs output which I got via mail. First the migration
from tape to disk then back from disk to tape.
Maybe you can explain what the problem is.
Maybe it is only a single random problem hopefully it is not
a problem because of truncated last block of 1st disk.
In my opinion like on tapes it should reread and than rewritten
to the 2nd disk.
21-Mar 20:23 backup-dir JobId 47703: The following 1 JobId was chosen to be
migrated: 46802
21-Mar 20:23 backup-dir JobId 47703: Migration using JobId=46802
Job=nihilnihil_home.2020-01-05_23.50.01_29
21-Mar 20:23 backup-dir JobId 47703: Start Migration JobId 47703,
Job=Migrate2FileTmpVol.2020-03-21_20.23.31_48
21-Mar 20:23 backup-dir JobId 47703: Using Device "HPUltrium4-2" to read.
21-Mar 20:23 backup-sd JobId 47703: 3307 Issuing autochanger "unload Volume
LTO40027, Slot 5, Drive 1" command.
21-Mar 20:27 backup-sd JobId 47703: 3304 Issuing autochanger "load Volume
LTO40026, Slot 9, Drive 1" command.
21-Mar 20:28 backup-sd JobId 47703: 3305 Autochanger "load Volume LTO40026,
Slot 9, Drive 1", status is OK.
21-Mar 20:28 backup-sd JobId 47703: Ready to read from volume "LTO40026" on
Tape device "HP Ultrium 4-2" (/dev/tape/by-id/scsi-HU19145705-nst).
21-Mar 20:28 backup-sd JobId 47703: Forward spacing Volume "LTO40026" to
addr=19:1457
22-Mar 00:36 backup-sd JobId 47703: End of Volume "LTO40026" at addr=628:5763
on device "HP Ultrium 4-2" (/dev/tape/by-id/scsi-HU19145705-nst).
22-Mar 00:37 backup-sd JobId 47703: 3307 Issuing autochanger "unload Volume
LTO40026, Slot 9, Drive 1" command.
22-Mar 00:38 backup-sd JobId 47703: 3304 Issuing autochanger "load Volume
LTO40025, Slot 17, Drive 1" command.
22-Mar 00:40 backup-sd JobId 47703: 3305 Autochanger "load Volume LTO40025,
Slot 17, Drive 1", status is OK.
22-Mar 00:40 backup-sd JobId 47703: Ready to read from volume "LTO40025" on
Tape device "HP Ultrium 4-2" (/dev/tape/by-id/scsi-HU19145705-nst).
22-Mar 00:40 backup-sd JobId 47703: Forward spacing Volume "LTO40025" to
addr=1:11779
22-Mar 05:33 backup-sd JobId 47703: End of Volume "LTO40025" at addr=0:0 on
device "HP Ultrium 4-2" (/dev/tape/by-id/scsi-HU19145705-nst).
22-Mar 05:33 backup-sd JobId 47703: 3307 Issuing autochanger "unload Volume
LTO40025, Slot 17, Drive 1" command.
22-Mar 05:34 backup-sd JobId 47703: 3304 Issuing autochanger "load Volume
LTO40027, Slot 5, Drive 1" command.
22-Mar 05:36 backup-sd JobId 47703: 3305 Autochanger "load Volume LTO40027,
Slot 5, Drive 1", status is OK.
22-Mar 05:36 backup-sd JobId 47703: Ready to read from volume "LTO40027" on
Tape device "HP Ultrium 4-2" (/dev/tape/by-id/scsi-HU19145705-nst).
22-Mar 05:36 backup-sd JobId 47703: Forward spacing Volume "LTO40027" to
addr=0:1
22-Mar 10:32 backup-sd JobId 47703: End of Volume "LTO40027" at addr=298:0 on
device "HP Ultrium 4-2" (/dev/tape/by-id/scsi-HU19145705-nst).
22-Mar 10:32 backup-sd JobId 47703: Elapsed time=14:03:10, Transfer rate=21.39
M Bytes/second
22-Mar 12:21 backup-dir JobId 47703: Bacula backup-dir 9.4.2 (04Feb19):
Build OS: x86_64-pc-linux-gnu debian buster/sid
Prev Backup JobId: 46802
Prev Backup Job: nihilnihil_home.2020-01-05_23.50.01_29
New Backup JobId: 47704
Current JobId: 47703
Current Job: Migrate2FileTmpVol.2020-03-21_20.23.31_48
Backup Level: Full
Client: backup-fd
FileSet: "Full Set" 2017-10-09 08:53:50
Read Pool: "Monthly" (From Job resource)
Read Storage: "FibreCAT TX48 S2" (From Pool resource)
Write Pool: "Migrate" (From Job Pool's NextPool resource)
Write Storage: "Disk2" (From Job Pool's NextPool resource)
Catalog: "MyCatalog" (From Client resource)
Start time: 21-Mar-2020 20:23:34
End time: 22-Mar-2020 12:16:45
Elapsed time: 15 hours 53 mins 11 secs
Priority: 21
SD Files Written: 1,030,385
SD Bytes Written: 1,082,331,572,757 (1.082 TB)
Rate: 18924.9 KB/s
Volume name(s): DISK016|DISK017
Volume Session Id: 41
Volume Session Time: 1584646035
Last Volume Bytes: 110,838,413,473 (110.8 GB)
SD Errors: 0
SD termination status: OK
Termination: Migration OK
<<< Here I am missing the DISK016 to DISK017 replacement request messages.
By the way they were found in extra mails >>>>
22-Mar 07:47 backup-sd JobId 47704:
WARNING: device is full! Please add more disk space then ...
Please mount append Volume "DISK016" or label a new one for:
Job: nihilnihil_home.2020-03-21_20.23.31_49
Storage: "DiskStorage2" (/media/baculadisk2)
Pool: Migrate
Media type: Disk
Before got this message I purged DISK017 so now the bacula asks for DISK017:
22-Mar 09:11 backup-sd JobId 47704: Please mount append Volume "DISK017" or
label a new one for:
Job: nihilnihil_home.2020-03-21_20.23.31_49
Storage: "DiskStorage2" (/media/baculadisk2)
Pool: Migrate
Media type: Disk
So it coninued with DISK017
Here the migration from disk to tape:
23-Mar 08:19 backup-dir JobId 47731: Migration using JobId=47704
Job=nihilnihil_home.2020-03-21_20.23.31_49
23-Mar 08:19 backup-dir JobId 47731: Start Migration JobId 47731,
Job=MigrateFile2Drive.2020-03-23_08.19.25_17
23-Mar 08:33 backup-sd JobId 47731: JobId=47731, Job
MigrateFile2Drive.2020-03-23_08.19.25_17 waiting to reserve a device.
… removed repeated lines
23-Mar 13:13 backup-sd JobId 47731: JobId=47731, Job
MigrateFile2Drive.2020-03-23_08.19.25_17 waiting to reserve a device.
23-Mar 13:16 backup-dir JobId 47731: Using Device "DiskStorage2" to read.
23-Mar 13:20 backup-sd JobId 47731: Warning: acquire.c:235 Read open File
device "DiskStorage2" (/media/baculadisk2) Volume "DISK016" failed:
ERR=file_dev.c:190 Could not
open(/media/baculadisk2/DISK016,OPEN_READ_ONLY,0640): ERR=No such file or
directory
23-Mar 13:20 backup-sd JobId 47731: Please mount read Volume "DISK016" for:
Job: MigrateFile2Drive.2020-03-23_08.19.25_17
Storage: "DiskStorage2" (/media/baculadisk2)
Pool: Migrate
Media type: Disk
23-Mar 14:20 backup-sd JobId 47731: Please mount read Volume "DISK016" for:
Job: MigrateFile2Drive.2020-03-23_08.19.25_17
Storage: "DiskStorage2" (/media/baculadisk2)
Pool: Migrate
Media type: Disk
23-Mar 16:24 backup-sd JobId 47731: Please mount read Volume "DISK016" for:
Job: MigrateFile2Drive.2020-03-23_08.19.25_17
Storage: "DiskStorage2" (/media/baculadisk2)
Pool: Migrate
Media type: Disk
23-Mar 18:27 backup-sd JobId 47731: Ready to read from volume "DISK016" on File
device "DiskStorage2" (/media/baculadisk2).
23-Mar 18:27 backup-sd JobId 47731: Forward spacing Volume "DISK016" to addr=217
>>>>
23-Mar 23:36 backup-sd JobId 47731: Error: block.c:682 [SE0208] Volume data
error at 0:0! Short block of 57010 bytes on device "DiskStorage2"
(/media/baculadisk2) discarded.
Maybe this line shows the problem?
<<<<
23-Mar 23:36 backup-sd JobId 47731: Error: read_records.c:160 block.c:682
[SE0208] Volume data error at 0:0! Short block of 57010 bytes on device
"DiskStorage2" (/media/baculadisk2) discarded.
23-Mar 23:36 backup-sd JobId 47731: End of Volume "DISK016" at
addr=972406571008 on device "DiskStorage2" (/media/baculadisk2).
23-Mar 23:36 backup-sd JobId 47731: Warning: acquire.c:235 Read open File
device "DiskStorage2" (/media/baculadisk2) Volume "DISK017" failed:
ERR=file_dev.c:190 Could not
open(/media/baculadisk2/DISK017,OPEN_READ_ONLY,0640): ERR=No such file or
directory
23-Mar 23:36 backup-sd JobId 47731: Please mount read Volume "DISK017" for:
Job: MigrateFile2Drive.2020-03-23_08.19.25_17
Storage: "DiskStorage2" (/media/baculadisk2)
Pool: Migrate
Media type: Disk
24-Mar 00:36 backup-sd JobId 47731: Please mount read Volume "DISK017" for:
Job: MigrateFile2Drive.2020-03-23_08.19.25_17
Storage: "DiskStorage2" (/media/baculadisk2)
Pool: Migrate
Media type: Disk
24-Mar 02:36 backup-sd JobId 47731: Please mount read Volume "DISK017" for:
Job: MigrateFile2Drive.2020-03-23_08.19.25_17
Storage: "DiskStorage2" (/media/baculadisk2)
Pool: Migrate
Media type: Disk
24-Mar 06:36 backup-sd JobId 47731: Please mount read Volume "DISK017" for:
Job: MigrateFile2Drive.2020-03-23_08.19.25_17
Storage: "DiskStorage2" (/media/baculadisk2)
Pool: Migrate
Media type: Disk
24-Mar 08:40 backup-sd JobId 47731: Ready to read from volume "DISK017" on File
device "DiskStorage2" (/media/baculadisk2).
24-Mar 08:40 backup-sd JobId 47731: Forward spacing Volume "DISK017" to addr=213
24-Mar 09:40 backup-sd JobId 47731: End of Volume "DISK017" at
addr=110838477984 on device "DiskStorage2" (/media/baculadisk2).
24-Mar 09:40 backup-sd JobId 47731: Elapsed time=15:12:21, Transfer rate=19.77
M Bytes/second
24-Mar 11:29 backup-dir JobId 47731: Warning: Found errors during the migration
process. The original job 47704 will be kept in the catalog and the Migration
job will be marked in Error
24-Mar 11:29 backup-dir JobId 47731: Error: bsock.c:388 Wrote 4 bytes to
Storage daemon:backup.localnet.cosmicstars.de:9103, but only 0 accepted.
24-Mar 11:29 backup-dir JobId 47731: Error: Bacula backup-dir 9.4.2 (04Feb19):
Build OS: x86_64-pc-linux-gnu debian buster/sid
Prev Backup JobId: 47704
Prev Backup Job: nihilnihil_home.2020-03-21_20.23.31_49
New Backup JobId: 47732
Current JobId: 47731
Current Job: MigrateFile2Drive.2020-03-23_08.19.25_17
Backup Level: Full
Client: backup-fd
FileSet: "Full Set" 2017-10-09 08:53:50
Read Pool: "Migrate" (From Command input)
Read Storage: "Disk2" (From Pool resource)
Write Pool: "Monthly" (From Command input)
Write Storage: "FibreCAT TX48 S2" (From Command input)
Catalog: "MyCatalog" (From Client resource)
Start time: 23-Mar-2020 13:16:16
End time: 24-Mar-2020 11:29:02
Elapsed time: 22 hours 12 mins 46 secs
Priority: 21
SD Files Written: 1,030,385
SD Bytes Written: 1,082,331,572,757 (1.082 TB)
Rate: 13534.9 KB/s
Volume name(s): LTO40025|LTO40035
Volume Session Id: 66
Volume Session Time: 1584646035
Last Volume Bytes: 334,145,323,008 (334.1 GB)
SD Errors: 2
SD termination status: OK
Termination: *** Migration Error ***
In my opinion the job should be possible to migrate without errors.
Cheers,
Pierre
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
