Re: [Bacula-users] Configuring autochanger with SAS LTO-5 drives
Hi, Thank you, Rudolf. This is very useful information! Thank you for taking effort to benchmark this. Best, Ivan On Friday, June 23, 2017 03:53:04 PM Cejka Rudolf wrote: > Cejka Rudolf wrote (2017/06/05): > > Cejka Rudolf wrote (2017/06/02): > > > Ivan Adzhubey wrote (2017/06/01): > > > > b) What is the effect of MaximumFileSize option and what would be its > > > > optimal value for my IBM LTO-5 SAS drives? I have used 8GB value > > > > found in one of the list posts, while the documentation suggests 2GB > > > > for LTO-4. But even set at 8GB this would create lots of EOF marks on > > > > a 1.5TB tape, do we really need so many? > > > > > > Hi, I do use 16 GB. Every EOF mark means around 3 seconds delay. So if > > > you have over 200 files on the tape using 8 GB, it is around 10 minutes > > > extra per tape.> > > Hi, small fix. It seems that it is even around 5-6 seconds delay resulting > > in extra 20 minutes per tape. And worse, I'm afraid that the tape drive > > do not stop nor slowdown tape movement, which would mean over 10 % of the > > tape lost because of filemarks. Hope that I'm wrong. > > Hi, I finally have done and finished real testing with Maximum File Size > option. Tested on LTO-6 drive with LTO-5 tape, so the results are relevant > for LTO-5, used btape utility and fill s (simplified) command. > > Fortunately, I has negligible impact on tape capacity, but unfortunately, I > has really dramatical impact on overall write speed and you have to count > not just 5-6 seconds, but better 8-10 seconds per file. I also added time > to read one file at 140 MB/s, which is important for seeking during > restores. > > File Simplified Simplified Bytes Files Rough time to > sizefill timefill rate written written read one file > > 1 GB 6:44:1861.8 MB/s 1498688192512 1499 00:00:07 > 2 GB 4:51:3085.7 MB/s 1498737278976 750 00:00:14 > 4 GB 3:54:57 106.3 MB/s 1498762641408 375 00:00:29 > 8 GB 3:24:22 122.2 MB/s 1499224932352 188 00:00:57 > 16 GB 3:11:09 130.7 MB/s 149945640550494 00:01:54 > 32 GB 3:04:35 135.4 MB/s 149969030348847 00:03:49 > 64 GB 3:01:17 137.8 MB/s 149957496012824 00:07:37 > 128 GB 2:59:37 139.1 MB/s 149960366489612 00:15:14 > > And it seems that the results are perfectly reproducible. Three successive > tests with 16 GB file size have had exactly the same fill time 3:11:09! > Tests were done by mistake, when I wondered how it is possible that the > time stays exactly the same :o) > > Regards. The information in this e-mail is intended only for the person to whom it is addressed. If you believe this e-mail was sent to you in error and the e-mail contains patient information, please contact the Partners Compliance HelpLine at http://www.partners.org/complianceline . If the e-mail was sent to you in error but does not contain patient information, please contact the sender and properly dispose of the e-mail. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Configuring autochanger with SAS LTO-5 drives
Cejka Rudolf wrote (2017/06/05): > Cejka Rudolf wrote (2017/06/02): > > Ivan Adzhubey wrote (2017/06/01): > > > b) What is the effect of MaximumFileSize option and what would be its > > > optimal > > > value for my IBM LTO-5 SAS drives? I have used 8GB value found in one of > > > the > > > list posts, while the documentation suggests 2GB for LTO-4. But even set > > > at > > > 8GB this would create lots of EOF marks on a 1.5TB tape, do we really > > > need so > > > many? > > > > Hi, I do use 16 GB. Every EOF mark means around 3 seconds delay. So if you > > have > > over 200 files on the tape using 8 GB, it is around 10 minutes extra per > > tape. > > Hi, small fix. It seems that it is even around 5-6 seconds delay resulting in > extra 20 minutes per tape. And worse, I'm afraid that the tape drive do not > stop nor slowdown tape movement, which would mean over 10 % of the tape lost > because of filemarks. Hope that I'm wrong. Hi, I finally have done and finished real testing with Maximum File Size option. Tested on LTO-6 drive with LTO-5 tape, so the results are relevant for LTO-5, used btape utility and fill s (simplified) command. Fortunately, I has negligible impact on tape capacity, but unfortunately, I has really dramatical impact on overall write speed and you have to count not just 5-6 seconds, but better 8-10 seconds per file. I also added time to read one file at 140 MB/s, which is important for seeking during restores. File Simplified Simplified Bytes Files Rough time to sizefill timefill rate written written read one file 1 GB 6:44:1861.8 MB/s 1498688192512 1499 00:00:07 2 GB 4:51:3085.7 MB/s 1498737278976 750 00:00:14 4 GB 3:54:57 106.3 MB/s 1498762641408 375 00:00:29 8 GB 3:24:22 122.2 MB/s 1499224932352 188 00:00:57 16 GB 3:11:09 130.7 MB/s 149945640550494 00:01:54 32 GB 3:04:35 135.4 MB/s 149969030348847 00:03:49 64 GB 3:01:17 137.8 MB/s 149957496012824 00:07:37 128 GB 2:59:37 139.1 MB/s 149960366489612 00:15:14 And it seems that the results are perfectly reproducible. Three successive tests with 16 GB file size have had exactly the same fill time 3:11:09! Tests were done by mistake, when I wondered how it is possible that the time stays exactly the same :o) Regards. -- Rudolf Cejka http://www.fit.vutbr.cz/~cejkar Brno University of Technology, Faculty of Information Technology Bozetechova 2, 612 66 Brno, Czech Republic -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] MyCatalog job fails
From: Brian Blater
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] MyCatalog job fails
Message-ID:
Content-Type: text/plain; charset="utf-8"
After several successful Catalog backups I'm all of a sudden getting the
following error in my backup:
JobId 137: BeforeJob: Can't find your catalog (MyCatalog) in director
configuration
If I look in bacula-dir.conf I see the following:
# Generic catalog service
Catalog {
Name = MyCatalog
dbname = "bacula"; DB Address = "localhost"; dbuser = "bacula";
dbpassword = "*"
}
So I'm not sure why this has stopped working. Any ideas for me to look for?
All the other jobs complete successfully.
Thanks,
Brian
We have fixed this error by fixing ownerships and permissions on
/etc/bacula/*.conf files and our /etc/bacula/conf.d tree (we use a
non-standard modular configuration scheme).
Working ownerships and permissions on /etc/bacula/*.conf files:
root@backup2:/etc/bacula# ls -l *.conf
-rw-r- 1 root bacula 2357 Aug 9 2016 bacula-dir.conf
-rw-r- 1 root root941 Aug 3 2016 bacula-fd.conf
-rw-r- 1 root root 2414 Apr 18 11:35 bacula-sd.conf
-rw-r- 1 root root179 Jul 19 2016 bconsole.conf
-rw-r- 1 root root587 Jul 19 2016 tray-monitor.conf
For the tree we have fixed with:
find /etc/bacula/conf.d -exec chown root:bacula {} +
find /etc/bacula/conf.d -type d -exec chmod 755 {} +
find /etc/bacula/conf.d -type f -exec chmod 640 {} +
Charles
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
