Re: [Bacula-users] Backups to S3
On 1/18/2020 4:06 AM, Radosław Korzeniewski wrote: Hello, pt., 17 sty 2020 o 23:24 Dimitri Maziuk via Bacula-users < bacula-users@lists.sourceforge.net> napisał(a): Please let us know how much you end up paying, too: 4TB NAS HDD is about a hundred bucks, one-off, You are absolutely right when this is the first and only one storage copy of your backups. But when it is a second off-site copy then it becomes harder to maintain a low price. Then something like S3 will help a lot. That is why/when I started looking at amanda and bacula. My university runs a backup service where we only pay for storage. We ran with it for a couple of years and the money quickly added up to where it was cheaper to buy a new storage chassis full of sata drives *every other year* and have it co-located at CompSci a few blocks away. The only way I can see this working out is you absolutely must have your backups of-site and have absolutely nowhere to colocate your backup box, or if your colo charges will be comparable to S3. Dima ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Error: bsock.c:429 Write error sending 65536 bytes to Storage daemon:xxxx:9103: ERR=broken pipe
Hello, sob., 18 sty 2020 o 11:55 Marco Marino napisał(a): > I cannot enable jumbo frames because client and server are 2 hops away and > I cannot modify the network. They use public ips for connection, so I can > only reduce MTU server side. > OK. > Why is there an improvement of reliability when MTU = 1400 in your opinion? > I've made a guess in my previous email: > I bet you have some kind of network packet encapsulation on your backup >> path. A firewall or vpn, right? >> > it is a well known issue on this kind of network. best regards -- Radosław Korzeniewski rados...@korzeniewski.net ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] AWS VTL + Bacula
HI Who RestoreStorage? show config of RestoreStorage. Device aws.vtlchanger is autochanger. On Thu, Jan 16, 2020 at 10:59 AM Bruno Vane wrote: > Hello all, > > I'm trying a new, fresh deploy of bacula 9.4.2 and AWS VTL. > The thing is: I can make manual backups and scheduled backups runs fine as > well, problem is when bacula asks to mount one volume to a different drive > (tape), sometimes it asks it on backup and ALWAYS ask it on restore, so my > backup sometimes stuck and I can't do ANY restore at all. > > > Before I try to run restore: > > Autochanger "aws.vtlchanger" with devices: >"aws.vtldrive.01" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-01-lun-0-nst) >"aws.vtldrive.02" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-02-lun-0-nst) >"aws.vtldrive.03" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-03-lun-0-nst) >"aws.vtldrive.04" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-04-lun-0-nst) > > Device "RestoreStorage" is not open or does not exist. > == > > Device Tape is "aws.vtldrive.01" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-01-lun-0-nst) > mounted with: > Volume: Diario-0005 > Pool:Pool_Diario > Media type: ULT3580-TD5 > Total Bytes=9,098,514,432 Blocks=141,035 Bytes/block=64,512 > Positioned at File=11 Block=0 >Drive 0 is not loaded. > == > > Device Tape is "aws.vtldrive.02" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-02-lun-0-nst) > mounted with: > Volume: Vol-0008 > Pool:*unknown* > Media type: ULT3580-TD5 > Total Bytes Read=0 Blocks Read=0 Bytes/block=0 > Positioned at File=0 Block=0 >Drive 1 is not loaded. > == > > Device Tape is "aws.vtldrive.03" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-03-lun-0-nst) > mounted with: > Volume: Vol-0002 > Pool:*unknown* > Media type: ULT3580-TD5 > Total Bytes Read=0 Blocks Read=0 Bytes/block=0 > Positioned at File=0 Block=0 >Drive 2 is not loaded. > == > > Device Tape is "aws.vtldrive.04" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-04-lun-0-nst) > mounted with: > Volume: Diario-0010 > Pool:*unknown* > Media type: ULT3580-TD5 > Total Bytes Read=0 Blocks Read=0 Bytes/block=0 > Positioned at File=0 Block=0 >Drive 3 is not loaded. > == > > > Used Volume status: > Reserved volume: Diario-0005 on Tape device "aws.vtldrive.01" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-01-lun-0-nst) > Reader=0 writers=0 reserves=0 volinuse=0 worm=0 > Reserved volume: Diario-0010 on Tape device "aws.vtldrive.04" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-04-lun-0-nst) > Reader=0 writers=0 reserves=0 volinuse=0 worm=0 > Reserved volume: Vol-0002 on Tape device "aws.vtldrive.03" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-03-lun-0-nst) > Reader=0 writers=0 reserves=0 volinuse=0 worm=0 > Reserved volume: Vol-0008 on Tape device "aws.vtldrive.02" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-02-lun-0-nst) > Reader=0 writers=0 reserves=0 volinuse=0 worm=0 > > > > After I try to run restore: > Device status: > Autochanger "aws.vtlchanger" with devices: >"aws.vtldrive.01" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-01-lun-0-nst) >"aws.vtldrive.02" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-02-lun-0-nst) >"aws.vtldrive.03" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-03-lun-0-nst) >"aws.vtldrive.04" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-04-lun-0-nst) > > Device "RestoreStorage" is not open or does not exist. > == > > Device Tape is "aws.vtldrive.01" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-01-lun-0-nst) > mounted with: > Volume: Diario-0005 > Pool:Pool_Diario > Media type: ULT3580-TD5 > Total Bytes=9,098,514,432 Blocks=141,035 Bytes/block=64,512 > Positioned at File=11 Block=0 >Drive 0 is not loaded. > == > > Device Tape is "aws.vtldrive.02" > (/dev/tape/by-path/ip-192.168.1.250:3260-iscsi-iqn.1997-05.com.amazon:sgw-ae9b7ac7-tapedrive-02-lun-0-nst) > mounted with: > Volume: Vol-0008 > Pool:*unknown* > Media type: ULT3580-TD5 > Total Bytes
Re: [Bacula-users] Error: bsock.c:429 Write error sending 65536 bytes to Storage daemon:xxxx:9103: ERR=broken pipe
I cannot enable jumbo frames because client and server are 2 hops away and I cannot modify the network. They use public ips for connection, so I can only reduce MTU server side. Why is there an improvement of reliability when MTU = 1400 in your opinion? Il giorno sab 18 gen 2020 alle ore 10:56 Radosław Korzeniewski < rados...@korzeniewski.net> ha scritto: > Hello, > > Thanks for the update. > > sob., 18 sty 2020 o 09:36 Marco Marino napisał(a): > >> It seems that setting MTU = 1400 on the server solves the problem. >> > > So, it indeed was a network problem then. :) > > >> I'm doing a lot of tests with large backup (150GB, 1.5hours long). I will >> update this thread if the problem persists. >> > > For the best network performance you should raise MTU value up to 9000 > ensuring all your network equipment support it and not lower it to less > than 1500. > I bet you have some kind of network packet encapsulation on your backup > path. A firewall or vpn, right? > > best regards > > >> Thank you >> >> Il giorno gio 16 gen 2020 alle ore 16:21 Radosław Korzeniewski < >> rados...@korzeniewski.net> ha scritto: >> >>> Hello, >>> >>> pon., 13 sty 2020 o 20:44 Marco Marino >>> napisał(a): >>> so please don't tell me that the problem is the network >>> >>> It depends. You did not show any logs, so it is a bit hard to judge what >>> is going on your site. >>> >>> Please can you give me some advise? I don't know how to solve nor how to debug this problem. If I launch bacula with maximum debug level I don't see any interesting information related to the problem. >>> >>> Could you please show us your failed job logs? >>> >>> thanks >>> -- >>> Radosław Korzeniewski >>> rados...@korzeniewski.net >>> >> > > -- > Radosław Korzeniewski > rados...@korzeniewski.net > ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Issue with config setting "Max Virtual Full Interval"
Hello, pt., 10 sty 2020 o 10:38 Shaligram Bhagat, Yateen (Nokia - IN/Bangalore) < yateen.shaligram_bha...@nokia.com> napisał(a): > Hi all, > > > > I am using bacula v 9.4.4 on Centos 6.4. for disk file based backup. > Let's start simple. > 10-Jan 13:54 bacula-server-dir JobId 5738: Warning: This Job is not an > Accurate backup so is not equivalent to a Full backup. > Start correcting obvious issues which job is reporting. > 10-Jan 13:54 bacula-server-dir JobId 5738: Using Device "DeviceF1" to > write. 10-Jan 13:54 bacula-server-sd JobId 5738: Fatal error: Read and write > devices not properly initialized. Virtual full require a single device to read previous data and a single device to write consolidated job. It requires to read previous (virtual)full job and then all incremental ones. It means you have to ensure that Bacula has two devices configured and it can read required data, ie. the previous and the current virtual full do not share a volume. You should review your configuration and corrects errors. Then it start working. I hope it helps. best regards -- Radosław Korzeniewski rados...@korzeniewski.net ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backups to S3
Hello, pt., 17 sty 2020 o 23:24 Dimitri Maziuk via Bacula-users < bacula-users@lists.sourceforge.net> napisał(a): > Please let us know how much you end up paying, too: 4TB NAS HDD is about > a hundred bucks, one-off, You are absolutely right when this is the first and only one storage copy of your backups. But when it is a second off-site copy then it becomes harder to maintain a low price. Then something like S3 will help a lot. best regards -- Radosław Korzeniewski rados...@korzeniewski.net ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Error: bsock.c:429 Write error sending 65536 bytes to Storage daemon:xxxx:9103: ERR=broken pipe
Hello, Thanks for the update. sob., 18 sty 2020 o 09:36 Marco Marino napisał(a): > It seems that setting MTU = 1400 on the server solves the problem. > So, it indeed was a network problem then. :) > I'm doing a lot of tests with large backup (150GB, 1.5hours long). I will > update this thread if the problem persists. > For the best network performance you should raise MTU value up to 9000 ensuring all your network equipment support it and not lower it to less than 1500. I bet you have some kind of network packet encapsulation on your backup path. A firewall or vpn, right? best regards > Thank you > > Il giorno gio 16 gen 2020 alle ore 16:21 Radosław Korzeniewski < > rados...@korzeniewski.net> ha scritto: > >> Hello, >> >> pon., 13 sty 2020 o 20:44 Marco Marino napisał(a): >> >>> so please don't tell me that the problem is the network >>> >> >> It depends. You did not show any logs, so it is a bit hard to judge what >> is going on your site. >> >> >>> Please can you give me some advise? I don't know how to solve nor how to >>> debug this problem. If I launch bacula with maximum debug level I don't see >>> any interesting information related to the problem. >>> >> >> Could you please show us your failed job logs? >> >> thanks >> -- >> Radosław Korzeniewski >> rados...@korzeniewski.net >> > -- Radosław Korzeniewski rados...@korzeniewski.net ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Baculum beta1 - packages
Hello, There are available testing package repositories with Baculum beta1. If you want to try it, you can use the following repositories: Debian 9 Stretch: deb http://bacula.org/downloads/baculum/testing/debian stretch main deb-src http://bacula.org/downloads/baculum/testing/debian stretch main Debian 10 Buster: deb http://bacula.org/downloads/baculum/testing/debian buster main deb-src http://bacula.org/downloads/baculum/testing/debian buster main Ubuntu 16.04 Xenial: deb [ arch=amd64 ] http://bacula.org/downloads/baculum/testing/ubuntu xenial main deb-src http://bacula.org/downloads/baculum/testing/ubuntu xenial main Ubuntu 18.04 Bionic: deb [ arch=amd64 ] http://bacula.org/downloads/baculum/testing/ubuntu bionic main deb-src http://bacula.org/downloads/baculum/testing/ubuntu bionic main CentOS 7: [baculumrepo] name=Baculum CentOS repository baseurl=http://bacula.org/downloads/baculum/testing/centos gpgcheck=1 enabled=1 CentOS 8: [baculumrepo] name=Baculum CentOS repository baseurl=http://bacula.org/downloads/baculum/testing/centos8 gpgcheck=1 enabled=1 Please don't forget to import key if you don't have it: For DEB packages: wget -qO - http://bacula.org/downloads/baculum/baculum.pub | apt-key add - For RPM packages: rpm --import http://bacula.org/downloads/baculum/baculum.pub Please note that for CentOS are available two new packages: - baculum-api-selinux - baculum-web-selinux Testing packages for Fedora are temporary unavailable. They will be available later. For installation instruction please follow on Baculum chapter in the Console Manual for version 9.4. Installation process is still actual there: https://www.bacula.org/9.4.x-manuals/en/console/Baculum_API_Web_GUI_Tools.html Thank you for using Baculum and for your help with making Baculum better. Best regards, Marcin Haba (gani) -- "Greater love hath no man than this, that a man lay down his life for his friends." Jesus Christ "Większej miłości nikt nie ma nad tę, jak gdy kto życie swoje kładzie za przyjaciół swoich." Jezus Chrystus ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Authentication at Baculum [SOLVED]
Hello Ricardo, It is good to hear, that you solved problem with authentication and that you prepared HTML form changes for that. Yes, every contribution is welcome. Information about contributing in Bacula project you can find here: https://www.bacula.org/what-is-bacula/making-contributions/ You can share a patch with your changes. I will look at it. Thanks in advance. Best regards, Marcin Haba (gani) On Sat, 18 Jan 2020 at 01:14, Ricardo Aragão da Silva wrote: > > Hi, > > I solved the problem. > > Now my Baculum have a version of authentication using Prado Auth with a > simple HTML Form. I implemented using same file (htpasswd) of users. > > If this is an important feature for project, I can make a pull request. > > Thanks for your attention. > > Regards, > > Ricardo > > On Jan 17, 2020, at 12:13 AM, Ricardo Aragão da Silva > wrote: > > Hi guys, > > I disabled Auth Basic and works fine. Now I’m trying add a Prado Auth > customized.It works fine the authentication, but after login nothing data is > loaded. > > This error is showed to me : > > > > I think that I need set more some thing to works fine. I already set > $_SERVER[‘PHP_AUTH_USER’]. > > Someone had this problem? > > Thanks > > Ricardo > > > > On Jan 4, 2020, at 2:10 PM, Rasmus Linden wrote: > > Hi Ricardo! > I have baculum ( or its actually apache doing the lifting) authenticate > against my companies ldap server. > Works like a charm, highly recommendable solution. > All the best > Ras > > > On 5 Jan 2020, at 5:47 am, Marcin Haba wrote: > > Hello Ricardo, > > Yes, it is possible to disable Auth Basic in Baculum Web. To do that > you need to disable Auth Basic in your web server config file for > Baculum Web and then you need to do a workaround in code by defining > default Baculum Web user in gui/baculum/protected/Web/Init.php file, > somewhere at the beginning of this file, for example: > > $_SERVER['PHP_AUTH_USER'] = 'admin'; > $_SERVER['PHP_AUTH_PW'] = 'admin'; > > This way Baculum Web will default use this user/pass to work without Auth > Basic. > > For other methods, unfortunately HTML form nor OAuth2 for Baculum Web > are not supported. > > I hope it helps. > > Best regards, > Marcin Haba (gani) > > On Sat, 4 Jan 2020 at 00:32, Ricardo Aragão da Silva > wrote: > > > Hi guys, > > Someone knows if is possible disable Auth Basic of the Baculum or change for > other Auth type, like HTML form, for example ? Or use oauth2 to auth to web? > > Thanks > > Ricardo > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > > > > > -- > "Greater love hath no man than this, that a man lay down his life for > his friends." Jesus Christ > > "Większej miłości nikt nie ma nad tę, jak gdy kto życie swoje kładzie > za przyjaciół swoich." Jezus Chrystus > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- "Greater love hath no man than this, that a man lay down his life for his friends." Jesus Christ "Większej miłości nikt nie ma nad tę, jak gdy kto życie swoje kładzie za przyjaciół swoich." Jezus Chrystus ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
