Re: [Bacula-users] AWS S3 Backup

2019-07-19 Thread William Muriithi 
Ken,

Slightly unrelated but still think it fit well on this thread.

One of the purpose of using tapes is so that one can remove it later from the 
system and make it only physically available.  In case the system is 
compromised, you still have something that can only be destroyed by someone 
local to the data owners.

If one is using S3, how does bacula prevent a case like the Florida city where 
they had backups, but the backups were reachable from the compromised system?

Just trying to see if there is something I am missing as this solution seem to 
have a hole from my point of view.

Regards,
William


From: Kern Sibbald 
Sent: July 19, 2019 6:50:03 AM
To: Bryan Sockel; Bryan Sockel via Bacula-users 
(bacula-users@lists.sourceforge.net)
Subject: Re: [Bacula-users] AWS S3 Backup


On 7/18/19 10:14 PM, Bryan Sockel wrote:
Looking over my setup again.  I am not sure if the S3 Cloud driver is being 
compiled correctly.  How can i tell to see if the if it was compiled correctly.

I am following the process here: 
https://stackoverflow.com/questions/12172504/installing-the-libs3-on-linux but 
with the drivers from the bacula.org website.  I am never able to find the 
dependencies in step 5.  Tried installing the 2 rpm's created with the the 
nodep switch.



Thank You

From: "Bryan Sockel 
(bryan.soc...@mdaemon.com<mailto:bryan.soc...@mdaemon.com>)" 
<mailto:bryan.soc...@mdaemon.com>
To: "Bryan Sockel" <mailto:bryan.soc...@mdaemon.com>, 
"Bryan Sockel via Bacula-users 
(bacula-users@lists.sourceforge.net<mailto:bacula-users@lists.sourceforge.net>)"
 
<mailto:bacula-users@lists.sourceforge.net>,
 "Kern Sibbald (k...@sibbald.com<mailto:k...@sibbald.com>)" 
<mailto:k...@sibbald.com>
Date: Thu, 18 Jul 2019 10:11:07 -0500
Subject: Re: [Bacula-users] AWS S3 Backup

Should i be concerned that the plugins are being Rejected?

plugins.c:133-0 Rejected plugin: want=-sd.so name=s3 len=2
plugins.c:133-0 Rejected plugin: want=-sd.so name=libnss3.so len=10
plugins.c:133-0 Rejected plugin: want=-sd.so name=libs3.so.3 len=10


These objects (files) are not Bacula plugins.  I suspect that your definition 
of the PluginDirectory is not pointing to the Bacula plugins directory.

You are probably using some old distro supplied configuration, which installs 
Bacula in may directories on your filesystem -- this is *very* bad particularly 
for disaster recovery.  I recommend that you remove all old binaries, rebuild 
with the recommended Bacula ./configure set (installs almost everything in 
/opt/bacula/...).  Then try again.

Best regards,

Kern




Thank You,

Bryan Sockel
Systems Administrator
o: 817-601-3222 ext: 233e: 
bryan.soc...@mdaemon.com<mailto:bryan.soc...@mdaemon.com>

MDaemon Technologies<http://www.mdaemon.com>
Simple Secure Email

Visit us on Facebook<https://www.facebook.com/MDaemon.Technologies/> | 
LinkedIn<https://www.linkedin.com/company/alt-n-technologies-mdaemon-/> | 
YouTube<https://www.youtube.com/user/AltNtechnologies>

Sent using the MDaemon Messaging Server<http://www.mdaemon.com/>

From: "Bryan Sockel via Bacula-users 
(bacula-users@lists.sourceforge.net<mailto:bacula-users@lists.sourceforge.net>)"
 <mailto:bacula-users@lists.sourceforge.net>
To: "Kern Sibbald (k...@sibbald.com<mailto:k...@sibbald.com>)" 
<mailto:k...@sibbald.com>, 
bacula-users@lists.sourceforge.net<mailto:bacula-users@lists.sourceforge.net>
Date: Thu, 18 Jul 2019 08:04:17 -0500
Subject: Re: [Bacula-users] AWS S3 Backup

Hello,

Here is the requested Information:

Plugin Directory = "/usr/lib64"
ls  /usr/lib64/bacula-sd-cloud-driver-9.4.4.so
/usr/lib64/bacula-sd-cloud-driver-9.4.4.so


bacula-sd -d20
[root@bacula bacula]# bacula-sd: address_conf.c:274-0 Initaddr 0.0.0.0:9103
bacula-sd: init_dev.c:435-0 Open SD driver at 
/usr/lib64/bacula-sd-cloud-driver-9.4.4.so
bacula-sd: bnet_server.c:86-0 Addresses 0.0.0.0:9103
bacula-sd: init_dev.c:440-0 Lookup "BaculaSDdriver" in driver=cloud
bacula-sd: init_dev.c:442-0 Driver=cloud entry point=7f295e762e90
bacula-sd: stored.c:610-0 SD init done CloudStorage-1
List plugins. Hook count=0
List plugins. Hook count=0


status storage=Cloud
Connecting to Storage daemon Cloud at bacula:9103
bacula-sd Version: 9.4.4 (28 May 2019) x86_64-pc-linux-gnu redhat (Core)
Daemon started 18-Jul-19 07:48. Jobs: run=0, running=0.
 Heap: heap=135,168 smbytes=31,242 max_bytes=150,467 bufs=89 max_bufs=91
 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0 newbsr=0
 Res: ndevices=1 nautochgr=0
 Drivers: cloud
Running Jobs:
No Jobs running.

Jobs waiting to reserve a drive:

Terminated Jobs:
 JobId  LevelFiles  Bytes   Status   FinishedName
===
 1  Full  0 0   Error17-J

Re: [Bacula-users] AWS S3 Backup

2019-07-19 Thread Kern Sibbald 

  
  


On 7/18/19 10:14 PM, Bryan Sockel
  wrote:


  
  Looking over my setup again.  I am not sure if the S3
Cloud driver is being compiled correctly.  How can i tell to see
if the if it was compiled correctly.
   
  I am following the process here: https://stackoverflow.com/questions/12172504/installing-the-libs3-on-linux but
with the drivers from the bacula.org website.  I am never able
to find the dependencies in step 5.  Tried installing the 2
rpm's created with the the nodep switch. 
  

   

  
   
   
  

  Thank You
   
  From: "Bryan Sockel
  (bryan.soc...@mdaemon.com)"
  
  To: "Bryan
Sockel" , "Bryan Sockel via
Bacula-users (bacula-users@lists.sourceforge.net)"
, "Kern Sibbald
(k...@sibbald.com)" 
Date: Thu, 18 Jul 2019 10:11:07 -0500
        Subject: Re: [Bacula-users] AWS S3 Backup
 
Should i be concerned that
  the plugins are being Rejected?
 
plugins.c:133-0 Rejected
  plugin: want=-sd.so name=s3 len=2
  plugins.c:133-0 Rejected plugin: want=-sd.so
  name=libnss3.so len=10
  plugins.c:133-0 Rejected plugin: want=-sd.so
  name=libs3.so.3 len=10

  

  



These objects (files) are not Bacula plugins.  I suspect that
  your definition of the PluginDirectory is not pointing to the
  Bacula plugins directory.  

You are probably using some old distro supplied configuration,
  which installs Bacula in may directories on your filesystem --
  this is *very* bad particularly for disaster recovery.  I
  recommend that you remove all old binaries, rebuild with the
  recommended Bacula ./configure set (installs almost everything in
  /opt/bacula/...).  Then try again.
Best regards,
Kern


  

  

   
 

  
Thank You,

  Bryan
  Sockel
  Systems Administrator
  o:
  817-601-3222 ext: 233    e:
  bryan.soc...@mdaemon.com
  
  MDaemon
Technologies
  Simple
Secure Email
  
  Visit us on Facebook
  | LinkedIn
  | YouTube
  
  Sent using the MDaemon
Messaging Server
  

 
  From: "Bryan Sockel via Bacula-users
(bacula-users@lists.sourceforge.net)"

To: "Kern Sibbald (k...@sibbald.com)"
,
bacula-users@lists.sourceforge.net
Date: Thu, 18 Jul 2019 08:04:17 -0500
Subject: Re: [Bacula-users] AWS S3 Backup
 
Hello,
 
Here is the
  requested Information:
 
Plugin Directory = "/usr/lib64"
ls  /usr/lib64/bacula-sd-cloud-driver-9.4.4.so
  /usr/lib64/bacula-sd-cloud-driver-9.4.4.so
 

  
 
bacula-sd -d20
  [root@bacula bacula]# bacula-sd:
  address_conf.c:274-0 Initaddr 0.0.0.0:9103
  bacula-sd: init_dev.c:435-0 Open SD driver at
  /usr/lib64/bacula-sd-cloud-driver-9.4.4.so
  bacula-sd: bnet_server.c:86-0 Addresses
  0.0.0.0:9103
  bacula-sd: init_dev.c:440-0 Lookup
  "BaculaSDdriver" in driver=cloud
  bacula-sd: init_dev.c:442-0 Driver=cloud entry
  point=7f295e762e90
  bacula-sd: stored.c:610-0 SD init done
  CloudStorage-1
  List plugins. Hook count=0
  List plugins. Hook count=0
 
 

  status storage=Cloud
Connecting to Storage daemon Cloud at
bacula:9103
  bacula-sd Version: 9.4.4 (28 May 2019)
x86_64-pc-linux-gnu redhat (Core)
Daemon started 18-Jul-19 07:48. Jobs: run=0,
running=0.
 Heap: heap=135,168 smbytes=31,242
max_bytes=150,467 bu

Re: [Bacula-users] AWS S3 Backup

2019-07-19 Thread Olivier Delestre 

Perhaps the same problem with the Aligned Volume Plugin :
Error: [SE0003] Lookup of symbol "BaculaSDdriver" in driver 
Aligned-xxx-1 for device 
/opt/bacula/plugins/bacula-sd-aligned-driver-9.4.4.so failed: ER
R=/opt/bacula/plugins/bacula-sd-aligned-driver-9.4.4.so: undefined 
symbol: BaculaSDdriver


Today i use a Rpm install from https://bacula.org/packages/

Today i can't use this :(


Le 18/07/2019 à 22:31, Heitor Faria a écrit :

Hello Bryan,

Should i be concerned that the plugins are being Rejected?
plugins.c:133-0 Rejected plugin: want=-sd.so name=s3 len=2
plugins.c:133-0 Rejected plugin: want=-sd.so name=libnss3.so len=10
plugins.c:133-0 Rejected plugin: want=-sd.so name=libs3.so.3 len=10

These messages are misleading but completly harmless.
It looks like now addons for Bacula SD are called Drivers, so this is 
something related to this change.



Thank You,

Regards,


*Bryan Sockel*
Systems Administrator
*o*: 817-601-3222 ext: 233 *e*: bryan.soc...@mdaemon.com

*MD*aemon Technologies 
Simple Secure Email

-- 



MSc Heitor Faria
CEO Bacula LATAM
mobile1: + 1 909 655-8971
mobile2: + 55 61 98268-4220
linkedin icon 


logo 
América Latina
bacula.lat  | bacula.com.br 




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] AWS S3 Backup

2019-07-18 Thread Heitor Faria 
Hello Bryan, 
> Should i be concerned that the plugins are being Rejected?
> plugins.c:133-0 Rejected plugin: want=-sd.so name=s3 len=2
> plugins.c:133-0 Rejected plugin: want=-sd.so name=libnss3.so len=10
> plugins.c:133-0 Rejected plugin: want=-sd.so name=libs3.so.3 len=10

These messages are misleading but completly harmless. 
It looks like now addons for Bacula SD are called Drivers, so this is something 
related to this change. 

> Thank You,

Regards, 
> Bryan Sockel
> Systems Administrator
> o : 817-601-3222 ext: 233 e : bryan.soc...@mdaemon.com

> [ http://www.mdaemon.com/ | MDaemon Technologies ]
> Simple Secure Email

> --

MSc Heitor Faria 
CEO Bacula LATAM 
mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ] 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] AWS S3 Backup

2019-07-18 Thread Bryan Sockel via Bacula-users 
Looking over my setup again.  I am not sure if the S3 Cloud driver is being 
compiled correctly.  How can i tell to see if the if it was compiled 
correctly.


I am following the process here: 
https://stackoverflow.com/questions/12172504/installing-the-libs3-on-linux 
but with the drivers from the bacula.org website.  I am never able to find 
the dependencies in step 5.  Tried installing the 2 rpm's created with the 
the nodep switch. 






Thank You



From: "Bryan Sockel (bryan.soc...@mdaemon.com)" 

To: "Bryan Sockel" , "Bryan Sockel via 
Bacula-users (bacula-users@lists.sourceforge.net)" 
, "Kern Sibbald (k...@sibbald.com)" 

Date: Thu, 18 Jul 2019 10:11:07 -0500
Subject: Re: [Bacula-users] AWS S3 Backup


Should i be concerned that the plugins are being Rejected?


plugins.c:133-0 Rejected plugin: want=-sd.so name=s3 len=2
plugins.c:133-0 Rejected plugin: want=-sd.so name=libnss3.so len=10
plugins.c:133-0 Rejected plugin: want=-sd.so name=libs3.so.3 len=10





Thank You,

Bryan Sockel
Systems Administrator
o: 817-601-3222 ext: 233e: bryan.soc...@mdaemon.com

MDaemon Technologies
Simple Secure Email

Visit us on Facebook | LinkedIn | YouTube

Sent using the MDaemon Messaging Server


From: "Bryan Sockel via Bacula-users (bacula-users@lists.sourceforge.net)" 

To: "Kern Sibbald (k...@sibbald.com)" , 
bacula-users@lists.sourceforge.net
Date: Thu, 18 Jul 2019 08:04:17 -0500
Subject: Re: [Bacula-users] AWS S3 Backup


Hello,


Here is the requested Information:


Plugin Directory = "/usr/lib64"
ls  /usr/lib64/bacula-sd-cloud-driver-9.4.4.so
/usr/lib64/bacula-sd-cloud-driver-9.4.4.so




bacula-sd -d20
[root@bacula bacula]# bacula-sd: address_conf.c:274-0 Initaddr 0.0.0.0:9103
bacula-sd: init_dev.c:435-0 Open SD driver at 
/usr/lib64/bacula-sd-cloud-driver-9.4.4.so
bacula-sd: bnet_server.c:86-0 Addresses 0.0.0.0:9103
bacula-sd: init_dev.c:440-0 Lookup "BaculaSDdriver" in driver=cloud
bacula-sd: init_dev.c:442-0 Driver=cloud entry point=7f295e762e90
bacula-sd: stored.c:610-0 SD init done CloudStorage-1
List plugins. Hook count=0
List plugins. Hook count=0




status storage=Cloud
Connecting to Storage daemon Cloud at bacula:9103
bacula-sd Version: 9.4.4 (28 May 2019) x86_64-pc-linux-gnu redhat (Core)
Daemon started 18-Jul-19 07:48. Jobs: run=0, running=0.
 Heap: heap=135,168 smbytes=31,242 max_bytes=150,467 bufs=89 max_bufs=91
 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0 newbsr=0
 Res: ndevices=1 nautochgr=0
 Drivers: cloud
Running Jobs:
No Jobs running.

Jobs waiting to reserve a drive:

Terminated Jobs:
 JobId  LevelFiles  Bytes   Status   FinishedName
===
 1  Full  0 0   Error17-Jul-19 16:04 BackupClient1
 2  Full  0 0   Error17-Jul-19 16:29 BackupClient1
 3  Full  0 0   Error17-Jul-19 23:15 BackupClient1
 4  Full  0 0   Error17-Jul-19 23:25 BackupCatalog

Device status:
Device Cloud: "CloudStorage-1" (/backups/CloudStorage) is not open.
Configured device capabilities:
   EOF BSR BSF FSR FSF EOM !REM RACCESS AUTOMOUNT LABEL !ANONVOLS 
!ALWAYSOPEN
Device state:
   !OPENED !TAPE !LABEL !APPEND !READ !EOT !WEOT !EOF !WORM !NEXTVOL !SHORT 
!MOUNTED !MALLOC
   Writers=0 reserves=0 blocked=0 enabled=1 usage=0
Attached JobIds:
Device parameters:
   Archive name: /backups/CloudStorage Device name: CloudStorage-1
   File=0 block=0
   Min block=0 Max block=0
   Available Cache Space=21.05 GB
==

Cloud transfer status:
   Uploads   (0 B/s) (ETA 0 s) Queued=0 0 B, Processed=0 0 B, Done=0 0 B, 
Failed=0 0 B
   Downloads (0 B/s) (ETA 0 s) Queued=0 0 B, Processed=0 0 B, Done=0 0 B, 
Failed=0 0 B

Used Volume status:






When running a job status just shows waiting on Storage message.


Thank You,



From: "Kern Sibbald (k...@sibbald.com)" 
To: Bryan Sockel , 
bacula-users@lists.sourceforge.net
Date: Thu, 18 Jul 2019 12:00:22 +0200
Subject: Re: [Bacula-users] AWS S3 Backup


Hello,
Please insure that the PluginDirectory is defined in the bacula-sd.conf 
file.  Then check and ensure that the plugin is in that directory.
Finally, the following commands could potentially help us:
stop the storage daemon
start it by hand in a shell window with -d20 as one of the options.
bconsole
status storage=
where  is the name of any storage device.
The status of the plugins should be sent to the stdout of the shell window 
where you restarted the storage daemon.
The output of the compile and link of the storage daemon would possibly be 
helpful.


Best regards,
Kern
On 7/17/19 5:40 PM, Bryan Sockel via Bacula-users wrote:
Hey Guys,


Trying to setup a new backup server to run backups to an AWS S3 Bucket.  I 
was able build both required version of the libs3 driver and bacula 
community install (9.4.4

Re: [Bacula-users] AWS S3 Backup

2019-07-18 Thread Bryan Sockel via Bacula-users 
Should i be concerned that the plugins are being Rejected?


plugins.c:133-0 Rejected plugin: want=-sd.so name=s3 len=2
plugins.c:133-0 Rejected plugin: want=-sd.so name=libnss3.so len=10
plugins.c:133-0 Rejected plugin: want=-sd.so name=libs3.so.3 len=10





Thank You,

Bryan Sockel
Systems Administrator
o: 817-601-3222 ext: 233e: bryan.soc...@mdaemon.com

MDaemon Technologies
Simple Secure Email

Visit us on Facebook | LinkedIn | YouTube

Sent using the MDaemon Messaging Server


From: "Bryan Sockel via Bacula-users (bacula-users@lists.sourceforge.net)" 

To: "Kern Sibbald (k...@sibbald.com)" , 
bacula-users@lists.sourceforge.net
Date: Thu, 18 Jul 2019 08:04:17 -0500
Subject: Re: [Bacula-users] AWS S3 Backup


Hello,


Here is the requested Information:


Plugin Directory = "/usr/lib64"
ls  /usr/lib64/bacula-sd-cloud-driver-9.4.4.so
/usr/lib64/bacula-sd-cloud-driver-9.4.4.so




bacula-sd -d20
[root@bacula bacula]# bacula-sd: address_conf.c:274-0 Initaddr 0.0.0.0:9103
bacula-sd: init_dev.c:435-0 Open SD driver at 
/usr/lib64/bacula-sd-cloud-driver-9.4.4.so
bacula-sd: bnet_server.c:86-0 Addresses 0.0.0.0:9103
bacula-sd: init_dev.c:440-0 Lookup "BaculaSDdriver" in driver=cloud
bacula-sd: init_dev.c:442-0 Driver=cloud entry point=7f295e762e90
bacula-sd: stored.c:610-0 SD init done CloudStorage-1
List plugins. Hook count=0
List plugins. Hook count=0




status storage=Cloud
Connecting to Storage daemon Cloud at bacula:9103
bacula-sd Version: 9.4.4 (28 May 2019) x86_64-pc-linux-gnu redhat (Core)
Daemon started 18-Jul-19 07:48. Jobs: run=0, running=0.
 Heap: heap=135,168 smbytes=31,242 max_bytes=150,467 bufs=89 max_bufs=91
 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0 newbsr=0
 Res: ndevices=1 nautochgr=0
 Drivers: cloud
Running Jobs:
No Jobs running.

Jobs waiting to reserve a drive:

Terminated Jobs:
 JobId  LevelFiles  Bytes   Status   FinishedName
===
 1  Full  0 0   Error17-Jul-19 16:04 BackupClient1
 2  Full  0 0   Error17-Jul-19 16:29 BackupClient1
 3  Full  0 0   Error17-Jul-19 23:15 BackupClient1
 4  Full  0 0   Error17-Jul-19 23:25 BackupCatalog

Device status:
Device Cloud: "CloudStorage-1" (/backups/CloudStorage) is not open.
Configured device capabilities:
   EOF BSR BSF FSR FSF EOM !REM RACCESS AUTOMOUNT LABEL !ANONVOLS 
!ALWAYSOPEN
Device state:
   !OPENED !TAPE !LABEL !APPEND !READ !EOT !WEOT !EOF !WORM !NEXTVOL !SHORT 
!MOUNTED !MALLOC
   Writers=0 reserves=0 blocked=0 enabled=1 usage=0
Attached JobIds:
Device parameters:
   Archive name: /backups/CloudStorage Device name: CloudStorage-1
   File=0 block=0
   Min block=0 Max block=0
   Available Cache Space=21.05 GB
==

Cloud transfer status:
   Uploads   (0 B/s) (ETA 0 s) Queued=0 0 B, Processed=0 0 B, Done=0 0 B, 
Failed=0 0 B
   Downloads (0 B/s) (ETA 0 s) Queued=0 0 B, Processed=0 0 B, Done=0 0 B, 
Failed=0 0 B

Used Volume status:






When running a job status just shows waiting on Storage message.


Thank You,



From: "Kern Sibbald (k...@sibbald.com)" 
To: Bryan Sockel , 
bacula-users@lists.sourceforge.net
Date: Thu, 18 Jul 2019 12:00:22 +0200
Subject: Re: [Bacula-users] AWS S3 Backup


Hello,
Please insure that the PluginDirectory is defined in the bacula-sd.conf 
file.  Then check and ensure that the plugin is in that directory.
Finally, the following commands could potentially help us:
stop the storage daemon
start it by hand in a shell window with -d20 as one of the options.
bconsole
status storage=
where  is the name of any storage device.
The status of the plugins should be sent to the stdout of the shell window 
where you restarted the storage daemon.
The output of the compile and link of the storage daemon would possibly be 
helpful.


Best regards,
Kern
On 7/17/19 5:40 PM, Bryan Sockel via Bacula-users wrote:
Hey Guys,


Trying to setup a new backup server to run backups to an AWS S3 Bucket.  I 
was able build both required version of the libs3 driver and bacula 
community install (9.4.4) and all appears to be correct.  I need a little 
help setting up my bacula-dir and bacula-sd files in order to use the 
backup.  I think i have the Bacula-SD file configs correct, but beyond that 
i am unsure of how to proceed.




bacula-sd.conf 


Device {
  Name = CloudStorage
  Device Type = Cloud
  Cloud = S3Cloud
  Archive Device = /backups/CloudStorage
  Maximum Part Size = 1000
  Media Type = CloudType
  LabelMedia = yes
  Random Access = Yes;
  AutomaticMount = yes
  RemovableMedia = no
  AlwaysOpen = no
}
Cloud {
  Name = S3Cloud
  Driver = "S3"
  HostName = "s3.amazonaws.com"
  BucketName = "s3-test"
  AccessKey = "AccessKey"
  SecretKey = "SecretKey"
  Protocol = HTTPS
  UriStyle = VirtualH

Re: [Bacula-users] AWS S3 Backup

2019-07-18 Thread Bryan Sockel via Bacula-users 
Hello,



Here is the requested Information:


Plugin Directory = "/usr/lib64"

ls  /usr/lib64/bacula-sd-cloud-driver-9.4.4.so
/usr/lib64/bacula-sd-cloud-driver-9.4.4.so





bacula-sd -d20
[root@bacula bacula]# bacula-sd: address_conf.c:274-0 Initaddr 0.0.0.0:9103
bacula-sd: init_dev.c:435-0 Open SD driver at 
/usr/lib64/bacula-sd-cloud-driver-9.4.4.so
bacula-sd: bnet_server.c:86-0 Addresses 0.0.0.0:9103
bacula-sd: init_dev.c:440-0 Lookup "BaculaSDdriver" in driver=cloud
bacula-sd: init_dev.c:442-0 Driver=cloud entry point=7f295e762e90
bacula-sd: stored.c:610-0 SD init done CloudStorage-1
List plugins. Hook count=0
List plugins. Hook count=0





status storage=Cloud
Connecting to Storage daemon Cloud at bacula:9103
bacula-sd Version: 9.4.4 (28 May 2019) x86_64-pc-linux-gnu redhat (Core)
Daemon started 18-Jul-19 07:48. Jobs: run=0, running=0.
 Heap: heap=135,168 smbytes=31,242 max_bytes=150,467 bufs=89 max_bufs=91
 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0 newbsr=0
 Res: ndevices=1 nautochgr=0
 Drivers: cloud
Running Jobs:
No Jobs running.

Jobs waiting to reserve a drive:

Terminated Jobs:
 JobId  LevelFiles  Bytes   Status   FinishedName
===
 1  Full  0 0   Error17-Jul-19 16:04 BackupClient1
 2  Full  0 0   Error17-Jul-19 16:29 BackupClient1
 3  Full  0 0   Error17-Jul-19 23:15 BackupClient1
 4  Full  0 0   Error17-Jul-19 23:25 BackupCatalog

Device status:
Device Cloud: "CloudStorage-1" (/backups/CloudStorage) is not open.
Configured device capabilities:
   EOF BSR BSF FSR FSF EOM !REM RACCESS AUTOMOUNT LABEL !ANONVOLS 
!ALWAYSOPEN
Device state:
   !OPENED !TAPE !LABEL !APPEND !READ !EOT !WEOT !EOF !WORM !NEXTVOL !SHORT 
!MOUNTED !MALLOC
   Writers=0 reserves=0 blocked=0 enabled=1 usage=0
Attached JobIds:
Device parameters:
   Archive name: /backups/CloudStorage Device name: CloudStorage-1
   File=0 block=0
   Min block=0 Max block=0
   Available Cache Space=21.05 GB
==

Cloud transfer status:
   Uploads   (0 B/s) (ETA 0 s) Queued=0 0 B, Processed=0 0 B, Done=0 0 B, 
Failed=0 0 B
   Downloads (0 B/s) (ETA 0 s) Queued=0 0 B, Processed=0 0 B, Done=0 0 B, 
Failed=0 0 B

Used Volume status:






When running a job status just shows waiting on Storage message.


Thank You,




From: "Kern Sibbald (k...@sibbald.com)" 
To: Bryan Sockel , 
bacula-users@lists.sourceforge.net
Date: Thu, 18 Jul 2019 12:00:22 +0200
Subject: Re: [Bacula-users] AWS S3 Backup



Hello,

Please insure that the PluginDirectory is defined in the bacula-sd.conf 
file.  Then check and ensure that the plugin is in that directory.

Finally, the following commands could potentially help us:

stop the storage daemon

start it by hand in a shell window with -d20 as one of the options.

bconsole

status storage=

where  is the name of any storage device.

The status of the plugins should be sent to the stdout of the shell window 
where you restarted the storage daemon.

The output of the compile and link of the storage daemon would possibly be 
helpful.




Best regards,

Kern

On 7/17/19 5:40 PM, Bryan Sockel via Bacula-users wrote:
Hey Guys,


Trying to setup a new backup server to run backups to an AWS S3 Bucket.  I 
was able build both required version of the libs3 driver and bacula 
community install (9.4.4) and all appears to be correct.  I need a little 
help setting up my bacula-dir and bacula-sd files in order to use the 
backup.  I think i have the Bacula-SD file configs correct, but beyond that 
i am unsure of how to proceed.




bacula-sd.conf 


Device {
  Name = CloudStorage
  Device Type = Cloud
  Cloud = S3Cloud
  Archive Device = /backups/CloudStorage
  Maximum Part Size = 1000
  Media Type = CloudType
  LabelMedia = yes
  Random Access = Yes;
  AutomaticMount = yes
  RemovableMedia = no
  AlwaysOpen = no
}
Cloud {
  Name = S3Cloud
  Driver = "S3"
  HostName = "s3.amazonaws.com"
  BucketName = "s3-test"
  AccessKey = "AccessKey"
  SecretKey = "SecretKey"
  Protocol = HTTPS
  UriStyle = VirtualHost
  Truncate Cache = AfterUpload
  Upload = EachPart
  Region = "us-east-1"
  MaximumUploadBandwidth = 5MB/s
}





Thank You
Bryan











___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] AWS S3 Backup

2019-07-18 Thread Kern Sibbald 

  
  
Hello,
Please insure that the PluginDirectory is defined in the
  bacula-sd.conf file.  Then check and ensure that the plugin is in
  that directory.
Finally, the following commands could potentially help us:
stop the storage daemon
start it by hand in a shell window with -d20 as one of the
  options.

bconsole
status storage=
where  is the name of any storage device.
The status of the plugins should be sent to the stdout of the
  shell window where you restarted the storage daemon.
The output of the compile and link of the storage daemon would
  possibly be helpful.



Best regards,
Kern

On 7/17/19 5:40 PM, Bryan Sockel via
  Bacula-users wrote:


  
  Hey Guys,
   
  Trying to setup a new backup server to run backups to
an AWS S3 Bucket.  I was able build both required version of the
libs3 driver and bacula community install (9.4.4) and all
appears to be correct.  I need a little help setting up my
bacula-dir and bacula-sd files in order to use the backup.  I
think i have the Bacula-SD file configs correct, but beyond that
i am unsure of how to proceed.
   
   
  bacula-sd.conf 
   
  
Device {
    Name = CloudStorage
    Device Type = Cloud
    Cloud = S3Cloud
    Archive Device = /backups/CloudStorage
    Maximum Part Size = 1000
    Media Type = CloudType
    LabelMedia = yes
    Random Access = Yes;
    AutomaticMount = yes
    RemovableMedia = no
    AlwaysOpen = no
  }
Cloud {
    Name = S3Cloud
    Driver = "S3"
    HostName = "s3.amazonaws.com"
    BucketName = "s3-test"
    AccessKey = "AccessKey"
    SecretKey = "SecretKey"
    Protocol = HTTPS
    UriStyle = VirtualHost
    Truncate Cache = AfterUpload
    Upload = EachPart
    Region = "us-east-1"
    MaximumUploadBandwidth = 5MB/s
  }
   
  
   
  

  
Thank You
  Bryan
  
 

  
  
  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


  


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] AWS S3 Backup

2019-07-18 Thread Radosław Korzeniewski 
Hello,

What is your bacula-sd.conf -> Storage resource defined?

best regards

śr., 17 lip 2019 o 23:05 Bryan Sockel via Bacula-users <
bacula-users@lists.sourceforge.net> napisał(a):

> After further testing i noticed the following error when i check the
> storage daemon status:
>
> Jul 17 15:50:43 hostserver bacula-sd[2137]: cloud_dev.c:690 Could not open
> Cloud driver type=1 for Device=CloudStorage-1.
>
> Here is my bacula-sd.conf for ref:
>
> Device {
>   Name = CloudStorage-1
>   Device Type = Cloud
>   Cloud = S3Cloud
>   Archive Device = /backups/CloudStorage
>   Maximum Part Size = 100 MB
>   Media Type = CloudType
>   LabelMedia = yes
>   Random Access = Yes;
>   AutomaticMount = yes
>   RemovableMedia = no
>   AlwaysOpen = no
> }
>
>
> Cloud {
>   Name = S3Cloud
>   Driver = "S3"
>   HostName = "s3.amazonaws.com"
>   BucketName = "BucketName"
>   AccessKey = "AccessKey"
>   SecretKey = "SecretKey"
>   Protocol = HTTPS
>   UriStyle = VirtualHost
>   Truncate Cache = AfterUpload
>   Upload = EachPart
>   Region = "us-east-1"
>   MaximumUploadBandwidth = 5MB/s
> }
>
> Bacula-Dir.Conf:
>
> Storage {
>   Name = "Cloud"
>   SdPort = 9103
>   Address = "FQDN"
>   Password = "Password"
>   Device = "CloudStorage-1"
>   MediaType = "Cloud"
> #  Autochanger = "File1"
>   MaximumConcurrentJobs = 10
> }
>
>
> Thank You
>
>
>
>
> From: "Bryan Sockel via Bacula-users (bacula-users@lists.sourceforge.net)"
> 
> To: bacula-users@lists.sourceforge.net
> Date: Wed, 17 Jul 2019 10:40:00 -0500
> Subject: [Bacula-users] AWS S3 Backup
>
> Hey Guys,
>
> Trying to setup a new backup server to run backups to an AWS S3 Bucket.  I
> was able build both required version of the libs3 driver and bacula
> community install (9.4.4) and all appears to be correct.  I need a little
> help setting up my bacula-dir and bacula-sd files in order to use the
> backup.  I think i have the Bacula-SD file configs correct, but beyond that
> i am unsure of how to proceed.
>
>
> bacula-sd.conf
>
> Device {
>   Name = CloudStorage
>   Device Type = Cloud
>   Cloud = S3Cloud
>   Archive Device = /backups/CloudStorage
>   Maximum Part Size = 1000
>   Media Type = CloudType
>   LabelMedia = yes
>   Random Access = Yes;
>   AutomaticMount = yes
>   RemovableMedia = no
>   AlwaysOpen = no
> }
> Cloud {
>   Name = S3Cloud
>   Driver = "S3"
>   HostName = "s3.amazonaws.com"
>   BucketName = "s3-test"
>   AccessKey = "AccessKey"
>   SecretKey = "SecretKey"
>   Protocol = HTTPS
>   UriStyle = VirtualHost
>   Truncate Cache = AfterUpload
>   Upload = EachPart
>   Region = "us-east-1"
>   MaximumUploadBandwidth = 5MB/s
> }
>
>
>
> Thank You
> Bryan
>
>
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>


-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] AWS S3 Backup

2019-07-17 Thread Bryan Sockel via Bacula-users 
After further testing i noticed the following error when i check the storage 
daemon status:


Jul 17 15:50:43 hostserver bacula-sd[2137]: cloud_dev.c:690 Could not open 
Cloud driver type=1 for Device=CloudStorage-1.



Here is my bacula-sd.conf for ref:


Device {
  Name = CloudStorage-1
  Device Type = Cloud
  Cloud = S3Cloud
  Archive Device = /backups/CloudStorage
  Maximum Part Size = 100 MB
  Media Type = CloudType
  LabelMedia = yes
  Random Access = Yes;
  AutomaticMount = yes
  RemovableMedia = no
  AlwaysOpen = no
}




Cloud {
  Name = S3Cloud
  Driver = "S3"
  HostName = "s3.amazonaws.com"
  BucketName = "BucketName"
  AccessKey = "AccessKey"
  SecretKey = "SecretKey"
  Protocol = HTTPS
  UriStyle = VirtualHost
  Truncate Cache = AfterUpload
  Upload = EachPart
  Region = "us-east-1"
  MaximumUploadBandwidth = 5MB/s
}



Bacula-Dir.Conf:


Storage {
  Name = "Cloud"
  SdPort = 9103
  Address = "FQDN"
  Password = "Password"
  Device = "CloudStorage-1"
  MediaType = "Cloud"
#  Autochanger = "File1"
  MaximumConcurrentJobs = 10
}



Thank You





From: "Bryan Sockel via Bacula-users (bacula-users@lists.sourceforge.net)" 

To: bacula-users@lists.sourceforge.net
Date: Wed, 17 Jul 2019 10:40:00 -0500
Subject: [Bacula-users] AWS S3 Backup


Hey Guys,


Trying to setup a new backup server to run backups to an AWS S3 Bucket.  I 
was able build both required version of the libs3 driver and bacula 
community install (9.4.4) and all appears to be correct.  I need a little 
help setting up my bacula-dir and bacula-sd files in order to use the 
backup.  I think i have the Bacula-SD file configs correct, but beyond that 
i am unsure of how to proceed.




bacula-sd.conf 


Device {
  Name = CloudStorage
  Device Type = Cloud
  Cloud = S3Cloud
  Archive Device = /backups/CloudStorage
  Maximum Part Size = 1000
  Media Type = CloudType
  LabelMedia = yes
  Random Access = Yes;
  AutomaticMount = yes
  RemovableMedia = no
  AlwaysOpen = no
}
Cloud {
  Name = S3Cloud
  Driver = "S3"
  HostName = "s3.amazonaws.com"
  BucketName = "s3-test"
  AccessKey = "AccessKey"
  SecretKey = "SecretKey"
  Protocol = HTTPS
  UriStyle = VirtualHost
  Truncate Cache = AfterUpload
  Upload = EachPart
  Region = "us-east-1"
  MaximumUploadBandwidth = 5MB/s
}





Thank You
Bryan

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users