[Bacula-users] LTO 6 compression
Hey folks, I see that LTO 6 holds 2.5T data per tape, or 6.25T compressed. I've never used HW compression before so am wondering whether its performance is variable like SW compression. i.e. depends on the file contents just what kind of compression ratio you'll get. And also how reliable is it? If it is just as reliable why would someone choose not to use it (and therefore why is there an option to not use it)? thanks, -Alan -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bare metal restore
I've seen conflicting comments online about this. I know this used to work. Assuming only Linux systems, and a further assumption that they will all be RHEL based systems, does Bacula support any way of bare-metal restores? And to be even more specific, these would all be VMs. Thanks in advance. JBB -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO 6 compression
> I see that LTO 6 holds 2.5T data per tape, or 6.25T compressed. The 6.25TB is only an estimate. If you have non compressible data you will get close to 2.5 TB of space on your tape. If you have all text files you may fit 15 TB on a single tape.. > I've never used HW compression before so am wondering whether its > performance is variable like SW compression. i.e. depends on the > file contents just what kind of compression ratio you'll get. > > And also how reliable is it? If it is just as reliable why would > someone choose not to use it (and therefore why is there an option to > not use it)? > HW compression is 100% reliable. Just leave compression on at the HW level and make sure you have software compression off. HW compression will not slow down your backups and it will not reduce your tape if you have non compressible data. John -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO 6 compression
On Tue, May 7, 2013 at 9:45 AM, John Drescher wrote: > > The 6.25TB is only an estimate. If you have non compressible data you > will get close to 2.5 TB of space on your tape. If you have all text > files you may fit 15 TB on a single tape.. Great, thanks for that! That's what I thought but I've never used HW compression. So since I don't have an LTO 6 yet, is there a good way to get an estimate of the compressability of my data? If I just tar cz my data will that give me a close ballpark? Or better bzip? Or something else? -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO 6 compression
On Tue, May 07, 2013 at 10:11:27AM -0400, Alan McKay wrote: > On Tue, May 7, 2013 at 9:45 AM, John Drescher wrote: > > > > The 6.25TB is only an estimate. If you have non compressible data you > > will get close to 2.5 TB of space on your tape. If you have all text > > files you may fit 15 TB on a single tape.. > > Great, thanks for that! That's what I thought but I've never used HW > compression. > > So since I don't have an LTO 6 yet, is there a good way to get an > estimate of the compressability of my data? > > If I just tar cz my data will that give me a close ballpark? Or > better bzip? Or something else? > If you're looking for pure compression speed, check out lzo, it works decently on text files and is as fast as the disks you can throw at it ;-) All the best, Uwe -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO 6 compression
On 07/05/2013, at 09:15 a.m., John Drescher wrote: >> I see that LTO 6 holds 2.5T data per tape, or 6.25T compressed. > > The 6.25TB is only an estimate. If you have non compressible data you > will get close to 2.5 TB of space on your tape. If you have all text > files you may fit 15 TB on a single tape.. > >> I've never used HW compression before so am wondering whether its >> performance is variable like SW compression. i.e. depends on the >> file contents just what kind of compression ratio you'll get. >> >> And also how reliable is it? If it is just as reliable why would >> someone choose not to use it (and therefore why is there an option to >> not use it)? > > HW compression is 100% reliable. Just leave compression on at the HW > level and make sure you have software compression off. HW compression > will not slow down your backups and it will not reduce your tape if > you have non compressible data. > > John > > -- > Learn Graph Databases - Download FREE O'Reilly Book > "Graph Databases" is the definitive new guide to graph databases and > their applications. This 200-page book is written by three acclaimed > leaders in the field. The early access version is available now. > Download your free book today! http://p.sf.net/sfu/neotech_d2d_may > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users Currently I have a LTO3 magazine with HW compression on. From a theoretical max storage of 400GB, sometimes it gets very good compression rates, and manages to fit near 700GB. I had it turned off before, and since I turned it on I haven't noticed any difference in backup time. My recommendation: turn off SW compression and let the hardware do its job. LDC - Gustavo El Khoury -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO 6 compression
> Currently I have a LTO3 magazine with HW compression on. From a theoretical > max storage of 400GB, sometimes it gets very good compression rates, and > manages to fit near 700GB I have an LTO2 tape that is used only for a specific dataset that is very compressible. Currently I it has 3TB on a single LTO2 tape. *list media pool=LTO2-Calculated-Data +-++---+-+---+--+--+-+--+---+---+-+ | mediaid | volumename | volstatus | enabled | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-++---+-+---+--+--+-+--+---+---+-+ | 212 | A00053 | Append| 1 | 3,006,834,453,504 | 3,025 | 31,536,000 | 1 | 14 | 1 | LTO-2 | 2013-05-03 09:59:36 | +-++---+-+---+--+--+-+--+---+---+-+ With that said outside of the few edge cases most of my 180 LTO2 tapes fit around 300 GB which is less than the claim of 400GB. John -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO 6 compression
> If I just tar cz my data will that give me a close ballpark? Or > better bzip? Or something else? I think bzip would be a good ballpark estimate to the HW compression in lto tape drives. John -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO 6 compression
On Tue, May 7, 2013 at 10:36 AM, John Drescher wrote: > I think bzip would be a good ballpark estimate to the HW compression > in lto tape drives. Great, thanks! -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bare metal restore
Hello, 2013/5/7 Jonathan Bayer > I've seen conflicting comments online about this. > > I know this used to work. > > Assuming only Linux systems, and a further assumption that they will all > be RHEL based systems, does Bacula support any way of bare-metal > restores? And to be even more specific, these would all be VMs. > If your machines are VM guests then I recommend to backup it as disk images. It will be the easiest BMR you can imagine. For successful backup/restore you need to assure offline VM guest or some kind of OS quiescence (snapshot?). Do not forgot to export and backup a VM guest configuration (OVF or XML file depend of your hypervisor). best regards -- Radosław Korzeniewski rados...@korzeniewski.net -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-fd 5.x on Synology Atom(TM) CPU K525 DSM4.0: compiling fails
hi,
I try to get Bacula 5.x working on a Synology box with DSM 4.0. I need only the
bacula-fd client, but compiling failes (tested with 5.0.5 and 5.2.13) on the
same error:
# uname -a
Linux synology 2.6.32.12 #2198 SMP Wed Mar 7 15:39:16 CST 2012 x86_64 GNU/Linux
[...]
libtool: link: warning:
`/usr/local/i686-linux-gnu/i686-linux-gnu/lib/libstdc++.la' seems to be moved
libtool: link: warning:
`/usr/local/i686-linux-gnu/i686-linux-gnu/lib/libstdc++.la' seems to be moved
Make of lib is good
make[1]: Leaving directory `/tmp/bacula/bacula-5.2.13/src/lib'
==>Entering directory /tmp/bacula/bacula-5.2.13/src/findlib
make[1]: Entering directory `/tmp/bacula/bacula-5.2.13/src/findlib'
Compiling find.c
Compiling match.c
Compiling find_one.c
Compiling attribs.c
attribs.c: In function 'void encode_stat(char*, stat*, int, int32_t, int)':
attribs.c:259: error: 'struct stat' has no member named 'st_flags'
attribs.c: In function 'int decode_stat(char*, stat*, int, int32_t*)':
attribs.c:363: error: 'struct stat' has no member named 'st_flags'
attribs.c:363: error: 'struct stat' has no member named 'st_flags'
attribs.c:365: error: 'struct stat' has no member named 'st_flags'
attribs.c: In function 'bool set_attributes(JCR*, ATTR*, BFILE*)':
attribs.c:544: error: 'struct stat' has no member named 'st_flags'
attribs.c:544: error: 'chflags' was not declared in this scope
make[1]: *** [attribs.lo] Error 1
make[1]: Leaving directory `/tmp/bacula/bacula-5.2.13/src/findlib'
== Error in /tmp/bacula/bacula-5.2.13/src/findlib ==
[...]
==>Entering directory /tmp/bacula/bacula-5.2.13/src/filed
make[1]: Entering directory `/tmp/bacula/bacula-5.2.13/src/filed'
Compiling filed.c
Compiling authenticate.c
Compiling acl.c
Compiling backup.c
Compiling estimate.c
Compiling fd_plugins.c
Compiling accurate.c
Compiling filed_conf.c
Compiling heartbeat.c
Compiling job.c
Compiling pythonfd.c
Compiling restore.c
Compiling status.c
Compiling verify.c
Compiling verify_vol.c
Compiling xattr.c
make[1]: *** No rule to make target `../findlib/libbacfind.la', needed by
`bacula-fd'. Stop.
make[1]: Leaving directory `/tmp/bacula/bacula-5.2.13/src/filed'
== Error in /tmp/bacula/bacula-5.2.13/src/filed ==
The file "/usr/local/i686-linux-gnu/i686-linux-gnu/lib/libstdc++.la" is a link
to "/opt/lib/libstdc++.la", otherwise, I get "no such file ..."
/configure --enable-client-only --enable-smartalloc --disable-conio
--prefix=/opt/local --sysconfdir=/opt/local/etc/bacula
--with-scriptdir=/opt/local/etc/bacula/scripts --build=i686-pc-linux
Configuration on Tue May 7 17:32:51 CEST 2013:
Host: i686-pc-linux-gnu -- unknown unknown
Bacula version: Bacula 5.2.13 (19 February 2013)
Source code location: .
Install binaries: /opt/local/sbin
Install libraries:/opt/local/lib
Install config files: /opt/local/etc/bacula
Scripts directory:/opt/local/etc/bacula/scripts
Archive directory:/tmp
Working directory:/opt/local/opt/bacula/working
PID directory:/var/run
Subsys directory: /var/run/subsys
Man directory:${datarootdir}/man
Data directory: /opt/local/share
Plugin directory: /opt/local/lib
C Compiler: gcc 4.2.1
C++ Compiler: /opt/bin/g++ 4.2.1
Compiler flags:-g -O2 -Wall -fno-strict-aliasing -fno-exceptions
-fno-rtti
Linker flags:
Libraries:-lpthread -ldl -ldl
Statically Linked Tools: no
Statically Linked FD: no
Statically Linked SD: no
Statically Linked DIR:no
Statically Linked CONS: no
Database backends:None
Database port:
Database name:bacula
Database user:bacula
Job Output Email: root@localhost
Traceback Email: root@localhost
SMTP Host Address:localhost
Director Port:9101
File daemon Port: 9102
Storage daemon Port: 9103
Director User:
Director Group:
Storage Daemon User:
Storage DaemonGroup:
File Daemon User:
File Daemon Group:
Large file support: no
Bacula conio support: no
readline support: no
TCP Wrappers support: no
TLS support: no
Encryption support: no
ZLIB support: yes
LZO support: no
enable-smartalloc:yes
enable-lockmgr: no
bat support: no
enable-gnome: no
enable-bwx-console: no
enable-tray-monitor: no
client-only: yes
build-dird: yes
build-stored: yes
Plugin support: yes
AFS support: no
ACL support: no
XATTR support:yes
Python support: no
systemd support: no
Batch insert enabled: None
The package optware-devel is ins
Re: [Bacula-users] LTO 6 compression
> On Tue, 7 May 2013 11:01:27 -0400, Alan McKay said: > > On Tue, May 7, 2013 at 10:36 AM, John Drescher wrote: > > I think bzip would be a good ballpark estimate to the HW compression > > in lto tape drives. > > > Great, thanks! Don't forget to include a fast enough spool disk (you need to scale up the max uncompressed speed). __Martin -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-fd 5.x on Synology Atom(TM) CPU K525 DSM4.0: compiling fails
On 5/7/2013 11:40 AM, Denny Schierz wrote:
> hi,
>
> I try to get Bacula 5.x working on a Synology box with DSM 4.0. I need only
> the bacula-fd client, but compiling failes (tested with 5.0.5 and 5.2.13) on
> the same error:
>
> # uname -a
> Linux synology 2.6.32.12 #2198 SMP Wed Mar 7 15:39:16 CST 2012 x86_64
> GNU/Linux
>
>
> [...]
> libtool: link: warning:
> `/usr/local/i686-linux-gnu/i686-linux-gnu/lib/libstdc++.la' seems to be moved
> libtool: link: warning:
> `/usr/local/i686-linux-gnu/i686-linux-gnu/lib/libstdc++.la' seems to be moved
> Make of lib is good
>
> make[1]: Leaving directory `/tmp/bacula/bacula-5.2.13/src/lib'
> ==>Entering directory /tmp/bacula/bacula-5.2.13/src/findlib
> make[1]: Entering directory `/tmp/bacula/bacula-5.2.13/src/findlib'
> Compiling find.c
> Compiling match.c
> Compiling find_one.c
> Compiling attribs.c
> attribs.c: In function 'void encode_stat(char*, stat*, int, int32_t, int)':
> attribs.c:259: error: 'struct stat' has no member named 'st_flags'
> attribs.c: In function 'int decode_stat(char*, stat*, int, int32_t*)':
> attribs.c:363: error: 'struct stat' has no member named 'st_flags'
> attribs.c:363: error: 'struct stat' has no member named 'st_flags'
> attribs.c:365: error: 'struct stat' has no member named 'st_flags'
> attribs.c: In function 'bool set_attributes(JCR*, ATTR*, BFILE*)':
> attribs.c:544: error: 'struct stat' has no member named 'st_flags'
> attribs.c:544: error: 'chflags' was not declared in this scope
> make[1]: *** [attribs.lo] Error 1
> make[1]: Leaving directory `/tmp/bacula/bacula-5.2.13/src/findlib'
For whatever reason, the configure script thinks you have a chflags()
function. Apparently, there is not one and configure is getting confused.
Try commenting out the #define HAVE_CHFLAGS in the config.h file that
gets created in the source directory AFTER you run configure and BEFORE
you run make.
>
>== Error in /tmp/bacula/bacula-5.2.13/src/findlib ==
>
> [...]
>
> ==>Entering directory /tmp/bacula/bacula-5.2.13/src/filed
> make[1]: Entering directory `/tmp/bacula/bacula-5.2.13/src/filed'
> Compiling filed.c
> Compiling authenticate.c
> Compiling acl.c
> Compiling backup.c
> Compiling estimate.c
> Compiling fd_plugins.c
> Compiling accurate.c
> Compiling filed_conf.c
> Compiling heartbeat.c
> Compiling job.c
> Compiling pythonfd.c
> Compiling restore.c
> Compiling status.c
> Compiling verify.c
> Compiling verify_vol.c
> Compiling xattr.c
> make[1]: *** No rule to make target `../findlib/libbacfind.la', needed by
> `bacula-fd'. Stop.
> make[1]: Leaving directory `/tmp/bacula/bacula-5.2.13/src/filed'
>
>
>== Error in /tmp/bacula/bacula-5.2.13/src/filed ==
>
> The file "/usr/local/i686-linux-gnu/i686-linux-gnu/lib/libstdc++.la" is a
> link to "/opt/lib/libstdc++.la", otherwise, I get "no such file ..."
>
> /configure --enable-client-only --enable-smartalloc --disable-conio
> --prefix=/opt/local --sysconfdir=/opt/local/etc/bacula
> --with-scriptdir=/opt/local/etc/bacula/scripts --build=i686-pc-linux
>
> Configuration on Tue May 7 17:32:51 CEST 2013:
>
> Host: i686-pc-linux-gnu -- unknown unknown
> Bacula version:Bacula 5.2.13 (19 February 2013)
> Source code location: .
> Install binaries: /opt/local/sbin
> Install libraries: /opt/local/lib
> Install config files: /opt/local/etc/bacula
> Scripts directory: /opt/local/etc/bacula/scripts
> Archive directory: /tmp
> Working directory: /opt/local/opt/bacula/working
> PID directory: /var/run
> Subsys directory: /var/run/subsys
> Man directory: ${datarootdir}/man
> Data directory:/opt/local/share
> Plugin directory: /opt/local/lib
> C Compiler:gcc 4.2.1
> C++ Compiler: /opt/bin/g++ 4.2.1
> Compiler flags: -g -O2 -Wall -fno-strict-aliasing -fno-exceptions
> -fno-rtti
> Linker flags:
> Libraries: -lpthread -ldl -ldl
> Statically Linked Tools: no
> Statically Linked FD: no
> Statically Linked SD: no
> Statically Linked DIR:no
> Statically Linked CONS: no
> Database backends: None
> Database port:
> Database name: bacula
> Database user: bacula
>
> Job Output Email: root@localhost
> Traceback Email: root@localhost
> SMTP Host Address: localhost
>
> Director Port: 9101
> File daemon Port: 9102
> Storage daemon Port: 9103
>
> Director User:
> Director Group:
> Storage Daemon User:
> Storage DaemonGroup:
> File Daemon User:
> File Daemon Group:
>
> Large file support:no
> Bacula conio support: no
> readline support: no
> TCP Wrappers support: no
> TLS support: no
> Encryption support:
[Bacula-users] Pool Types
I'm doing some pool-usage and adjustments to our setup of bacula. I noticed in the user's manual that the pool type has other definitions: Backup Save Archive etc I'm interested to know if either Save or Archive are in use, and how they're being used rhys -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Pool Types
On 08.05.2013 13:51, rhys frank wrote: > I'm doing some pool-usage and adjustments to our setup of bacula. > > I noticed in the user's manual that the pool type has other > definitions: > > Backup > Save > Archive > etc > > I'm interested to know if either Save or Archive are in use, and how > they're being used I manually set tapes to "Archive" when I take them off-site, and set the expire to a bignum. Cheers, GaryB-) -- Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
