Re: [Bacula-users] Half-speed backup problem

2010-07-20 Thread Rory Campbell-Lange
On 21/07/10, Craig Miskell (craig.misk...@opus.co.nz) wrote:
> Rory Campbell-Lange wrote:
> >On 19/07/10, Rory Campbell-Lange (r...@campbell-lange.net) wrote:
> > > I ran a full backup of a volume last week on Bacula v2.4.4 and I
> > > have now upgraded to 5.0.2. I'm getting half the throughput last
> > > week as I am now.
> > > 
> > > Last week's test volume was a 2.1TB xfs volume and it read/wrote
> > > on average at 70MB/s. I am now backing up a 4.4TB ext3 volume and
> > > bconsole's status client shows backup running at less than 30MB/s.
> > > Hardware compression has been enabled in both cases.
> > > 
> > > Both volumes are RAID5 Coraid (ATA over Ethernet) devices. I'd be
> > > grateful for any pointers for getting to the bottom of this.
> > 
> > With reference to 
> > http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg36340.html
> > I wonder if I should configure the following settings:
> > 
> >   Maximum File Size = 5G
> >   Maximum Spool Size = 370g
> >   Maximum Job Spool Size = 20g
> >   Maximum Block Size = 262144
> >   Maximum Network Buffer Size = 262144
> > 
> > for faster throughput.  I haven't set any of these parameters at the moment.
> 
> I can vouch for Maximum File Size = 5G at least; it's a totally
> safe/backwards compatible change to make, and doing that took my
> backups from 38MB/s to 46Mb/s (~20% improvement).  And I can give
> some tentative support to Maximum Block Size = 262144; in some small
> scale tests yesterday (on a small number of large files only), I
> went from 47MB/s to 64Mb/s (~25%).  I haven't yet done full-scale
> tests though.
> 
> Be aware that it seems probable that if you change Maximum Block
> Size on a device, you may (probably?) need to change that back to
> the default on the device if you wish to restore from backups done
> with the default block size.
> 
> The other settings (Spool size and Network Buffer Size) will help in
> getting your data onto the backup server and ensuring there's enough
> data for your tape to chew on, and are good.  Actual sizing for the
> Spool settings will depend on how big your backups are; I don't have
> enough experience (or data) to comment much.

Thanks very much for the comments, Craig. I'm leaving the majority of
the previous emails above because others may find it germane to anyone
else who may wish to comment on this debate. I'll definitely set the
Maximum File Size as you suggest.

Following your comments, Craig. From other comments on the list about
Maximum Block Size it appears that this could be a dangerous change to
make. In our case we may not be the party retrieving the data and we
have to make that process as easy as possible. It would be great to have
a comment on the safety of using Maximum Block Size from others on this
list.

Regarding spooling, I re-read the entry here:
http://www.bacula.org/manuals/en/concepts/concepts/Data_Spooling.html
Spooling specifically is used to avoid shoe-shining, so in my case it
looks like a good idea because the tape seems to be waiting for data.
The iotop tool shows quite big differences in read IO from the target
volume (i.e 100MB/s one moment, 18MB/s the next.

If I've got a 2.2TB backup writing to LTO4 tapes at just over 1TB/tape
using hardware compression I wonder what the approprate spool sizes
would be? I've only got a 300G internal volume available for spooling.

Spool Size = 250GB # maximum spool size for this job
Maximum Spool Size = 250GB # only one job at a time
Maximum Job Spool Size = 25000 # 250GB in bytes
Spool Directory = /tapespool   # XFS filesystem preferred?

I'd be grateful on any comments about spool sizes and whether this is
appropriate for my situtation with locally attached storage and and LTO4
tape library. The central issue is that the locally attached storage can
be read at well over 150MB/s and I'm only getting to tape at under
40MB/s.

Regards
Rory

-- 
Rory Campbell-Lange
r...@campbell-lange.net

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Can I take a base job from data already in the SD?

2010-07-20 Thread Phil Stracchino
On 07/20/10 10:15, Mister IT Guru wrote:
> I've been reading up on some of the new features, and one of them is a 
> base job. Do I need to do an actual full backup to create a base, or can 
> I make one from existing backed up data?

You cannot, to my knowledge, create a base job from an existing Full
backup.  The point of a Base job is that it should contain only
mostly-unchanging files, preferably unchanging files that are common to
a large group of machines.  For example, if you have a hundred Windows
XP clients, and you start out with a Base job consisting of the complete
install image for that machine before any users or user files are
created on it, then all of those files need to be backed up only once
for all 100 clients - and if the base install for those machines
changes, say when Windows updates are applied or applications installed,
then only the changed files need to be re-backed up, and only once.


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Half-speed backup problem

2010-07-20 Thread Craig Miskell
Rory Campbell-Lange wrote:
> On 19/07/10, Rory Campbell-Lange (r...@campbell-lange.net) wrote:
>> I ran a full backup of a volume last week on Bacula v2.4.4 and I have
>> now upgraded to 5.0.2. I'm getting half the throughput last week as I am
>> now.
>>
>> Last week's test volume was a 2.1TB xfs volume and it read/wrote on
>> average at 70MB/s. I am now backing up a 4.4TB ext3 volume and
>> bconsole's status client shows backup running at less than 30MB/s.
>> Hardware compression has been enabled in both cases.
>>
>> Both volumes are RAID5 Coraid (ATA over Ethernet) devices. I'd be
>> grateful for any pointers for getting to the bottom of this.
> 
> With reference to 
> http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg36340.html
> I wonder if I should configure the following settings:
> 
>   Maximum File Size = 5G
>   Maximum Spool Size = 370g
>   Maximum Job Spool Size = 20g
>   Maximum Block Size = 262144
>   Maximum Network Buffer Size = 262144
> 
> for faster throughput.  I haven't set any of these parameters at the moment.

I can vouch for Maximum File Size = 5G at least; it's a totally safe/backwards 
compatible change to make, and doing that 
took my backups from 38MB/s to 46Mb/s (~20% improvement).  And I can give some 
tentative support to Maximum Block Size = 
262144; in some small scale tests yesterday (on a small number of large files 
only), I went from 47MB/s to 64Mb/s 
(~25%).  I haven't yet done full-scale tests though.

Be aware that it seems probable that if you change Maximum Block Size on a 
device, you may (probably?) need to change 
that back to the default on the device if you wish to restore from backups done 
with the default block size.

The other settings (Spool size and Network Buffer Size) will help in getting 
your data onto the backup server and 
ensuring there's enough data for your tape to chew on, and are good.  Actual 
sizing for the Spool settings will depend 
on how big your backups are; I don't have enough experience (or data) to 
comment much.

-- 
Craig Miskell
Senior Systems Administrator
Opus International Consultants
Phone: +64 4 471 7209
I wish there was a knob on the TV to turn up the intelligence. There's
  a knob called "brightness", but it doesn't work.
 -- Gallagher

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Half-speed backup problem

2010-07-20 Thread Rory Campbell-Lange
On 19/07/10, Rory Campbell-Lange (r...@campbell-lange.net) wrote:
> I ran a full backup of a volume last week on Bacula v2.4.4 and I have
> now upgraded to 5.0.2. I'm getting half the throughput last week as I am
> now.
> 
> Last week's test volume was a 2.1TB xfs volume and it read/wrote on
> average at 70MB/s. I am now backing up a 4.4TB ext3 volume and
> bconsole's status client shows backup running at less than 30MB/s.
> Hardware compression has been enabled in both cases.
> 
> Both volumes are RAID5 Coraid (ATA over Ethernet) devices. I'd be
> grateful for any pointers for getting to the bottom of this.

With reference to 
http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg36340.html
I wonder if I should configure the following settings:

  Maximum File Size = 5G
  Maximum Spool Size = 370g
  Maximum Job Spool Size = 20g
  Maximum Block Size = 262144
  Maximum Network Buffer Size = 262144

for faster throughput.  I haven't set any of these parameters at the moment.

However I've just run some tests on the 4.4TB ext3 volume in question and I get
the following results when reading and writing 40GB*:

40960MiBKiB/s  CPU%
Write   76487 2
Read   163435 2
i.e. I can read from the ext3 volume at 163MB/s.

* I used the Coraid ddt tool which specially ensures that disk cache flushes
  are done to ensure good stats.

If anyone has any insights into why I might be able to write at only 30MB/s I'd
be grateful to know.

Rory

-- 
Rory Campbell-Lange
r...@campbell-lange.net

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing "Maximum Block Size": reading previous backups

2010-07-20 Thread Craig Miskell
Alex Chekholko wrote:
> On Tue, 20 Jul 2010 11:11:49 +1200
> Craig Miskell  wrote:
> 
>> Hi,
>>  It looks like I need to beef up "Maximum Block Size" to get good 
>> performance out of our LTO-4 tape drives.
>>
>> Before I do, I'd like to know what effect this has on restoring from backups 
>> taken with the default block size.  Will I 
>> need to modify the Device configuration back to it's default setting to be 
>> able to restore from those tapes, or will 
>> Bacula figure out what it needs to do?
>>
> 
> I believe it is the former.
 >
> I did same thing (upped 'Maximum Block Size" for LTO-4 performance) but
> didn't test any restores from the tapes written with the old block
> size.  And eventually they were recycled.

Thanks.

Does anyone have any experience with using bextract on a tape written with 
non-default block sizes, or indication that 
it will/won't work?  There's nothing in the bootstrap file, or command line 
arguments to bextract, that looks like it 
could be used to define the block size, and by definition there isn't any 
storage daemon (nor necessarily any SD config 
files) available at that point.

I see bextract as an excellent near-bare metal recovery tool, but it would suck 
if it only works on default block sizes.

Ta,


-- 
Craig Miskell
Senior Systems Administrator
Opus International Consultants
Phone: +64 4 471 7209
 > Why do I have to justify a system change to someone who is
 > barely aware that "their" computer doesn't contain a magic elf
 > who can draw pictures very fast and in reverse?
Because they're the ones holding the check-signing pen.

- Satya P, on A.S.R

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula 5.0.2 FreeBSD port fails to build during upgrade

2010-07-20 Thread Paul Mather
On Jul 20, 2010, at 3:10 PM, Dan Langille wrote:

> On 7/20/2010 12:20 PM, Paul Mather wrote:
>> I'm running FreeBSD 8.1-PRERELEASE (RELENG_8).  Recently, the 
>> sysutils/bacula-{client,server} ports were updated to 5.0.2.  Unfortunately, 
>> when updating via portmaster, the bacula-client port updated successfully, 
>> but bacula-server did not.  It fails to build:
>> 
>> [[...]]
>> Compiling ua_restore.c
>> Compiling ua_run.c
>> Compiling ua_select.c
>> Compiling ua_server.c
>> Compiling ua_status.c
>> Compiling ua_tree.c
>> Compiling ua_update.c
>> Compiling vbackup.c
>> Compiling verify.c
>> Linking bacula-dir ...
>> /usr/ports/sysutils/bacula-server/work/bacula-5.0.2/libtool --silent 
>> --tag=CXX --mode=link /usr/bin/c++  -L/usr/local/lib -L../lib -L../cats 
>> -L../findlib -o bacula-dir dird.o admin.o authenticate.o autoprune.o 
>> backup.o bsr.o catreq.o dir_plugins.o dird_conf.o expand.o fd_cmds.o 
>> getmsg.o inc_conf.o job.o jobq.o migrate.o mountreq.o msgchan.o next_vol.o 
>> newvol.o pythondir.o recycle.o restore.o run_conf.o scheduler.o ua_acl.o 
>> ua_cmds.o ua_dotcmds.o ua_query.o ua_input.o ua_label.o ua_output.o 
>> ua_prune.o ua_purge.o ua_restore.o ua_run.o ua_select.o ua_server.o 
>> ua_status.o ua_tree.o ua_update.o vbackup.o verify.o  -lbacfind -lbacsql 
>> -lbacpy -lbaccfg -lbac -lm   -L/usr/local/lib -lpq -lcrypt -lpthread  -lintl 
>>  -lwrap /usr/local/lib/libintl.so /usr/local/lib/libiconv.so -Wl,-rpath 
>> -Wl,/usr/local/lib -lssl -lcrypto
>> /usr/local/lib/libbacsql.so: undefined reference to 
>> `rwl_writelock(s_rwlock_tag*)'
>> *** Error code 1
>> 
>> Stop in /usr/ports/sysutils/bacula-server/work/bacula-5.0.2/src/dird.
>> 
>> 
>>   == Error in 
>> /usr/ports/sysutils/bacula-server/work/bacula-5.0.2/src/dird ==
>> 
>> 
>> *** Error code 1
>> 
>> Stop in /usr/ports/sysutils/bacula-server/work/bacula-5.0.2.
>> *** Error code 1
>> 
>> Stop in /usr/ports/sysutils/bacula-server.
>> *** Error code 1
>> 
>> Stop in /usr/ports/sysutils/bacula-server.
>> 
>> 
>> It looks to me that the linking step above is wrong: it is picking up the 
>> old version of the library installed in /usr/local/lib by 
>> sysutils/bacula-server 5.0.0_1.  It shouldn't be including 
>> "-L/usr/local/lib" in the invocation of libtool.
>> 
>> Anyone who builds the port from scratch will not have a problem, but anyone 
>> updating via portmaster or portupgrade will run into the problems above.
> 
> Agreed.  I heard about this yesterday, but have not had time to fix it.
> 
> We're also going to change the port to default to PostgreSQL instead of 
> SQLite.
> 
> Sorry you encountered the problem.

No problems, as the workaround was simple and I wanted to give folks a 
heads-up.  (I guess I should have been more explicit, but the workaround is 
simply to pkg_delete the bacula-server port and reinstall it, rather than 
trying to upgrade via portmaster/portupgrade.  Deleting the port won't remove 
any local configuration files, for those who might be worried.)

Good to hear that PostgreSQL will become the default back-end database.  Nice 
work!

Cheers,

Paul.



--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Restore issues

2010-07-20 Thread John Drescher
>>> How do I cause bacula to read these volumes and/or rewrite them into 
>>> database?
>
> bscan, I think.
>
Yes, if the volumes have not been recycled bscan is the tool pull the
attributes back into the database. Better fix the retention periods in
the configuration and reload the configs before running bscan to
protect against database pruning after bscan finishes.

John

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula 5.0.2 FreeBSD port fails to build during upgrade

2010-07-20 Thread Dan Langille
On 7/20/2010 12:20 PM, Paul Mather wrote:
> I'm running FreeBSD 8.1-PRERELEASE (RELENG_8).  Recently, the 
> sysutils/bacula-{client,server} ports were updated to 5.0.2.  Unfortunately, 
> when updating via portmaster, the bacula-client port updated successfully, 
> but bacula-server did not.  It fails to build:
>
> [[...]]
> Compiling ua_restore.c
> Compiling ua_run.c
> Compiling ua_select.c
> Compiling ua_server.c
> Compiling ua_status.c
> Compiling ua_tree.c
> Compiling ua_update.c
> Compiling vbackup.c
> Compiling verify.c
> Linking bacula-dir ...
> /usr/ports/sysutils/bacula-server/work/bacula-5.0.2/libtool --silent 
> --tag=CXX --mode=link /usr/bin/c++  -L/usr/local/lib -L../lib -L../cats 
> -L../findlib -o bacula-dir dird.o admin.o authenticate.o autoprune.o backup.o 
> bsr.o catreq.o dir_plugins.o dird_conf.o expand.o fd_cmds.o getmsg.o 
> inc_conf.o job.o jobq.o migrate.o mountreq.o msgchan.o next_vol.o newvol.o 
> pythondir.o recycle.o restore.o run_conf.o scheduler.o ua_acl.o ua_cmds.o 
> ua_dotcmds.o ua_query.o ua_input.o ua_label.o ua_output.o ua_prune.o 
> ua_purge.o ua_restore.o ua_run.o ua_select.o ua_server.o ua_status.o 
> ua_tree.o ua_update.o vbackup.o verify.o  -lbacfind -lbacsql -lbacpy -lbaccfg 
> -lbac -lm   -L/usr/local/lib -lpq -lcrypt -lpthread  -lintl  -lwrap 
> /usr/local/lib/libintl.so /usr/local/lib/libiconv.so -Wl,-rpath 
> -Wl,/usr/local/lib -lssl -lcrypto
> /usr/local/lib/libbacsql.so: undefined reference to 
> `rwl_writelock(s_rwlock_tag*)'
> *** Error code 1
>
> Stop in /usr/ports/sysutils/bacula-server/work/bacula-5.0.2/src/dird.
>
>
>== Error in 
> /usr/ports/sysutils/bacula-server/work/bacula-5.0.2/src/dird ==
>
>
> *** Error code 1
>
> Stop in /usr/ports/sysutils/bacula-server/work/bacula-5.0.2.
> *** Error code 1
>
> Stop in /usr/ports/sysutils/bacula-server.
> *** Error code 1
>
> Stop in /usr/ports/sysutils/bacula-server.
>
>
> It looks to me that the linking step above is wrong: it is picking up the old 
> version of the library installed in /usr/local/lib by sysutils/bacula-server 
> 5.0.0_1.  It shouldn't be including "-L/usr/local/lib" in the invocation of 
> libtool.
>
> Anyone who builds the port from scratch will not have a problem, but anyone 
> updating via portmaster or portupgrade will run into the problems above.

Agreed.  I heard about this yesterday, but have not had time to fix it.

We're also going to change the port to default to PostgreSQL instead of 
SQLite.

Sorry you encountered the problem.

-- 
Dan Langille - http://langille.org/

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Restore issues

2010-07-20 Thread Dan Langille
On 7/20/2010 10:39 AM, Troy Kocher wrote:
>>
>>
>> Listers,
>>
>> Hope someone can provide some help.
>>
>> I have installed Bacula-Server 5.0.0_1&  Bacula-Client 5.0.0 from FreeBSD 
>> 7.3RELEASE's ports collection on my backup server named (fatso) fatso-dir, 
>> fatso-sd, and fatso-fd.  I have another FreeBSD7.2RELEASE box named 
>> (database) running postgresql-server-8.4.4_2, with several databases, along 
>> with bacula.  I use NO tape, but rather back everything up to disk on 
>> fatso-sd.  I have several clients, FreeBSD&  Windows.>80% of them preform 
>> nightly backups without any problem, with only a few file errors on the 
>> window boxes.  Therefore I believe my configuration good, although in need 
>> of a little tuning.
>>
>> My issue is restoring.  Today I noticed one of my email users was missing 
>> data.  So I tried to dig it out of Bacula.
>>
>> I identified the job I wanted to look in:
>> -rw-r-  1 bacula  wheel6462085756 Jul 13 02:21 MailF-0087
>> -rw-r-  1 bacula  wheel1716756031 Jul 19 02:15 MailF-0091
>>
>> But when I tried to query it. .
>> *restore
>> Automatically selected Catalog: MyCatalog
>> Using Catalog "MyCatalog"
>>
>> First you select one or more JobIds that contain files
>> to be restored. ..
>>
>> To select the JobIds, you have the following choices:
>>  1: List last 20 Jobs run
>>  2: List Jobs where a given File is saved
>>  3: Enter list of comma separated JobIds to select
>> ..
>> Select item:  (1-13): 3
>> Enter JobId(s), comma separated, to restore: 87
>> Unable to get Job record for JobId=87: ERR=sql_get.c:316 No Job found for 
>> JobId 87
>>
>> How do I cause bacula to read these volumes and/or rewrite them into 
>> database?

bscan, I think.

>> It concerns me that even though it appears for the dates on volumes in my 
>> backup directory, that dailys are working properly, but is the catalog on 
>> pgsql getting updated ??
>>
>> Tips would really be appreciated.
-
It sounds like your retention limits differ.  There are three types of 
retention: File, Job, Volume.

I suspect that is your problem.  The Job retention limit appears to have 
expired.

-- 
Dan Langille - http://langille.org/

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan and wrong mysql password

2010-07-20 Thread Dan Langille
On 7/20/2010 8:11 AM, Proskurin Kirill wrote:
> On 20/07/10 15:13, Dan Langille wrote:
>> On 7/20/2010 7:05 AM, Proskurin Kirill wrote:
>>> On 20/07/10 14:59, Proskurin Kirill wrote:
 On 20/07/10 14:48, Dan Langille wrote:

>> mysql.c:195 Unable to connect to MySQL server.
>> Database=bacula User=root
>
> That is user root
>
>> MySQL connect failed either server not running or your
>> authorization is
>> incorrect.
>>
>> But it is not true:
>>
>> mysql -ubacula -phidden bacula
>
> This is user bacula

 It is a misstype, sorry.
 Of course I use user bacula, db bacula, right pass and -h localhost.
 But it is still get auth failed.

 I check it really many times - I can successfully auth via mysql but
 can`t via bscan.

>>>
>>> Here all this again:
>>>
>>> apollo# bscan -ubacula -phidden -h localhost -v -r -c
>>
>> I think you want -P, not -p.
>
> Wow - it works! Thank you!
> In man page it is:
>
> -p password
> Specify database password (default: none)
>

I don't know what man page you're looking at, but that's what where I 
got my information.  :)

-- 
Dan Langille - http://langille.org/

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Configuration Problem - On Ubuntu 10.04, Bacula Version 5.0.1-1ubuntu1

2010-07-20 Thread Joel Staker
Greetings,

I am a netadmin for a small city.  We have been using bacula for a while but 
ran into a problem during an upgrade.  I would gladly pay someone knowledgeable 
to give me some help fixing my broken configs.  If you are interested,  please 
email me directly.  I could pay 250.00 via paypal or some other payment method 
for a fix today.

Thanks.  I will send you the current configs if you are interested.  I don't 
really want to put them in this email as they are undergoing changes as we try 
to fix the problem ourselves.

Regards,

Joel

You can call me at area code (eight-three-one) 406-1044



--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula 5.0.2 FreeBSD port fails to build during upgrade

2010-07-20 Thread Paul Mather
I'm running FreeBSD 8.1-PRERELEASE (RELENG_8).  Recently, the 
sysutils/bacula-{client,server} ports were updated to 5.0.2.  Unfortunately, 
when updating via portmaster, the bacula-client port updated successfully, but 
bacula-server did not.  It fails to build:

[[...]]
Compiling ua_restore.c
Compiling ua_run.c
Compiling ua_select.c
Compiling ua_server.c
Compiling ua_status.c
Compiling ua_tree.c
Compiling ua_update.c
Compiling vbackup.c
Compiling verify.c
Linking bacula-dir ...
/usr/ports/sysutils/bacula-server/work/bacula-5.0.2/libtool --silent --tag=CXX 
--mode=link /usr/bin/c++  -L/usr/local/lib -L../lib -L../cats -L../findlib -o 
bacula-dir dird.o admin.o authenticate.o autoprune.o backup.o bsr.o catreq.o 
dir_plugins.o dird_conf.o expand.o fd_cmds.o getmsg.o inc_conf.o job.o jobq.o 
migrate.o mountreq.o msgchan.o next_vol.o newvol.o pythondir.o recycle.o 
restore.o run_conf.o scheduler.o ua_acl.o ua_cmds.o ua_dotcmds.o ua_query.o 
ua_input.o ua_label.o ua_output.o ua_prune.o ua_purge.o ua_restore.o ua_run.o 
ua_select.o ua_server.o ua_status.o ua_tree.o ua_update.o vbackup.o verify.o  
-lbacfind -lbacsql -lbacpy -lbaccfg -lbac -lm   -L/usr/local/lib -lpq -lcrypt 
-lpthread  -lintl  -lwrap /usr/local/lib/libintl.so /usr/local/lib/libiconv.so 
-Wl,-rpath -Wl,/usr/local/lib -lssl -lcrypto
/usr/local/lib/libbacsql.so: undefined reference to 
`rwl_writelock(s_rwlock_tag*)'
*** Error code 1

Stop in /usr/ports/sysutils/bacula-server/work/bacula-5.0.2/src/dird.


  == Error in /usr/ports/sysutils/bacula-server/work/bacula-5.0.2/src/dird 
==


*** Error code 1

Stop in /usr/ports/sysutils/bacula-server/work/bacula-5.0.2.
*** Error code 1

Stop in /usr/ports/sysutils/bacula-server.
*** Error code 1

Stop in /usr/ports/sysutils/bacula-server.


It looks to me that the linking step above is wrong: it is picking up the old 
version of the library installed in /usr/local/lib by sysutils/bacula-server 
5.0.0_1.  It shouldn't be including "-L/usr/local/lib" in the invocation of 
libtool.

Anyone who builds the port from scratch will not have a problem, but anyone 
updating via portmaster or portupgrade will run into the problems above.

Cheers,

Paul.


--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing "Maximum Block Size": reading previous backups

2010-07-20 Thread Alex Chekholko
On Tue, 20 Jul 2010 11:11:49 +1200
Craig Miskell  wrote:

> Hi,
>   It looks like I need to beef up "Maximum Block Size" to get good 
> performance out of our LTO-4 tape drives.
> 
> Before I do, I'd like to know what effect this has on restoring from backups 
> taken with the default block size.  Will I 
> need to modify the Device configuration back to it's default setting to be 
> able to restore from those tapes, or will 
> Bacula figure out what it needs to do?
> 

I believe it is the former.

I did same thing (upped 'Maximum Block Size" for LTO-4 performance) but
didn't test any restores from the tapes written with the old block
size.  And eventually they were recycled.

Regards,
-- 
Alex Chekholko   ch...@genomics.upenn.edu

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Please mount volume...

2010-07-20 Thread John Drescher
On Tue, Jul 20, 2010 at 11:23 AM, Bill Arlofski  wrote:
> On 07/19/10 15:26, John Drescher wrote:
>
>>> JJ wrote:
>>> That worked! It So I basically need to wipe it and then readd to the bacula 
>>> by issuing 'label barcodes'?
>>
>> Yes.
>>
>>> And the problem was that it was corrupt?
>>>
>>
>> The problem is that volume did not contain a valid volume label. It
>> appears that for some reason the labeling did not work when you first
>> added the volume. I am not sure of the cause of that.
>>
>> John
>
>
> John, it is possible that this was caused because he was initially using the
> rewinding tape device /dev/st0 instead of the non-rewinding device /dev/nst0?
>  You had cause this configuration issue earlier in the thread.
>
The reason why I did not think it was caused by that on the tape
KL0339 is because the tape was not used after the label operation. The
last written date was 000-00-00 00:00:00 and only a single block was
written to that tape.

John

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Please mount volume...

2010-07-20 Thread Bill Arlofski
On 07/19/10 15:26, John Drescher wrote:

>> JJ wrote:
>> That worked! It So I basically need to wipe it and then readd to the bacula 
>> by issuing 'label barcodes'?
> 
> Yes.
> 
>> And the problem was that it was corrupt?
>>
> 
> The problem is that volume did not contain a valid volume label. It
> appears that for some reason the labeling did not work when you first
> added the volume. I am not sure of the cause of that.
> 
> John


John, it is possible that this was caused because he was initially using the
rewinding tape device /dev/st0 instead of the non-rewinding device /dev/nst0?
 You had cause this configuration issue earlier in the thread.

Just a thought

-- 
Bill Arlofski
Reverse Polarity, LLC

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Can I take a base job from data already in the SD?

2010-07-20 Thread Mister IT Guru
I've been reading up on some of the new features, and one of them is a 
base job. Do I need to do an actual full backup to create a base, or can 
I make one from existing backed up data?

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Restore issues

2010-07-20 Thread Troy Kocher
> 
> 
> Listers, 
> 
> Hope someone can provide some help.
> 
> I have installed Bacula-Server 5.0.0_1 & Bacula-Client 5.0.0 from FreeBSD 
> 7.3RELEASE's ports collection on my backup server named (fatso) fatso-dir, 
> fatso-sd, and fatso-fd.  I have another FreeBSD7.2RELEASE box named 
> (database) running postgresql-server-8.4.4_2, with several databases, along 
> with bacula.  I use NO tape, but rather back everything up to disk on 
> fatso-sd.  I have several clients, FreeBSD & Windows.  >80% of them preform 
> nightly backups without any problem, with only a few file errors on the 
> window boxes.  Therefore I believe my configuration good, although in need of 
> a little tuning.  
> 
> My issue is restoring.  Today I noticed one of my email users was missing 
> data.  So I tried to dig it out of Bacula.  
> 
> I identified the job I wanted to look in:
> -rw-r-  1 bacula  wheel6462085756 Jul 13 02:21 MailF-0087
> -rw-r-  1 bacula  wheel1716756031 Jul 19 02:15 MailF-0091
> 
> But when I tried to query it. . 
> *restore
> Automatically selected Catalog: MyCatalog
> Using Catalog "MyCatalog"
> 
> First you select one or more JobIds that contain files
> to be restored. ..
> 
> To select the JobIds, you have the following choices:
> 1: List last 20 Jobs run
> 2: List Jobs where a given File is saved
> 3: Enter list of comma separated JobIds to select
> ..
> Select item:  (1-13): 3
> Enter JobId(s), comma separated, to restore: 87
> Unable to get Job record for JobId=87: ERR=sql_get.c:316 No Job found for 
> JobId 87
> 
> How do I cause bacula to read these volumes and/or rewrite them into database?
> 
> It concerns me that even though it appears for the dates on volumes in my 
> backup directory, that dailys are working properly, but is the catalog on 
> pgsql getting updated ??
> 
> Tips would really be appreciated.
> 
> Thanks
> Troy
> 



smime.p7s
Description: S/MIME cryptographic signature
--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan and wrong mysql password

2010-07-20 Thread Proskurin Kirill
On 20/07/10 15:13, Dan Langille wrote:
> On 7/20/2010 7:05 AM, Proskurin Kirill wrote:
>> On 20/07/10 14:59, Proskurin Kirill wrote:
>>> On 20/07/10 14:48, Dan Langille wrote:
>>>
> mysql.c:195 Unable to connect to MySQL server.
> Database=bacula User=root

 That is user root

> MySQL connect failed either server not running or your
> authorization is
> incorrect.
>
> But it is not true:
>
> mysql -ubacula -phidden bacula

 This is user bacula
>>>
>>> It is a misstype, sorry.
>>> Of course I use user bacula, db bacula, right pass and -h localhost.
>>> But it is still get auth failed.
>>>
>>> I check it really many times - I can successfully auth via mysql but
>>> can`t via bscan.
>>>
>>
>> Here all this again:
>>
>> apollo# bscan -ubacula -phidden -h localhost -v -r -c
>
> I think you want -P, not -p.

Wow - it works! Thank you!
In man page it is:

-p password
   Specify database password (default: none)

And nothing about a -P


-- 
Best regards,
Proskurin Kirill

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan and wrong mysql password

2010-07-20 Thread Dan Langille
On 7/20/2010 7:05 AM, Proskurin Kirill wrote:
> On 20/07/10 14:59, Proskurin Kirill wrote:
>> On 20/07/10 14:48, Dan Langille wrote:
>>
 mysql.c:195 Unable to connect to MySQL server.
 Database=bacula User=root
>>>
>>> That is user root
>>>
 MySQL connect failed either server not running or your authorization is
 incorrect.

 But it is not true:

 mysql -ubacula -phidden bacula
>>>
>>> This is user bacula
>>
>> It is a misstype, sorry.
>> Of course I use user bacula, db bacula, right pass and -h localhost.
>> But it is still get auth failed.
>>
>> I check it really many times - I can successfully auth via mysql but
>> can`t via bscan.
>>
>
> Here all this again:
>
> apollo# bscan -ubacula -phidden -h localhost -v -r -c

I think you want -P, not -p.

> /usr/local/etc/bacula-sd.conf
> /backup/production/server.domain.org/server.domain-full-0093
> bscan: butil.c:282 Using device: "/backup/production/server.domain.org"
> for reading.
> 20-Jul 11:02 bscan JobId 0: Ready to read from volume
> "server.domain-full-0093" on device "server.domain.org"
> (/backup/production/server.domain.org).
> 20-Jul 11:02 bscan: ERROR TERMINATION at bscan.c:305
> mysql.c:195 Unable to connect to MySQL server.
> Database=bacula User=bacula
> MySQL connect failed either server not running or your authorization is
> incorrect.
>
>
> apollo# mysql -ubacula -phidden -h localhost bacula
> Welcome to the MySQL monitor.  Commands end with ; or \g.
> Your MySQL connection id is 88794
> Server version: 5.1.44 FreeBSD port: mysql-server-5.1.44
>
> Type 'help;' or '\h' for help. Type '\c' to clear the current input
> statement.
>
> mysql>  quit
> Bye
>


-- 
Dan Langille - http://langille.org/

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan and wrong mysql password

2010-07-20 Thread Proskurin Kirill
On 20/07/10 14:59, Proskurin Kirill wrote:
> On 20/07/10 14:48, Dan Langille wrote:
>
>>> mysql.c:195 Unable to connect to MySQL server.
>>> Database=bacula User=root
>>
>> That is user root
>>
>>> MySQL connect failed either server not running or your authorization is
>>> incorrect.
>>>
>>> But it is not true:
>>>
>>> mysql -ubacula -phidden bacula
>>
>> This is user bacula
>
> It is a misstype, sorry.
> Of course I use user bacula, db bacula, right pass and -h localhost.
> But it is still get auth failed.
>
> I check it really many times - I can successfully auth via mysql but
> can`t via bscan.
>

Here all this again:

apollo# bscan -ubacula -phidden -h localhost -v -r -c 
/usr/local/etc/bacula-sd.conf 
/backup/production/server.domain.org/server.domain-full-0093
bscan: butil.c:282 Using device: "/backup/production/server.domain.org" 
for reading.
20-Jul 11:02 bscan JobId 0: Ready to read from volume 
"server.domain-full-0093" on device "server.domain.org" 
(/backup/production/server.domain.org).
20-Jul 11:02 bscan: ERROR TERMINATION at bscan.c:305
mysql.c:195 Unable to connect to MySQL server.
Database=bacula User=bacula
MySQL connect failed either server not running or your authorization is 
incorrect.


apollo# mysql -ubacula -phidden -h localhost bacula
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 88794
Server version: 5.1.44 FreeBSD port: mysql-server-5.1.44

Type 'help;' or '\h' for help. Type '\c' to clear the current input 
statement.

mysql> quit
Bye

-- 
Best regards,
Proskurin Kirill

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan and wrong mysql password

2010-07-20 Thread Proskurin Kirill
On 20/07/10 14:48, Dan Langille wrote:

>> mysql.c:195 Unable to connect to MySQL server.
>> Database=bacula User=root
>
> That is user root
>
>> MySQL connect failed either server not running or your authorization is
>> incorrect.
>>
>> But it is not true:
>>
>> mysql -ubacula -phidden bacula
>
> This is user bacula

It is a misstype, sorry.
Of course I use user bacula, db bacula, right pass and -h localhost.
But it is still get auth failed.

I check it really many times - I can successfully auth via mysql but 
can`t via bscan.

-- 
Best regards,
Proskurin Kirill

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bscan and wrong mysql password

2010-07-20 Thread Dan Langille
On 7/20/2010 5:24 AM, Proskurin Kirill wrote:
> Hello.
>
> What we have:
> FreeBSD-8.0
> bacula-client-3.0.3
> bacula-server-3.0.3
> ysql-client-5.1.44
> mysql-server-5.1.44
>
> I try to restore catalog records from volume and do:
>
> bscan -p hidden -v -r -c /usr/local/etc/bacula-sd.conf
> /backup/production/server.domain.org/server.domain.org-full-0093
>
> bscan: butil.c:282 Using device: "/backup/production/server.domain.org"
> for reading.
> 20-Jul 09:11 bscan JobId 0: Ready to read from volume
> "server.domain.org-full-0093" on device "server.domain.org"
> (/backup/production/server.domain.org).
> 20-Jul 09:12 bscan: ERROR TERMINATION at bscan.c:305
> mysql.c:195 Unable to connect to MySQL server.
> Database=bacula User=root

That is user root

> MySQL connect failed either server not running or your authorization is
> incorrect.
>
> But it is not true:
>
> mysql -ubacula -phidden bacula

This is user bacula

> Welcome to the MySQL monitor.  Commands end with ; or \g.
> Your MySQL connection id is 88184
> Server version: 5.1.44 FreeBSD port: mysql-server-5.1.44
>
> Type 'help;' or '\h' for help. Type '\c' to clear the current input
> statement.
>
> mysql>  Ctrl-C -- exit!
>
> So - why bscan failed authorization? Whats wrong?
>
> P.S. I try to set -h localhost and I try to use root mysql auth - not helps.


-- 
Dan Langille - http://langille.org/

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] bscan and wrong mysql password

2010-07-20 Thread Proskurin Kirill
Hello.

What we have:
FreeBSD-8.0
bacula-client-3.0.3
bacula-server-3.0.3
ysql-client-5.1.44
mysql-server-5.1.44

I try to restore catalog records from volume and do:

bscan -p hidden -v -r -c /usr/local/etc/bacula-sd.conf 
/backup/production/server.domain.org/server.domain.org-full-0093

bscan: butil.c:282 Using device: "/backup/production/server.domain.org" 
for reading.
20-Jul 09:11 bscan JobId 0: Ready to read from volume 
"server.domain.org-full-0093" on device "server.domain.org" 
(/backup/production/server.domain.org).
20-Jul 09:12 bscan: ERROR TERMINATION at bscan.c:305
mysql.c:195 Unable to connect to MySQL server.
Database=bacula User=root
MySQL connect failed either server not running or your authorization is 
incorrect.

But it is not true:

mysql -ubacula -phidden bacula
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 88184
Server version: 5.1.44 FreeBSD port: mysql-server-5.1.44

Type 'help;' or '\h' for help. Type '\c' to clear the current input 
statement.

mysql> Ctrl-C -- exit!

So - why bscan failed authorization? Whats wrong?

P.S. I try to set -h localhost and I try to use root mysql auth - not helps.

-- 
Best regards,
Proskurin Kirill

--
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users