Re: [Bacula-users] Problems backing up to disk

2011-06-25 Thread Mehma Sarja
On 6/25/11 1:13 PM, mikewilt wrote:
> I have set up two similar installations at home and at church.  They both 
> have the same problem.  Both are running under Linux:
>
> Linux version 2.6.26-2-686 (Debian 2.6.26-26lenny1) (da...@debian.org) (gcc 
> version 4.1.3 20080704 (prerelease) (Debian 4.1.2-25)) #1 SMP Thu Nov 25 
> 01:53:57 UTC 2010
>
> Both are running Bacula Version: 5.0.3 (04 August 2010)
>
> I configured to use disk storage based on the chapter "Automated Disk Backup" 
> in the user manual.
>
> It seems to work ok for a while, but the volume status for disk volumes turns 
> fairly quickly to "Error".  At this point they don't get used or recycled and 
> it runs out of usable volumes.  I have been able to restore from such volumes 
> so their contents seems to be ok.  I can force it to purge them but that is 
> very tedious.
>
> Any ideas out there?
>
> Mike
>
Mike,

The only thing I can conjecture due to the lack of disclosure of the 
seemingly closely-held details is that you are the common denominator in 
both church and home setups. Hence, you have done something wrong. Are 
the volumes overfilling the disks? Could be. Or it could be one of many 
other causes. What does the error say? A list of the "messages" output 
will be helpful. So, I hope you don't get overly frustrated with 
Bacula.We can only help once you share the details.

Mehma

--
All the data continuously generated in your IT infrastructure contains a 
definitive record of customers, application performance, security 
threats, fraudulent activity and more. Splunk takes this data and makes 
sense of it. Business sense. IT sense. Common sense.. 
http://p.sf.net/sfu/splunk-d2d-c1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Problems backing up to disk

2011-06-25 Thread mikewilt
I have set up two similar installations at home and at church.  They both have 
the same problem.  Both are running under Linux:

Linux version 2.6.26-2-686 (Debian 2.6.26-26lenny1) (da...@debian.org) (gcc 
version 4.1.3 20080704 (prerelease) (Debian 4.1.2-25)) #1 SMP Thu Nov 25 
01:53:57 UTC 2010

Both are running Bacula Version: 5.0.3 (04 August 2010)

I configured to use disk storage based on the chapter "Automated Disk Backup" 
in the user manual.  

It seems to work ok for a while, but the volume status for disk volumes turns 
fairly quickly to "Error".  At this point they don't get used or recycled and 
it runs out of usable volumes.  I have been able to restore from such volumes 
so their contents seems to be ok.  I can force it to purge them but that is 
very tedious.

Any ideas out there?

Mike

+--
|This was sent by m...@mwilt.org via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
All the data continuously generated in your IT infrastructure contains a 
definitive record of customers, application performance, security 
threats, fraudulent activity and more. Splunk takes this data and makes 
sense of it. Business sense. IT sense. Common sense.. 
http://p.sf.net/sfu/splunk-d2d-c1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Migrating form mysql to postgresql: Loading the database takes very long

2011-06-25 Thread Gavin McCullagh
On Tue, 21 Jun 2011, Marcus Mülbüsch wrote:

> I want to migrate my bacula installation from mysql to postgresql, 
> following the guide in 
> http://www.bacula.org/5.0.x-manuals/en/main/main/Installing_Configuring_Post.html#SECTION00445
> 
> After dumping and converting the database the sql-file now has 9GiB.

One note I'd like to make on the page above is that the mysqldump command
includes the --skip-opt command.

This is not reliable to use if you have a reasonably large "File" table as
it includes an option to buffer query result in RAM before outputting to
file.  We have 65 million entries and our 6GB RAM + 2GB swap is not enough
to hold the buffer, so mysqldump ends up getting killed every time before
it finishes.

It seems you need to drop --quick which is implied in --skip-opt.  The
resulting command that I'm working with at the moment is:

mysqldump -t -n -c --compatible=postgresql --skip-quote-names --quick \
--lock-tables --add-drop-table --add-locks --create-options 
--disable-keys \
--extended-insert --set-charset  -u bacula -ppassword bacula \
| grep -v "INSERT INTO Status"\
| sed -e 's/-00-00 00:00:00/1970-01-01 00:00:00/g' \
| sed -e 's/\\0//' > bacula-backup.sql`

That being said, this is untested so far -- I haven't actually done the
migration -- but this is the plan thus far :-)

Feedback/corrections welcome...

Gavin


-- 
Gavin McCullagh
Senior System Administrator
IT Services
Griffith College 
South Circular Road
Dublin 8
Ireland
Tel: +353 1 4163365
http://www.gcd.ie
http://www.gcd.ie/brochure.pdf
http://www.gcd.ie/opendays
http://www.gcd.ie/ebrochure

This E-mail is from Griffith College.
The E-mail and any files transmitted with it are confidential and may be
privileged and are intended solely for the use of the individual or entity
to whom they are addressed. If you are not the addressee you are prohibited
from disclosing its content, copying it or distributing it otherwise than to
the addressee. If you have received this e-mail in error, please immediately
notify the sender by replying to this e-mail and delete the e-mail from your
computer.

Bellerophon Ltd, trades as Griffith College (registered in Ireland No.
60469) with its registered address as Griffith College Campus, South
Circular Road, Dublin 8, Ireland.


--
All the data continuously generated in your IT infrastructure contains a 
definitive record of customers, application performance, security 
threats, fraudulent activity and more. Splunk takes this data and makes 
sense of it. Business sense. IT sense. Common sense.. 
http://p.sf.net/sfu/splunk-d2d-c1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Director with 3 dedicated storage servers

2011-06-25 Thread John Drescher
>> Dear John, I am confused now:
>> It is still not clear to me how the Director does know where the File
>> Storage is
>> attached? As I wrote we have 3 dedicated SD storage servers, the Director
>> server
>> has no storage to hold the backup.
>> Or do you mean that we have also to run the Director on our 3 SD servers?
>>

You run the storage-daemon on any machine containing storage and
configure the director machine to use these storages. Remember in
bacula there are 3 different daemons (storage, director and client).

John

--
All the data continuously generated in your IT infrastructure contains a 
definitive record of customers, application performance, security 
threats, fraudulent activity and more. Splunk takes this data and makes 
sense of it. Business sense. IT sense. Common sense.. 
http://p.sf.net/sfu/splunk-d2d-c1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Director with 3 dedicated storage servers

2011-06-25 Thread xunil321


John M. Drescher wrote:
> 
> On Sat, Jun 25, 2011 at 9:13 AM, xunil321 
> wrote:
>>
>> Dear all,
>> we want to setup Bacula 5.0.3 under SLES 11 SP1 in the following way:
>> 1x Director and three DEDICATED SD servers (each system has 6TB disk
>> storage
>> and one LTO-4 tape autochanger). We learnt from this list that this
>> separation
>> can be done ie director and sd can live on different machines.
> 
> Yes. For the last 7 years I have had my director on a different
> machine than my storage machines. For most of this my database is/was
> on a different machine as well.
> 
>> But we are not sure about these mechanism:
>> - to use the file storage of our 3 SD servers the director has to mount
>> by
>> NFS
> 
> No, you do not want to mount storage by NFS. I would put a storage
> daemon on each machine.
> 
> Dear John, I am confused now:
> It is still not clear to me how the Director does know where the File
> Storage is
> attached? As I wrote we have 3 dedicated SD storage servers, the Director
> server
> has no storage to hold the backup.
> Or do you mean that we have also to run the Director on our 3 SD servers?
> 
> Rainer
> 
>>   these filesystems for the backup, right?
>> -  how does have the director access to the LTO-4 tape of our 3 SD
>> servers
>>   ie from where does it know the location of the autochanger
>> -  how to we have to configure/compile  Bacula 5.0.3 for the DEDICATED SD
>>   servers ie with the same options as we did it for the director?
>> Many thanks for any hints!
>> Rainer
>> --
>> View this message in context:
>> http://old.nabble.com/Director-with-3-dedicated-storage-servers-tp31925923p31925923.html
>> Sent from the Bacula - Users mailing list archive at Nabble.com.
>>
>>
>> --
>> All the data continuously generated in your IT infrastructure contains a
>> definitive record of customers, application performance, security
>> threats, fraudulent activity and more. Splunk takes this data and makes
>> sense of it. Business sense. IT sense. Common sense..
>> http://p.sf.net/sfu/splunk-d2d-c1
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
> 
> 
> 
> -- 
> John M. Drescher
> 
> --
> All the data continuously generated in your IT infrastructure contains a 
> definitive record of customers, application performance, security 
> threats, fraudulent activity and more. Splunk takes this data and makes 
> sense of it. Business sense. IT sense. Common sense.. 
> http://p.sf.net/sfu/splunk-d2d-c1
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
> 
> 

-- 
View this message in context: 
http://old.nabble.com/Director-with-3-dedicated-storage-servers-tp31925923p31926629.html
Sent from the Bacula - Users mailing list archive at Nabble.com.


--
All the data continuously generated in your IT infrastructure contains a 
definitive record of customers, application performance, security 
threats, fraudulent activity and more. Splunk takes this data and makes 
sense of it. Business sense. IT sense. Common sense.. 
http://p.sf.net/sfu/splunk-d2d-c1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Director with 3 dedicated storage servers

2011-06-25 Thread Ben Walton
Excerpts from xunil321's message of Sat Jun 25 09:13:26 -0400 2011:

> -  how to we have to configure/compile  Bacula 5.0.3 for the DEDICATED SD 
>servers ie with the same options as we did it for the director?

Build RPMs one one system that split the whole package out into dir,
fd and sd sub-packages.  Then just install the RPMs where you need
them.  Doing this ensures things are always built with the same
options.  It also makes option modification simpler and maintenance
becomes much nicer too.  For SLES, you may even find that someone else
has done the work for you.

If you need to see a good package split for the .spec file in your
RPMs, look at the way Debian split it up.  (I used that split as the
basis for my solaris packages.)

Once you've installed the sd rpm on the dedicated storage services,
you just need to setup the auth between the components but this is
roughly the same as if they local.

Thanks
-Ben
--
Ben Walton
Systems Programmer - CHASS
University of Toronto
C:416.407.5610 | W:416.978.4302


--
All the data continuously generated in your IT infrastructure contains a 
definitive record of customers, application performance, security 
threats, fraudulent activity and more. Splunk takes this data and makes 
sense of it. Business sense. IT sense. Common sense.. 
http://p.sf.net/sfu/splunk-d2d-c1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Director with 3 dedicated storage servers

2011-06-25 Thread John Drescher
On Sat, Jun 25, 2011 at 9:13 AM, xunil321  wrote:
>
> Dear all,
> we want to setup Bacula 5.0.3 under SLES 11 SP1 in the following way:
> 1x Director and three DEDICATED SD servers (each system has 6TB disk storage
> and one LTO-4 tape autochanger). We learnt from this list that this
> separation
> can be done ie director and sd can live on different machines.

Yes. For the last 7 years I have had my director on a different
machine than my storage machines. For most of this my database is/was
on a different machine as well.

> But we are not sure about these mechanism:
> - to use the file storage of our 3 SD servers the director has to mount by
> NFS

No, you do not want to mount storage by NFS. I would put a storage
daemon on each machine.

>   these filesystems for the backup, right?
> -  how does have the director access to the LTO-4 tape of our 3 SD servers
>   ie from where does it know the location of the autochanger
> -  how to we have to configure/compile  Bacula 5.0.3 for the DEDICATED SD
>   servers ie with the same options as we did it for the director?
> Many thanks for any hints!
> Rainer
> --
> View this message in context: 
> http://old.nabble.com/Director-with-3-dedicated-storage-servers-tp31925923p31925923.html
> Sent from the Bacula - Users mailing list archive at Nabble.com.
>
>
> --
> All the data continuously generated in your IT infrastructure contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and makes
> sense of it. Business sense. IT sense. Common sense..
> http://p.sf.net/sfu/splunk-d2d-c1
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>



-- 
John M. Drescher

--
All the data continuously generated in your IT infrastructure contains a 
definitive record of customers, application performance, security 
threats, fraudulent activity and more. Splunk takes this data and makes 
sense of it. Business sense. IT sense. Common sense.. 
http://p.sf.net/sfu/splunk-d2d-c1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Director with 3 dedicated storage servers

2011-06-25 Thread xunil321

Dear all,
we want to setup Bacula 5.0.3 under SLES 11 SP1 in the following way:
1x Director and three DEDICATED SD servers (each system has 6TB disk storage
and one LTO-4 tape autochanger). We learnt from this list that this
separation
can be done ie director and sd can live on different machines.
But we are not sure about these mechanism:
- to use the file storage of our 3 SD servers the director has to mount by
NFS 
   these filesystems for the backup, right?
-  how does have the director access to the LTO-4 tape of our 3 SD servers
   ie from where does it know the location of the autochanger
-  how to we have to configure/compile  Bacula 5.0.3 for the DEDICATED SD 
   servers ie with the same options as we did it for the director?
Many thanks for any hints!
Rainer 
-- 
View this message in context: 
http://old.nabble.com/Director-with-3-dedicated-storage-servers-tp31925923p31925923.html
Sent from the Bacula - Users mailing list archive at Nabble.com.


--
All the data continuously generated in your IT infrastructure contains a 
definitive record of customers, application performance, security 
threats, fraudulent activity and more. Splunk takes this data and makes 
sense of it. Business sense. IT sense. Common sense.. 
http://p.sf.net/sfu/splunk-d2d-c1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users