Re: [Bacula-users] Exchange Plugin Restore

2011-08-15 Thread Duncan McQueen
James,

Are there any trips or techniques on restoring using the Exchange plugin?  I 
assume that one issue could be this is a new clean server we are restoring to, 
and the plugin might be erroring out.  Should I do a debug trace (and what is 
the best way to do that keeping the service running as a Local system account)?


Duncan W. McQueen
911 Main Street, Suite 2400
Kansas City, MO 64105
(816) 421-0644 Telephone
(816) 421-0758 Facsimile
dmcqu...@vomer.com

The Biggest Little Law Firm (r) in Kansas City! 

NOTICE: The information contained in this e-mail message may be privileged, 
confidential and protected from disclosure. If you are not the intended 
recipient, any dissemination, distribution or copying is strictly prohibited. 
If you think that you have received this e-mail message in error, please e-mail 
the sender at dmcqu...@vomer.com

-Original Message-
From: James Harper [mailto:james.har...@bendigoit.com.au] 
Sent: Thursday, August 11, 2011 10:06 PM
To: Duncan McQueen
Subject: RE: [Bacula-users] Exchange Plugin Restore

 
 I think I read that the Exchange plugin just doesn't work - perhaps
that is
 the issue.   The files are there but error out.  In addition, I
noticed the
 @EXCHANGE directory being created off the root C:\.  I assume what
should be
 created is something within the exchange store, so something
fundamentally
 must be broken.

It does sound like something is wrong. There is a bug somewhere, in the
SD I think, that causes the logfiles not to restore correctly on an
incremental restore. It can be worked around but is somewhat painful.
For a full backup and restore I've never had a problem.

Can you describe the situation you are trying to restore from? Did a
server fail or are you just testing.

James

--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Exchange Plugin Restore

2011-08-15 Thread James Harper
 James,
 
 Are there any trips or techniques on restoring using the Exchange
plugin?  I
 assume that one issue could be this is a new clean server we are
restoring to,
 and the plugin might be erroring out.  Should I do a debug trace (and
what is
 the best way to do that keeping the service running as a Local system
 account)?
 

Can you first try restoring only from the full job? I have had trouble
restoring from full+incremental jobs before, but if the full job by
itself doesn't work then you have a different problem.

James

--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Copy jobs

2011-08-15 Thread Jérôme Blion

Hello,

I'm trying to copy jobs from one server to another.
I defined 2 storage daemons:

==
# Definition of file storage device
Storage {
  Name = File
  Address = tucana.domain# N.B. Use a fully qualified 
name here

  SDPort = 9103
  Password = password1
  Maximum Concurrent Jobs = 5
  Device = FileStorage
  Media Type = File
}

Storage {
  Name = File-Copy
  Address = carina.domain
  SDPort = 9103
  Password = password2
  Maximum Concurrent Jobs = 5
  Device = FileStorage
  Media Type = File
}
==

I defined 2 pools:

==
# File Pool definition
Pool {
  Name = File
  Pool Type = Backup
  Recycle = yes   # Bacula can automatically 
recycle Volumes

  LabelFormat = Vol
  AutoPrune = yes # Prune expired volumes
  Volume Retention = 35 days  # one month
  Maximum Volume Bytes = 50G  # Limit Volume size to something 
reasonable

  Maximum Volumes = 100   # Limit number of Volumes in Pool
  Recycle Oldest Volume = yes
  RecyclePool = Scratch
  NextPool = File-Copy
}

# File Pool definition
Pool {
  Name = File-Copy
  Pool Type = Backup
  Recycle = yes   # Bacula can automatically 
recycle Volumes

  LabelFormat = Copy
  AutoPrune = yes # Prune expired volumes
  Volume Retention = 35 days  # one month
  Maximum Volume Bytes = 50G  # Limit Volume size to something 
reasonable

  Maximum Volumes = 80# Limit number of Volumes in Pool
  Recycle Oldest Volume = yes
  Storage = File-Copy
}
==

Then, I created a job:
==
Job {
  Name = CopyJob
  Type = Copy
  Level = Full
  Client = tucana-fd
  FileSet = Full Set
  Messages = Standard
  Pool = File
  Maximum Concurrent Jobs = 4
  Storage = File
  Selection Type = Client
  SelectionPattern = tucana-fd
}
==

When I run it, I have the following director status:

Running Jobs:
Console connected at 15-août011 14:34
Console connected at 15-août011 17:53
 JobId Level   Name   Status
==
 25044 FullCopyJob.2011-08-15_17.47.16_39 is waiting on max Client jobs
 25045 FullCopyJob.2011-08-15_17.47.16_40 is waiting on Storage 
File-Copy
 25046 Increme  Backup_tucana.2011-08-15_17.47.16_41 is waiting on 
Storage File

 25047 FullCopyJob.2011-08-15_17.47.16_42 is waiting on max Client jobs

In this link: 
http://www.bacula.org/manuals/en/concepts/concepts/Migration_Copy.html
It's written that Migration is only implemented for a single Storage 
daemon. You cannot read on one Storage daemon and write on another.


Is this sentence still true ?
Can you confirm I'm concerned by this limitation ?

Best regards.
Jerome Blion.
--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Copy jobs

2011-08-15 Thread Joe Nyland
I would also like to know the answer to Jerome's initial question of whether 
the limitation still exists, which stops us from being able to copy between 
storage daemons. 

Copying data between SD's would be the 'icing on the cake' to my new Bacula 
system!

Kind regards,

Joe


On 15 Aug 2011, at 17:16, Jérôme Blion jerome.bl...@free.fr wrote:

 Hello, 
 
 I'm trying to copy jobs from one server to another.
 I defined 2 storage daemons: 
 
 ==
 # Definition of file storage device
 Storage {
   Name = File
   Address = tucana.domain# N.B. Use a fully qualified name 
 here
   SDPort = 9103
   Password = password1
   Maximum Concurrent Jobs = 5
   Device = FileStorage
   Media Type = File
 }
 
 Storage {
   Name = File-Copy
   Address = carina.domain
   SDPort = 9103
   Password = password2
   Maximum Concurrent Jobs = 5
   Device = FileStorage
   Media Type = File
 }
 ==
 
 I defined 2 pools: 
 
 ==
 # File Pool definition
 Pool {
   Name = File
   Pool Type = Backup
   Recycle = yes   # Bacula can automatically recycle 
 Volumes
   LabelFormat = Vol
   AutoPrune = yes # Prune expired volumes
   Volume Retention = 35 days  # one month
   Maximum Volume Bytes = 50G  # Limit Volume size to something 
 reasonable
   Maximum Volumes = 100   # Limit number of Volumes in Pool
   Recycle Oldest Volume = yes
   RecyclePool = Scratch
   NextPool = File-Copy
 }
 
 # File Pool definition
 Pool {
   Name = File-Copy
   Pool Type = Backup
   Recycle = yes   # Bacula can automatically recycle 
 Volumes
   LabelFormat = Copy
   AutoPrune = yes # Prune expired volumes
   Volume Retention = 35 days  # one month
   Maximum Volume Bytes = 50G  # Limit Volume size to something 
 reasonable
   Maximum Volumes = 80# Limit number of Volumes in Pool
   Recycle Oldest Volume = yes
   Storage = File-Copy
 }
 ==
 
 Then, I created a job: 
 ==
 Job {
   Name = CopyJob
   Type = Copy
   Level = Full
   Client = tucana-fd
   FileSet = Full Set
   Messages = Standard
   Pool = File
   Maximum Concurrent Jobs = 4
   Storage = File
   Selection Type = Client
   SelectionPattern = tucana-fd
 }
 ==
 
 When I run it, I have the following director status: 
 
 Running Jobs:
 Console connected at 15-août011 14:34
 Console connected at 15-août011 17:53
  JobId Level   Name   Status
 ==
  25044 FullCopyJob.2011-08-15_17.47.16_39 is waiting on max Client jobs
  25045 FullCopyJob.2011-08-15_17.47.16_40 is waiting on Storage File-Copy
  25046 Increme  Backup_tucana.2011-08-15_17.47.16_41 is waiting on Storage 
 File
  25047 FullCopyJob.2011-08-15_17.47.16_42 is waiting on max Client jobs
 
 In this link: 
 http://www.bacula.org/manuals/en/concepts/concepts/Migration_Copy.html
 It's written that Migration is only implemented for a single Storage daemon. 
 You cannot read on one Storage daemon and write on another.
 
 Is this sentence still true ?
 Can you confirm I'm concerned by this limitation ?
 
 Best regards.
 Jerome Blion.
 --
 uberSVN's rich system and user administration capabilities and model 
 configuration take the hassle out of deploying and managing Subversion and 
 the tools developers use with it. Learn more about uberSVN and get a free 
 download at:  http://p.sf.net/sfu/wandisco-dev2dev
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] multiple spool files / concurrent spooling/despooing again

2011-08-15 Thread mark . bergman
While I'm not able to contribute patches, I'd like to voice my support
for the concept of having multiple spool files to enable concurrent
spooling  de-spooling that Ralph Gross brought up in 2007[1] and which
Jesper Krogh submitted as a feature request in 2009[2].

Problem synopsis:

Data spooling is a necessity to get good throughput to modern,
high-speed tape drives, but bacula pauses the spooling as soon as
it starts writing to tape, which drastically reduces throughput.

Here are some numbers from our environment:

[A] Throughput w/o spooling: ~22MB/s
this represents the aggregate of the speed to read data from
disk and write to tape, with shoe-shining, network congestion,
disk contention, etc.

[B] Throughput to spool file: ~55MB/s
this represents the aggregate of the speed to read data from
disk (a 9TB logical volume made up from multiple RAID5 and RAID6
LUNs) and write to the RAID-10 spool partition. This includes
any network congestion, disk contention, etc.

[C] Throuput from disk spool file to LTO-4 tape: ~108MB/s
This is the raw despooling-speed.

[D] End-to-end throughput with spooling: ~27MB/s
This is very disappointing...this is the overall throughput of
[B] + [C] above. While eliminating shoe-shining is
much better for the tape media and tape drive, the
overall performance is almost identical to [A], while
it should be close to [B]. The reason for the decrease
in performance is that bacula stops all spooling as soon
as it starts de-spooling.

In an ideal configuration, there could be multiple spool directories defined,
and bacula would open a new spool file in the next directory as soon as it
begins despooling. An example bacula-sd configuration might contain:

Spool Directory=/raid0-A/spool
Spool Directory=/raid0-B/spool
Spool Directory=/raid0-C/spool
Concurrent Spool=yes

where each /raid0-* mount point is a separate RAID-0 array, so as to
minimize contention.

The Concurrent Spool option would determine whether spooling follows
the existing behavior, or if multiple spool files (possibly in different
directories) are used concurrently for spooling and despooling.

If the user defines a single spool directory (as in the current
configuration), and does not defined Concurrent Spool = yes, the
existing behavior would occur.


[1] http://copilotco.com/mail-archives/bacula-devel.2007/msg02642.html
[2] http://www.bacula.org/git/cgit.cgi/bacula/plain/bacula/projects?h=Branch-5.1

Thanks,

Mark


--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Need some help

2011-08-15 Thread Ignacio Cardona
Dear all,
I will be very glad if someone could help me.  I have decided
after many recommendations to implement Bacula software in the environment
of my e-commerce. The version that I'm trying to test is Bacula 5.0.3. I
have started reading the docs and all the stuff but I am completly mess up
with the information. I have experience in backup tools (TSM, NetBackup,
BackupEXEC). But in this case I cannot follow the installation guide so if
someone could give me a hand by giving some advices or at least how to begin
the instalation (I have downloaded the depackes and the Bacula 5.0.3) but my
problem starts when I have to perform de ./configure I don't know how to
configure it I mean when I use cat configure it looks like a script I have
to edit it or I'm suppose to edit another different file? Could help me with
that or give me some kind of guide more organize than the one that is on
bacula.com or at least tell me the order in which I am suppose to follow it.

Thanks in advance!
Don't hesitate in contact me for further questions!

Ignacio Cardona.
--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Exchange Plugin Restore

2011-08-15 Thread Duncan McQueen
One slight change I am doing is using regex to filter out only the exchange 
portions.  I am passing in EXCHANGE to the Regexp question.


Duncan W. McQueen
911 Main Street, Suite 2400
Kansas City, MO 64105
(816) 421-0644 Telephone
(816) 421-0758 Facsimile
dmcqu...@vomer.com

The Biggest Little Law Firm (r) in Kansas City! 

NOTICE: The information contained in this e-mail message may be privileged, 
confidential and protected from disclosure. If you are not the intended 
recipient, any dissemination, distribution or copying is strictly prohibited. 
If you think that you have received this e-mail message in error, please e-mail 
the sender at dmcqu...@vomer.com

-Original Message-
From: James Harper [mailto:james.har...@bendigoit.com.au] 
Sent: Monday, August 15, 2011 9:51 AM
To: Duncan McQueen
Cc: Bacula-users@lists.sourceforge.net
Subject: RE: [Bacula-users] Exchange Plugin Restore

 James,
 
 Are there any trips or techniques on restoring using the Exchange
plugin?  I
 assume that one issue could be this is a new clean server we are
restoring to,
 and the plugin might be erroring out.  Should I do a debug trace (and
what is
 the best way to do that keeping the service running as a Local system
 account)?
 

Can you first try restoring only from the full job? I have had trouble
restoring from full+incremental jobs before, but if the full job by
itself doesn't work then you have a different problem.

James

--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Copy jobs

2011-08-15 Thread Dan Langille

On Aug 15, 2011, at 12:16 PM, Jérôme Blion wrote:

 Hello, 
 
 I'm trying to copy jobs from one server to another.
 I defined 2 storage daemons: 
 
 
[snip]

 
 In this link: 
 http://www.bacula.org/manuals/en/concepts/concepts/Migration_Copy.html
 It's written that Migration is only implemented for a single Storage daemon. 
 You cannot read on one Storage daemon and write on another.
 
 Is this sentence still true ?

Yes.

 Can you confirm I'm concerned by this limitation ?


Yes, you cannot run copy jobs between Storage Daemons.

-- 
Dan Langille - http://langille.org

--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Need some help

2011-08-15 Thread Eric Pratt
2011/8/15 Ignacio Cardona ignaciocard...@gmail.com:
 Dear all,
     I will be very glad if someone could help me.  I have decided
 after many recommendations to implement Bacula software in the environment
 of my e-commerce. The version that I'm trying to test is Bacula 5.0.3. I
 have started reading the docs and all the stuff but I am completly mess up
 with the information. I have experience in backup tools (TSM, NetBackup,
 BackupEXEC). But in this case I cannot follow the installation guide so if
 someone could give me a hand by giving some advices or at least how to begin
 the instalation (I have downloaded the depackes and the Bacula 5.0.3) but my
 problem starts when I have to perform de ./configure I don't know how to
 configure it I mean when I use cat configure it looks like a script I have
 to edit it or I'm suppose to edit another different file? Could help me with
 that or give me some kind of guide more organize than the one that is on
 bacula.com or at least tell me the order in which I am suppose to follow it.

 Thanks in advance!
 Don't hesitate in contact me for further questions!

 Ignacio Cardona.

You should check with your operating system's package manager to see
if it already has a bacula package.  Then you can just install the
packages from your package manager and ignore compiling bacula (ie. no
need to worry about ./configure.)

If your operating system does not have a package, you can always run
this command to get help with the configure script:

 ./configure --help

Generally, if you don't think you need any specific compile-time
options enabled, you can just type this:

 ./configure  make  make install

Make sure you are root when you run this.  The configure script will
automatically scan your system for you.  It prepares the software so
it can be compiled for your system.  Unless you get an error that
causes configure to exit, you wont have to do anything more than
what's above to get the software configured, compiled, and installed.
After that, you can start following the reference manual on
configuring your directory, storage, and file daemons.

Eric

--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Exchange Plugin Restore

2011-08-15 Thread James Harper
 
 One slight change I am doing is using regex to filter out only the
exchange
 portions.  I am passing in EXCHANGE to the Regexp question.
 

Can you try just marking the /@EXCHANGE root directory?

James

--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Ignore fileset changes

2011-08-15 Thread Thomas Mueller
Am Wed, 10 Aug 2011 09:43:05 +0200 schrieb Olle Romo:

 Thank you Uwe. I misunderstood the concept.
 
 Is there a way to have Bacula just continue incremental backup of a
 drive even if it was offline for one run?
 


IMHO no, it will fail if a path is not available.

you could create a sort of dynamic fileset e.g. create a fileset on the 
fly on the client.

blog post I found (not using this feature this myself):
http://machine-cycle.blogspot.com/2010/02/dynamic-bacula-filesets.html

(don't forget to add Ignore FileSet Changes in the fileset and Accurate 
= yes in your job definition)

- Thomas



--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users