[Bacula-users] bconsole and bacula-dir always exit when restore

2010-12-01 Thread amybac
use "restore all", and select a job(this job is a little big, 200k files and 
14GB backedup), 
when entering the backed up file tree, bconsole exit and bacula-dir also exit.

a more painful thing is that every time I start a dir or fd, it need 1hour...
this waste too much time.

+--
|This was sent by lt...@163.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Network send error to SD. ERR=Connection timed out

2010-12-01 Thread rauch . holger
Hi,

I'm running Bacula 5.0.2 on a Debian Lenny AMD64 system and I'm trying to
back up data to a HP 1/8 G2 autoloader equipped with a HP Ultrium 920 drive.
I get the above message when backing up a particular host; the other ones
work without any problem. Interestingly enough, before I get this message,
spooling all files from the host to be backed up (on which bacula-sd runs)
to the host on which bacula-sd runs works without problems. Also, the
*initial* spooling of data works, as shown by this message from "status
* storage" run from within bconsole a few mintues before the error occurred:

Running Jobs:
Writing: Full Backup job QNAP_backup JobId=1194 Volume="ADE887L3"
pool="WeeklyBackups" device="HPUltrium920LTO3" (/dev/nst0)
spooling=0 despooling=1 despool_wait=0
Files=147,033 Bytes=107,330,630,244 Bytes/sec=77,945,265
FDReadSeqNo=2,758,023 in_msg=2380019 out_msg=14 fd=6

and also

Autochanger "HPStorageWorks18G2Autoldr" with devices:
   "HPUltrium920LTO3" (/dev/nst0)
Device "HPUltrium920LTO3" (/dev/nst0) is mounted with:
Volume:  ADE887L3
Pool:WeeklyBackups
Media type:  LTO-3
Slot 4 is loaded in drive 0.
Total Bytes=1,854,145,536 Blocks=7,073 Bytes/block=262,144
Positioned at File=0 Block=7,074

and

Used Volume status:
ADE887L3 on device "HPUltrium920LTO3" (/dev/nst0)
Reader=0 writers=1 devres=0 volinuse=1

Two minutes later the error message mentioned above appeared. What might be
the cause for such an error (Network send error to SD. ERR=Connection timed
out)?

Thanks in advance & kind regards,

   Holger


signature.asc
Description: Digital signature
--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Solaris Dir can not access Linux FD

2010-12-01 Thread Dan Langille
On 12/1/2010 8:27 PM, amybac wrote:
>
> Dan Langille wrote:
>> On 12/1/2010 8:04 PM, amybac wrote:
>>
>>>
>>> Francisco Javier Funes... wrote:
>>>
 The Solaris server is in the same subnet as the Linux Server?

>>>
>>> No, but I have another solaris C, C is not the same subnet with Sserver, 
>>> and Sserver can access C.
>>>
>>>
>>>
 You can ping the host?

>>>
>>> yes. alive.
>>>
>>>
>>>
 There's a firewall or 'smart' router between hosts?

>>>
>>> No firewall. do you mean smartroute process? I didn't find this process and 
>>> service.
>>>
>>>
>>>
 Can you telnet from Linux Server to Solaris Server in the bacula ports?

>>>
>>> No. but telnet did not work between Sserver and solaris C,and they backup 
>>> successfully
>>> ==>a little more: when telnet from Sserver to C, it hangs at" connected to 
>>> C, Escape is ^]", seems waiting there and no "xx>" --- this means telnet 
>>> success??
>>> when telnet from Sserver to Lserver, it hangs at " trying Lserver..." and 
>>> waiting there..
>>>
>>
>> The following is normal:
>>
>> $ telnet 10.55.0.1 9102
>> Trying 10.55.0.1...
>> Connected to bast.unixathome.org.
>> Escape character is '^]'.
>> typesomethinghere
>> Connection closed by foreign host.
>> $
>>
>
> Dan, yes, seems Lserver and Server can not telnet to each other, as shown 
> above. Then how to deal with this?
> thanks

You figure out why.  :)

This is a network issue.  It's back to basics.

Confirm that the daemons are running.  Confirm that you can telnet to 
that port from that host. In my case, I would ssh to 10.55.0.1, then 
from that host, telnet to to the same host.  If you can, then you KNOW 
it's an access issue between the hosts.

-- 
Dan Langille - http://langille.org/

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Solaris Dir can not access Linux FD

2010-12-01 Thread amybac

Dan Langille wrote:
> On 12/1/2010 8:04 PM, amybac wrote:
> 
> > 
> > Francisco Javier Funes... wrote:
> > 
> > > The Solaris server is in the same subnet as the Linux Server?
> > > 
> > 
> > No, but I have another solaris C, C is not the same subnet with Sserver, 
> > and Sserver can access C.
> > 
> > 
> > 
> > > You can ping the host?
> > > 
> > 
> > yes. alive.
> > 
> > 
> > 
> > > There's a firewall or 'smart' router between hosts?
> > > 
> > 
> > No firewall. do you mean smartroute process? I didn't find this process and 
> > service.
> > 
> > 
> > 
> > > Can you telnet from Linux Server to Solaris Server in the bacula ports?
> > > 
> > 
> > No. but telnet did not work between Sserver and solaris C,and they backup 
> > successfully
> > ==>a little more: when telnet from Sserver to C, it hangs at" connected to 
> > C, Escape is ^]", seems waiting there and no "xx>" --- this means telnet 
> > success??
> > when telnet from Sserver to Lserver, it hangs at " trying Lserver..." and 
> > waiting there..
> > 
> 
> The following is normal:
> 
> $ telnet 10.55.0.1 9102
> Trying 10.55.0.1...
> Connected to bast.unixathome.org.
> Escape character is '^]'.
> typesomethinghere
> Connection closed by foreign host.
> $
> 

Dan, yes, seems Lserver and Server can not telnet to each other, as shown 
above. Then how to deal with this?
thanks

> 
> 
> 
> > 
> > 
> > 
> > > Solaris: Sserver   Dir+SD
> > > Linux:   LserverFD Client
> > > 
> > > when I use "status client" to see Lserver status:
> > > Connecting to Client Lserver-fd at 135.252.169.202:9102
> > > 
> > > Fatal error: bsock.c:134 Unable to connect to Client: Lserver-fd on 
> > > Lserver:9102. ERR=Connection timed out
> > > 
> > > on Lserver:
> > > # netstat -anlp|grep 9102
> > > tcp0  0 0.0.0.0:91020.0.0.0:* 
> > >   LISTEN  21547/bacula-fd
> > > (it is normal here???)
> > > 
> > > And nothing in /etc/hosts.deny on Lserver.
> > > 
> > > If I telnet from Sserver:
> > > telnet Lserver 9102
> > > Trying Lserver...
> > > telnet: Unable to connect to remote host: Connection timed out
> > > 
> > 
> 
> 
> -- 
> Dan Langille - http://langille.org/


+--
|This was sent by lt...@163.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Solaris Dir can not access Linux FD

2010-12-01 Thread Dan Langille
On 12/1/2010 8:04 PM, amybac wrote:
>
> Francisco Javier Funes... wrote:
>> The Solaris server is in the same subnet as the Linux Server?
>
> No, but I have another solaris C, C is not the same subnet with Sserver, and 
> Sserver can access C.
>
>
>> You can ping the host?
>
> yes. alive.
>
>
>> There's a firewall or 'smart' router between hosts?
>
> No firewall. do you mean smartroute process? I didn't find this process and 
> service.
>
>
>> Can you telnet from Linux Server to Solaris Server in the bacula ports?
>
> No. but telnet did not work between Sserver and solaris C,and they backup 
> successfully
> ==>a little more: when telnet from Sserver to C, it hangs at" connected to C, 
> Escape is ^]", seems waiting there and no "xx>" --- this means telnet 
> success??
> when telnet from Sserver to Lserver, it hangs at 
> " trying Lserver..." and waiting there..

The following is normal:

$ telnet 10.55.0.1 9102
Trying 10.55.0.1...
Connected to bast.unixathome.org.
Escape character is '^]'.
typesomethinghere
Connection closed by foreign host.
$


>
>
>> Solaris: Sserver   Dir+SD
>> Linux:   LserverFD Client
>>
>> when I use "status client" to see Lserver status:
>> Connecting to Client Lserver-fd at 135.252.169.202:9102
>>
>> Fatal error: bsock.c:134 Unable to connect to Client: Lserver-fd on 
>> Lserver:9102. ERR=Connection timed out
>>
>> on Lserver:
>> # netstat -anlp|grep 9102
>> tcp0  0 0.0.0.0:91020.0.0.0:*   
>> LISTEN  21547/bacula-fd
>> (it is normal here???)
>>
>> And nothing in /etc/hosts.deny on Lserver.
>>
>> If I telnet from Sserver:
>> telnet Lserver 9102
>> Trying Lserver...
>> telnet: Unable to connect to remote host: Connection timed out


-- 
Dan Langille - http://langille.org/

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Solaris Dir can not access Linux FD

2010-12-01 Thread amybac

Francisco Javier Funes... wrote:
> The Solaris server is in the same subnet as the Linux Server? 

No, but I have another solaris C, C is not the same subnet with Sserver, and 
Sserver can access C.


> You can ping the host? 

yes. alive.


> There's a firewall or 'smart' router between hosts?

No firewall. do you mean smartroute process? I didn't find this process and 
service.


> Can you telnet from Linux Server to Solaris Server in the bacula ports?

No. but telnet did not work between Sserver and solaris C,and they backup 
successfully
==>a little more: when telnet from Sserver to C, it hangs at" connected to C, 
Escape is ^]", seems waiting there and no "xx>" --- this means telnet success??
   when telnet from Sserver to Lserver, it hangs at " 
trying Lserver..." and waiting there..


> Solaris: Sserver   Dir+SD
> Linux:   Lserver    FD Client
> 
> when I use "status client" to see Lserver status:
> Connecting to Client Lserver-fd at 135.252.169.202:9102
> 
> Fatal error: bsock.c:134 Unable to connect to Client: Lserver-fd on 
> Lserver:9102. ERR=Connection timed out
> 
> on Lserver:
> # netstat -anlp|grep 9102
> tcp        0      0 0.0.0.0:9102                0.0.0.0:*                   
> LISTEN      21547/bacula-fd
> (it is normal here???)
> 
> And nothing in /etc/hosts.deny on Lserver.
> 
> If I telnet from Sserver:
> telnet Lserver 9102
> Trying Lserver...
> telnet: Unable to connect to remote host: Connection timed out
> 


+--
|This was sent by lt...@163.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Solaris Dir can not access Linux FD

2010-12-01 Thread amybac

Francisco Javier Funes... wrote:
> The Solaris server is in the same subnet as the Linux Server? 

No, but I have another solaris C, C is not the same subnet with Sserver, and 
Sserver can access C.


> You can ping the host? 

yes. alive.


> There's a firewall or 'smart' router between hosts?

No firewall. do you mean smartroute process? I didn't find this process and 
service.


> Can you telnet from Linux Server to Solaris Server in the bacula ports?

No. but telnet did not work between Sserver and solaris C,and they backup 
successfully


> Solaris: Sserver   Dir+SD
> Linux:   Lserver    FD Client
> 
> when I use "status client" to see Lserver status:
> Connecting to Client Lserver-fd at 135.252.169.202:9102
> 
> Fatal error: bsock.c:134 Unable to connect to Client: Lserver-fd on 
> Lserver:9102. ERR=Connection timed out
> 
> on Lserver:
> # netstat -anlp|grep 9102
> tcp        0      0 0.0.0.0:9102                0.0.0.0:*                   
> LISTEN      21547/bacula-fd
> (it is normal here???)
> 
> And nothing in /etc/hosts.deny on Lserver.
> 
> If I telnet from Sserver:
> telnet Lserver 9102
> Trying Lserver...
> telnet: Unable to connect to remote host: Connection timed out
> 


+--
|This was sent by lt...@163.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Using Copy Job to create quarterly FULL backups

2010-12-01 Thread Dan Langille
On 12/1/2010 6:55 AM, Paulo Martinez wrote:
> Am 01.12.2010 um 02:35 schrieb Dan Langille:
>>
>> This is different from what I want.  You are doing a Full backup
>> every six months. I'm doing one every month.  But every quarter, one
>> of the backups goes to a different pool.  Thus, I need two backup
>> Jobs.  One with a quarterly Schedule, another with a non-quarterly
>> shedule. something like this:
>
>
> Interesting setup.
>
>
>> Schedule {
>>   Name = "QuarterlyCycle"
>>   Run = Level=Full jan apr jul oct 1st sun at 8:15
>> }
>>
>> Schedule {
>>   Name = "Q-OtherCycle"
>>   Run = Level=Full Feb Mar May Jun Aug Sep Nov Dec 1st sun at 8:15
>>   Run = Differential 2nd-5th sun at 5:55
>>   Run = Incremental mon-sat at 5:55
>> }
>>
>> Then two Jobs:
>>
>>
>> Job {
>>   Name = "BackupCatalog"
>>Full Backup Pool = Full-month
>>Differential Backup Pool = Differential-week
>>Incremental Backup Pool = Incremental-day
>> }
>>
>>
>> Job {
>>Name = "Quarterly"
>>Full Backup Pool = Full-quarterly
>> }
>>
>
>
>
>
> I am not sure if "Full Backup Pool = Full-month" can be overwritten by
> the Schedule Resource.
>
> Schedule {
>
>Name = "Q-OtherCycle and QuarterlyCycle"
>
>Run = Level=Full Pool=Full-quarterly jan apr
> jul oct 1st sun at 8:15
>Run = Level=Full Pool=Full-month Feb Mar May Jun Aug
> Sep Nov Dec 1st sun at 8:15


That is better.  One schedule.

>Run = Differential 2nd-5th sun at 5:55
>Run = Incremental mon-sat at 5:55
> }
>
> in this case the Differential backups would use also the last Full-
> quarterly backup as reference.
>
> Does the schedule "pool"-entry override the job "Full Backup Pool"-
> entry ?

I don't go.  Either the docs or a simple test will tell you.

-- 
Dan Langille - http://langille.org/

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Scheduling question

2010-12-01 Thread Dan Langille
On 12/1/2010 11:52 AM, dietervh wrote:
> How do I define that there should be a differential the third and last 
> saterday?
>
> This is what I have now, but it should be the thirth and fifth saterday :
> Level=Differential 2nd-5th sat at 0:05
>
> Is this a good idea :
>
>
>  Run = Level=Full 1st sat at 0:05
>  Run = Level=Differential 2nd-5th sat at 0:05
>  Run = Level=Incremental sun-fri at 0:05

Create a schedule that runs on the 3rd, 4th, and 5th Saturday.

Add a Run Before Script.  In that script, check to see if you are 
running on the 4th Saturday.  If you are, and 5th Saturday exists, error 
out and the Job will not run.

-- 
Dan Langille - http://langille.org/

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula stalls after 2.5 TB

2010-12-01 Thread Dan Langille
On 12/1/2010 2:28 PM, John Acar wrote:
> Hi all,
>
> I am running Bacula 3.0.2 (Mysql) on Centos 4.8.  I have a Spectra T380 
> changer with 50 tape slots.  I need to archive about 7 TB of data.  The first 
> time I attempted to back it up, the job stalled on 2.559TB and errored out.  
> I figured it might be the drive i used since I have had trouble with that 
> drive so I used drive-2.  The job stopped at precisely the same spot but I 
> did not get any errors.  Bacula still thinks the job is running.
>
> Device "Drive-2" (/dev/nst0) is mounted with:
>  Volume:  037172L4
>  Pool:Default
>  Media type:  LTO-4
>  Slot 43 is loaded in drive 1.
>  Total Bytes=21,018,267,648 Blocks=325,803 Bytes/block=64,512
>  Positioned at File=21 Block=304
> 
>
> Used Volume status:
> 037172L4 on device "Drive-2" (/dev/nst0)
>  Reader=0 writers=1 devres=0 volinuse=1
> 
>
> 
>
> Connecting to Client gsoc-fd at localhost:9102
>
> gsoc-fd Version: 3.0.2 (18 July 2009)  i686-redhat-linux-gnu redhat
> Daemon started 29-Nov-10 15:13, 2 Jobs run since started.
>   Heap: heap=598,016 smbytes=220,928 max_bytes=223,165 bufs=117 max_bufs=120
>   Sizeof: boffset_t=8 size_t=4 debug=0 trace=0
>
> Running Jobs:
> JobId 440 Job TNET.2010-11-30_09.39.39_08 is running.
>  Backup Job started: 30-Nov-10 09:39
>  Files=1,229 Bytes=2,559,801,067,520 Bytes/sec=24,701,351 Errors=0
>  Files Examined=1,229
>  Processing file: /firewall/mysql/archive/sdw_netflow/netflow_20100430.tar
>  SDReadSeqNo=5 fd=5
> Director connected at: 01-Dec-10 14:26
>
> The backup is done from a SAN mount on the backup server and bacula sends it 
> to tape.  The mount is up and I can manually access the data.  I tried 
> searching the archive for a similar problem but I am not quite sure what to 
> look for.
>
> Anyone have any ideas?

Ignore the 2.5TB.  I would concentrate on the time this job has been 
running.  Let it continue to run.  Perhaps the Catalog is now busy.

Also follow the suggestions from Wolfgang.

-- 
Dan Langille - http://langille.org/

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula stalls after 2.5 TB

2010-12-01 Thread Wolfgang Denk
Dear John Acar,

In message <9f3ac5511e192548bc1d06fd1bc1ef8306f5453...@gsoc-bb01.treas.local> 
you wrote:
> 
> I am running Bacula 3.0.2 (Mysql) on Centos 4.8.  I have a Spectra T380 
> changer with 50 tape slots.  I need to archive about 7 TB of data.  The first 
> time I attempted to back it up, the job stalled on 2.559TB and errored out.  
> I figured it might be the 
> drive i used since I have had trouble with that drive so I used drive-2.  The 
> job stopped at precisely the same spot but I did not get any errors.  Bacula 
> still thinks the job is running.

Are you sure it really stops? How long did you wait?

> Running Jobs:
> JobId 440 Job TNET.2010-11-30_09.39.39_08 is running.
> Backup Job started: 30-Nov-10 09:39
> Files=1,229 Bytes=2,559,801,067,520 Bytes/sec=24,701,351 Errors=0
> Files Examined=1,229
> Processing file: /firewall/mysql/archive/sdw_netflow/netflow_20100430.tar
> SDReadSeqNo=5 fd=5
> Director connected at: 01-Dec-10 14:26

repeat the "status dir" command a fw times. Are any of the counters
(Files, Bytes, Files Examined) and the file name changing?

What does "status storage" report?

Can you see or hear if the tape drive is active?

What does a "ls -l /firewall/mysql/archive/sdw_netflow/netflow_20100430.tar"
on that system show?  Is there any chance that this is a sparse file
with (big) holes (eventually even unintentionally, like after some
error in a RAID)?

Best regards,

Wolfgang Denk

-- 
DENX Software Engineering GmbH, MD: Wolfgang Denk & Detlev Zundel
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-10 Fax: (+49)-8142-66989-80 Email: w...@denx.de
"One planet is all you get."

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Troubles with bacula and vchanger.

2010-12-01 Thread Josh Fisher

On 12/1/2010 12:58 PM, Matt Coleman - Digital Domain wrote:
> Hello,
>
> I am trying to set up bacula to backup our company's desktop systems.
> The system I'm running bacula on has two eSATA docks. We'd like to back
> files up to drives in the eSATA docks, and be able to remove each drive
> and store it powered off once it's full. So, I've settled on
> bacula+vchanger as the most appropriate solution for our needs
> (Retrospect does what we need, too, but it's slow, unwieldy, and I
> believe even harder than bacula to extract individual files from a backup).
>
> I am currently testing with two hard drives that I have added to my
> vchanger configuration (set up with autofs mounting them using UUIDs as
> recommended by the vchanger HOWTO that's included with the source). I
> have only created 80GB partitions on them (to speed up the testing) and
> have told bacula and vchanger to create 4 19GB volumes. Yesterday before
> I left the office, I started a job and saw that it was writing to the
> first volume on the first drive. When I got to work today, I found that
> the backup had failed after only completing about 300MB. When I tried to
> inspect the drives, I found that I couldn't even mount the first drive.
> I rebooted and was able to mount the drive, however now vchanger doesn't
> show any magazines when I run the listmags command.

Do you mean autofs would not mount the drive after the crash? As in, the 
ls command hung when you tried to list the drive's root directory? If 
so, did you look at dmesg following the crash? Neither Bacula nor 
vchanger do anything that should affect autofs. They are just 
reading/writing files.

Also, did the vchanger initmag command give any messages? It looks like 
there are only 4 volume files listed after the crash, but the 
slots_per_magazine=12 in the vchanger config should have caused initmag 
to create 12 (empty) volume files. Did the 'label barcodes' command in 
bconsole work as expected?

I suggest you run e2fsck on the drives, then erase the files on the 
drive and in /var/lib/bacula/vchanger and re-run the initmag. Before 
using with Bacula, check that listmags works as expected. Then perform a 
load and unload manually with vchanger and confirm that also works. If 
not, then it may be a permissions issue. The root directory of the 
drives and the /var/lib/bacula/vchanger directory must have rwx for the 
user:group that bacula-sd runs as.

> I have created several pastebins with relevant information:
> commands tried and their output: http://pastebin.com/0bFNcBhF
> bacula-dir.conf: http://pastebin.com/b2iq9TsP
> bacula-sd.conf: http://pastebin.com/qJE6kLPw
> bacula-fd.conf: http://pastebin.com/CprDnrz1
> vchanger.conf: http://pastebin.com/J2RgzWDk
>
> Thanks for your help!
>
> Matt
>

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula stalls after 2.5 TB

2010-12-01 Thread John Acar
Hi all,

I am running Bacula 3.0.2 (Mysql) on Centos 4.8.  I have a Spectra T380 changer 
with 50 tape slots.  I need to archive about 7 TB of data.  The first time I 
attempted to back it up, the job stalled on 2.559TB and errored out.  I figured 
it might be the drive i used since I have had trouble with that drive so I used 
drive-2.  The job stopped at precisely the same spot but I did not get any 
errors.  Bacula still thinks the job is running.

Device "Drive-2" (/dev/nst0) is mounted with:
Volume:  037172L4
Pool:Default
Media type:  LTO-4
Slot 43 is loaded in drive 1.
Total Bytes=21,018,267,648 Blocks=325,803 Bytes/block=64,512
Positioned at File=21 Block=304


Used Volume status:
037172L4 on device "Drive-2" (/dev/nst0)
Reader=0 writers=1 devres=0 volinuse=1




Connecting to Client gsoc-fd at localhost:9102

gsoc-fd Version: 3.0.2 (18 July 2009)  i686-redhat-linux-gnu redhat 
Daemon started 29-Nov-10 15:13, 2 Jobs run since started.
 Heap: heap=598,016 smbytes=220,928 max_bytes=223,165 bufs=117 max_bufs=120
 Sizeof: boffset_t=8 size_t=4 debug=0 trace=0

Running Jobs:
JobId 440 Job TNET.2010-11-30_09.39.39_08 is running.
Backup Job started: 30-Nov-10 09:39
Files=1,229 Bytes=2,559,801,067,520 Bytes/sec=24,701,351 Errors=0
Files Examined=1,229
Processing file: /firewall/mysql/archive/sdw_netflow/netflow_20100430.tar
SDReadSeqNo=5 fd=5
Director connected at: 01-Dec-10 14:26

The backup is done from a SAN mount on the backup server and bacula sends it to 
tape.  The mount is up and I can manually access the data.  I tried searching 
the archive for a similar problem but I am not quite sure what to look for.  

Anyone have any ideas?

John

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Troubles with bacula and vchanger.

2010-12-01 Thread Matt Coleman - Digital Domain
Hello,

I am trying to set up bacula to backup our company's desktop systems. 
The system I'm running bacula on has two eSATA docks. We'd like to back 
files up to drives in the eSATA docks, and be able to remove each drive 
and store it powered off once it's full. So, I've settled on 
bacula+vchanger as the most appropriate solution for our needs 
(Retrospect does what we need, too, but it's slow, unwieldy, and I 
believe even harder than bacula to extract individual files from a backup).

I am currently testing with two hard drives that I have added to my 
vchanger configuration (set up with autofs mounting them using UUIDs as 
recommended by the vchanger HOWTO that's included with the source). I 
have only created 80GB partitions on them (to speed up the testing) and 
have told bacula and vchanger to create 4 19GB volumes. Yesterday before 
I left the office, I started a job and saw that it was writing to the 
first volume on the first drive. When I got to work today, I found that 
the backup had failed after only completing about 300MB. When I tried to 
inspect the drives, I found that I couldn't even mount the first drive. 
I rebooted and was able to mount the drive, however now vchanger doesn't 
show any magazines when I run the listmags command.

I have created several pastebins with relevant information:
commands tried and their output: http://pastebin.com/0bFNcBhF
bacula-dir.conf: http://pastebin.com/b2iq9TsP
bacula-sd.conf: http://pastebin.com/qJE6kLPw
bacula-fd.conf: http://pastebin.com/CprDnrz1
vchanger.conf: http://pastebin.com/J2RgzWDk

Thanks for your help!

Matt

-- 
Matt Coleman
Audio Engineer - Studio B
Digital Domain
www.digido.com
(800) 344-4361
(407) 831-0233


--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Large scale disk-to-disk Bacula deployment

2010-12-01 Thread Marcello Romani
Il 01/12/2010 16:04, Henrik Johansen ha scritto:
> Hi folks,
>
> I did prepare a paper for this years "Bacula Konferenz 2010" about doing
> large scale, high peformance disk-to-disk backups with Bacula but
> unfortunately my workload prohibited me from submitting.
>
> I have turned the essence of the paper into a few blog posts which will
> explain our setup, why we chose Bacula over the competetion (IBM,
> Symanted and CommVault) and give some real world numbers from our Bacula
> deployment.
>
> The first post is out now if people should be interested and can be found 
> here :
>
> http://blog.myunix.dk/2010/12/01/large-scale-disk-to-disk-backups-using-bacula/
>
> The remaining posts will follow over the next month or so.
>
>

Very interesting. I'm looking seriously at bacula, although for a much 
smaller setup than yours (to say the least). Your first post got me very 
interested. I hope to read soom the other chapters of the tale...

-- 
Marcello Romani

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Scheduling question

2010-12-01 Thread dietervh
How do I define that there should be a differential the third and last saterday?

This is what I have now, but it should be the thirth and fifth saterday : 
Level=Differential 2nd-5th sat at 0:05

Is this a good idea : 


        Run = Level=Full 1st sat at 0:05
        Run = Level=Differential 2nd-5th sat at 0:05
        Run = Level=Incremental sun-fri at 0:05



Thanks,
D

+--
|This was sent by die...@linuxhelp.be via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Large scale disk-to-disk Bacula deployment

2010-12-01 Thread Henrik Johansen
Hi folks,

I did prepare a paper for this years "Bacula Konferenz 2010" about doing
large scale, high peformance disk-to-disk backups with Bacula but
unfortunately my workload prohibited me from submitting.

I have turned the essence of the paper into a few blog posts which will
explain our setup, why we chose Bacula over the competetion (IBM,
Symanted and CommVault) and give some real world numbers from our Bacula
deployment.

The first post is out now if people should be interested and can be found here 
: 

http://blog.myunix.dk/2010/12/01/large-scale-disk-to-disk-backups-using-bacula/

The remaining posts will follow over the next month or so.


-- 
Med venlig hilsen / Best Regards

Henrik Johansen
hen...@scannet.dk
Tlf. 75 53 35 00

ScanNet Group
A/S ScanNet 

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] what is the max size of a File Volume should be?

2010-12-01 Thread amybac

Jon Langseth wrote:
> On 2010-12-01 09:10, amybac wrote:
> 
> > If I want to back up whole system and the Max volume size reached, bacula
> > will automatically add another volume (File) for it? or how to 
> > automatically do this?
> > 
> 
> In your Storage Daemon configuration (bacula-sd.conf) add 
> "LabelMedia = Yes" to the Device definition of your File storage:
> Device {
> Media Type = File
> [...]
> LabelMedia = yes;
> [...]
> }
> 
> You should also inluce a Label Format to your Pool in bacula-dir.conf:
> Pool {
> Pool Type = Backup
> [...]
> Storage = File
> Label Format = Volume
> }
> 


by using this set, if first volume reach its size, the second volume(File) will 
be auto
created and labeled? then what is the name? a random string?

+--
|This was sent by lt...@163.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] best practices for pool limits with disk storage

2010-12-01 Thread Igor Zinovik
  Hello, bacula-users@ readers.

I'm running bacula 5.0.3 on linux server with 2.1 TB NFS
share and I'm trying to correctly limit my volumes and
pools so that they wont grow larger than 2.1 TB.

I decided to size my pools following way:
I defined 3 pools they are : "full pool" for full backups,
"diff pool" for differential and "incr pool" for incremental.
For "full pool" I use approximately 59% of NFS volume size
this is about 1250 GB (250 * 5), for "diff pool" I use about
22% it is 480 GB (160 * 3) and for "incr pool" I use 19% from
backup volume this is 400 GB (40 * 10).  Do I understand right
that maximum total space for all pools will be 2130 GB.  My NFS
volume size in GB is 2170.  Do I calculate my "maximum volume bytes"
and "maximum volumes" correct, e.g. can my pools grow larger
than 2.1 TB?  How many bytes metadata takes in volumes?

Can anybody share his/her limits for pools?  I'm just thinking
that ten 40GB volumes for incremental backups is a bit an overkill.
I'm going to backup about 10 *nix machines and pair of windows servers.
Incremental backup of typical linux box right now is 6 to 100
megabytes, so I'm not sure about maximum volume bytes for "incr pool".

pool {
  name = "full pool"
  pool type = backup
  action on purge = truncate
  autoprune = yes
  recycle = yes
  # e.g. fullvol-20101125 fullvol-20110312, ...
  label format = "fullvol-${Year}${Month}${Day+}"
  volume retention = 6 months
  maximum volume bytes = 250g
  maximum volume jobs = 40
  maximum volumes = 5
}

pool {
  name = "diff pool"
  pool type = backup
  action on purge = truncate
  autoprune = yes
  recycle = yes
  label format = "diffvol-${Year}${Month}${Day+}"
  volume retention = 6 months
  maximum volume bytes = 160g
  maximum volume jobs = 80
  maximum volumes = 3
}

pool {
  name = "incr pool"
  pool type = backup
  action on purge = truncate
  autoprune = yes
  recycle = yes
  label format = "incrvol-${Year}${Month}${Day+}"
  volume retention = 21 days
  maximum volume bytes = 10g
  maximum volume jobs = 200
  maximum volumes = 40
}

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] what is the max size of a File Volume should be?

2010-12-01 Thread amybac

Jon Langseth wrote:
> On 2010-12-01 09:10, amybac wrote:
> 
> > If I want to back up whole system and the Max volume size reached, bacula
> > will automatically add another volume (File) for it? or how to 
> > automatically do this?
> > 
> 
> In your Storage Daemon configuration (bacula-sd.conf) add 
> "LabelMedia = Yes" to the Device definition of your File storage:
> Device {
> Media Type = File
> [...]
> LabelMedia = yes;
> [...]
> }
> 
> You should also inluce a Label Format to your Pool in bacula-dir.conf:
> Pool {
> Pool Type = Backup
> [...]
> Storage = File
> Label Format = Volume
> }
> 


by using this set, if first volume reach its size, the second volume(File) will 
be auto
created and labeled? then what is the name? a random string or "Volume+xxx"?

+--
|This was sent by lt...@163.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] what is the max size of a File Volume should be?

2010-12-01 Thread John Drescher
> Given OS is 64-bit and Bacula is 32-bit.
>
> Pool {
> Maximum Volume Bytes = nnn?
> ..
> }
>
> if use File (Disk) to store the backup. This nnn should be one file size, 
> right?
> then what is the max number here?
>
Whatever you want. Just make sure you divide your storage well enough
such that recycling works. I mean if you make the size too big such
that there are only 2 volumes recycling will may not work efficiently.
Remember when a volume is recycled every single job on the volume must
be recycled at the same time.

John

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] MSL6030: added a second tape reader -> problem

2010-12-01 Thread Simone Martina
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi at all,
yesterday I've added a second LTO-4 ULTRIUM 1640 tape reader into my HP
MSL6030 SCSI tape library. I'm using Bacula 5.0.2 on Centos 5 x64.
I've updated my config in this way:

## bacula-sd.conf
Autochanger {
  Name = "Autochanger"
  Device = Drive-1, Drive-2
  Changer Device = /dev/sg5
  Changer Command = "/etc/bacula/mtx-changer %c %o %S %a %d"
}
Device {
  Name = Drive-1
  Drive Index = 0
  Media Type = LTO-4
  Archive Device = /dev/nst1
  AutomaticMount = yes;   # when device opened, read it
  AlwaysOpen = yes;
  RemovableMedia = yes;
  RandomAccess = no;
#  Maximum File Size = 5GB
 Changer Command = "/etc/bacula/mtx-changer %c %o %S %a %d"
 Changer Device = /dev/sg5
 AutoChanger = yes
  Spool Directory = /srv/baculaspool
  Maximum Spool Size = 50G
# Enable the Alert command only if you have the mtx package loaded
Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
# If you have smartctl, enable this, it has more info than tapeinfo
Alert Command = "sh -c 'smartctl -H -l error %c'"
}
Device {
  Name = Drive-2
  Drive Index = 1
  Media Type = LTO-4
  Archive Device = /dev/nst0
  AutomaticMount = yes;   # when device opened, read it
  AlwaysOpen = yes;
  RemovableMedia = yes;
  RandomAccess = no;
#  Maximum File Size = 5GB
 Changer Command = "/etc/bacula/mtx-changer %c %o %S %a %d"
 Changer Device = /dev/sg5
 AutoChanger = yes
  Spool Directory = /srv/baculaspool
  Maximum Spool Size = 50G
# Enable the Alert command only if you have the mtx package loaded
Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
# If you have smartctl, enable this, it has more info than tapeinfo
Alert Command = "sh -c 'smartctl -H -l error %c'"
}

##bacula-dir.conf (storage section):
# LTO-4 Storage
Storage {
  Name = TAPE
  Address = backup2.lan
  SDPort = 9103
  Password = "sdpassword"
  Device = Drive-1
  Media Type = LTO-4
  Maximum Concurrent Jobs = 20
}

# LTO-4 Storage 2nd drive
Storage {
  Name = TAPE2
  Address = backup2.lan
  SDPort = 9103
  Password = "sdpassword"
  Device = Drive-2
  Media Type = LTO-4
  Maximum Concurrent Jobs = 20
}

# MSL6030 Autochanger
Storage {
  Name = MSL6000
  Address = backup2.lan
  SDPort = 9103
  Password = "sdpassword"
  Device = Autochanger
  Media Type = LTO-4
  Autochanger = Yes
  Maximum Concurrent Jobs = 20
}

The old drive is Drive-1, meanwhile the new one is Drive-2. I've
connected both the library (/dev/sg5) than the two reader to the same
SCSI chain using 3 SCSI cables and an ending SCSI terminator.
The library is happy, but when I've tried to run a backup job, Bacula
choices the first tape (the old one): after 2 or 3 megabytes the job
fails with this messages:

01-Dec 12:41 backup2.lan-sd JobId 2032: Wrote label to prelabeled Volume
"NN6036L4" on device "Drive-1" (/dev/nst1)
01-Dec 12:41 backup2.lan-sd JobId 2032: Error: block.c:577 Write error
at 0:12 on device "Drive-1" (/dev/nst1). ERR=Input/output error.
01-Dec 12:42 backup2.lan-sd JobId 2032: Error: block.c:318 Volume data
error at 0:4294967295!
Block checksum mismatch in block=11 len=64512: calc=669ee9d3 blk=a7b18121
01-Dec 12:42 backup2.lan-sd JobId 2032: Error: Re-read last block at EOT
failed. ERR=block.c:318 Volume data error at 0:4294967295!
Block checksum mismatch in block=11 len=64512: calc=669ee9d3 blk=a7b18121

and tries to load a new tape from the same pool (incremental pool).
After used any of available tapes, Bacula request a new one but fails again.

Now I've cancelled all jobs and, after erased a tape, I've tried to run
a manual backup jobs forcing use the new tape reader: this jobs ends
successful!
Till yesterday morning I've always use the old reader without troubles,
but now I got this error into dmesg:

st1: Current: sense key: Aborted Command
Add. Sense: Information unit iuCRC error detected

INFO: task mt:19730 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mtD 810001587120 0 19730   7392
(NOTLB)
 810027741cd8 0082 0001 810020ed2d68
 81003efa5928 0007 81003c138080 81003ff3f080
 0a275d268df9 3627 81003c138268 00028807aa5a
Call Trace:
 [] wait_for_completion+0x79/0xa2
 [] default_wake_function+0x0/0xe
 [] :st:st_do_scsi+0x1f4/0x221
 [] :st:st_int_ioctl+0x5f2/0x92b
 [] __handle_mm_fault+0x5f3/0x1039
 [] :st:st_ioctl+0xaa5/0xe1f
 [] do_page_fault+0x4fe/0x874
 [] do_ioctl+0x55/0x6b
 [] vfs_ioctl+0x457/0x4b9
 [] audit_syscall_entry+0x180/0x1b3
 [] sys_ioctl+0x59/0x78
 [] tracesys+0xd5/0xe0

Any suggestions?

Thanks,

Simone
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJM9kzaAAoJEC9yUzzw9wFDjzsIAJBFXZ0iruR8tmksNzENBqJ1
2XnFLdK8Mcqt4s0udfhgqT5E/HAIVIeg3Yd8y4761Tw9HIfrczZxayM5C+PWWFMW
+w6oFAUrm2uSnBXr1t39m5Ye0Mz5dAlBVqs1/vUl7YB4d/uBCHQPi4qPp+S1/klU
FZS6

Re: [Bacula-users] Using Copy Job to create quarterly FULL backups

2010-12-01 Thread Paulo Martinez
Am 01.12.2010 um 02:35 schrieb Dan Langille:
>
> This is different from what I want.  You are doing a Full backup  
> every six months. I'm doing one every month.  But every quarter, one  
> of the backups goes to a different pool.  Thus, I need two backup  
> Jobs.  One with a quarterly Schedule, another with a non-quarterly  
> shedule. something like this:


Interesting setup.


> Schedule {
>  Name = "QuarterlyCycle"
>  Run = Level=Full jan apr jul oct 1st sun at 8:15
> }
>
> Schedule {
>  Name = "Q-OtherCycle"
>  Run = Level=Full Feb Mar May Jun Aug Sep Nov Dec 1st sun at 8:15
>  Run = Differential 2nd-5th sun at 5:55
>  Run = Incremental mon-sat at 5:55
> }
>
> Then two Jobs:
>
>
> Job {
>  Name = "BackupCatalog"
>   Full Backup Pool = Full-month
>   Differential Backup Pool = Differential-week
>   Incremental Backup Pool = Incremental-day
> }
>
>
> Job {
>   Name = "Quarterly"
>   Full Backup Pool = Full-quarterly
> }
>




I am not sure if "Full Backup Pool = Full-month" can be overwritten by  
the Schedule Resource.

Schedule {

  Name = "Q-OtherCycle and QuarterlyCycle"

  Run = Level=Full Pool=Full-quarterly jan apr  
jul oct 1st sun at 8:15
  Run = Level=Full Pool=Full-month Feb Mar May Jun Aug  
Sep Nov Dec 1st sun at 8:15

  Run = Differential 2nd-5th sun at 5:55
  Run = Incremental mon-sat at 5:55
}

in this case the Differential backups would use also the last Full- 
quarterly backup as reference.

Does the schedule "pool"-entry override the job "Full Backup Pool"- 
entry ?

PM




--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] what is the max size of a File Volume should be?

2010-12-01 Thread Jon Langseth
On 2010-12-01 09:10, amybac wrote:
> If I want to back up whole system and the Max volume size reached, bacula
> will automatically add another volume (File) for it? or how to automatically 
> do this?

In your Storage Daemon configuration (bacula-sd.conf) add 
"LabelMedia = Yes" to the Device definition of your File storage:
Device {
  Media Type = File
  [...]
  LabelMedia = yes;
  [...]
}

You should also inluce a Label Format to your Pool in bacula-dir.conf:
Pool {
  Pool Type = Backup
  [...]
  Storage = File
  Label Format = Volume
}

-- 
Jon Langseth, Systems/network administrator, IT-Tjenesten,
Høgskolen i Gjøvik (Gjøvik University College) - http://www.hig.no
Direkte(direct): +47 61135156  Mobil(cell): +47 95102410
IT-Tjenesten:+47 61135300  Sentralbord: +47 61135100  Fax: +47 61135301

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Not blocking on both SDs together

2010-12-01 Thread Matthew Seaman
On 01/12/2010 01:49, Dan Langille wrote:
> On 11/30/2010 11:09 AM, Matthew Seaman wrote:
>>
>> Hi,
>>
>> We have a setup with two storage director machines at different
>> locations.  Most of the clients are in one hosting center, and use the
>> local SD, while several are scattered at various locations around the
>> net and use the other SD. There's a single director driving all this,
>> and one catalogue for everything.
>>
>> One annoying feature we've noticed is that should the 2nd SD block
>> [which has happened due to filling up a partition] it holds up all
>> backups to the 1st SD.  Is there any way of avoiding this effect?  I
>> can't see why a failure backing up client X to SD 2 should prevent
>> client Y from backing up to SD 1.
> 
> (hello Matthew)
> 
> What version of Bacula are you using?

5.0.3 -- mostly on Centos 5 but with occasional Debian clients and
a few FreeBSD boxes (one of the SDs, but the one involved in all the
trouble is running Centos)

# yum list installed | grep bacula
bacula-bat.x86_64 5.0.3-1
installed
bacula-libs.x86_645.0.3-1
installed
bacula-postgresql.x86_64  5.0.3-1
installed

> Can you show us the emails for the jobs that cause this problem?

Hmmm... Let me see.  Here's an example of a machine being held up.
It's not very informative really -- looks completely normal, except the
start time is delayed by about 18h:

30-Nov 15:57 bacula-dir01.lon.squiz.co.uk- JobId 7922: Start Backup
JobId 7922, Job=staff-cms01_FS.2010-11-29_21.30.00_18
30-Nov 15:57 bacula-dir01.lon.squiz.co.uk- JobId 7922: Using Device
"squizuk.FileStorage"
30-Nov 15:57 staff-cms01.squiz.co.uk-fd JobId 7922: shell command: run
ClientRunBeforeJob "/usr/local/squizuk/bin/dontbackup.sh"
30-Nov 16:00 staff-cms01.squiz.co.uk-fd JobId 7922:  Disallowed
filesystem. Will not descend from / into /lib/init/rw
30-Nov 16:01 staff-cms01.squiz.co.uk-fd JobId 7922:  Disallowed
filesystem. Will not descend from / into /sys
30-Nov 16:04 bacula-sd01.squiz.co.uk-sd JobId 7922: Job write elapsed
time = 00:07:40, Transfer rate = 3.615 M Bytes/second
30-Nov 16:07 bacula-dir01.lon.squiz.co.uk- JobId 7922: Bacula
bacula-dir01.lon.squiz.co.uk- 5.0.3 (04Aug10): 30-Nov-2010 16:07:58
  Build OS:   x86_64-redhat-linux-gnu redhat
  JobId:  7922
  Job:staff-cms01_FS.2010-11-29_21.30.00_18
  Backup Level:   Full
  Client: "staff-cms01.squiz.co.uk-fd" 5.0.2 (28Apr10)
x86_64-pc-linux-gnu,debian,5.0.5
  FileSet:"Squiz mini FileSet" 2010-10-07 13:39:49
  Pool:   "squizuk Pool" (From Job resource)
  Catalog:"SquizUK" (From Client resource)
  Storage:"squizuk.Storage" (From Pool resource)
  Scheduled time: 29-Nov-2010 21:30:00
  Start time: 30-Nov-2010 15:57:13
  End time:   30-Nov-2010 16:07:58
  Elapsed time:   10 mins 45 secs
  Priority:   10
  FD Files Written:   50,702
  SD Files Written:   50,702
  FD Bytes Written:   1,642,749,568 (1.642 GB)
  SD Bytes Written:   1,663,142,853 (1.663 GB)
  Rate:   2546.9 KB/s
  Software Compression:   19.4 %
  VSS:no
  Encryption: yes
  Accurate:   yes
  Volume name(s): squizuk-0098
  Volume Session Id:  317
  Volume Session Time:1290704982
  Last Volume Bytes:  105,574,812,148 (105.5 GB)
  Non-fatal FD errors:0
  SD Errors:  0
  FD termination status:  OK
  SD termination status:  OK
  Termination:Backup OK

30-Nov 16:07 bacula-dir01.lon.squiz.co.uk- JobId 7922: Begin pruning
Jobs older than 14 days .
30-Nov 16:08 bacula-dir01.lon.squiz.co.uk- JobId 7922: Pruned 2 Jobs for
client staff-cms01.squiz.co.uk-fd from catalog.
30-Nov 16:08 bacula-dir01.lon.squiz.co.uk- JobId 7922: Begin pruning Jobs.
30-Nov 16:08 bacula-dir01.lon.squiz.co.uk- JobId 7922: No Files found to
prune.
30-Nov 16:08 bacula-dir01.lon.squiz.co.uk- JobId 7922: End auto prune.

The run-before job is a one-liner script where an admin can create a
file as a way of temporarily blocking the nightly backups without
needing access to the bacula configs.  In the normal course of events it
doesn't do anything.

Cheers,

Matthew

-- 
Matthew Seaman
Systems Administrator
E msea...@squiz.co.uk

Squiz Ltd. A Zetland House, 109-123 Clifton Street, London EC2A 4LD
P +44 (0) 207 101 8300 F +44 (0) 870 112 3394 W www.squiz.co.uk

UNITED KINGDOM AUSTRALIA NEW ZEALAND EUROPE UNITED STATES
LONDON EDINBURGH

SUPPORTED OPEN SOURCE SOLUTIONS



signature.asc
Description: OpenPGP digital signature
--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get starte

Re: [Bacula-users] Solaris Dir can not access Linux FD

2010-12-01 Thread Francisco Javier Funes Nieto
The Solaris server is in the same subnet as the Linux Server? You can
ping the host? There's a firewall or 'smart' router between hosts?

Can you telnet from Linux Server to Solaris Server in the bacula ports?

J.

2010/12/1 amybac :
> Solaris: Sserver   Dir+SD
> Linux:   Lserver    FD Client
>
> when I use "status client" to see Lserver status:
> Connecting to Client Lserver-fd at 135.252.169.202:9102
>
> Fatal error: bsock.c:134 Unable to connect to Client: Lserver-fd on 
> Lserver:9102. ERR=Connection timed out
>
> on Lserver:
> # netstat -anlp|grep 9102
> tcp        0      0 0.0.0.0:9102                0.0.0.0:*                   
> LISTEN      21547/bacula-fd
> (it is normal here???)
>
> And nothing in /etc/hosts.deny on Lserver.
>
> If I telnet from Sserver:
> telnet Lserver 9102
> Trying Lserver...
> telnet: Unable to connect to remote host: Connection timed out
>
> don't know why?
>
> thanks
>
> +--
> |This was sent by lt...@163.com via Backup Central.
> |Forward SPAM to ab...@backupcentral.com.
> +--
>
>
>
> --
> Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
> Tap into the largest installed PC base & get more eyes on your game by
> optimizing for Intel(R) Graphics Technology. Get started today with the
> Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
> http://p.sf.net/sfu/intelisp-dev2dev
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>



-- 
_

Francisco Javier Funes Nieto [esen...@gmail.com]
CANONIGOS
Servicios Informáticos para PYMES.
Cl. Cruz 2, 1º Oficina 7
Tlf: 958.536759 / 661134556
Fax: 958.521354
GRANADA - 18002

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Unknown error with HP scsi tapedrive

2010-12-01 Thread Francisco Javier Funes Nieto
Hi Dan,

Two tape test with two different tapes or with only one?

The two tape test with the same tape works ok (all "This is correct!")

Other problem I see is the media use:

|  11 | Completo01-01 | Full  |   1 | 190,149,249,024 |
  191 |4,320,000 |   1 |0 | 0 | Ultrium   |
2010-09-24 00:30:59
|  12 | Completo01-02 | Full  |   1 | 191,598,317,568 |
  192 |4,320,000 |   1 |0 | 0 | Ultrium   |
2010-09-24 13:42:15 |


The last Full Backup that works only use 190Gb of space for each tape
(three tapes needed for 750Gb of data aprox.- I use FD compression)

Are the LTO3 medium corrupt or bad? It's possible to test all the tape
for errors like fsck or similar?

Thanks.

Javier

2010/12/1 Dan Langille :
> On 11/30/2010 7:03 PM, Francisco Javier Funes Nieto wrote:
>>
>> Hi all,
>>
>>> From one month ago I've (rare) errors in one of my Bacula installation
>>
>> with the Full Backups onto HP StorageWorks 920 LTO3 tapedrive (SCSI)
>>
>> The Full Backup takes three LTO3 tapes (+/- 750GB) but with the first
>> or second tape the tapedrive goes offline with the following error in
>> /var/log/messages:
>>
>> Nov 30 22:58:50 goliat kernel: [121427.669048]
>> SIMODE0[0xc]:(ENOVERRUN|ENIOERR)
>> Nov 30 22:58:50 goliat kernel: [121427.669053] CCSCBCTL[0x4]:(CCSCBDIR)
>> Nov 30 22:58:50 goliat kernel: [121427.669063] scsi1: REG0 == 0xaee0,
>> SINDEX = 0x113, DINDEX = 0x108
>> Nov 30 22:58:50 goliat kernel: [121427.669071] scsi1: SCBPTR == 0x2,
>> SCB_NEXT == 0xff80, SCB_NEXT2 == 0xff80
>> Nov 30 22:58:50 goliat kernel: [121427.669080] CDB 0 0 0 0 0 0
>> Nov 30 22:58:50 goliat kernel: [121427.669081] STACK: 0x0 0x0 0x0 0x0
>> 0x0 0x0 0x0 0x0
>> Nov 30 22:58:50 goliat kernel: [121427.669106]<  Dump
>> Card State Ends>>
>> Nov 30 22:59:00 goliat kernel: [121438.298052] st 1:0:3:0: Device
>> offlined - not ready after error recovery
>> Nov 30 22:59:00 goliat kernel: [121438.298073] st0: Error 7 (sugg.
>> bt 0x0, driver bt 0x0, host bt 0x7).
>>
>> This is the Bacula output:
>>
>> 30-Nov 22:59 goliat-sd JobId 515: Error: Error writing final EOF to
>> tape. This Volume may not be readable.
>> dev.c:1745 ioctl MTWEOF error on "Ultrium" (/dev/nst0). ERR=Error de
>> entrada/salida.
>> 30-Nov 22:59 goliat-sd JobId 515: Job write elapsed time = 21:38:17,
>> Transfer rate = 3.259 M Bytes/second
>> 30-Nov 22:59 goliat-fd JobId 515: Fatal error: backup.c:1019 Network
>> send error to SD. ERR=Connection reset by peer
>> 30-Nov 22:59 goliat-dir JobId 515: Error: Bacula goliat-dir 5.0.2
>> (28Apr10): 30-Nov-2010 22:59:10
>>
>>
>> I don't know if is a medium error, a tapedrive related error or scsi card
>> error.
>>
>> Someone found similar error or behaviour in their Bacula installations?
>>
>> I use bacula 5.0.2 over Debian Lenny 64bits.
>
> Have you run the btape test with this tape drive and done a two tape test?
> NOTE: this will destroy any data on the tapes and requires a tape in the
> drive (and in slot 1 if you are using an autochanger during the test).
>
> --
> Dan Langille - http://langille.org/
>



-- 
_

Francisco Javier Funes Nieto [esen...@gmail.com]
CANONIGOS
Servicios Informáticos para PYMES.
Cl. Cruz 2, 1º Oficina 7
Tlf: 958.536759 / 661134556
Fax: 958.521354
GRANADA - 18002

--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Solaris Dir can not access Linux FD

2010-12-01 Thread amybac

amybac wrote:
> Solaris: Sserver   Dir+SD
> Linux:   LserverFD Client
> 
> when I use "status client" to see Lserver status:
> Connecting to Client Lserver-fd at 135.252.169.202:9102
> 
> Fatal error: bsock.c:134 Unable to connect to Client: Lserver-fd on 
> Lserver:9102. ERR=Connection timed out
> 
> on Lserver:
> # netstat -anlp|grep 9102
> tcp0  0 0.0.0.0:91020.0.0.0:*   
> LISTEN  21547/bacula-fd   
> (it is normal here???)
> 
> And nothing in /etc/hosts.deny on Lserver.
> 
> If I telnet from Sserver:
> telnet Lserver 9102
> Trying Lserver...
> telnet: Unable to connect to remote host: Connection timed out
> 
> don't know why?
> 
> thanks


No firewall found since the iptables is stopped. So, it is a little strange.

+--
|This was sent by lt...@163.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] what is the max size of a File Volume should be?

2010-12-01 Thread amybac
If I want to back up whole system and the Max volume size reached, bacula
will automatically add another volume (File) for it? or how to automatically do 
this?


amybac wrote:
> Given OS is 64-bit and Bacula is 32-bit.
> 
> Pool {
> Maximum Volume Bytes = nnn?
> ..
> }
> 
> if use File (Disk) to store the backup. This nnn should be one file size, 
> right?
> then what is the max number here?


+--
|This was sent by lt...@163.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users