Re: [Bacula-users] Network error with FD during Backup: ERR=Connection reset by peer

2012-09-27 Thread Michael Neuendorf
 The transfer rate is very low in the first server log. Perhaps there
 truly is a problem with a NIC in this hypervisor, or cable, switch,
etc.

There is a second server on this host, which is being backuped too,
without any problems, either in backup or general network performance.

But I will check, if there are any errors on that port on my switch.

Btw: in the other scenario, all machines are running on the same
hypervisor; no physical switches involved.

Regards
Michael
 

 
NovaNet GmbH
Kupferstr. 65
44532 Lunen
Telefon: 02306/202100
FAX: 02306/202109
WEB: www.novanetgmbh.de
Firmensitz: Lunen
Amtsgericht Dortmund HRB 17273
USt-ID DE 124793480, St.-Nr. 316/5759/0318
Geschaftsfuhrerin: Dipl. Informatikerin (FH) Desiree Wunsche

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Network error with FD during Backup: ERR=Connection reset by peer

2012-09-27 Thread Michael Neuendorf
  2012-09-19 22:58:45   bacula-dir JobId 13962: Start Backup JobId
13962,
 Job=nina_systemstate.2012-09-19_21.50.01_31
  2012-09-19 22:58:46   bacula-dir JobId 13962: Using Device
 FileStorageLocal
  2012-09-19 23:02:41   nina-fd JobId 13962: DIR and FD clocks differ
by 233
 seconds, FD automatically compensating.
  2012-09-19 23:02:41   nina-fd JobId 13962: DIR and FD clocks differ
by 233
 seconds, FD automatically compensating.
  2012-09-19 23:02:45   nina-fd JobId 13962: shell command: run
 ClientRunBeforeJob C:/backup/bacula/systemstate.cmd
  2012-09-19 23:02:45   nina-fd JobId 13962: shell command: run
 ClientRunBeforeJob C:/backup/bacula/systemstate.cmd
  2012-09-19 23:03:40   bacula-dir JobId 13962: Sending Accurate
information.
  2012-09-19 23:05:12   bacula-dir-sd JobId 13962: Job write elapsed
time =
 00:01:21, Transfer rate = 2.517 M Bytes/second
  2012-09-19 23:09:06   nina-fd JobId 13962: shell command: run
 ClientAfterJob C:/backup/bacula/systemstate.cmd cleanup
  2012-09-19 23:09:06   nina-fd JobId 13962: shell command: run
 ClientAfterJob C:/backup/bacula/systemstate.cmd cleanup
  2012-09-19 23:05:17   bacula-dir JobId 13962: Fatal error: Network
error with
 FD during Backup: ERR=Connection reset by peer
 
 We have seen that same error (Connection reset by peer) ocassionally
for
 many months.  Some are normal - Mac/Windows desktops/laptops that
 either get rebooted or removed from the network during a backup, etc.
 But sometimes we see this error with UNIX servers that are up 24x7.
We
 suspect that it is network related since we've had similar errors with
print
 servers and non-Bacula backup servers.  But we have yet to pin it
down.  We
 restart failed jobs in Bacula so typically the job always completes OK
even
 after initially getting this error on the first try.
 I'd be curious to know if others get these errors occasionally and
what
 version of Bacula that you're running.

I did a couple of installations and I never faced with this error
before. Anyway, never say never again.
 In the first scenario we were backing up to  tape for a few years and
then migrated to a disc based solution. Everything worked like a charm.
This particular problem occurred first, when we migrated the problem
server from a physical machine to a virtualized one (with VMware
converter). As I mentioned in the reply to Josh, there is another
virtual server on this host without any problems.

Has anyone probably issues with nic drivers, too. I used a mix of E1000
or flexible in the vm config.

However, can someone tell me, where the problem has its origin. Is it
the FD, SD or the Dir? It's not clear for me.

Tom: How did you restart the job. Did you have a script or do you do it
by hand?

Regards
Michael
 

 
NovaNet GmbH
Kupferstr. 65
44532 Lunen
Telefon: 02306/202100
FAX: 02306/202109
WEB: www.novanetgmbh.de
Firmensitz: Lunen
Amtsgericht Dortmund HRB 17273
USt-ID DE 124793480, St.-Nr. 316/5759/0318
Geschaftsfuhrerin: Dipl. Informatikerin (FH) Desiree Wunsche

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Help for Webacula Installation

2012-09-27 Thread Gaurav Gautam
Hi,

Can you please help me to install Webacula 5.5?

Tx
Gaurav Gautam
9971766211



DISCLAIMER
This email is intended only for the person or the entity to whom it is 
addressed and may contain information which is confidential and privileged. Any 
review, retransmission, dissemination or any other use of the said information 
by person or entities other than intended recipient is unauthorized and 
prohibited. If you are not the intended recipient, please delete this email and 
contact the sender.

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Network error with FD during Backup: ERR=Connection reset by peer

2012-09-27 Thread DAHLBOKUM Markus (FPT INDUSTRIAL)
I did a couple of installations and I never faced with this error

before. Anyway, never say never again.

In the first scenario we were backing up to  tape for a few years and

then migrated to a disc based solution. Everything worked like a charm.

This particular problem occurred first, when we migrated the problem

server from a physical machine to a virtualized one (with VMware

converter). As I mentioned in the reply to Josh, there is another

virtual server on this host without any problems.



Has anyone probably issues with nic drivers, too. I used a mix of E1000

or flexible in the vm config.



However, can someone tell me, where the problem has its origin. Is it

the FD, SD or the Dir? It's not clear for me.


Hi Michael,

I might have a similar problem. We also used Bacula for years and now migrated 
our main server to VMware.
In the first 3 month everything worked fine but after the summer shut down I 
saw the broken pipe error.

My configuration:
On the storage server, a huge disk storage is attached. Here only the file 
daemon is running. (VMware)
On the backup server the director and the storage daemons are running. 
(physical server)

OS is in both cases Ubuntu 12.04 64 bit.
Kernel: 3.2.0-27
Bacula taken from the Ubuntu packages: 5.2.5-0ubuntu6.1

We don't use a tape changer, and the weekly full backup needs 2 tapes. The job 
starts at Saturday and normally waits for the second tape which I change on 
Monday morning.
But since the shutdown the network is reset after exactly 15 minutes and the 
job stops with a broken pipe error.
I have added the heartbeat interval on all daemons, but no change.

What is a little suspicious, is that when I reschedule the job during the week, 
the job waits for the tape 1, 2 or three days without a problem. When it starts 
on weekends, error!
In my case it might be an update of our switch's firmware. Some other guy from 
IT updated all switches. Next weekend I will be able to test my backup with the 
old firmware again. Perhaps this is was the reason in my case.
Did you have any changes in your network environment?

I will post if the firmware was the problem.

Regarding your question which daemon is causing the trouble, is there really no 
output which daemon get the error. In my case it's the communication between 
the FD on the VMware-server and the SD.
25-Aug 16:18 ttl010-sd JobId 31: Job backup4.2012-08-25_09.08.00_15 is waiting. 
Cannot find any appendable volumes.
Please use the label command to create a new Volume for:
Storage:  Drive-1 (/dev/nst0)
Pool: Pool-backup4
Media type:   LTO-4
25-Aug 16:33 ttl011-fd JobId 31: Error: bsock.c:389 Write error sending 65536 
bytes to Storage daemon:160.220.129.201:9103: ERR=Connection timed out
25-Aug 16:33 ttl011-fd JobId 31: Fatal error: backup.c:1190 Network send error 
to SD. ERR=Connection timed out
25-Aug 16:33 ttl010-sd JobId 31: Error: bsock.c:389 Write error sending -6 
bytes to client:160.220.129.203:36643: ERR=Connection reset by peer
25-Aug 16:33 ttl010-dir JobId 31: Error: Bacula ttl010-dir 5.2.5 (26Jan12):

Regards,
Markus
--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO3 tape capacity (variable?)

2012-09-27 Thread Alan Brown
On 26/09/12 22:37, Stephen Thompson wrote:
 I think I pointed this out before, but I also have used and new tapes 
 with 400-800Gb on them. It seems really hit or miss, though the tapes 
 with 400Gb or less are probably a 1/3 of my tapes. The other 2/3 have 
 above 400Gb. 

If you have small blocking factors and a lot of small files it's 
possible that bacula overheads are high (it reports actual data on tape, 
not data+overheads)

In my experience, tapes which achieve high compression factors are 
usually full of incremental backups containing highly repetitive data 
such as logfiles.


Tape capacities are quoted in Gb = 1*10^9, while bacula uses GiB for its 
reporting, but the kind of underrun you're seeing can't be entirely 
explained by that small difference.

I've occasionally seen LTO5 tapes marked as full when they're well short 
of expected capacity but this generally happens on a drive which is 
about to request a cleaning tape. Marking them as append has a 50:50 
chance of allowing them to continue and generally they're fine when 
recycled.

Have you tried btape to test the tape in question, or used dd to see how 
many bytes are actually on the tape? Smartctl will help too.





--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Network error with FD during Backup: ERR=Connection reset by peer

2012-09-27 Thread Thomas Lohman
 Tom: How did you restart the job. Did you have a script or do you do it
 by hand?

There are Job options to reschedule jobs on error:

Reschedule On Error = yes
Reschedule Interval = 30 minutes
Reschedule Times = 18

The above will reschedule the job 30 minutes after the failure and it'll 
try and do that 18 times before finally giving up.  These options come 
in handy if you're backing up laptops or other computers that may not be 
on your network 24x7.

hope this helps,


--tom


--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Network error with FD during Backup: ERR=Connection reset by peer

2012-09-27 Thread Josh Fisher

On 9/27/2012 4:15 AM, DAHLBOKUM Markus (FPT INDUSTRIAL) wrote:

 I did a couple of installations and I never faced with this error

 before. Anyway, never say never again.

 In the first scenario we were backing up to tape for a few years and

 then migrated to a disc based solution. Everything worked like a charm.

 This particular problem occurred first, when we migrated the problem

 server from a physical machine to a virtualized one (with VMware

 converter). As I mentioned in the reply to Josh, there is another

 virtual server on this host without any problems.

 

 Has anyone probably issues with nic drivers, too. I used a mix of E1000

 or flexible in the vm config.

 

 However, can someone tell me, where the problem has its origin. Is it

 the FD, SD or the Dir? It's not clear for me.

 Hi Michael,

 I might have a similar problem. We also used Bacula for years and now 
 migrated our main server to VMware.

 In the first 3 month everything worked fine but after the summer shut 
 down I saw the broken pipe error.

 My configuration:

 On the storage server, a huge disk storage is attached. Here only the 
 file daemon is running. (VMware)

 On the backup server the director and the storage daemons are running. 
 (physical server)

 OS is in both cases Ubuntu 12.04 64 bit.

 Kernel: 3.2.0-27

 Bacula taken from the Ubuntu packages: 5.2.5-0ubuntu6.1

 We don’t use a tape changer, and the weekly full backup needs 2 tapes. 
 The job starts at Saturday and normally waits for the second tape 
 which I change on Monday morning.

 But since the shutdown the network is reset after exactly 15 minutes 
 and the job stops with a broken pipe error.

 I have added the heartbeat interval on all daemons, but no change.

 What is a little suspicious, is that when I reschedule the job during 
 the week, the job waits for the tape 1, 2 or three days without a 
 problem. When it starts on weekends, error!

 In my case it might be an update of our switch’s firmware. Some other 
 guy from IT updated all switches. Next weekend I will be able to test 
 my backup with the old firmware again. Perhaps this is was the reason 
 in my case.

 Did you have any changes in your network environment?


I seem to remember someone on here having this problem previously. 
Bacula daemons all set socket option SO_KEEPALIVE to keep the 
connections from timing out, but a switch in between was not properly 
honoring the TCP keepalive. When the switch times out the connection, 
both FD and DIR then think the other side closed the connection.

However, Michael mentioned that on the second scenario all servers are 
on the same hypervisor and there is no switch. Maybe the place to start 
is to move the failing VM to the other hypervisor and see if it still 
fails. Perhaps there is some difference in the VMWare configs.

 I will post if the firmware was the problem.

 Regarding your question which daemon is causing the trouble, is there 
 really no output which daemon get the error. In my case it’s the 
 communication between the FD on the VMware-server and the SD.

 25-Aug 16:18 ttl010-sd JobId 31: Job backup4.2012-08-25_09.08.00_15 is 
 waiting. Cannot find any appendable volumes.

 Please use the label command to create a new Volume for:

 Storage: Drive-1 (/dev/nst0)

 Pool: Pool-backup4

 Media type: LTO-4

 25-Aug 16:33 ttl011-fd JobId 31: Error: bsock.c:389 Write error 
 sending 65536 bytes to Storage daemon:160.220.129.201:9103: 
 ERR=Connection timed out

 25-Aug 16:33 ttl011-fd JobId 31: Fatal error: backup.c:1190 Network 
 send error to SD. ERR=Connection timed out

 25-Aug 16:33 ttl010-sd JobId 31: Error: bsock.c:389 Write error 
 sending -6 bytes to client:160.220.129.203:36643: ERR=Connection reset 
 by peer

 25-Aug 16:33 ttl010-dir JobId 31: Error: Bacula ttl010-dir 5.2.5 
 (26Jan12):

 Regards,
 Markus



 --
 Everyone hates slow websites. So do we.
 Make your web apps faster with AppDynamics
 Download AppDynamics Lite for free today:
 http://ad.doubleclick.net/clk;258768047;13503038;j?
 http://info.appdynamics.com/FreeJavaPerformanceDownload.html


 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] file signatures PKI vs FileSet

2012-09-27 Thread lst_hoe02
Hello

i wonder which of the cryptographic signatures is used and how if i  
specify in the FileSet option signature=md5 and on the client FD  
config PKI Signatures=yes. In the manual is stated that the PKI  
Signatures is not configurable but uses SHA-2 if available, otherwise  
SHA-1. This lead to the following questions:

- Is the signature upgraded in this case to SHA-1?
- Is one of them silently ignored if both are specified or will both  
be calculated and used?

Many Thanks

Andreas




--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Extremely Slow Performance

2012-09-27 Thread Rodrigo Abrantes Antunes

Hi, I'm having extremely slow performance when backing up, a 10gb backup
took around 3h. Where should I start looking?

 During a backup I can see bacula-sd using 100% cpu, memory usage is
normal. My system is a vmware virtual machine with a cpu with two 2,5ghz
cores and 2gb ram. The vm have a separate partition for the volumes using
ext4 and mounted via RDM in a fc storage array with raid6. I tried mapping
more cores and more ram for the vm with the same result so I don't think
the problem is lack of resources.

 Thanks.
--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula trying to load tape that was removed:Re: newbie - problem labeling / adding tapes to pool

2012-09-27 Thread Simon Tyler
Hello again,

I sort of feel like I'm spamming this mailing list so I'll keep it short:

I tried the 'update volumes' command to try to manually tell bacula that
the tapes were in the autochanger. The catalog was aware of all the tapes
but had some of them incorrectly marked as not in autochanger. I set the
correct tapes as being present in autochanger, it accepted the command, but
when I do a status they don't show.

I started wondering if bacula was having a problem writing to mysql db, so
I got the idea to query mysql directly. So for example:
mysql select concat(VolumeName,', ',Slot) from Media;
+--+
| concat(VolumeName,', ',Slot) |
+--+
| TestVolume001, 0 |
| vmappp03_backup_test, 0  |
| TPMBU002, 0  |
| TPMBU001, 3  |
| TPMBU005, 4  |
| TPMBU007, 5  |
| TPMBU003, 0  |
| TPMBU011, 0  |
| TPMBU009, 7  |
| TPMBU014, 8  |
| TPMBU015, 6  |
+--+
11 rows in set (0.00 sec)

Mysql shows correctly which tapes are in slots 3 thru 8, but bacula only
reports slots 3,4,5,6; the others are marked with an * and bacula behaves
as if they're empty.

I guess I can experiment however I like, I don't see how I can break it any
worse so I'll keep experimenting.
--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Extremely Slow Performance

2012-09-27 Thread Rodrigo Abrantes Antunes

Citando Davide Franco dfra...@dflc.ch:
On Thu, Sep 27, 2012 at 7:04 PM, Rodrigo Abrantes Antunes  
rodrigoantu...@pelotas.ifsul.edu.br wrote:


Hi, I'm having extremely slow performance when backing up, a 10gb  
backup took around 3h. Where should I start looking?


  During a backup I can see bacula-sd using 100% cpu, memory  
usage is normal. My system is a vmware virtual machine with a cpu  
with two 2,5ghz cores and 2gb ram. The vm have a separate partition  
for the volumes using ext4 and mounted via RDM in a fc storage  
array with raid6. I tried mapping more cores and more ram for the  
vm with the same result so I don't think the problem is lack of  
resources.


  Thanks.


 
--

Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
 



Hi Rodrigo,

   giving more informations like



  * version of the director, storage, fd
  * which database back-end are you using
  * did you install the vmware tools ?
  * which operating system (version) are using ?
  * on what kind of storage does your DRM point to (sata, iscsi, fc, etc.)
  * etc.


will give us more ideas to troubleshoot your problem.

Regards

Davide



Director: 5.0.1-1ubuntu1
Storage: 5.0.1-1ubuntu1
FD: 5.0.1-1ubuntu1 (some clients have lower version)
Database: mysqI
OS: Ubuntu 10.04.4 x64 Server
FC Storage 4 GBits/s.
All my network is Gigabit Ethernet.

One question: can vmware tools have any influence in this case? From what
I know vmware tools is mainly for better graphics performance  isn't it? I
din't installed it.

Thanks
--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Extremely Slow Performance

2012-09-27 Thread Davide Franco
On Thu, Sep 27, 2012 at 7:04 PM, Rodrigo Abrantes Antunes 
rodrigoantu...@pelotas.ifsul.edu.br wrote:

 **

 Hi, I'm having extremely slow performance when backing up, a 10gb backup
 took around 3h. Where should I start looking?

 During a backup I can see bacula-sd using 100% cpu, memory usage is
 normal. My system is a vmware virtual machine with a cpu with two 2,5ghz
 cores and 2gb ram. The vm have a separate partition for the volumes using
 ext4 and mounted via RDM in a fc storage array with raid6. I tried mapping
 more cores and more ram for the vm with the same result so I don't think
 the problem is lack of resources.

 Thanks.


 --
 Everyone hates slow websites. So do we.
 Make your web apps faster with AppDynamics
 Download AppDynamics Lite for free today:
 http://ad.doubleclick.net/clk;258768047;13503038;j?
 http://info.appdynamics.com/FreeJavaPerformanceDownload.html
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

 Hi Rodrigo,

giving more informations like

   - version of the director, storage, fd
   - which database back-end are you using
   - did you install the vmware tools ?
   - which operating system (version) are using ?
   - on what kind of storage does your DRM point to (sata, iscsi, fc, etc.)
   - etc.

will give us more ideas to troubleshoot your problem.

Regards

Davide
--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO3 tape capacity (variable?)

2012-09-27 Thread Stephen Thompson
On 09/25/2012 10:43 AM, Alan Brown wrote:
 On 25/09/12 17:43, Stephen Thompson wrote:
 Our Sun/Oracle service engineer claims that our drives do not require
 cleaning tapes.  Does that sound legit?

 In general: true (as in, Don't do it as a scheduled item), but all LTO
 drives require cleaning tapes from time to time and sometimes benefit
 from loading one even if the clean light isn't on. It primarily
 depends on the cleanliness of the room where the drive is.

 Our throughput is pretty reasonable for our hardware -- we do use disk
 staging and get something like 60Mb/s to tape.

 60Mb/s is _slow_ for LTO3. You need to take a serious look at what
 you're using as stage disk and consider using a raid0 array of SSDs in
 order to keep up.

 Lastly, the tapes that get 200 vs 800 are from the same batch of tapes,
 same number of uses, and used by the same pair of SL500 drives.  That's
 primarily why I wondered if it could be data dependent (or a bacula bug).


 What happens if you mark the volumes as append and put them back in
 the library?


I haven't had a lot of time to look into this today, but I do this quick 
test and it immediately marks the volume Full again.

27-Sep 14:20 sd-SL500 JobId 260069: Volume FB0763 previously written, 
moving to end of data.
27-Sep 14:21 sd-SL500 JobId 260069: Ready to append to end of Volume 
FB0763 at file=110.
27-Sep 14:21 sd-SL500 JobId 260069: Spooling data ...
27-Sep 14:21 sd-SL500 JobId 260069: Job write elapsed time = 00:00:01, 
Transfer rate = 759.3 K Bytes/second
27-Sep 14:21 sd-SL500 JobId 260069: Committing spooled data to Volume 
FB0763. Despooling 762,358 bytes ...
27-Sep 14:21 sd-SL500 JobId 260069: End of Volume FB0763 at 110:1 on 
device SL500-Drive-0 (/dev/SL500-Drive-0). Write of 262144 bytes got -1.
27-Sep 14:21 sd-SL500 JobId 260069: Re-read of last block succeeded.
27-Sep 14:21 sd-SL500 JobId 260069: End of medium on Volume FB0763 
Bytes=219,730,936,832 Blocks=838,207 at 27-Sep-2012 14:21.
27-Sep 14:21 sd-SL500 JobId 260069: 3307 Issuing autochanger unload 
slot 36, drive 0 command.





 I've seen transient scsi errors result in tapes being marked as full.

 What does smartctl show for the drive and tape in question? (run this
 against the /dev/sg of the tape drive)





-- 
Stephen Thompson   Berkeley Seismological Laboratory
step...@seismo.berkeley.edu215 McCone Hall # 4760
404.538.7077 (phone)   University of California, Berkeley
510.643.5811 (fax) Berkeley, CA 94720-4760

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO3 tape capacity (variable?)

2012-09-27 Thread Alan Brown
On 27/09/12 22:25, Stephen Thompson wrote:
 What happens if you mark the volumes as append and put them back in
 the library?



 I haven't had a lot of time to look into this today, but I do this 
 quick test and it immediately marks the volume Full again.


Then it really is full and the rest is down to overheads.

Consider using larger block sizes.





--
Got visibility?
Most devs has no idea what their production app looks like.
Find out how fast your code is with AppDynamics Lite.
http://ad.doubleclick.net/clk;262219671;13503038;y?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO3 tape capacity (variable?)

2012-09-27 Thread Stephen Thompson


On 9/27/12 6:17 PM, Alan Brown wrote:
 On 27/09/12 22:25, Stephen Thompson wrote:
 What happens if you mark the volumes as append and put them back in
 the library?



 I haven't had a lot of time to look into this today, but I do this
 quick test and it immediately marks the volume Full again.


 Then it really is full and the rest is down to overheads.

 Consider using larger block sizes.




Aren't these considered reasonable settings for LTO3?

   Maximum block size = 262144   # 256kb
   Maximum File Size = 2gb



thanks for the help!
Stephen
-- 
Stephen Thompson   Berkeley Seismological Laboratory
step...@seismo.berkeley.edu215 McCone Hall # 4760
404.538.7077 (phone)   University of California, Berkeley
510.643.5811 (fax) Berkeley, CA 94720-4760

--
Got visibility?
Most devs has no idea what their production app looks like.
Find out how fast your code is with AppDynamics Lite.
http://ad.doubleclick.net/clk;262219671;13503038;y?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users