Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-09 Thread Marcello Romani
Il 03/03/2011 18:05, Phil Stracchino ha scritto: On 03/03/11 09:52, Fabio Napoleoni - ZENIT wrote: Il giorno 03/mar/2011, alle ore 04.52, Fabio Napoleoni - ZENIT ha scritto: I have my director using an external raid device which exports its filesystem with nfs protocol as storage. I just

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-06 Thread Kjetil Torgrim Homme
Sean Clark smcl...@tamu.edu writes: In my experience, slow performance like this (i.e. 5MB/s on at least 100Mb ethernet) usually turns out to be the client's fault. Compression seems to be a very common culprit. Try switching compression off completely and see how much of a difference that

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread Fabio Napoleoni - ZENIT
Il giorno 03/mar/2011, alle ore 04.52, Fabio Napoleoni - ZENIT ha scritto: I have my director using an external raid device which exports its filesystem with nfs protocol as storage. I just ended my bacula configuration and just launched my first remote job. I have this in the report

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread John Drescher
On Thu, Mar 3, 2011 at 9:52 AM, Fabio Napoleoni - ZENIT fa...@zenit.org wrote: Il giorno 03/mar/2011, alle ore 04.52, Fabio Napoleoni - ZENIT ha scritto: I have my director using an external raid device which exports its filesystem with nfs protocol as storage. I just ended my bacula

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread Alan Brown
John Drescher wrote: I made a try with this results JobId 7: Spooling data ... JobId 7: Job write elapsed time = 00:13:07, Transfer rate = 1.295 M Bytes/second JobId 7: Committing spooled data to Volume FullVolume-0004. Despooling 1,021,072,888 bytes ... JobId 7: Despooling elapsed time

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread Phil Stracchino
On 03/03/11 09:52, Fabio Napoleoni - ZENIT wrote: Il giorno 03/mar/2011, alle ore 04.52, Fabio Napoleoni - ZENIT ha scritto: I have my director using an external raid device which exports its filesystem with nfs protocol as storage. I just ended my bacula configuration and just launched

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread Steve Ellis
On 3/3/2011 6:52 AM, Fabio Napoleoni - ZENIT wrote: JobId 7: Spooling data ... JobId 7: Job write elapsed time = 00:13:07, Transfer rate = 1.295 M Bytes/second JobId 7: Committing spooled data to Volume FullVolume-0004. Despooling 1,021,072,888 bytes ... JobId 7: Despooling elapsed time =

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread Fabio Napoleoni - ZENIT
Il giorno 03/mar/2011, alle ore 17.58, Alan Brown ha scritto: John Drescher wrote: I made a try with this results JobId 7: Spooling data ... JobId 7: Job write elapsed time = 00:13:07, Transfer rate = 1.295 M Bytes/second JobId 7: Committing spooled data to Volume FullVolume-0004.

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread Alan Brown
Fabio Napoleoni - ZENIT wrote: Thank you for your analysis, after that I think that the problem is not the nfs overhead, because the despooling phase (over nfs filsystem) has a transfer rate of 7.3 MBps, so it's fine. Instead the first phase (bacula-fd - bacula-sd) happens at 1.2 MBps

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread Sean Clark
(Dangit, that last reply was supposed to go to the list, not just the sender of the email...let me try this again) On 03/03/2011 12:40 PM, Fabio Napoleoni - ZENIT wrote: Thank you for your analysis, after that I think that the problem is not the nfs overhead, because the despooling phase (over

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread Fabio Napoleoni - ZENIT
Il giorno 03/mar/2011, alle ore 20.53, Alan Brown ha scritto: Fabio Napoleoni - ZENIT wrote: Thank you for your analysis, after that I think that the problem is not the nfs overhead, because the despooling phase (over nfs filsystem) has a transfer rate of 7.3 MBps, so it's fine. Instead

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread John Drescher
On Thu, Mar 3, 2011 at 4:11 PM, Fabio Napoleoni - ZENIT fa...@zenit.org wrote: Il giorno 03/mar/2011, alle ore 20.53, Alan Brown ha scritto: Fabio Napoleoni - ZENIT wrote: Thank you for your analysis, after that I think that the problem is not the nfs overhead, because the despooling phase

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread Sean Clark
On 03/03/2011 03:21 PM, John Drescher wrote: On Thu, Mar 3, 2011 at 4:11 PM, Fabio Napoleoni - ZENIT fa...@zenit.org wrote: [...] So the poor throughput is given by software compression. I don't know what to choose in the speed vs space tradeoff. Ideally the best option could be

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread John Drescher
On Thu, Mar 3, 2011 at 5:57 PM, Sean Clark smcl...@tamu.edu wrote: On 03/03/2011 03:21 PM, John Drescher wrote: On Thu, Mar 3, 2011 at 4:11 PM, Fabio Napoleoni - ZENIT fa...@zenit.org wrote: [...] So the poor throughput is given by software compression. I don't know what to choose in the

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread John Drescher
Well, depending on what you consider mainline. What I meant by mainline was a filesystem that was considered stable in the mainline kernel. John -- What You Don't Know About Data Connectivity CAN Hurt You This paper

Re: [Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-03 Thread Sean Clark
On 03/03/2011 05:12 PM, John Drescher wrote: That was one of the choices. btrfs is still considered highly experimental at this point. John Well, that's definitely true, though so far for me it's been more reliable than one might think. (I did, just yesterday, run into what appeared to be an

[Bacula-users] Should I use data spooling when writing to nfs mounted storage?

2011-03-02 Thread Fabio Napoleoni - ZENIT
I have my director using an external raid device which exports its filesystem with nfs protocol as storage. I just ended my bacula configuration and just launched my first remote job. I have this in the report JobId 3: Job write elapsed time = 00:14:23, Transfer rate = 1.182 M Bytes/second