[OpenAFS] Re: WAN speed

2012-03-26 Thread Andrew Deason
On Sat, 24 Mar 2012 02:59:19 +0200 (EET) jukka.tuomi...@finndesign.fi wrote: > Thanks for the help, I got it working now > > -chunksize 23 transfer speeds: > > 20M/2000 files: > > SSH to AFS ~150KB/s > AFS to SSH ~285KB/s To be clear, none of the suggestions given were intended to improve this

Re: [OpenAFS] Re: WAN speed

2012-03-23 Thread jukka . tuominen
> On Fri, 23 Mar 2012 01:02:10 +0200 (EET) > jukka.tuomi...@finndesign.fi wrote: > >> > 109M single file: >> > >> > SSH to AFS ~525KB/s >> > AFS to SSH ~800KB/s > [...] >> I tried turning off encryption, but it didn't make a notable >> difference with either file transfer test > > Okay, well that

[OpenAFS] Re: WAN speed

2012-03-23 Thread Andrew Deason
On Fri, 23 Mar 2012 23:30:32 +0200 (EET) jukka.tuomi...@finndesign.fi wrote: > I'm propably not doing this correctly, but hopefully we're on to > something: > > 1st trial > # afsd -chunksize 20 > > afsd: Error calling AFSOP_CACHEINODE: not configured > > 2nd trial > # invoke-rc.d openafs-client

Re: [OpenAFS] Re: WAN speed

2012-03-23 Thread jukka . tuominen
> On Fri, 23 Mar 2012 01:02:10 +0200 (EET) > jukka.tuomi...@finndesign.fi wrote: > >> > 109M single file: >> > >> > SSH to AFS ~525KB/s >> > AFS to SSH ~800KB/s > [...] >> I tried turning off encryption, but it didn't make a notable >> difference with either file transfer test > > Okay, well that

[OpenAFS] Re: WAN speed

2012-03-23 Thread Andrew Deason
On Fri, 23 Mar 2012 01:02:10 +0200 (EET) jukka.tuomi...@finndesign.fi wrote: > > 109M single file: > > > > SSH to AFS ~525KB/s > > AFS to SSH ~800KB/s [...] > I tried turning off encryption, but it didn't make a notable > difference with either file transfer test Okay, well that's obviously bette

Re: [OpenAFS] Re: WAN speed

2012-03-22 Thread jukka . tuominen
I tried turning off encryption, but it didn't make a notable difference with either file transfer test br, jukka > > >> On Thu, 22 Mar 2012 21:43:50 +0200 (EET) >> jukka.tuomi...@finndesign.fi wrote: >> >>> I just moved ~20M/~2000 files >> >> Do you mean each file is 20M? Or you moved 2000 files

Re: [OpenAFS] Re: WAN speed

2012-03-22 Thread jukka . tuominen
> On Thu, 22 Mar 2012 21:43:50 +0200 (EET) > jukka.tuomi...@finndesign.fi wrote: > >> I just moved ~20M/~2000 files > > Do you mean each file is 20M? Or you moved 2000 files, and added > together they form 20M of data in total? 20M in total > >> AFS to SSH server ~220KB/s >> SSH server to A

Re: [OpenAFS] Re: WAN speed

2012-03-22 Thread Jeffrey Altman
On 3/22/2012 3:43 PM, jukka.tuomi...@finndesign.fi wrote: > > Hi all, > > here are some ping results outside LAN: > > 1.62 1.80 1.62 2.33 1.69 1.64 1.75 2.35 5.77 3.85 4.69 2.73 ... > > The internet speed is the same 100/5. > > I just moved ~20M/~2000 files > AFS to SSH server ~22

[OpenAFS] Re: WAN speed

2012-03-22 Thread Andrew Deason
On Thu, 22 Mar 2012 21:43:50 +0200 (EET) jukka.tuomi...@finndesign.fi wrote: > I just moved ~20M/~2000 files Do you mean each file is 20M? Or you moved 2000 files, and added together they form 20M of data in total? > AFS to SSH server ~220KB/s > SSH server to AFS ~80KB/s > > The client was

Re: [OpenAFS] Re: WAN speed

2012-03-22 Thread jukka . tuominen
Hi all, here are some ping results outside LAN: 1.62 1.80 1.62 2.33 1.69 1.64 1.75 2.35 5.77 3.85 4.69 2.73 ... The internet speed is the same 100/5. I just moved ~20M/~2000 files AFS to SSH server ~220KB/s SSH server to AFS ~80KB/s The client was in WAN this time, whereas both

Re: [OpenAFS] Re: WAN speed

2012-03-22 Thread Jeffrey Altman
The lacks large window sizes is unlikely the issue in this case. The use case is reading large numbers of small files which require a separate RPC for each object. An 8MB window size won't help when the file sizes are small and the number of files is large. The RPC latency * number of RPCs is

Re: [OpenAFS] Re: WAN speed

2012-03-22 Thread Simon Wilkinson
On 22 Mar 2012, at 15:23, Andrew Deason wrote: > On Thu, 22 Mar 2012 15:20:20 + > Simon Wilkinson wrote: > >> That limit is imposed because it is the point at which the current RX >> implementation loses the queue efficiency/throughput tradeoff. You can >> run with a larger window size, but

[OpenAFS] Re: WAN speed

2012-03-22 Thread Andrew Deason
On Thu, 22 Mar 2012 15:20:20 + Simon Wilkinson wrote: > That limit is imposed because it is the point at which the current RX > implementation loses the queue efficiency/throughput tradeoff. You can > run with a larger window size, but it will actually make things go > slower. > > It was nai

Re: [OpenAFS] Re: WAN speed

2012-03-22 Thread Simon Wilkinson
On 22 Mar 2012, at 15:09, Andrew Deason wrote: > On Thu, 22 Mar 2012 10:18:44 -0400 > chas williams - CONTRACTOR wrote: > >> but besides this limit, there is also another determining factor in >> rx. rx, like tcp, negotiates a window of data to send before waiting >> for an ack from the other

[OpenAFS] Re: WAN speed

2012-03-22 Thread Andrew Deason
On Thu, 22 Mar 2012 10:18:44 -0400 chas williams - CONTRACTOR wrote: > but besides this limit, there is also another determining factor in > rx. rx, like tcp, negotiates a window of data to send before waiting > for an ack from the other side which lets me data get sent. if the > window doesnt