[Pvfs2-developers] tuning kernel buffer settings

2006-11-29 Thread Phil Carns
We recently ran some tests that we thought would be interesting to share. We used the following setup: - single client - 16 servers - gigabit ethernet - read/write tests, with 40 GB files - using reads and writes of 100 MB each in size - varying number of processes running concurrently on the

Re: [Pvfs2-developers] tuning kernel buffer settings

2006-11-29 Thread Sam Lang
These are great results Phil. Its nice to have you guys doing this testing. Did you get a chance to run any of your tests with the threaded version of pvfs2-client? I added -threaded option, which runs pvfs2-client-core-threaded instead of pvfs2-client-core. For the case where you're

Re: [Pvfs2-developers] tuning kernel buffer settings

2006-11-29 Thread Murali Vilayannur
Hi Phil, Thanks for running these tests. I think this buffer size will be dependant on the machine configuration right? If we work out a simple formula for the buffer size based on say memory b/w (and/or latency), network b/w (and/or latency), we could plug that in as a sane default (bandwidth .

Re: [Pvfs2-developers] tuning kernel buffer settings

2006-11-29 Thread Murali Vilayannur
Hi Phil, Attached patch fixes the read buffer bug that you had mentioned and also implements the variable sized buffer counts and lengths that we can pass as command line options to pvfs2-client-core. I did not implement module time options for buffer size settings since that is fairly