[Lustre-discuss] Slow Copy (Small Files) 1 RPC In Flight?

2013-06-21 Thread Andrew Mast
Hello, I am new to Lustre and wanted to run a small simple small copy test between 2 virtual machines from MDT/OST server to client's local disk. I realize small file performance is never fast, but this seems particularly slow considering the data is all buffered in memory with little to no disk

Re: [Lustre-discuss] Slow Copy (Small Files) 1 RPC In Flight?

2013-06-21 Thread Lee, Brett
...@lists.lustre.org] On Behalf Of Andrew Mast Sent: Friday, June 21, 2013 3:42 PM To: lustre-discuss@lists.lustre.org Subject: [Lustre-discuss] Slow Copy (Small Files) 1 RPC In Flight? Hello, I am new to Lustre and wanted to run a small simple small copy test between 2 virtual machines from MDT

Re: [Lustre-discuss] Slow Copy (Small Files) 1 RPC In Flight?

2013-06-21 Thread Drokin, Oleg
Hello! On Jun 21, 2013, at 5:42 PM, Andrew Mast wrote: Hello, I am new to Lustre and wanted to run a small simple small copy test between 2 virtual machines from MDT/OST server to client's local disk. I realize small file performance is never fast, but this seems particularly slow

Re: [Lustre-discuss] Slow Copy (Small Files) 1 RPC In Flight?

2013-06-21 Thread Andrew Mast
@lists.lustre.org *Subject:* [Lustre-discuss] Slow Copy (Small Files) 1 RPC In Flight? ** ** Hello, I am new to Lustre and wanted to run a small simple small copy test between 2 virtual machines from MDT/OST server to client's local disk. ** ** I realize small file performance is never fast

Re: [Lustre-discuss] Slow Copy (Small Files) 1 RPC In Flight?

2013-06-21 Thread Andrew Mast
Oleg, Very clear, thank you for the explanation, I misunderstood readahead. Yes the 1gb and 10gb file transfer tests was on par with NFS. Our use case is typically compiling and find/grep through (30gb) amounts of source code so it seems we are stuck with small files. Andy On Fri, Jun 21, 2013

Re: [Lustre-discuss] Slow Copy (Small Files) 1 RPC In Flight?

2013-06-21 Thread Drokin, Oleg
Hello! On Jun 21, 2013, at 9:07 PM, Andrew Mast wrote: Very clear, thank you for the explanation, I misunderstood readahead. Yes the 1gb and 10gb file transfer tests was on par with NFS. Our use case is typically compiling and find/grep through (30gb) amounts of source code so it seems we