Re: [Lustre-discuss] Performance Drop creating big files

2008-06-02 Thread Roger Spellman
> I would suspect the Lustre client side caching influencing your write > performance. 10GB is not adequate, try atleast 4x of the RAM size for > file-sizes. > HTH, > -Kums Kums, thanks for the suggestion. I have 4G of RAM on my client and 4G of RAM on my server. I typically create 20G files,

Re: [Lustre-discuss] Performance Drop creating big files

2008-06-01 Thread Jason Rappleye
Hi Roger, This sounds terribly familiar. The likely cause can be found by reading through the following thread: http://lists.lustre.org/pipermail/lustre-discuss/2008-March/007024.html Note that running dumpe2fs on each device, as suggested by one of the messages in the thread, did *not* res

Re: [Lustre-discuss] Performance Drop creating big files

2008-05-30 Thread Marty Barnaby
riday, May 30, 2008 3:07 PM To: Lundgren, Andrew Cc: Roger Spellman; lustre-discuss@lists.lustre.org Subject: RE: [Lustre-discuss] Performance Drop creating big files I meant use file-size that are 4x the RAM size :-). So if your RAM size is 4GB, use atleast 16GB file-sizes for the benchmarks. O

Re: [Lustre-discuss] Performance Drop creating big files

2008-05-30 Thread Lundgren, Andrew
I get it. Thanks! > -Original Message- > From: Kumaran Rajaram [mailto:[EMAIL PROTECTED] > Sent: Friday, May 30, 2008 3:07 PM > To: Lundgren, Andrew > Cc: Roger Spellman; lustre-discuss@lists.lustre.org > Subject: RE: [Lustre-discuss] Performance Drop creating big files

Re: [Lustre-discuss] Performance Drop creating big files

2008-05-30 Thread Kumaran Rajaram
o: Roger Spellman > > Cc: lustre-discuss@lists.lustre.org > > Subject: Re: [Lustre-discuss] Performance Drop creating big files > > > > Roger, > > > > I would suspect the Lustre client side caching influencing your write > > performance. 10GB is not adequate, try

Re: [Lustre-discuss] Performance Drop creating big files

2008-05-30 Thread Lundgren, Andrew
Friday, May 30, 2008 3:01 PM > To: Roger Spellman > Cc: lustre-discuss@lists.lustre.org > Subject: Re: [Lustre-discuss] Performance Drop creating big files > > Roger, > > I would suspect the Lustre client side caching influencing your write > performance. 10GB is not adequ

Re: [Lustre-discuss] Performance Drop creating big files

2008-05-30 Thread Kumaran Rajaram
Roger, I would suspect the Lustre client side caching influencing your write performance. 10GB is not adequate, try atleast 4x of the RAM size for file-sizes. Try doing the same tests with O_DIRECT flag as it'd truly measure your disk I/O performance bypassing FS + buffer cache. HTH, -Kums On Fr

[Lustre-discuss] Performance Drop creating big files

2008-05-30 Thread Roger Spellman
I am seeing the following odd behavior. I have several OSSes, each with a 7T RAID 5. If I use a single client to create a single 1T file which is striped to a single OST, the performance starts off at about 400 MB/s (which is typical for my HW), then gradually decreases, until it reaches 250