Re: [Lustre-discuss] Reply High difference in I/O network traffic in lustre client

2010-02-03 Thread Atul Vidwansa
Hi Lex, If you are using Lustre for small files, another blog post of mine would be helpful. Have a look at http://blogs.sun.com/atulvid/entry/improving_performance_of_small_files The post includes some tips on improving performance of small files and also has recommendations on tools to use fo

Re: [Lustre-discuss] Reply High difference in I/O network traffic in lustre client

2010-02-02 Thread Lex
That was my mistake, i know the disadvantage / advantage of using stripe or not, but ...it was that. I am finding the way to re-arrange our small files and soft links. Do you have any hint ? > If you are using small files, you shouldn't be striping your files over > multiple OSTs. That is increa

Re: [Lustre-discuss] Reply High difference in I/O network traffic in lustre client

2010-02-02 Thread Lex
did you measure the performance of this system before lustre? > specifically Tell me exactly what information useful for you to help me diagnose our problem, plz , your symptoms make it look like your disk system > can't handle the load. since you have lots of small activity, > the issue wouldn

Re: [Lustre-discuss] Reply High difference in I/O network traffic in lustre client

2010-02-01 Thread Andreas Dilger
On 2010-02-01, at 08:29, Lex wrote: > I have 8 OSSs and 8 OSTs. Hadware info: > > CPU Intel(R) xeon E5420 2.5 Ghz Chipset intel 5000P > 8GB RAM > 8 x 1.5TB hard disks, divided into 2 arrays with raid controller > adaptec 5805 > > We using 2 x 1Gigabit Ethernet card with linux bonding ( OS is >

[Lustre-discuss] Reply High difference in I/O network traffic in lustre client

2010-02-01 Thread Lex
From: Lex Date: Mon, Feb 1, 2010 at 10:28 PM Subject: Re: [Lustre-discuss] High difference in I/O network traffic in lustre client To: Mag Gam I have 8 OSSs and 8 OSTs. Hadware info: CPU Intel(R) xeon E5420 2.5 Ghz Chipset intel 5000P 8GB RAM 8 x 1.5TB hard disks, divided into 2 arrays with ra