Re: [Lustre-discuss] Lustre playground in VirtualBox?

2009-08-12 Thread Isaac Huang
On Mon, Aug 10, 2009 at 03:39:52PM +0200, Wolfgang Stief wrote: > Hi out there! > > Before I start installing and fiddling around: Are there any reasons > AGAINST setting up a Lustre playground in a VirtualBox environment? I > just want to play around w/ recovery and debugging situations and > upg

Re: [Lustre-discuss] Lustre 1.8.1 distribution missing kernel source?

2009-08-12 Thread Brian J. Murrell
On Wed, 2009-08-12 at 12:01 -0600, Kevin Van Maren wrote: > I think the issues is this is all that is listed: > > Base Linux Kernel Source - unpatched (installable RPM) > kernel-2.6.18-128.1.14.el5.src.rpm > > Where is the version with the Lustre patches? The Lustre patch is in the RPM along wi

Re: [Lustre-discuss] Help: NIC Changed Error

2009-08-12 Thread Isaac Huang
On Mon, Aug 10, 2009 at 03:56:13PM +0800, Lee Amy wrote: > .. > It seems this method cannot solve my problem. My NID is > 10.0.38@tcp, and furthermore when I add the item > > options lnet network=tcp0(eth1) > > I still encountered the same problem and after this failure I change > this it

Re: [Lustre-discuss] Lustre 1.8.1 distribution missing kernel source?

2009-08-12 Thread Kevin Van Maren
I think the issues is this is all that is listed: Base Linux Kernel Source - unpatched (installable RPM) kernel-2.6.18-128.1.14.el5.src.rpm Where is the version with the Lustre patches? Kevin Brian J. Murrell wrote: > On Wed, 2009-08-12 at 15:08 +1000, Richard Smith wrote: > >> I downloade

Re: [Lustre-discuss] Distributed Object storage lookup of small files

2009-08-12 Thread tao.a.wu
If you serve 3 req/s, you will likely need a distributed in-memory cache. Things like Terracotta or Coherence may work well for your dataset (500 GB), although I haven't used either. -Tao From: lustre-discuss-boun...@lists.lustre.org [mailto:lustre-discu

Re: [Lustre-discuss] Lustre 1.8.1 distribution missing kernel source?

2009-08-12 Thread Brian J. Murrell
On Wed, 2009-08-12 at 15:08 +1000, Richard Smith wrote: > I downloaded Lustre 1.8.1 today, but didn't see any kernel-source rpm. Which distro? > There were a few new src.rpm packages whose equivalent wasn't in 1.8.0.1. Right. Starting with 1.8.1, we are packaging our kernels just like the vendo

Re: [Lustre-discuss] lustre performance degrade on SuSE 11

2009-08-12 Thread Tharindu Rukshan Bamunuarachchi
One more notice ... I have created OSS/MDS on SuSE 11 (1.8.1) and tried to access it from SuSE 10 (1.8.0). I can reach required bandwidth (~46.8 MB/s) !!! If I have not done any mistake, seems to be SuSE 11 Lustre (1.8.1) Client does not perform well with SuSE 10 Lustre (1.8.0) MDS/OSS. Could

Re: [Lustre-discuss] lustre performance degrade on SuSE 11

2009-08-12 Thread Tharindu Rukshan Bamunuarachchi
Do you have any idea about following error ... ? I can see this on both MDS and OSS ...? I tried to Google this, but could not find anything interesting ? LustreError: 3039:0:(socklnd_cb.c:2228:ksocknal_recv_hello()) Unknown protocol version (2.x expected) from 172.25.88.202 172.25.88.202

Re: [Lustre-discuss] lustre performance degrade on SuSE 11

2009-08-12 Thread Tharindu Rukshan Bamunuarachchi
there is only one NIC in each machine. Does lustre need more than one nic in each machine ? suse11-202:~ # ifconfig eth0 Link encap:Ethernet HWaddr 00:14:4F:EB:47:8C inet addr:172.25.88.202 Bcast:172.25.88.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1

Re: [Lustre-discuss] lustre performance degrade on SuSE 11

2009-08-12 Thread Mag Gam
How many NICs do you have on your client, MDS, OSS? I am suspecting its a routing issue. Do you have more than 1 NIC on all of these boxes? options lnet 'networks="tcp0(eth0,eth1),elan0"' I advise you to take a look at 5.1.1 in the Lustre manual, manual.lustre.org/images/4/48/LustreManual_1.6_ma

Re: [Lustre-discuss] lustre performance degrade on SuSE 11

2009-08-12 Thread Tharindu Rukshan Bamunuarachchi
I can SCP from/to client machine at 50 MB/s rate. Interface is up at 1000Full. No packet loss. Just like to emphasize ... Client is SuSE 11 (1.8.1) and OSS/MDS are SuSE 10 (1.8.0) suse11-202:~ # scp SLES-11-DVD-x86_64-GM-DVD1.iso 172.25.88.220: Password: SLES-11-DVD-x86_64-GM-DVD1.iso

[Lustre-discuss] applications question

2009-08-12 Thread Mag Gam
Since we have been using lustre for a while now we would like to port some of them to use I/O features of lustre. Currently, all of the applications are very memory intensive, meaning they take in the entire dataset at 1 time load it into memory (64GB) and process. I was wondering if there are some

Re: [Lustre-discuss] lustre performance degrade on SuSE 11

2009-08-12 Thread Mag Gam
Is your network setup properly? Can you scp/ftp file to your OSS as a test? Check if your network interfaces are properly connected (autoneg, 1000Full). make sure you aren't getting any packet loss (netstat -i). Also First then that and see how it goes. On Wed, Aug 12, 2009 at 3:37 AM, Tharindu R

[Lustre-discuss] lustre performance degrade on SuSE 11

2009-08-12 Thread Tharindu Rukshan Bamunuarachchi
hi All, I have following lustre installation. Node A : OSS (SuSE 10) - 1.8.0 Node B : MDS (SuSE 10) - 1.8.0 Node C: Client (SuSE 11) - 1.8.1 When try to run "dd" command on lustre mount, it is only writing at 2.1 MB/s But If mount same file system on Node B, I can achive 45 MB/s

Re: [Lustre-discuss] Large scale delete results in lag on clients

2009-08-12 Thread Arden Wiebe
Jim: Mag just started a good thread about a live back up. Depending on your budget if the spare boxes are available and enough disks just make another Lustre filesystem and copy the existing data over with smb. Here is a screenshot of my commodity hardware rig-up of a 5.4 TB raid10 Lustre Fil