Okay this is kinda weird but here you go. -----Original Message----- From: Brown, David M JR Sent: Thursday, May 31, 2007 1:33 PM To: Brown, David M JR Subject: Okay some test data and question
Okay at last months outage on the big cluster [0] I ran some tests using pvfs on variety they all revolved around equal number of client and server nodes. The fx.pnl.gov link below should point you to the source rpm I used to build pvfs and the raw testing data and some csv's that sum up the data. The raw and csv's are packaged together. Some explanation about the tests, the tests were done attempting to slam as much data as fast as possible into the file system all at the same time, and goes something like this. 1) Setup N equal number of data servers and clients. 2) From each client choose a server to write to and determine the path of least resistance to that server, try to make the data from this client to this server as fast as possible. For pvfs this means run the client and server on the same box. 3) Simultaneously write a large chunk of data from all the clients to their individually selected server from above. The objective is to increase N to large numbers to see what performance hits are taken by the file system. There is a README file in the raw data file to take a look at that does a little more explaining than what I've got here. Okay Question: The data shows some interesting things as it jumps to the higher numbers theres a step increase in the time it takes to dd a 10Gb file from 45-50s then jumps up to 65-70s on some nodes and they are groupped across the node set as well. Any clues as to what could cause this? As always, let me know if you have any questions or can't get parts of the email I posted. [0] http://mscf.emsl.pnl.gov/hardware/config_mpp2.shtml File Download Location: https://fx.pnl.gov/Files.aspx?EmailID=a5d4ec79-059c-4a7e-9125-b28c2c0b1f07 * This was an automatically generated message from the PNNL Web File Transfer Service. The file(s) will be available for download for up to 10 days. Please note that some email software does not properly display URL links as hyperlinks. If you can not click the link below, you must copy and paste the URL into your web browser. Be careful to copy and paste the entire link and remove any inadvertently added spaces. For technical assistance and support, contact the PNNL Help Desk by phone at (509) 375-6789 or by email at [EMAIL PROTECTED] _______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
