James,
In my view, there would be a single benchmarking package that
would have the option of running/not running any number of subtests
within it. Another pressing issue is, how configurable do we want to
make it the tests? HPL and Atlas have a large number of settings that
have to be used for performance testing and many people will not know
what the optimal settings are for these benchmarks. Therefore, to get a
feel for many different types of systems, after your beta version of the
package is ready, it would be useful to have as many people as possible
on the dev list here, test the package with different settings and
optimizations. My only fear is that you develop a tool that very few
people know how to configure or use without being an expert in HPL or
ATLAS. It might be a bit tricky, but I love the idea and am glad you are
working on it.
Regards,
Christopher
-----Original Message-----
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of James
Sent: Thursday, April 12, 2007 7:01 PM
To: [EMAIL PROTECTED]
Subject: [Oscar-devel] Thanks for having me!
Hello everyone!
I am an undergrad at Louisiana Tech University, my degree focus is on
Computer Science and I plan to graduate in November of this year. My SoC
project is the OSCAR Bench project that will incorporate benchmarks into
OSCAR. I would love to hear any suggestions, or vision you have for the
project. I expect my proposal will change a good bit between now and
August.
Some pressing thoughts I have had are:
Where in OSCAR does OSCAR Bench belong? Should it be run as part of the
'test cluster' if the users downloads it? Would an additional GUI button
be added if the user downloads my package? My thoughts are that the
benchmark should be able to run independently of the Wizard, but with
the requirement that the cluster be an OSCAR cluster, e.g., it has an
OSCAR database. That could be removed as well, but I would like to build
off OSCAR as much as possible, so I don't have to recreate any wheels.
This is future thinking on my part, because I am not sure what data I
may want that OSCAR has to offer (if any).
Also what benchmarks are most relevant? If I work with the HPCC
benchmark package, do I need to include HPL? From experience I have used
the HPCC benchmark for about 4 months now, I have also built/used ATLAS
to go with it. I noticed a post here regarding IO benchmarking, so I
really want to narrow my focus down to a few specific
benchmarks/packages.
And the final thought was: Should all the benchmarks be clumped into 1
package, or should each be its own package. For instance: an Atlas
package, a HPL package, a HPCC packages, etc...,
Thanks again for the chance to work with you,
James Elliott
------------------------------------------------------------------------
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share
your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDE
V
_______________________________________________
Oscar-devel mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/oscar-devel
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Oscar-devel mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/oscar-devel