Paul Ramsey ha scritto:
> Perhaps I am misunderstanding the example from the users list, but the 
> changes to property access for wfs1.1 seem to have affected normal 
> renderer use, which is why the user ran across the problem.
> 
> I was going to ask a completely orthogonal question: there are all sorts 
> of test cases floating around to ensure that *behavior* remains correct 
> through changes, but none to ensure that *performance* remains correct, 
> or at least "within acceptable norms".  Did you expect that your changes 
> would impair rendering by a couple orders of magnitude?  If not, it 
> would have been good that a test case told you that you did, so that 
> repairing that situation could have been your next order of business.

Theoretically we could do some basic performance testing using 
JUnitPerf. Tests are set up so that they fail if they take more than
a specified amount of time to run.

The issue is setting them up... performance depends a lot of things,
the machine you're running the test onto, location of the databases,
network state, jdk you're using (we do have more or less 1 order
of magnitude difference in that test between jdk 1.4 and jdk 1.6).

Serious performance checks include those performed by Eclipse, see an 
example report here:
http://download.eclipse.org/eclipse/downloads/drops/M20070209-0010/performance/performance.php

Doing this requires having a dedicated build server (so you have just 
one reference machine), using always the same jdk, and running a 
different set of tests than the normal build.
If there is a performance drop of, say, 30-50% compared to a reference 
build, then a mail should be sent to developers noting it.
And reference performance numbers should be updated from time to time,
since we are expected to improve, but also to slow down a bit when we
add flexibility to the library.

Soo... I agree with you we should have something like this, I'm just 
wondering where the resources for doing it are :-)

Cheers
Andrea

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Geotools-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/geotools-devel

Reply via email to