Hi all,
Hi,
thanks for the many replies so far. As far as I see it, there are three
major concerns:
- The regression tests might take too long to run,
- the regression tests might be too cumbersome to execute,
- the findings of the regression tests might not justify the efforts to
run them.
Just a note from experience:
We (the chart team) have a CWS (chart05) for which we started the
auto-tests ourselves. Jogi helped us with installing the basics, which
is a one-time effort (having some links and stuff to click on).
Once this was done, all I did was selecting the the patch of our CWS
build, installed it via an install tools (SUT). After this was finished,
I just started the Test-Tool Launcher, selected the tests I want to run
and clicked on "Start". Then, the tests ran (they did over last week-end).
Now, the tests are all finished, and there was one error in a test that
was due to a change I did in the CWS. It was no regression, in this case
it was a test that relied on a false behaviour. However, we found this
problem before we sent the CWS to QA, and saved the time of ping-pong or
the time of a QA engineer to find out why the test fails (I did the
change in the code, so it is probably easier for me to know what goes
wrong there).
All in all, I think this was a success. Apart from the one-time effort
(which was also less than an hour), it is a rather quick procedure (for
me, not the machine doing the tests ;-) ), and we proved that it can
show problems before a CWS is set to "Ready for QA".
So, for me all three concerns were no issues.
Ok, I must admit that it is not always possible to run tests over the
week-end and that for other modules the tests might run longer than two
days, but you are flexible in this respect, you can just select a couple
of tests which you think may be worth checking.
-Bjoern
P.S.: I must admit that I don't know how much of the infrastructure I
used is also available to non-Sun-employees, but I think the idea is to
make everything available to everybody in the long run.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
