On 10/26/06, Leo Li <[EMAIL PROTECTED]> wrote:
Hi, Vladimir:
Sorry for the delay.
I am willing to share my script. It will be great if we can use real
application as a supplement for our testcase.
But...actually, I am not quite sure about what the script is.:)
From my point of view (other people can have other point :) ) it is ant
based script that:
- download application (if needed);
- download tests (if needed);
- do some 'standard' modification (if needed);
- run application tests over the harmony runtime.
Also it may prepare results for wiki or something else :)
thanks, Vladimir
Note, you can look at
*HARMONY-995*<http://issues.apache.org/jira/browse/HARMONY-995>,
file cc.zip to see a preliminary structure of 'buildtest' module
On 10/25/06, Vladimir Ivanov <[EMAIL PROTECTED]> wrote:
>
> Excellent!
>
>
>
> I have one more idea: we already have buildtest module. Some time ago we
> agreed to extends it by coverage and japi scripts (I hope it happens
> soon:)
> ). May be we extend it one more time and store here some scripts for
> automatic run of other-projects unit tests? Seems, in this case we can
> easily reproduce tests run and enable new platforms.
>
> Of cause, we can not cover all application but we can define some list
of
> 'most important application'.
>
> Is it OK?
>
> Leo, could you share your script for Derby?
>
> Tony, could you share your scripts for ant and log4j?
>
>
>
> thanks, Vladimir
>
>
> PS. The directory structure may be something like that:
> builtest
> - trunk
> - cc
> - coverage
> - japi
> - application_test
> - derby
> - ant
> - etc
> - misc (some other scripts)
> On 10/25/06, Geir Magnusson Jr. <[EMAIL PROTECTED]> wrote:
> >
> > Nice work!
> >
> > More inline..
> >
> > Leo Li wrote:
> > > 467 Tests Run
> > > 94% Pass (443 tests passed)
> > > 6% Fail (24 tests failed)
> > > 5 Suites skipped
> > >
> > > The main progress focuses here:
> > > 1. Harmony classlib fails to load class when user-defined security
> > policy
> > > exists. It is due to the sequence of library loading of VM, which
has
> > been
> > > resolved now.
> > > 2. A new workround for derby tests which allow useprocess to run
test
> or
> > > else several testcases might fail due to derby lack these tests when
> > > useprocess = false.
> > > 3. Derby source code uses the version and the name of java vm to
> decide
> > > what
> > > to do, while current IBM VM has the version of "1.4.2" and the name
of
> > > "j9",
> > > which has different output on the screen from that of standard RI
1.5.
> > At
> > > the same time Derby test compares the output of the iteractive test
> > scripts
> > > to that of expected. I have made some slight modification in its
> source
> > > code, but I have not throughly change this odd behavior, ...,too
> much:(
> >
> > Have you approached the derby community with the changes?
> >
> > >
> > > Besides, some testcase fails even on RI. I exclude
> > > a "derbynetclientmats" test suit since it will hang both RI and
> Harmony.
> > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > something in the left.
> > >
> > > I have updated the wiki of derby on Hamony:
> > > http://wiki.apache.org/harmony/Apache_Derby.
> > >
> >
>
>
--
Leo Li
China Software Development Lab, IBM
