Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-10-09 Thread Vladimir Ivanov
On 10/6/06, Geir Magnusson Jr. <[EMAIL PROTECTED]> wrote: > > - 'cc' - for cruise control script (and move current stuff to this dir); > > - 'coverage' - for coverage scripts (It will nice if somebody also placed > here data from issue 564); > > - 'japi' - for script to run 'japi'-tool. Agreed

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-10-08 Thread Vladimir Ivanov
On 10/6/06, Mark Hindess <[EMAIL PROTECTED]> wrote: > > Agreed on all three. Do we have a japi script? I have one but it's a little specific to the wrapper we use for the builds that report to the -commits list. But I can provide it if it will help. If this script requires some updates I a

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-10-06 Thread Geir Magnusson Jr.
Thanks - maybe someone can massage that to fit with what we're building... Mark Hindess wrote: On 6 October 2006 at 9:41, "Geir Magnusson Jr." <[EMAIL PROTECTED]> wrote: Vladimir Ivanov wrote: While nobody objects :) the right place for coverage scripts is 'buildtest' module. Seems, that thi

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-10-06 Thread Mark Hindess
On 6 October 2006 at 9:41, "Geir Magnusson Jr." <[EMAIL PROTECTED]> wrote: > > > Vladimir Ivanov wrote: > > While nobody objects :) the right place for coverage scripts is 'buildtest' > > module. > > > > Seems, that this module should be a little bit reorder: new top level > > directories shoul

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-10-06 Thread Geir Magnusson Jr.
Vladimir Ivanov wrote: While nobody objects :) the right place for coverage scripts is 'buildtest' module. Seems, that this module should be a little bit reorder: new top level directories should be created: - 'cc' - for cruise control script (and move current stuff to this dir); - 'coverage

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-10-06 Thread Vladimir Ivanov
While nobody objects :) the right place for coverage scripts is 'buildtest' module. Seems, that this module should be a little bit reorder: new top level directories should be created: - 'cc' - for cruise control script (and move current stuff to this dir); - 'coverage' - for coverage scripts (

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-10-03 Thread Vladimir Ivanov
On 10/3/06, Mark Hindess <[EMAIL PROTECTED]> wrote: Regarding the 'run japi' script what are you planning to do here? The IBM Build/test builds also run japi (on linux only since we get enough information using one platform and linux is easier). We might as well share ant code. Also note tha

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-10-03 Thread Mark Hindess
On 3 October 2006 at 21:08, "Vladimir Ivanov" <[EMAIL PROTECTED]> wrote: > > I have one more question about coverage: should it be the part of the B&T > infrastructure or integrated to the current classlib build system? > > From my point of view it should be a part of B&TI while it is rarely use

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-10-03 Thread Vladimir Ivanov
I have one more question about coverage: should it be the part of the B&T infrastructure or integrated to the current classlib build system? From my point of view it should be a part of B&TI while it is rarely used functionality and no needs to waste regular build by this data (it does not requ

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-10-02 Thread Vladimir Ivanov
The coverage information was updated on the wiki to current state (issue 564 also was updated): http://wiki.apache.org/harmony/Coverage_information thanks, Vladimir

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-09-05 Thread Vladimir Ivanov
The coverage information was updated on the wiki to current state. thanks, Vladimir

RE: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-08-21 Thread Ivanov, Alexey A
>Subject: Re: [classlib] [testing] Coverage (was Re: 37% of total test >execution time is spent in a single test) > >The coverage information was updated on the wiki. Also, coverage for >accessibility, awt, instrument and sound modules was added. I have a >problem >to calculate co

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-08-20 Thread Vladimir Ivanov
Coverage for swing module was added. thanks, Vladimir On 8/18/06, Tim Ellison <[EMAIL PROTECTED]> wrote: Thanks for updating the numbers Vladimir. Overall I think they look quite respectable. There are a few places where it looks like we could use more test coverage. It's a great way to co

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-08-18 Thread Tim Ellison
Thanks for updating the numbers Vladimir. Overall I think they look quite respectable. There are a few places where it looks like we could use more test coverage. It's a great way to contribute to Harmony (he said, hinting to the lurkers ). Pick a favourite package, kick the wheels of Harmony u

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-08-18 Thread Vladimir Ivanov
The coverage information was updated on the wiki. Also, coverage for accessibility, awt, instrument and sound modules was added. I have a problem to calculate coverage for swing module (test run hang up) so issue 564 will be updated later. thanks, Vladimir On 6/20/06, Paulex Yang <[EMAIL PROTEC

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-20 Thread Paulex Yang
Vladimir Ivanov wrote: Classes from exclude list are now specified as green. I've update wiki (http://wiki.apache.org/harmony/Coverage_information) and coverage pages. Great, thank you, Vladimir! Thanks, Vladimir On 6/16/06, Paulex Yang <[EMAIL PROTECTED]> wrote: Vladimir Vladimir Ivan

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-19 Thread Vladimir Ivanov
Classes from exclude list are now specified as green. I've update wiki (http://wiki.apache.org/harmony/Coverage_information) and coverage pages. Thanks, Vladimir On 6/16/06, Paulex Yang <[EMAIL PROTECTED]> wrote: Vladimir Vladimir Ivanov wrote: >> >> The current reports don't provide code s

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-16 Thread Paulex Yang
Vladimir Vladimir Ivanov wrote: The current reports don't provide code source linking. Are you going to add it? There were no information for 'security' and 'auth' modules, but, I have updated the pages and now there is source code linking for all modules. One more issue to discuss: exclude

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-15 Thread Vladimir Ivanov
The current reports don't provide code source linking. Are you going to add it? There were no information for 'security' and 'auth' modules, but, I have updated the pages and now there is source code linking for all modules. One more issue to discuss: excluded classes present in the coverage

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-14 Thread Stepan Mishura
On 6/15/06, Vladimir Ivanov wrote: I've update web (viv.byethost15.com) - published fresh coverage information. No awt package in the beans coverage table anymore. Also I've update the jira-564 by extended script (that include security, auth, crypto, lang and rmi packages). Hi Vladimir, The

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-14 Thread Vladimir Ivanov
I've update web (viv.byethost15.com) - published fresh coverage information. No awt package in the beans coverage table anymore. Also I've update the jira-564 by extended script (that include security, auth, crypto, lang and rmi packages). Now I have 2 questions/ issues to discuss: 1) preferable

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-14 Thread Geir Magnusson Jr
Mark Hindess wrote: > On 14 June 2006 at 7:04, Geir Magnusson Jr <[EMAIL PROTECTED]> wrote: >> yes. >> >> And/or add it to the upcoming donation of the [testing] infrastructure >> to make it part of the CI runs. > > Are you talking about me? It's just an ant file and a few script so I > hope yo

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-14 Thread Mark Hindess
On 14 June 2006 at 7:04, Geir Magnusson Jr <[EMAIL PROTECTED]> wrote: > > yes. > > And/or add it to the upcoming donation of the [testing] infrastructure > to make it part of the CI runs. Are you talking about me? It's just an ant file and a few script so I hope you aren't expecting too much.

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-14 Thread Geir Magnusson Jr
yes. And/or add it to the upcoming donation of the [testing] infrastructure to make it part of the CI runs. geir Nathan Beyer wrote: > Is there any possibility of adding this to an Ant script that can optionally > be run with the build scripts? I'd like to make this easier for everyone to > run

RE: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-13 Thread Nathan Beyer
Is there any possibility of adding this to an Ant script that can optionally be run with the build scripts? I'd like to make this easier for everyone to run while developing. Has anyone tried any other coverage tools? Like TPTP for Eclipse, Clover or Corbetura (sp)? -Nathan > -Original Messa

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-13 Thread Mark Hindess
On 13 June 2006 at 18:50, "Vladimir Ivanov" <[EMAIL PROTECTED]> wrote: > > > > P.S. I think java.awt does not currently belong to beans module, > > > though who knows what the future may bring us :) > > In fact, coverage information is gathered for each jar, that, to > some extend corresponds to

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-13 Thread Vladimir Ivanov
I've update the web site by information about auth, crypto and rmi modules. The exclude list also was added. I'm not sure that all tests were run correctly so I'm going to verify test runs. Thanks, Vladimir On 6/13/06, Vladimir Ivanov <[EMAIL PROTECTED]> wrote: > One more thing I've missed

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-13 Thread Vladimir Ivanov
One more thing I've missed: what is the exclude list you've finally ended with? I'm going to publish it ASAP. > P.S. I think java.awt does not currently belong to beans module, > though who knows what the future may bring us :) In fact, coverage information is gathered for each jar, that, to

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-13 Thread Paulex Yang
Vladimir Ivanov wrote: Latest Harmony API source coverage by Harmony API unit tests results I stored at wiki page http://wiki.apache.org/harmony/Coverage_information Cool! Thank you, Vladimir. Would you please also add the excluded class list, so that we can differentiate them from the classe

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-13 Thread Mikhail Loenko
Cool! Sorry, I've missed it One more thing I've missed: what is the exclude list you've finally ended with? Thanks, Mikhail 2006/6/13, Vladimir Ivanov <[EMAIL PROTECTED]>: The detailed info available at http://viv.byethost15.com/ (this address also pointed on wiki-page). Do you need additiona

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-13 Thread Vladimir Ivanov
The detailed info available at http://viv.byethost15.com/ (this address also pointed on wiki-page). Do you need additional information ? Thanks, Vladimir On 6/13/06, Mikhail Loenko <[EMAIL PROTECTED]> wrote: Great! Is it possible to see uncovered classes/methods/lines? Thanks, Mikhail P.

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-13 Thread Tim Ellison
Mikhail Loenko wrote: > Great! Yep, that's great. > Is it possible to see uncovered classes/methods/lines? There is a link at the top of the wiki page to show details. > Thanks, > Mikhail > > P.S. I think java.awt does not currently belong to beans module, > though who knows what the future ma

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-13 Thread Mikhail Loenko
Great! Is it possible to see uncovered classes/methods/lines? Thanks, Mikhail P.S. I think java.awt does not currently belong to beans module, though who knows what the future may bring us :) 2006/6/13, Vladimir Ivanov <[EMAIL PROTECTED]>: Latest Harmony API source coverage by Harmony API uni

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-12 Thread Vladimir Ivanov
Latest Harmony API source coverage by Harmony API unit tests results I stored at wiki page http://wiki.apache.org/harmony/Coverage_information I'm going to refresh it bi-weekly (seems, it is enough for coverage). I think we have got a agreement on the test naming convention[1], but for sur

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-08 Thread Paulex Yang
Mikhail Loenko wrote: 2006/6/8, Paulex Yang <[EMAIL PROTECTED]>: Vladimir, Vladimir Ivanov wrote: > Thanks Paulex! > > I did the same, but could not send results due to spam filter J > Observations: > > 1. Coverage results look pretty much similar. > 2. Exclude list looks pretty much simila

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-07 Thread Mikhail Loenko
2006/6/8, Paulex Yang <[EMAIL PROTECTED]>: Vladimir, Vladimir Ivanov wrote: > Thanks Paulex! > > I did the same, but could not send results due to spam filter J > Observations: > > 1. Coverage results look pretty much similar. > 2. Exclude list looks pretty much similar too, but, looks like

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-07 Thread Paulex Yang
Vladimir, Vladimir Ivanov wrote: Thanks Paulex! I did the same, but could not send results due to spam filter J Observations: 1. Coverage results look pretty much similar. 2. Exclude list looks pretty much similar too, but, looks like it depends on the way of data collection (I didn't ru

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-06 Thread Vladimir Ivanov
Thanks Paulex! I did the same, but could not send results due to spam filter J Observations: 1. Coverage results look pretty much similar. 2. Exclude list looks pretty much similar too, but, looks like it depends on the way of data collection (I didn't run ant task and the list is a litt

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-06 Thread Paulex Yang
I've attach the scripts and excluded class lists to JIRA, please refer to https://issues.apache.org/jira/browse/HARMONY-564. Enjoy it:). Mark Hindess wrote: On 2 June 2006 at 10:37, Paulex Yang <[EMAIL PROTECTED]> wrote: Mark, I'm glad that there is someone else has interest on emma, I'v

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-02 Thread Vladimir Ivanov
Paulex, And I have got some ant script and more excluded list for emma, if anyone has interests, I can upload it to JIRA. Yes please, upload the list into JIRA. I'm going to experiment with the list and source coverage of HY API too. When I tried to experiment with HY API by unit tests co

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-01 Thread Mark Hindess
On 2 June 2006 at 10:37, Paulex Yang <[EMAIL PROTECTED]> wrote: > > Mark, > > I'm glad that there is someone else has interest on emma, I've tried it > before. AFAIK, emma works by instrumentation, but sometimes for classes > in bootclasspath, the instrumentation cannot work, there are two case

Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)

2006-06-01 Thread Paulex Yang
Mark, I'm glad that there is someone else has interest on emma, I've tried it before. AFAIK, emma works by instrumentation, but sometimes for classes in bootclasspath, the instrumentation cannot work, there are two cases: 1. Some instrumented classes cannot be loaded by VM. 2. Some classes can