Re: [testing] Peace (was: Re: svn commit: r419522 - in /incubator/harmony/enhanced/classlib/trunk/modules/nio: .classpath build.xml make/hyproperties.xml src/test/java/common/ src/test/java/common/org

2006-07-26 Thread Vladimir Ivanov
On 7/24/06, Alexei Zakharov [EMAIL PROTECTED] wrote: Hi Vladimir, Cons: 1. More complex algorithms of grouping / selecting tests for execution: harness (being it Junit, TestNG or my own script) must understand word mark-up instead of just simple walking directories. BTW, after brief

Re: [testing] Peace (was: Re: svn commit: r419522 - in /incubator/harmony/enhanced/classlib/trunk/modules/nio: .classpath build.xml make/hyproperties.xml src/test/java/common/ src/test/java/common/org

2006-07-26 Thread Vladimir Ivanov
The more I work with our tests the more I see that managing tests via directory layout is worse than using metadata. I thought about three more characteristics we might want to mark-up tests with: - Platform-specific unit tests - Harmony implementation test vs. API tests - Broken buggy

Re: [testing] Peace (was: Re: svn commit: r419522 - in /incubator/harmony/enhanced/classlib/trunk/modules/nio: .classpath build.xml make/hyproperties.xml src/test/java/common/ src/test/java/common/org

2006-07-26 Thread Richard Liang
Vladimir Ivanov wrote: The more I work with our tests the more I see that managing tests via directory layout is worse than using metadata. Agree :-) I thought about three more characteristics we might want to mark-up tests with: - Platform-specific unit tests - Harmony implementation

Re: [testing] Peace (was: Re: svn commit: r419522 - in /incubator/harmony/enhanced/classlib/trunk/modules/nio: .classpath build.xml make/hyproperties.xml src/test/java/common/ src/test/java/common/org

2006-07-26 Thread George Harley
Richard Liang wrote: Vladimir Ivanov wrote: The more I work with our tests the more I see that managing tests via directory layout is worse than using metadata. Agree :-) I thought about three more characteristics we might want to mark-up tests with: - Platform-specific unit tests -

Re: [testing] Peace (was: Re: svn commit: r419522 - in /incubator/harmony/enhanced/classlib/trunk/modules/nio: .classpath build.xml make/hyproperties.xml src/test/java/common/ src/test/java/common/org

2006-07-24 Thread Vladimir Ivanov
Let me add a couple of words. The problem: in Harmony unit test suite we need to mark-up somehow and manage: - Platform-specific unit tests - Harmony implementation test vs. API tests - Broken buggy tests - Tests failing due to bug in implementation - [Potentially in future] type of test –

Re: [testing] Peace (was: Re: svn commit: r419522 - in /incubator/harmony/enhanced/classlib/trunk/modules/nio: .classpath build.xml make/hyproperties.xml src/test/java/common/ src/test/java/common/org

2006-07-24 Thread Alexei Zakharov
Hi Vladimir, Cons: 1. More complex algorithms of grouping / selecting tests for execution: harness (being it Junit, TestNG or my own script) must understand word mark-up instead of just simple walking directories. BTW, after brief browsing of the JUnit 4.0 documentation I didn't find any

[testing] Peace (was: Re: svn commit: r419522 - in /incubator/harmony/enhanced/classlib/trunk/modules/nio: .classpath build.xml make/hyproperties.xml src/test/java/common/ src/test/java/common/org/ s

2006-07-06 Thread Tim Ellison
May I tactfully suggest that we get this back to a discussion of the pros and cons of JUnit test suites and/or TestNG metadata vs. directory layout. It sounds like we all want to resolve that problem asap. Regards, Tim George Harley wrote: Mark Hindess wrote: On 6 July 2006 at 18:05, George