+1
[EMAIL PROTECTED] wrote on 12/03/2002 05:09:16 PM:
> Hi all,
>
> After lots of discussion regarding the conformance test restructuring,
> there were many people in favour of option (2), and/or proposed variants
of
> option (2). We propose to move forward with Shane Curcuru's proposal for
> restructuring the test harness.
>
> The goal of this discussion is to "agree on basic principles to get the
job
> done for existing committers to test Xalan releases, and let the
committers
> who will actually perform this work finish the details and implement a
> working
> system".
>
> - create an accept tree, parallel to the conf tree
> - have in the accept tree only a few categories (including idkey, output,
> sort, whitespace)
> - have in these categories only the tests for which processors do not
agree
> on the output (see considerations below)
> - pass an option to the test harness (perhaps "qetest.processor")
> indicating which processor was used
> - update the test harness to choose the correct gold file for the test
> - an example of the naming scheme: (sort21 case)
>
> /accept/sort/sort21.xml
> /accept/sort/sort21.xsl
> XML and XSL pair for test
>
> /accept-gold/sort/sort21.out
> "default" output file that output will be checked against
>
> /accept-gold/sort/sort21-XalanJ-C.out
> should XalanJ-C ("XSLTC") have correct output that doesn't match
> sort21.out, it would go here.
> similar files may exist for XalanC or XalanJ-I ("Xalan").
>
> Considerations made in the proposal:
>
> - attempts will be made to reduce the number of test cases going into the
> accept bucket. This will be done by making improvements to the test
harness
> in detecting these differences, and rewriting test cases to remain
> processor independent where possible.
> - attempts will be made to reduce the number of 'gold' files in the
> accept-gold tree. By only creating processor-specific gold files when
> necessary, duplication of files will be reduced.
> - as the test files are tagged with every new Xalan release, it should be
> easy to check out test files corresponding to a certain previous release.
> - in the event of future multi-dimensionality, additional gold files can
be
> created, or directory structures can be duplicated.
>
> Please respond with any comments, objections, opinions you may have --
>
> Thanks!
> Gordon
>
> ----
> Gordon Chiu
> [EMAIL PROTECTED]
>
