On Tue, Aug 27, 2013 at 8:44 AM, Herbert Duerr <h...@apache.org> wrote:
> On 25.08.2013 16:12, Andrea Pescetti wrote:
>>
>> On 19/08/2013 Herbert Duerr wrote:
>>>
>>> An example of a test case where a formula ("addition") is checked is in
>>> [1]. This file is clean and easy enough that it could be used as a
>>> template for more formula checks.
>>> [1]
>>>
>>> http://svn.apache.org/repos/asf/openoffice/trunk/test/testuno/source/fvt/uno/sc/formula/AddtionOperatorInFormula.java
>>>
>>
>> I find it quite verbose (well, it's Java) and too hard for an "ordinary"
>> QA volunteer, who could probably write a simple ODT file to check a
>> bugfix in formula handling but couldn't write a Java testcase.
>>
>> Of course, this approach has also huge benefits, like automation.
>>
>> Perhaps it is possible to convert a few key test cases, like Regina's
>> ODT file in the blocker bug
>> https://issues.apache.org/ooo/show_bug.cgi?id=122997 to this framework?
>
>
> A good idea. I just wrote a task [1] and a script [2] that takes a slightly
> modified version of Regina's sample document and checks whether all of its
> tests pass. This script is now part of the Functional Verification Test
> (a.k.a. FVT).
>
> [1] https://issues.apache.org/ooo/show_bug.cgi?id=123119
> [2] http://svn.apache.org/r1517802
>
> Adding further test spreadsheets is simple. They need a "TestID" row and a
> "TestOK" row like [3]. Such new test spreadsheets have to be added to [4]'s
> testFormulaDocs() method to be picked up.
>Nice. If we can have test cases written by non-programmers, and then automated testing of these sheets, then we'll have the best of both worlds. I assume we'd want to agree on a test template. For example, one approach is to bootstrap the tests like this: 1) Have the fundamental test cases for IF(), TRUE(), FALSE() and a handful of other core functions written in Java, not requiring a test spreadsheet. 2) Then write the test cases for the specialized functions in test documents, and reserve a cell (A1 for example) to return 1 if all tests in the document pass, 0 otherwise. 3) Automate the loading and evaluation of the test documents. (Since the test documents would depend on correct operation of IF(), we cannot use the test documents to test IF() itself) Would something like this work? -Rob > [2] > http://svn.apache.org/viewvc/openoffice/trunk/test/testuno/data/uno/sc/fvt/FormulaTest1.ods > [3] > http://svn.apache.org/viewvc/openoffice/trunk/test/testuno/source/fvt/uno/sc/formula/TestFormulaDocs.java?view=markup > > Herbert > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@openoffice.apache.org > For additional commands, e-mail: dev-h...@openoffice.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@openoffice.apache.org For additional commands, e-mail: dev-h...@openoffice.apache.org
