Dear Rony,
Previously I had only run the tests without updating the builds. I have now
re-built ooRexx for all platforms on Jenkins. This triggers the tests
automatically so this time I am confident I am running the tests with the
correct version of ooRexx (Revision 12106).
Unfortunately this did not change much, the only test that passes is for
Ubuntu16.
The failures on Jenkins may well be related to different problems for different
platforms. I have only triggered the complete tests, without limitations.
What worries me the most are the segmentation faults during the tests.
Here a snippet from the different logs from Jenkins:
Started by upstream project "ooRexx-CentOS7-build" build number 388
originally caused by:
Started by user P.O. Jonsson
Running as SYSTEM
Building remotely on naffnet01 in workspace
/home/netrexx/workspace/ooRexx-CentOS7-test
Updating svn://svn.code.sf.net/p/oorexx/code-0/test/trunk at revision
'2020-08-27T18:33:21.131 +0100'
At revision 12106
Executing .../ooRexx/base/class/RexxQueue.testGroup
Executing .../ooRexx/base/class/Routine.testGroup
/tmp/jenkins6975566864321430835.sh: line 11: 61801 Segmentation fault rexx
./testOORexx.rex -s
Build step 'Execute shell' marked build as failure
Finished: FAILURE
----------------------------------------------------------------------
Started by upstream project "ooRexx-macOS1014-build" build number 378
originally caused by:
Started by user P.O. Jonsson
Running as SYSTEM
Building remotely on pos-Mac-mini in workspace
/Users/jenkins/workspace/ooRexx-macOS1014-test
Updating svn://svn.code.sf.net/p/oorexx/code-0/test/trunk at revision
'2020-08-27T19:18:16.046 +0200'
At revision 12106
Executing .../ooRexx/utilities/rxqueue/rxQueue.testGroup
Executing .../ooRexx/utilities/rxsubcom/rxsubcom.testGroup
ooTest Framework - Automated Test of the ooRexx Interpreter
Interpreter: REXX-ooRexx_5.0.0(MT)_64-bit 6.05 27 Aug 2020
OS Name: DARWIN
SysVersion: Darwin 18.7.0
Tests ran: 23862
Assertions: 386161
Failures: 0
Errors: 1
[error] 20200827 19:24:35.567123
svn: r12104 Change date: 2020-08-18 13:17:34 +0200
Test: TEST_NEW_ARRAY_FROM_FILE
Class: Routine.testGroup
File: .../ooRexx/base/class/Routine.testGroup
Event: [SYNTAX 93.938] raised unexpectedly.
Method argument 1 must have a string value.
Line: 253
*-* Compiled method "NEW" with scope "Routine".
253 *-* r=.routine~new("r", arr) -- create routine from array
*-* Compiled method "SEND" with scope "Message".
1561 *-* .message~new(self, methodName)~send
1536 *-* self~doTheTest(fName, aTestResult) -- carry out the testmethod
552 *-* test~execute(testResult, verbose)
552 *-* test~execute(testResult, verbose)
110 *-* suite~execute(testResult)
79 *-* retCode = 'worker.rex'(arguments)
Interpreter: REXX-ooRexx_5.0.0(MT)_64-bit 6.05 27 Aug 2020
OS Name: DARWIN
SysVersion: Darwin 18.7.0
Tests ran: 23862
Assertions: 386161
Failures: 0
Errors: 1
File search: 00:00:01.379001
Suite construction: 00:00:01.111666
Test execution: 00:06:45.076312
Total time: 00:06:47.695384
Build step 'Execute shell' marked build as failure
Finished: FAILURE
----------------------------------------------------------------------
Started by upstream project "ooRexx-Raspbian94-build" build number 242
originally caused by:
Started by user P.O. Jonsson
Running as SYSTEM
Building remotely on pos-Pi-2B in workspace
/home/pi/workspace/workspace/ooRexx-Raspbian94-test
Updating svn://svn.code.sf.net/p/oorexx/code-0/test/trunk at revision
'2020-08-27T19:40:11.170 +0200'
At revision 12106
Executing .../ooRexx/base/class/RexxQueue.testGroup
Executing .../ooRexx/base/class/Routine.testGroup
Segmentation fault
Build step 'Execute shell' marked build as failure
Finished: FAILURE
----------------------------------------------------------------------
Started by upstream project "oorexx-ubuntu16-build" build number 435
originally caused by:
Started by user P.O. Jonsson
Running as SYSTEM
Building remotely on ubuntu16 in workspace
/home/jenkins/slave/workspace/oorexx-ubuntu16-test
Updating svn://svn.code.sf.net/p/oorexx/code-0/test/trunk at revision
'2020-08-27T19:24:55.895 +0200'
At revision 12106
Executing .../ooRexx/utilities/rxqueue/rxQueue.testGroup
Executing .../ooRexx/utilities/rxsubcom/rxsubcom.testGroup
ooTest Framework - Automated Test of the ooRexx Interpreter
Interpreter: REXX-ooRexx_5.0.0(MT)_64-bit 6.05 27 Aug 2020
OS Name: LINUX
SysVersion: Linux 4.4.0-154-generic
Tests ran: 23871
Assertions: 385961
Failures: 0
Errors: 0
File search: 00:00:03.081001
Suite construction: 00:00:04.859802
Test execution: 00:07:55.078728
Total time: 00:08:03.505892
Finished: SUCCESS
----------------------------------------------------------------------
Started by upstream project "ooRexx-windows32-build" build number 267
originally caused by:
Started by user P.O. Jonsson
Running as SYSTEM
Building remotely on pos-Windows in workspace
C:\Users\jenkins\workspace\ooRexx-windows32-test
Updating svn://svn.code.sf.net/p/oorexx/code-0/test/trunk at revision
'2020-08-27T20:00:03.287 +0200'
At revision 12106
Executing ...\ooRexx\utilities\rxqueue\rxQueue.testGroup
Executing ...\ooRexx\utilities\rxsubcom\rxsubcom.testGroup
ooTest Framework - Automated Test of the ooRexx Interpreter
Interpreter: REXX-ooRexx_5.0.0(MT)_32-bit 6.05 27 Aug 2020
OS Name: WindowsNT
SysVersion: Windows 10.0.18363
Tests ran: 24000
Assertions: 373793
Failures: 0
Errors: 1
[error] 20200827 20:04:49.415000
svn: r12104 Change date: 2020-08-18 13:17:34 +0200
Test: TEST_NEW_ARRAY_FROM_FILE
Class: Routine.testGroup
File: ...\ooRexx\base\class\Routine.testGroup
Event: [SYNTAX 93.915] raised unexpectedly.
Method option must be one of "CL"; found "20200827 20:04:28.994000:
startTest".
Line: 253
*-* Compiled method "NEW" with scope "Routine".
253 *-* r=.routine~new("r", arr) -- create routine from array
*-* Compiled method "SEND" with scope "Message".
1561 *-* .message~new(self, methodName)~send
1536 *-* self~doTheTest(fName, aTestResult) -- carry out the testmethod
552 *-* test~execute(testResult, verbose)
552 *-* test~execute(testResult, verbose)
110 *-* suite~execute(testResult)
79 *-* retCode = 'worker.rex'(arguments)
Interpreter: REXX-ooRexx_5.0.0(MT)_32-bit 6.05 27 Aug 2020
OS Name: WindowsNT
SysVersion: Windows 10.0.18363
Tests ran: 24000
Assertions: 373793
Failures: 0
Errors: 1
File search: 00:00:07.282000
Suite construction: 00:00:01.177000
Test execution: 00:05:57.002000
Total time: 00:06:05.753000
C:\Users\Jenkins\workspace\ooRexx-windows32-test\oorexxTest>exit 2
Build step 'Execute Windows batch command' marked build as failure
Finished: FAILURE
----------------------------------------------------------------------
Started by upstream project "ooRexx-windows64-build" build number 270
originally caused by:
Started by an SCM change
Running as SYSTEM
Building remotely on pos-Windows in workspace
C:\Users\jenkins\workspace\ooRexx-windows64-test
Updating svn://svn.code.sf.net/p/oorexx/code-0/test/trunk at revision
'2020-08-27T15:03:55.207 +0200'
U ooRexx\base\class\EventSemaphore.testGroup
At revision 12106
Executing ...\ooRexx\utilities\rxqueue\rxQueue.testGroup
Executing ...\ooRexx\utilities\rxsubcom\rxsubcom.testGroup
ooTest Framework - Automated Test of the ooRexx Interpreter
Interpreter: REXX-ooRexx_5.0.0(MT)_64-bit 6.05 27 Aug 2020
OS Name: WindowsNT
SysVersion: Windows 10.0.18363
Tests ran: 24000
Assertions: 386699
Failures: 0
Errors: 1
[error] 20200827 15:12:04.268000
svn: r12104 Change date: 2020-08-18 13:17:34 +0200
Test: TEST_NEW_ARRAY_FROM_FILE
Class: Routine.testGroup
File: ...\ooRexx\base\class\Routine.testGroup
Event: [SYNTAX 93.915] raised unexpectedly.
Method option must be one of "CL"; found "-134 ** 7".
Line: 253
*-* Compiled method "NEW" with scope "Routine".
253 *-* r=.routine~new("r", arr) -- create routine from array
*-* Compiled method "SEND" with scope "Message".
1561 *-* .message~new(self, methodName)~send
1536 *-* self~doTheTest(fName, aTestResult) -- carry out the testmethod
552 *-* test~execute(testResult, verbose)
552 *-* test~execute(testResult, verbose)
110 *-* suite~execute(testResult)
79 *-* retCode = 'worker.rex'(arguments)
Interpreter: REXX-ooRexx_5.0.0(MT)_64-bit 6.05 27 Aug 2020
OS Name: WindowsNT
SysVersion: Windows 10.0.18363
Tests ran: 24000
Assertions: 386699
Failures: 0
Errors: 1
File search: 00:00:05.524000
Suite construction: 00:00:01.751000
Test execution: 00:09:17.270000
Total time: 00:09:24.555000
C:\Users\Jenkins\workspace\ooRexx-windows64-test\oorexxTest>exit 2
Build step 'Execute Windows batch command' marked build as failure
Finished: FAILURE
----------------------------------------------------------------------
Hälsningar/Regards/Grüsse,
P.O. Jonsson
oor...@jonases.se
> Am 27.08.2020 um 18:47 schrieb Rony G. Flatscher <rony.flatsc...@wu.ac.at>:
>
> Dear P.O.,
>
> back, now ran the tests without problems on Mac and Linux:
>
> wu114217:class rony$ rexx Method.testGroup
> Interpreter: REXX-ooRexx_5.0.0(MT)_64-bit 6.05 27 Aug 2020
> OS Name: DARWIN
> SysVersion: Darwin 18.7.0
>
> Tests ran: 59
> Assertions: 104
> Failures: 0
> Errors: 0
>
> Test execution: 00:00:00.059426
>
> wu114217:class rony$ rexx Routine.testGroup
> Interpreter: REXX-ooRexx_5.0.0(MT)_64-bit 6.05 27 Aug 2020
> OS Name: DARWIN
> SysVersion: Darwin 18.7.0
>
> Tests ran: 63
> Assertions: 100
> Failures: 0
> Errors: 0
>
> Test execution: 00:00:00.057993
>
> wu114217:class rony$ rexx -v
> Open Object Rexx Version 5.0.0 r12106
> Build date: Aug 27 2020
> Addressing mode: 64
> Copyright (c) 1995, 2004 IBM Corporation. All rights reserved.
> Copyright (c) 2005-2020 Rexx Language Association. All rights reserved.
> This program and the accompanying materials are made available under the terms
> of the Common Public License v1.0 which accompanies this distribution or at
> http://www.oorexx.org/license.html <http://www.oorexx.org/license.html>
> wu114217:class rony$
>
>
> ... cut ....
>
> rony@rony-linux:~/dev/oorexx-code-0/test/trunk/ooRexx/base/class$ rexx
> Method.testGroup
> Interpreter: REXX-ooRexx_5.0.0(MT)_64-bit 6.05 27 Aug 2020
> OS Name: LINUX
> SysVersion: Linux 4.15.0-112-generic
>
> Tests ran: 59
> Assertions: 104
> Failures: 0
> Errors: 0
>
> Test execution: 00:00:00.030012
>
> rony@rony-linux:~/dev/oorexx-code-0/test/trunk/ooRexx/base/class$ rexx
> Routine.testGroup
> Interpreter: REXX-ooRexx_5.0.0(MT)_64-bit 6.05 27 Aug 2020
> OS Name: LINUX
> SysVersion: Linux 4.15.0-112-generic
>
> Tests ran: 63
> Assertions: 100
> Failures: 0
> Errors: 0
>
> Test execution: 00:00:00.026602
>
> rony@rony-linux:~/dev/oorexx-code-0/test/trunk/ooRexx/base/class$ rexx -v
> Open Object Rexx Version 5.0.0 r12106
> Build date: Aug 27 2020
> Addressing mode: 64
> Copyright (c) 1995, 2004 IBM Corporation. All rights reserved.
> Copyright (c) 2005-2020 Rexx Language Association. All rights reserved.
> This program and the accompanying materials are made available under the terms
> of the Common Public License v1.0 which accompanies this distribution or at
> http://www.oorexx.org/license.html <http://www.oorexx.org/license.html>
> rony@rony-linux:~/dev/oorexx-code-0/test/trunk/ooRexx/base/class$
>
>
> ---rony
>
> On 27.08.2020 17:05, Rony G. Flatscher wrote:
>> Dear P.O.,
>>
>> On 27.08.2020 16:56, P.O. Jonsson wrote:
>>> I have removed the following limitation from all test-projects following
>>> Ronys change in the failing testcase.
>>>
>>> # exclude EventSemaphore.testGroup until bugg #1697 fixed + new problem
>>> around 1.6.2020
>>> -x EventSemaphore.testGroup
>>>
>>> Unfortunately there seems to be another issue clouding the view. I
>>> think/guess that it has something to do with these changes:
>>>
>>> Add tests for testing fix [r12102] ([oorexx:bugs:#1716] and related
>>> [oorexx:bugs:#1715]). (Details)
>>> by orexx
>>>
>>> U ooRexx\base\class\Method.testGroup
>>> U ooRexx\base\class\Routine.testGroup
>>> At revision 12103
>>> U ooRexx\base\class\Method.testGroup
>>> U ooRexx\base\class\Routine.testGroup
>>> At revision 12104
>>>
>>> Can someone please have a look? Currently either a segmentation fault
>>> occurs or errors result, see below. ALL tests are currently failing,
>>> prohibiting upload of artifacts.
>> Which version of ooRexx are you running the testcases with, ooRexx r12106 as
>> of today?
>>
>> Just ran the two testgroups:
>>
>> F:\work\svn\oorexx\test\trunk\ooRexx\base\class>rexx Method.testGroup
>> Interpreter: REXX-ooRexx_5.0.0(MT)_32-bit 6.05 27 Aug 2020
>> OS Name: WindowsNT
>> SysVersion: Windows 10.0.19041
>>
>> Tests ran: 59
>> Assertions: 104
>> Failures: 0
>> Errors: 0
>>
>> Test execution: 00:00:00.126000
>>
>>
>> F:\work\svn\oorexx\test\trunk\ooRexx\base\class>rexx Routine.testGroup
>> Interpreter: REXX-ooRexx_5.0.0(MT)_32-bit 6.05 27 Aug 2020
>> OS Name: WindowsNT
>> SysVersion: Windows 10.0.19041
>>
>> Tests ran: 63
>> Assertions: 100
>> Failures: 0
>> Errors: 0
>>
>> Test execution: 00:00:00.116000
>> They pass here.
>>
>> ... cut ..
>>
>> ---rony
>>
> _______________________________________________
> Oorexx-devel mailing list
> Oorexx-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/oorexx-devel
_______________________________________________
Oorexx-devel mailing list
Oorexx-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/oorexx-devel
