Hello,
VPP make test gives false positive results at the moment - there are cca 110
tests failed but build is marked successful.
The last correct run on ubuntu is [1].
The first false positive run on ubutnu is [2] - trigerred by Florin's patch [3].
It seems that the first failing test is test_ip4_irb.TestIpIrb:
00:22:48.177
==============================================================================
00:22:53.685 VAPI test
00:22:53.685
==============================================================================
00:22:53.685 run C VAPI tests
SKIP
00:22:53.685 run C++ VAPI tests
SKIP
00:22:53.685
00:22:53.685
==============================================================================
00:22:53.685 ERROR: setUpClass (test_ip4_irb.TestIpIrb)
00:22:53.685
------------------------------------------------------------------------------
00:22:53.685 Traceback (most recent call last):
00:22:53.685 File
"/w/workspace/vpp-verify-master-ubuntu1604/test/test_ip4_irb.py", line 57, in
setUpClass
00:22:53.685 cls.create_loopback_interfaces(range(1))
00:22:53.685 File
"/w/workspace/vpp-verify-master-ubuntu1604/test/framework.py", line 571, in
create_loopback_interfaces
00:22:53.685 setattr(cls, intf.name, intf)
00:22:53.685 File
"/w/workspace/vpp-verify-master-ubuntu1604/test/vpp_interface.py", line 91, in
name
00:22:53.685 return self._name
00:22:53.685 AttributeError: 'VppLoInterface' object has no attribute '_name'
00:22:53.685
And all following tests failes with connection failur during test case setup:
00:22:53.689
==============================================================================
00:22:53.689 ERROR: setUpClass (test_dvr.TestDVR)
00:22:53.689
------------------------------------------------------------------------------
00:22:53.689 Traceback (most recent call last):
00:22:53.689 File
"/w/workspace/vpp-verify-master-ubuntu1604/test/framework.py", line 362, in
setUpClass
00:22:53.689 cls.vapi.connect()
00:22:53.689 File
"/w/workspace/vpp-verify-master-ubuntu1604/test/vpp_papi_provider.py", line
141, in connect
00:22:53.689 self.vpp.connect(self.name, self.shm_prefix)
00:22:53.689 File "build/bdist.linux-x86_64/egg/vpp_papi.py", line 699, in
connect
00:22:53.689 async)
00:22:53.689 File "build/bdist.linux-x86_64/egg/vpp_papi.py", line 670, in
connect_internal
00:22:53.689 raise IOError(2, 'Connect failed')
00:22:53.689 IOError: [Errno 2] Connect failed
00:22:53.689
But result is OK:
00:22:53.689 Ran 156 tests in 162.407s
00:22:53.689
00:22:53.689 FAILED (errors=114, skipped=118)
00:22:53.691 1 test(s) failed, 3 attempt(s) left
00:22:53.697 Running tests using custom test runner
00:22:53.697 Active filters: file=None, class=None, function=None
00:22:53.697 0 out of 0 tests match specified filters
00:22:53.697 Not running extended tests (some tests will be skipped)
00:22:53.697
00:22:53.697 Ran 0 tests in 0.000s
00:22:53.697
00:22:53.697 OK
00:22:53.697 0 test(s) failed, 2 attempt(s) left
00:22:53.757 Killing possible remaining process IDs: 20845 21195 21197
00:22:53.766 make[2]: Leaving directory
'/w/workspace/vpp-verify-master-ubuntu1604/test'
00:22:53.767 make[1]: Leaving directory
'/w/workspace/vpp-verify-master-ubuntu1604'
00:22:53.768 + '[' x == x1 ']'
00:22:53.768 + echo
'*******************************************************************'
00:22:53.768 *******************************************************************
00:22:53.768 + echo '* VPP BUILD SUCCESSFULLY COMPLETED'
00:22:53.768 * VPP BUILD SUCCESSFULLY COMPLETED
00:22:53.768 + echo
'*******************************************************************'
00:22:53.768 *******************************************************************
Could somebody (Klement, Ed Kern ?) find the root cause and fix it, please?
Thanks,
Jan
[1] https://jenkins.fd.io/job/vpp-verify-master-ubuntu1604/12196/console
[2] https://jenkins.fd.io/job/vpp-verify-master-ubuntu1604/12199/console
[3] https://gerrit.fd.io/r/#/c/13180/
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#9677): https://lists.fd.io/g/vpp-dev/message/9677
Mute This Topic: https://lists.fd.io/mt/22588001/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
