Re: [csit-dev] [vpp-dev] VPP make test gives false positive
We're one csit induced recheck away from getting this fixed. On Mon, 2018-06-25 at 14:30 +, Maciek Konstantynowicz (mkonstan) via Lists.Fd.Io wrote: > Any updates on the latest status? > > -Maciek > > > > > On 22 Jun 2018, at 18:07, Ole Troan wrote: > > > > > > > > 13188 is already merged. > > 13186 fails consistently locally too, investigating. > > I think this was introduced with > > a98346f664aae148d26a8e158008b773d73db96f > > > > Cheers, > > Ole > > > > > > > > > > > > > From: vpp-dev@lists.fd.io On Behalf Of Ed > > > Kern via Lists.Fd.Io > > > Sent: Friday, June 22, 2018 12:07 PM > > > To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) > > l...@cisco.com> > > > Cc: vpp-dev@lists.fd.io > > > Subject: Re: [csit-dev] [vpp-dev] VPP make test gives false > > > positive > > > Importance: High > > > > > > Hey, > > > > > > responding because I dont see one from klement. > > > > > > looks like he has two gerrits pending > > > > > > https://gerrit.fd.io/r/#/c/13188/ > > > > > > to fix broken interfaces.. (this passed verification so trying to > > > get this one merged) > > > > > > and > > > > > > https://gerrit.fd.io/r/#/c/13186/ > > > > > > for the retries in error..this is not passing verification but i > > > have my fingers crossed that it will once > > > 13188 is merged. > > > > > > Hoping to get this behind us before the weekend.. > > > > > > Ed > > > > > > > > > > > > > > > On Jun 22, 2018, at 3:03 AM, Jan Gelety via Lists.Fd.Io > > cisco@lists.fd.io> wrote: > > > > > > Hello, > > > > > > VPP make test gives false positive results at the moment - there > > > are cca 110 tests failed but build is marked successful. > > > > > > The last correct run on ubuntu is [1]. > > > > > > The first false positive run on ubutnu is [2] – trigerred by > > > Florin’s patch [3]. > > > > > > It seems that the first failing test is test_ip4_irb.TestIpIrb: > > > > > > 00:22:48.177 > > > = > > > = > > > 00:22:53.685 VAPI test > > > 00:22:53.685 > > > = > > > = > > > 00:22:53.685 run C VAPI > > > tests SKI > > > P > > > 00:22:53.685 run C++ VAPI > > > tests SKIP > > > 00:22:53.685 > > > 00:22:53.685 > > > = > > > = > > > 00:22:53.685 ERROR: setUpClass (test_ip4_irb.TestIpIrb) > > > 00:22:53.685 > > > -- > > > 00:22:53.685 Traceback (most recent call last): > > > 00:22:53.685 File "/w/workspace/vpp-verify-master- > > > ubuntu1604/test/test_ip4_irb.py", line 57, in setUpClass > > > 00:22:53.685 cls.create_loopback_interfaces(range(1)) > > > 00:22:53.685 File "/w/workspace/vpp-verify-master- > > > ubuntu1604/test/framework.py", line 571, in > > > create_loopback_interfaces > > > 00:22:53.685 setattr(cls, intf.name, intf) > > > 00:22:53.685 File "/w/workspace/vpp-verify-master- > > > ubuntu1604/test/vpp_interface.py", line 91, in name > > > 00:22:53.685 return self._name > > > 00:22:53.685 AttributeError: 'VppLoInterface' object has no > > > attribute '_name' > > > 00:22:53.685 > > > > > > And all following tests failes with connection failur during test > > > case setup: > > > > > > 00:22:53.689 > > > = > > > = > > > 00:22:53.689 ERROR: setUpClass (test_dvr.TestDVR) > > > 00:22:53.689 > > > -- > > > 00:22:53.689 Traceback (most recent call last): > > > 00:22:53.689 File "/w/workspace/vpp-verify-master- > > > ubuntu1604/test/framework.py", line 362, in setUpClass > > > 00:22
Re: [csit-dev] [vpp-dev] VPP make test gives false positive
Any updates on the latest status? -Maciek > On 22 Jun 2018, at 18:07, Ole Troan wrote: > >> 13188 is already merged. > > 13186 fails consistently locally too, investigating. > I think this was introduced with a98346f664aae148d26a8e158008b773d73db96f > > Cheers, > Ole > > >> >> From: vpp-dev@lists.fd.io On Behalf Of Ed Kern via >> Lists.Fd.Io >> Sent: Friday, June 22, 2018 12:07 PM >> To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) >> >> Cc: vpp-dev@lists.fd.io >> Subject: Re: [csit-dev] [vpp-dev] VPP make test gives false positive >> Importance: High >> >> Hey, >> >> responding because I dont see one from klement. >> >> looks like he has two gerrits pending >> >> https://gerrit.fd.io/r/#/c/13188/ >> >> to fix broken interfaces.. (this passed verification so trying to get this >> one merged) >> >> and >> >> https://gerrit.fd.io/r/#/c/13186/ >> >> for the retries in error..this is not passing verification but i have my >> fingers crossed that it will once >> 13188 is merged. >> >> Hoping to get this behind us before the weekend.. >> >> Ed >> >> >> >> >> On Jun 22, 2018, at 3:03 AM, Jan Gelety via Lists.Fd.Io >> wrote: >> >> Hello, >> >> VPP make test gives false positive results at the moment - there are cca 110 >> tests failed but build is marked successful. >> >> The last correct run on ubuntu is [1]. >> >> The first false positive run on ubutnu is [2] – trigerred by Florin’s patch >> [3]. >> >> It seems that the first failing test is test_ip4_irb.TestIpIrb: >> >> 00:22:48.177 >> == >> 00:22:53.685 VAPI test >> 00:22:53.685 >> == >> 00:22:53.685 run C VAPI tests >> SKIP >> 00:22:53.685 run C++ VAPI tests >> SKIP >> 00:22:53.685 >> 00:22:53.685 >> == >> 00:22:53.685 ERROR: setUpClass (test_ip4_irb.TestIpIrb) >> 00:22:53.685 >> -- >> 00:22:53.685 Traceback (most recent call last): >> 00:22:53.685 File >> "/w/workspace/vpp-verify-master-ubuntu1604/test/test_ip4_irb.py", line 57, >> in setUpClass >> 00:22:53.685 cls.create_loopback_interfaces(range(1)) >> 00:22:53.685 File >> "/w/workspace/vpp-verify-master-ubuntu1604/test/framework.py", line 571, in >> create_loopback_interfaces >> 00:22:53.685 setattr(cls, intf.name, intf) >> 00:22:53.685 File >> "/w/workspace/vpp-verify-master-ubuntu1604/test/vpp_interface.py", line 91, >> in name >> 00:22:53.685 return self._name >> 00:22:53.685 AttributeError: 'VppLoInterface' object has no attribute '_name' >> 00:22:53.685 >> >> And all following tests failes with connection failur during test case setup: >> >> 00:22:53.689 >> == >> 00:22:53.689 ERROR: setUpClass (test_dvr.TestDVR) >> 00:22:53.689 >> -- >> 00:22:53.689 Traceback (most recent call last): >> 00:22:53.689 File >> "/w/workspace/vpp-verify-master-ubuntu1604/test/framework.py", line 362, in >> setUpClass >> 00:22:53.689 cls.vapi.connect() >> 00:22:53.689 File >> "/w/workspace/vpp-verify-master-ubuntu1604/test/vpp_papi_provider.py", line >> 141, in connect >> 00:22:53.689 self.vpp.connect(self.name, self.shm_prefix) >> 00:22:53.689 File "build/bdist.linux-x86_64/egg/vpp_papi.py", line 699, in >> connect >> 00:22:53.689 async) >> 00:22:53.689 File "build/bdist.linux-x86_64/egg/vpp_papi.py", line 670, in >> connect_internal >> 00:22:53.689 raise IOError(2, 'Connect failed') >> 00:22:53.689 IOError: [Errno 2] Connect failed >> 00:22:53.689 >> >> But result is OK: >> 00:22:53.689 Ran 156 tests in 162.407s >> 00:22:53.689 >> 00:22:53.689 FAILED (errors=114, skipped=118) >> 00:22:53.691 1 test(s) failed, 3 attempt(s) left >> 00:22:53.697 Ru
Re: [csit-dev] [vpp-dev] VPP make test gives false positive
> 13188 is already merged. 13186 fails consistently locally too, investigating. I think this was introduced with a98346f664aae148d26a8e158008b773d73db96f Cheers, Ole > > From: vpp-dev@lists.fd.io On Behalf Of Ed Kern via > Lists.Fd.Io > Sent: Friday, June 22, 2018 12:07 PM > To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) > > Cc: vpp-dev@lists.fd.io > Subject: Re: [csit-dev] [vpp-dev] VPP make test gives false positive > Importance: High > > Hey, > > responding because I dont see one from klement. > > looks like he has two gerrits pending > > https://gerrit.fd.io/r/#/c/13188/ > > to fix broken interfaces.. (this passed verification so trying to get this > one merged) > > and > > https://gerrit.fd.io/r/#/c/13186/ > > for the retries in error..this is not passing verification but i have my > fingers crossed that it will once > 13188 is merged. > > Hoping to get this behind us before the weekend.. > > Ed > > > > > On Jun 22, 2018, at 3:03 AM, Jan Gelety via Lists.Fd.Io > wrote: > > Hello, > > VPP make test gives false positive results at the moment - there are cca 110 > tests failed but build is marked successful. > > The last correct run on ubuntu is [1]. > > The first false positive run on ubutnu is [2] – trigerred by Florin’s patch > [3]. > > It seems that the first failing test is test_ip4_irb.TestIpIrb: > > 00:22:48.177 > == > 00:22:53.685 VAPI test > 00:22:53.685 > == > 00:22:53.685 run C VAPI tests > SKIP > 00:22:53.685 run C++ VAPI tests > SKIP > 00:22:53.685 > 00:22:53.685 > == > 00:22:53.685 ERROR: setUpClass (test_ip4_irb.TestIpIrb) > 00:22:53.685 > -- > 00:22:53.685 Traceback (most recent call last): > 00:22:53.685 File > "/w/workspace/vpp-verify-master-ubuntu1604/test/test_ip4_irb.py", line 57, in > setUpClass > 00:22:53.685 cls.create_loopback_interfaces(range(1)) > 00:22:53.685 File > "/w/workspace/vpp-verify-master-ubuntu1604/test/framework.py", line 571, in > create_loopback_interfaces > 00:22:53.685 setattr(cls, intf.name, intf) > 00:22:53.685 File > "/w/workspace/vpp-verify-master-ubuntu1604/test/vpp_interface.py", line 91, > in name > 00:22:53.685 return self._name > 00:22:53.685 AttributeError: 'VppLoInterface' object has no attribute '_name' > 00:22:53.685 > > And all following tests failes with connection failur during test case setup: > > 00:22:53.689 > == > 00:22:53.689 ERROR: setUpClass (test_dvr.TestDVR) > 00:22:53.689 > -- > 00:22:53.689 Traceback (most recent call last): > 00:22:53.689 File > "/w/workspace/vpp-verify-master-ubuntu1604/test/framework.py", line 362, in > setUpClass > 00:22:53.689 cls.vapi.connect() > 00:22:53.689 File > "/w/workspace/vpp-verify-master-ubuntu1604/test/vpp_papi_provider.py", line > 141, in connect > 00:22:53.689 self.vpp.connect(self.name, self.shm_prefix) > 00:22:53.689 File "build/bdist.linux-x86_64/egg/vpp_papi.py", line 699, in > connect > 00:22:53.689 async) > 00:22:53.689 File "build/bdist.linux-x86_64/egg/vpp_papi.py", line 670, in > connect_internal > 00:22:53.689 raise IOError(2, 'Connect failed') > 00:22:53.689 IOError: [Errno 2] Connect failed > 00:22:53.689 > > But result is OK: > 00:22:53.689 Ran 156 tests in 162.407s > 00:22:53.689 > 00:22:53.689 FAILED (errors=114, skipped=118) > 00:22:53.691 1 test(s) failed, 3 attempt(s) left > 00:22:53.697 Running tests using custom test runner > 00:22:53.697 Active filters: file=None, class=None, function=None > 00:22:53.697 0 out of 0 tests match specified filters > 00:22:53.697 Not running extended tests (some tests will be skipped) > 00:22:53.697 > 00:22:53.697 Ran 0 tests in 0.000s > 00:22:53.697 > 00:22:53.697 OK > 00:22:53.697 0 test(s) failed, 2 attempt(s) left > 00:22:53.757 Killing possible remaining process IDs: 20845 21195 21197 > 00:22:53.766 make[2]: Leaving directory > '/w/workspace/vpp-verify-master-ubunt
Re: [csit-dev] [vpp-dev] VPP make test gives false positive
13188 is already merged. From: vpp-dev@lists.fd.io On Behalf Of Ed Kern via Lists.Fd.Io Sent: Friday, June 22, 2018 12:07 PM To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) Cc: vpp-dev@lists.fd.io Subject: Re: [csit-dev] [vpp-dev] VPP make test gives false positive Importance: High Hey, responding because I dont see one from klement. looks like he has two gerrits pending https://gerrit.fd.io/r/#/c/13188/ to fix broken interfaces.. (this passed verification so trying to get this one merged) and https://gerrit.fd.io/r/#/c/13186/ for the retries in error..this is not passing verification but i have my fingers crossed that it will once 13188 is merged. Hoping to get this behind us before the weekend.. Ed On Jun 22, 2018, at 3:03 AM, Jan Gelety via Lists.Fd.Io mailto:jgelety=cisco@lists.fd.io>> wrote: Hello, VPP make test gives false positive results at the moment - there are cca 110 tests failed but build is marked successful. The last correct run on ubuntu is [1]. The first false positive run on ubutnu is [2] – trigerred by Florin’s patch [3]. It seems that the first failing test is test_ip4_irb.TestIpIrb: 00:22:48.177 == 00:22:53.685 VAPI test 00:22:53.685 == 00:22:53.685 run C VAPI tests SKIP 00:22:53.685 run C++ VAPI tests SKIP 00:22:53.685 00:22:53.685 == 00:22:53.685 ERROR: setUpClass (test_ip4_irb.TestIpIrb) 00:22:53.685 -- 00:22:53.685 Traceback (most recent call last): 00:22:53.685 File "/w/workspace/vpp-verify-master-ubuntu1604/test/test_ip4_irb.py", line 57, in setUpClass 00:22:53.685 cls.create_loopback_interfaces(range(1)) 00:22:53.685 File "/w/workspace/vpp-verify-master-ubuntu1604/test/framework.py", line 571, in create_loopback_interfaces 00:22:53.685 setattr(cls, intf.name, intf) 00:22:53.685 File "/w/workspace/vpp-verify-master-ubuntu1604/test/vpp_interface.py", line 91, in name 00:22:53.685 return self._name 00:22:53.685 AttributeError: 'VppLoInterface' object has no attribute '_name' 00:22:53.685 And all following tests failes with connection failur during test case setup: 00:22:53.689 == 00:22:53.689 ERROR: setUpClass (test_dvr.TestDVR) 00:22:53.689 -- 00:22:53.689 Traceback (most recent call last): 00:22:53.689 File "/w/workspace/vpp-verify-master-ubuntu1604/test/framework.py", line 362, in setUpClass 00:22:53.689 cls.vapi.connect() 00:22:53.689 File "/w/workspace/vpp-verify-master-ubuntu1604/test/vpp_papi_provider.py", line 141, in connect 00:22:53.689 self.vpp.connect(self.name, self.shm_prefix) 00:22:53.689 File "build/bdist.linux-x86_64/egg/vpp_papi.py", line 699, in connect 00:22:53.689 async) 00:22:53.689 File "build/bdist.linux-x86_64/egg/vpp_papi.py", line 670, in connect_internal 00:22:53.689 raise IOError(2, 'Connect failed') 00:22:53.689 IOError: [Errno 2] Connect failed 00:22:53.689 But result is OK: 00:22:53.689 Ran 156 tests in 162.407s 00:22:53.689 00:22:53.689 FAILED (errors=114, skipped=118) 00:22:53.691 1 test(s) failed, 3 attempt(s) left 00:22:53.697 Running tests using custom test runner 00:22:53.697 Active filters: file=None, class=None, function=None 00:22:53.697 0 out of 0 tests match specified filters 00:22:53.697 Not running extended tests (some tests will be skipped) 00:22:53.697 00:22:53.697 Ran 0 tests in 0.000s 00:22:53.697 00:22:53.697 OK 00:22:53.697 0 test(s) failed, 2 attempt(s) left 00:22:53.757 Killing possible remaining process IDs: 20845 21195 21197 00:22:53.766 make[2]: Leaving directory '/w/workspace/vpp-verify-master-ubuntu1604/test' 00:22:53.767 make[1]: Leaving directory '/w/workspace/vpp-verify-master-ubuntu1604' 00:22:53.768 + '[' x == x1 ']' 00:22:53.768 + echo '***' 00:22:53.768 *** 00:22:53.768 + echo '* VPP BUILD SUCCESSFULLY COMPLETED' 00:22:53.768 * VPP BUILD SUCCESSFULLY COMPLETED 00:22:53.768 + echo '***' 00:22:53.768 *** Could somebody (Klement, Ed Kern ?) find the root cause and fix it, please? Thanks, Jan [1] https://jenkins.fd.io/job/vpp-verify-master-ubuntu1604/12196/console [2] https://jenkins.fd.io/job/vpp
Re: [csit-dev] [vpp-dev] VPP make test gives false positive
Hey, responding because I dont see one from klement. looks like he has two gerrits pending https://gerrit.fd.io/r/#/c/13188/ to fix broken interfaces.. (this passed verification so trying to get this one merged) and https://gerrit.fd.io/r/#/c/13186/ for the retries in error..this is not passing verification but i have my fingers crossed that it will once 13188 is merged. Hoping to get this behind us before the weekend.. Ed On Jun 22, 2018, at 3:03 AM, Jan Gelety via Lists.Fd.Io mailto:jgelety=cisco@lists.fd.io>> wrote: Hello, VPP make test gives false positive results at the moment - there are cca 110 tests failed but build is marked successful. The last correct run on ubuntu is [1]. The first false positive run on ubutnu is [2] – trigerred by Florin’s patch [3]. It seems that the first failing test is test_ip4_irb.TestIpIrb: 00:22:48.177 == 00:22:53.685 VAPI test 00:22:53.685 == 00:22:53.685 run C VAPI tests SKIP 00:22:53.685 run C++ VAPI tests SKIP 00:22:53.685 00:22:53.685 == 00:22:53.685 ERROR: setUpClass (test_ip4_irb.TestIpIrb) 00:22:53.685 -- 00:22:53.685 Traceback (most recent call last): 00:22:53.685 File "/w/workspace/vpp-verify-master-ubuntu1604/test/test_ip4_irb.py", line 57, in setUpClass 00:22:53.685 cls.create_loopback_interfaces(range(1)) 00:22:53.685 File "/w/workspace/vpp-verify-master-ubuntu1604/test/framework.py", line 571, in create_loopback_interfaces 00:22:53.685 setattr(cls, intf.name, intf) 00:22:53.685 File "/w/workspace/vpp-verify-master-ubuntu1604/test/vpp_interface.py", line 91, in name 00:22:53.685 return self._name 00:22:53.685 AttributeError: 'VppLoInterface' object has no attribute '_name' 00:22:53.685 And all following tests failes with connection failur during test case setup: 00:22:53.689 == 00:22:53.689 ERROR: setUpClass (test_dvr.TestDVR) 00:22:53.689 -- 00:22:53.689 Traceback (most recent call last): 00:22:53.689 File "/w/workspace/vpp-verify-master-ubuntu1604/test/framework.py", line 362, in setUpClass 00:22:53.689 cls.vapi.connect() 00:22:53.689 File "/w/workspace/vpp-verify-master-ubuntu1604/test/vpp_papi_provider.py", line 141, in connect 00:22:53.689 self.vpp.connect(self.name, self.shm_prefix) 00:22:53.689 File "build/bdist.linux-x86_64/egg/vpp_papi.py", line 699, in connect 00:22:53.689 async) 00:22:53.689 File "build/bdist.linux-x86_64/egg/vpp_papi.py", line 670, in connect_internal 00:22:53.689 raise IOError(2, 'Connect failed') 00:22:53.689 IOError: [Errno 2] Connect failed 00:22:53.689 But result is OK: 00:22:53.689 Ran 156 tests in 162.407s 00:22:53.689 00:22:53.689 FAILED (errors=114, skipped=118) 00:22:53.691 1 test(s) failed, 3 attempt(s) left 00:22:53.697 Running tests using custom test runner 00:22:53.697 Active filters: file=None, class=None, function=None 00:22:53.697 0 out of 0 tests match specified filters 00:22:53.697 Not running extended tests (some tests will be skipped) 00:22:53.697 00:22:53.697 Ran 0 tests in 0.000s 00:22:53.697 00:22:53.697 OK 00:22:53.697 0 test(s) failed, 2 attempt(s) left 00:22:53.757 Killing possible remaining process IDs: 20845 21195 21197 00:22:53.766 make[2]: Leaving directory '/w/workspace/vpp-verify-master-ubuntu1604/test' 00:22:53.767 make[1]: Leaving directory '/w/workspace/vpp-verify-master-ubuntu1604' 00:22:53.768 + '[' x == x1 ']' 00:22:53.768 + echo '***' 00:22:53.768 *** 00:22:53.768 + echo '* VPP BUILD SUCCESSFULLY COMPLETED' 00:22:53.768 * VPP BUILD SUCCESSFULLY COMPLETED 00:22:53.768 + echo '***' 00:22:53.768 *** Could somebody (Klement, Ed Kern ?) find the root cause and fix it, please? Thanks, Jan [1] https://jenkins.fd.io/job/vpp-verify-master-ubuntu1604/12196/console [2] https://jenkins.fd.io/job/vpp-verify-master-ubuntu1604/12199/console [3] https://gerrit.fd.io/r/#/c/13180/ -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#9682): https://lists.fd.io/g/vpp-dev/message/9682 Mute This Topic: https://lists.fd.io/mt/22590606/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
