Re: [opnfv-tech-discuss] [SDNVPN] test Case fail criteria

2016-12-07 Thread Skiadas Romanos
nfv-tech-discuss@lists.opnfv.org Subject: Re: [opnfv-tech-discuss] [SDNVPN test Case fail criteria So make all test cases require 100% success and only do separation testing in a specific test that will be disabled? From: Nikolas Hermanns [mailto:nikolas.herma...@ericsson.com] Sent: Monday, D

Re: [opnfv-tech-discuss] [SDNVPN test Case fail criteria

2016-12-07 Thread Jose Lausuch
-tech-discuss] [SDNVPN test Case fail criteria So make all test cases require 100% success and only do separation testing in a specific test that will be disabled? From: Nikolas Hermanns [mailto:nikolas.herma...@ericsson.com] Sent: Monday, December 05, 2016 10:49 AM To: Skiadas Romanos; BV Gurava

Re: [opnfv-tech-discuss] [SDNVPN test Case fail criteria

2016-12-05 Thread Skiadas Romanos
So make all test cases require 100% success and only do separation testing in a specific test that will be disabled? From: Nikolas Hermanns [mailto:nikolas.herma...@ericsson.com] Sent: Monday, December 05, 2016 10:49 AM To: Skiadas Romanos; BV Guravareddy; opnfv-tech-discuss@lists.opnfv.org S

[opnfv-tech-discuss] [SDNVPN test Case fail criteria

2016-12-05 Thread Nikolas Hermanns
1. We need to change the 75% test criteria for all test. That just makes thing more complicated. Can we copy the tests we have an rewrite them so that we don't need the criteria? Then we disable the first test and run them when the bug is fixed upstream. 2. I think we should add a s