I think I found your problem. You are using 1.4.0 of the artifact and demo scripts. 1.6.0 is the Frankfurt version of the scripts. When I tested with 1.4.0 I get the same error as you do. When I tested with 1.6.0 I successfully get the packet generator to start vpp.
Brian -----Original Message----- From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of Brian Freeman Sent: Friday, November 13, 2020 8:55 AM To: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; onap-discuss@lists.onap.org; MALAKOV, YURIY <ym9...@att.com> Subject: Re: [onap-discuss] [Frankfurt]vFWCL Verification Issue *** Security Advisory: This Message Originated Outside of AT&T ***. Reference http://cso.att.com/EmailSecurity/IDSP.html for more information. Santosh, 1. From the png vm can you run these lines manually and see if the certificate is downloaded ? you may need to run openssl directly openssl s_client -showcerts -connect nexus.fd.io:443 57 # Install fd.io certificate 58 HOST=nexus.fd.io 59 PORT=443 60 TRUST_CERT_FILE="/etc/ssl/certs/ca-certificates.crt" 61 bash -c "echo -n | openssl s_client -showcerts -connect $HOST:$PORT 2>/dev/null | sed -ne '/-BEGIN CERTIFICATE-/,/-END CERTIFICATE-/p' >> $TRUST_CERT_FILE" 2. What version of ubuntu 14.04 are you running for the vFWCL images ? Brian -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Friday, November 13, 2020 1:04 AM To: onap-discuss@lists.onap.org; FREEMAN, BRIAN D <bf1...@att.com>; MALAKOV, YURIY <ym9...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian Thank you very much for the reply. I have herewith attached the cloud-init-output logs for PGN,FWL and SNK VMs. There was no change when I rebooted the VMs. Best Regards, Santosh Thapa Magar -----Original Message----- From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of Brian Freeman Sent: Friday, November 13, 2020 2:09 PM To: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; onap-discuss@lists.onap.org; MALAKOV, YURIY <ym9...@att.com> Subject: Re: [onap-discuss] [Frankfurt]vFWCL Verification Issue My mail corporate proxy munged the url in the log - can you do it as a text attachment ? Try rebooting (or re-running the install shell scripts that do the download and installation - probably the floating_ip was not up when the fd.io certificate download was attempted) https://urldefense.com/v3/__https://gerrit.onap.org/r/gitweb?p=demo.git;a=blob;f=vnfs*vFW*scripts*v_packetgen_install.sh;h=b872771148ba54c54781c8c651b41571549d6__;Ly8v!!BhdT!30tcjBm2gSvOiekiw1AfMl0tAqg9IFq2BQ4EgS01R0jIyOoftPhqDhp8ktWVLDc$ 978;hb=refs/heads/master Although the cloud-init log should show an error on the download of the certificate but perhaps it fails silently if ssh cant reach nexus.fd.io. 56 57 # Install fd.io certificate 58 HOST=nexus.fd.io 59 PORT=443 60 TRUST_CERT_FILE="/etc/ssl/certs/ca-certificates.crt" 61 bash -c "echo -n | openssl s_client -showcerts -connect $HOST:$PORT 2>/dev/null | sed -ne '/-BEGIN CERTIFICATE-/,/-END CERTIFICATE-/p' >> $TRUST_CERT_FILE" 62 I suspect its timing on the floating ip assignment but could be something else with the certificate. Brian -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Thursday, November 12, 2020 10:07 PM To: onap-discuss@lists.onap.org; FREEMAN, BRIAN D <bf1...@att.com>; MALAKOV, YURIY <ym9...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian Thank you very much for your suggestion. We created the new network and assigned that network id to the robot_properties.py file and we also changed the publickeyid. After that we executed vFWCL and it went well. We were able to allocate floating ip to the new network interface and were able to ssh to the VMs. After ssh we checked the cloud-init-output logs for each VMs[PacketGenerator, Firewall, Sink]. We found error in the PacketGenerator and firewall Cloud-init-output log. There was no error in Cloud-init-output log for sink. darkstat package was installed and running. We found server certificate error for getting packages from vpp repositories. We would be glad if you could help us slove this issue. Below is the snippet of packet generator cloud-init-output log. Err https://urldefense.com/v3/__https://nexus.fd.io__;!!BhdT!yD9CUA_MPiTwO-KTEmS95h-TsLbHfB8Aw53XsuOxFG-Kyt46SyLI7JB2l7vaFN8$ ./ Packages server certificate verification failed. CAfile: /etc/ssl/certs/ca-certificates.crt CRLfile: none Ign https://urldefense.com/v3/__https://nexus.fd.io__;!!BhdT!yD9CUA_MPiTwO-KTEmS95h-TsLbHfB8Aw53XsuOxFG-Kyt46SyLI7JB2l7vaFN8$ ./ Translation-en Fetched 15.4 kB in 12s (1226 B/s) W: GPG error: https://urldefense.com/v3/__http://ppa.launchpad.net__;!!BhdT!yD9CUA_MPiTwO-KTEmS95h-TsLbHfB8Aw53XsuOxFG-Kyt46SyLI7JB2Y4vBIuQ$ trusty InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY EB9B1D8886F44E2A W: Failed to fetch https://urldefense.com/v3/__https://nexus.fd.io/content/repositories/fd.io.stable.1609.ubuntu.trusty.main/./Packages__;!!BhdT!yD9CUA _MPiTwO-KTEmS95h-TsLbHfB8Aw53XsuOxFG-Kyt46SyLI7JB2koMw6_Q$ server certificate verification failed. CAfile: /etc/ssl/certs/ca-certificates.crt CRLfile: none E: Some index files failed to download. They have been ignored, or old ones used instead. Reading package lists... Building dependency tree... Reading state information... E: Unable to locate package vpp E: Unable to locate package vpp-dpdk-dkms E: Unable to locate package vpp-lib E: Unable to locate package vpp-dbg E: Unable to locate package vpp-plugins E: Unable to locate package vpp-dev Adding system startup for /etc/init.d/vpacketgen.sh ... /etc/rc0.d/K20vpacketgen.sh -> ../init.d/vpacketgen.sh /etc/rc1.d/K20vpacketgen.sh -> ../init.d/vpacketgen.sh /etc/rc6.d/K20vpacketgen.sh -> ../init.d/vpacketgen.sh /etc/rc2.d/S20vpacketgen.sh -> ../init.d/vpacketgen.sh /etc/rc3.d/S20vpacketgen.sh -> ../init.d/vpacketgen.sh /etc/rc4.d/S20vpacketgen.sh -> ../init.d/vpacketgen.sh /etc/rc5.d/S20vpacketgen.sh -> ../init.d/vpacketgen.sh start: Unknown job: vpp ./v_packetgen_init.sh: line 43: vppctl: command not found ./v_packetgen_init.sh: line 44: vppctl: command not found ./v_packetgen_init.sh: line 45: vppctl: command not found interface tap111 does not exist! ./v_packetgen_init.sh: line 50: vppctl: command not found ./v_packetgen_init.sh: line 64: vppctl: command not found ./v_packetgen_init.sh: line 65: vppctl: command not found ./v_packetgen_init.sh: line 66: vppctl: command not found ./v_packetgen_init.sh: line 67: vppctl: command not found ./v_packetgen_init.sh: line 68: vppctl: command not found ./v_packetgen_init.sh: line 69: vppctl: command not found ./v_packetgen_init.sh: line 70: vppctl: command not found ./v_packetgen_init.sh: line 71: vppctl: command not found ./v_packetgen_init.sh: line 72: vppctl: command not found ./v_packetgen_init.sh: line 73: vppctl: command not found Cloud-init v. 0.7.5 finished at Wed, 11 Nov 2020 04:39:38 +0000. Datasource DataSourceOpenStack [net,ver=2]. Up 260.00 seconds Following error were found in the Firewall Cloud-init-output log. Err https://urldefense.com/v3/__https://nexus.fd.io__;!!BhdT!yD9CUA_MPiTwO-KTEmS95h-TsLbHfB8Aw53XsuOxFG-Kyt46SyLI7JB2l7vaFN8$ ./ Packages server certificate verification failed. CAfile: /etc/ssl/certs/ca-certificates.crt CRLfile: none Ign https://urldefense.com/v3/__https://nexus.fd.io__;!!BhdT!yD9CUA_MPiTwO-KTEmS95h-TsLbHfB8Aw53XsuOxFG-Kyt46SyLI7JB2l7vaFN8$ ./ Translation-en Fetched 15.4 kB in 13s (1175 B/s) W: GPG error: https://urldefense.com/v3/__http://ppa.launchpad.net__;!!BhdT!yD9CUA_MPiTwO-KTEmS95h-TsLbHfB8Aw53XsuOxFG-Kyt46SyLI7JB2Y4vBIuQ$ trusty InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY EB9B1D8886F44E2A W: Failed to fetch https://urldefense.com/v3/__https://nexus.fd.io/content/repositories/fd.io.stable.1609.ubuntu.trusty.main/./Packages__;!!BhdT!yD9CUA _MPiTwO-KTEmS95h-TsLbHfB8Aw53XsuOxFG-Kyt46SyLI7JB2koMw6_Q$ server certificate verification failed. CAfile: /etc/ssl/certs/ca-certificates.crt CRLfile: none E: Some index files failed to download. They have been ignored, or old ones used instead. Reading package lists... Building dependency tree... Reading state information... E: Unable to locate package vpp E: Unable to locate package vpp-dpdk-dkms E: Unable to locate package vpp-lib E: Unable to locate package vpp-dbg E: Unable to locate package vpp-plugins E: Unable to locate package vpp-dev Making dependency file evel_unit.d for evel_unit.c Making dependency file jsmn.d for jsmn.c Making dependency file evel_batch.d for evel_batch.c Making dependency file evel_logging.d for evel_logging.c Making dependency file evel_voicequality.d for evel_voicequality.c Making dependency file evel_threshold_cross.d for evel_threshold_cross.c Making dependency file evel_event_mgr.d for evel_event_mgr.c Making dependency file evel_internal_event.d for evel_internal_event.c Making dependency file evel_throttle.d for evel_throttle.c Making dependency file evel_syslog.d for evel_syslog.c Making dependency file evel_strings.d for evel_strings.c Making dependency file evel_state_change.d for evel_state_change.c Making dependency file evel_scaling_measurement.d for evel_scaling_measurement.c Making dependency file evel_sipsignaling.d for evel_sipsignaling.c Making dependency file evel_heartbeat_fields.d for evel_heartbeat_fields.c Making dependency file evel_reporting_measurement.d for evel_reporting_measurement.c Making dependency file evel_json_buffer.d for evel_json_buffer.c Making dependency file evel_other.d for evel_other.c Making dependency file evel_jsonobject.d for evel_jsonobject.c Making dependency file evel_option.d for evel_option.c Making dependency file evel_mobile_flow.d for evel_mobile_flow.c Making dependency file evel_fault.d for evel_fault.c Making dependency file evel_event.d for evel_event.c Making dependency file hashtable.d for hashtable.c Making dependency file double_list.d for double_list.c Making dependency file ring_buffer.d for ring_buffer.c Making dependency file metadata.d for metadata.c Making dependency file evel.d for evel.c Cleaning API Library Cleaning VNF Reporting Cleaning EVEL unit test Making dependency file evel_unit.d for evel_unit.c Making dependency file jsmn.d for jsmn.c Making dependency file evel_batch.d for evel_batch.c Making dependency file evel_logging.d for evel_logging.c Making dependency file evel_voicequality.d for evel_voicequality.c Making dependency file evel_threshold_cross.d for evel_threshold_cross.c Making dependency file evel_event_mgr.d for evel_event_mgr.c Making dependency file evel_internal_event.d for evel_internal_event.c Making dependency file evel_throttle.d for evel_throttle.c Making dependency file evel_syslog.d for evel_syslog.c Making dependency file evel_strings.d for evel_strings.c Making dependency file evel_state_change.d for evel_state_change.c Making dependency file evel_scaling_measurement.d for evel_scaling_measurement.c Making dependency file evel_sipsignaling.d for evel_sipsignaling.c Making dependency file evel_heartbeat_fields.d for evel_heartbeat_fields.c Making dependency file evel_reporting_measurement.d for evel_reporting_measurement.c Making dependency file evel_json_buffer.d for evel_json_buffer.c Making dependency file evel_other.d for evel_other.c Making dependency file evel_jsonobject.d for evel_jsonobject.c Making dependency file evel_option.d for evel_option.c Making dependency file evel_mobile_flow.d for evel_mobile_flow.c Making dependency file evel_fault.d for evel_fault.c Making dependency file evel_event.d for evel_event.c Making dependency file hashtable.d for hashtable.c Making dependency file double_list.d for double_list.c Making dependency file ring_buffer.d for ring_buffer.c Making dependency file metadata.d for metadata.c Making dependency file evel.d for evel.c Making evel.o from evel.c /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel.c: In function 'evel_free_event': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel.c:458:7: warning: implicit declaration of function 'evel_free_hrtbt_field' [-Wimplicit-function-declaration] evel_free_hrtbt_field((EVENT_HEARTBEAT_FIELD *)evt_ptr); ^ Making metadata.o from metadata.c Making ring_buffer.o from ring_buffer.c Making double_list.o from double_list.c Making hashtable.o from hashtable.c Making evel_event.o from evel_event.c /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_event.c: In function 'evel_json_encode_eventtype': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_event.c:649:11: warning: implicit declaration of function 'evel_json_encode_voice_quality' [-Wimplicit-function-declaration] evel_json_encode_voice_quality(jbuf, (EVENT_VOICE_QUALITY *)event); ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_event.c:653:11: warning: implicit declaration of function 'evel_json_encode_threshold_cross' [-Wimplicit-function-declaration] evel_json_encode_threshold_cross(jbuf, (EVENT_THRESHOLD_CROSS *)event); ^ Making evel_fault.o from evel_fault.c Making evel_mobile_flow.o from evel_mobile_flow.c /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_mobile_flow.c: In function 'evel_json_encode_mobile_flow': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_mobile_flow.c:965:7: warning: implicit declaration of function 'evel_throttle_suppress_nv_pair' [-Wimplicit-function-declaration] if (!evel_throttle_suppress_nv_pair(jbuf->throttle_spec, ^ Making evel_option.o from evel_option.c /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_option.c: In function 'evel_force_option_intheader': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_option.c:393:18: warning: assignment discards 'const' qualifier from pointer target type [enabled by default] option->object = value; ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_option.c: In function 'evel_set_option_intheader': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_option.c:426:20: warning: assignment discards 'const' qualifier from pointer target type [enabled by default] option->object = value; ^ Making evel_jsonobject.o from evel_jsonobject.c /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_jsonobject.c: In function 'evel_new_jsonobjinstance': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_jsonobject.c:99:14: warning: unused variable 'key' [-Wunused-variable] jsmntok_t *key; ^ Making evel_other.o from evel_other.c /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c: In function 'evel_other_field_add_namedarray': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c:172:3: warning: passing argument 2 of 'ht_get' discards 'const' qualifier from pointer target type [enabled by default] list = (DLIST *)ht_get(other->namedarrays, hashname); ^ In file included from /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel.h:44:0, from /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c:29: /opt/VES/evel/evel-library/bldjobs/../code/evel_library/hashtable.h:95:7: note: expected 'char *' but argument is of type 'const char *' void *ht_get( HASHTABLE_T *hashtable, char *key ); ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c:178:6: warning: passing argument 2 of 'ht_set' discards 'const' qualifier from pointer target type [enabled by default] ht_set(other->namedarrays, hashname,(void*)nlist); ^ In file included from /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel.h:44:0, from /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c:29: /opt/VES/evel/evel-library/bldjobs/../code/evel_library/hashtable.h:86:6: note: expected 'char *' but argument is of type 'const char *' void ht_set( HASHTABLE_T *hashtable, char *key, void *value ); ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c: In function 'evel_json_encode_other': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c:302:27: warning: comparison between signed and unsigned integer expressions [-Wsign-compare] for( idx = 0; idx < ht->size; idx++ ) { ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c:347:25: warning: suggest braces around empty body in an 'if' statement [-Wempty-body] if(jsonobjp != NULL); ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c:361:15: warning: implicit declaration of function 'evel_enc_kv_object' [-Wimplicit-function-declaration] evel_enc_kv_object(jbuf, "objectInstance", jsonobjinst->jsonstring); ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c:366:10: warning: variable 'item_added3' set but not used [-Wunused-but-set-variable] bool item_added3 = false; ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c:277:8: warning: unused variable 'itm_added' [-Wunused-variable] bool itm_added = false; ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c: In function 'evel_free_other': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_other.c:474:16: warning: unused variable 'other_field_item' [-Wunused-variable] DLIST_ITEM * other_field_item = NULL; ^ Making evel_json_buffer.o from evel_json_buffer.c Making evel_reporting_measurement.o from evel_reporting_measurement.c Making evel_heartbeat_fields.o from evel_heartbeat_fields.c Making evel_sipsignaling.o from evel_sipsignaling.c /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_sipsignaling.c: In function 'evel_json_encode_signaling': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_sipsignaling.c:485:3: warning: implicit declaration of function 'evel_json_encode_vendor_field' [-Wimplicit-function-declaration] evel_json_encode_vendor_field(jbuf, &event->vnfname_field); ^ Making evel_scaling_measurement.o from evel_scaling_measurement.c /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_scaling_measurement.c: In function 'evel_json_encode_measurement': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_scaling_measurement.c:3140:15: warning: implicit declaration of function 'evel_enc_kv_object' [-Wimplicit-function-declaration] evel_enc_kv_object(jbuf, "objectInstance", jsonobjinst->jsonstring); ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_scaling_measurement.c:3145:10: warning: variable 'item_added3' set but not used [-Wunused-but-set-variable] bool item_added3 = false; ^ Making evel_state_change.o from evel_state_change.c Making evel_strings.o from evel_strings.c Making evel_syslog.o from evel_syslog. c Making evel_throttle.o from evel_throttle.c Making evel_internal_event.o from evel_internal_event.c Making evel_event_mgr.o from evel_event_mgr.c /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_event_mgr.c: In function 'evel_setup_curl': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_event_mgr.c:478:5: warning: format not a string literal and no format arguments [-Wformat-security] snprintf(local_address,sizeof(local_address),source_ip); ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_event_mgr.c:478:5: warning: format not a string literal and no format arguments [-Wformat-security] /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_event_mgr.c: In function 'evel_send_to_another_collector': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_event_mgr.c:1020:12: warning: variable 'curl_rc' set but not used [-Wunused-but-set-variable] CURLcode curl_rc; ^ /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_event_mgr.c: In function 'event_handler': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_event_mgr.c:1196:15: warning: implicit declaration of function 'sleep' [-Wimplicit-function-declaration] sleep(EVEL_COLLECTOR_RECONNECTION_WAIT_TIME); ^ Making evel_threshold_cross.o from evel_threshold_cross.c Making evel_voicequality.o from evel_voicequality.c /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_voicequality.c: In function 'evel_json_encode_voice_quality': /opt/VES/evel/evel-library/bldjobs/../code/evel_library/evel_voicequality.c:489:3: warning: implicit declaration of function 'evel_json_encode_vendor_field' [-Wimplicit-function-declaration] evel_json_encode_vendor_field(jbuf, &event->vendorVnfNameFields); ^ Making evel_logging.o from evel_logging.c Making evel_batch.o from evel_batch.c Making jsmn.o from jsmn.c Linking API Shared Library Linking API Static Library Making VNF Reporting Adding system startup for /etc/init.d/vfirewall.sh ... /etc/rc0.d/K20vfirewall.sh -> ../init.d/vfirewall.sh /etc/rc1.d/K20vfirewall.sh -> ../init.d/vfirewall.sh /etc/rc6.d/K20vfirewall.sh -> ../init.d/vfirewall.sh /etc/rc2.d/S20vfirewall.sh -> ../init.d/vfirewall.sh /etc/rc3.d/S20vfirewall.sh -> ../init.d/vfirewall.sh /etc/rc4.d/S20vfirewall.sh -> ../init.d/vfirewall.sh /etc/rc5.d/S20vfirewall.sh -> ../init.d/vfirewall.sh start: Unknown job: vpp ./v_firewall_init.sh: line 49: vppctl: command not found ./v_firewall_init.sh: line 50: vppctl: command not found ./v_firewall_init.sh: line 51: vppctl: command not found ./v_firewall_init.sh: line 52: vppctl: command not found ./v_firewall_init.sh: line 53: vppctl: command not found ./v_firewall_init.sh: line 54: vppctl: command not found interface tap111 does not exist! interface tap222 does not exist! Cloud-init v. 0.7.5 finished at Wed, 11 Nov 2020 04:36:28 +0000. Datasource DataSourceOpenStack [net,ver=2]. Up 245.71 seconds Best Regards Santosh Thapa Magar -----Original Message----- From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of Brian Freeman Sent: Wednesday, November 11, 2020 10:30 PM To: onap-discuss@lists.onap.org; FREEMAN, BRIAN D <bf1...@att.com>; Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; MALAKOV, YURIY <ym9...@att.com> Subject: Re: [onap-discuss] [Frankfurt]vFWCL Verification Issue I couldn't find the reference but I remember a few years ago testing this in TLAB. I think you need to create a separate external network (seprate from the floating ip network) for the public ip assignments for the VNF's - ONAP will assign in that network and then you should be able to assign the floating IP from your public network to that IP. Openstack is picky about what types of network it allows the floating ip's to be attached/NAT'd to and it specifically prevents assignments within the same network (as best I can recollect) Brian -----Original Message----- From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of Brian Freeman Sent: Tuesday, November 10, 2020 10:56 PM To: onap-discuss@lists.onap.org; FREEMAN, BRIAN D <bf1...@att.com>; Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; MALAKOV, YURIY <ym9...@att.com> Subject: Re: [onap-discuss] [Frankfurt]vFWCL Verification Issue *** Security Advisory: This Message Originated Outside of AT&T ***. Reference http://cso.att.com/EmailSecurity/IDSP.html for more information. incorrect* type. -----Original Message----- From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of Brian Freeman Sent: Tuesday, November 10, 2020 10:54 PM To: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; onap-discuss@lists.onap.org; MALAKOV, YURIY <ym9...@att.com> Subject: Re: [onap-discuss] [Frankfurt]vFWCL Verification Issue *** Security Advisory: This Message Originated Outside of AT&T ***. Reference http://cso.att.com/EmailSecurity/IDSP.html for more information. Usually that means the network was created as the correct type. When you created the onap oam network and subnet did you select an external network type (not sure that is the correct openstack description but only some network types can be associated with a public floating IP) brian -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Tuesday, November 10, 2020 9:24 PM To: onap-discuss@lists.onap.org; FREEMAN, BRIAN D <bf1...@att.com>; MALAKOV, YURIY <ym9...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian We tried to attach floating IP to the public interface created by vFWCL from Openstack GUI, there was error that the floating ip could not be attached to the public interface of Packet Generator VM. However we are able to attach floating IPs to other VMs from Openstack GUI. We are just wondering why we could not attach floating ip to the public interface of Packet Generator VM. Do you have any knowledge about such event? Best Regards Santosh Thapa Magar -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Thursday, November 5, 2020 10:22 AM To: 'onap-discuss@lists.onap.org' <onap-discuss@lists.onap.org>; 'bf1...@att.com' <bf1...@att.com>; 'MALAKOV, YURIY' <ym9...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian, Thank you very much for the suggestion. We will have a look into it and let you know if there is any issue. Best Regards Santosh Thapa Magar -----Original Message----- From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of Brian Freeman Sent: Wednesday, November 4, 2020 11:57 PM To: onap-discuss@lists.onap.org; Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; MALAKOV, YURIY <ym9...@att.com> Subject: Re: [onap-discuss] [Frankfurt]vFWCL Verification Issue The pub_key is pulled in from the robot properties.py [testsuite/oom.git] / resources / config / eteshare / config / robot_properties.py 94 GLOBAL_INJECTED_PUBLIC_KEY = "{{ .Values.vnfPubKey }}" [demo.git] / preload_data / defaults / preload_data.json 1 { 2 "key_name": "vfw_key${uuid}", 3 "pub_key": "${GLOBAL_INJECTED_PUBLIC_KEY}", 4 "repo_url_blob": "https://urldefense.com/v3/__https://nexus.onap.org/content/repositories/raw__;!!BhdT!xTwKeuyQ6MxKTqxTPxGPz5kvviaHfYSgFIqTFBPiH4zlqY 61FFRglX-rlBqvpD4$ ", 5 "repo_url_artifacts": "${GLOBAL_INJECTED_ARTIFACTS_REPO_URL}", 6 "demo_artifacts_version": "${GLOBAL_INJECTED_ARTIFACTS_VERSION}", 7 "onap_private_net_id": "${GLOBAL_INJECTED_NETWORK}", 8 "onap_private_subnet_id": "${GLOBAL_INJECTED_OPENSTACK_PRIVATE_SUBNET_ID}", 9 "onap_private_net_cidr": "${GLOBAL_INJECTED_OPENSTACK_PRIVATE_NET_CIDR}", 10 "sec_group": "${GLOBAL_INJECTED_OPENSTACK_SECURITY_GROUP}", 11 "dcae_collector_ip": "${GLOBAL_INJECTED_DCAE_COLLECTOR_IP}", 12 "dcae_collector_port": "30417", 13 "public_net_id": "${GLOBAL_INJECTED_PUBLIC_NET_ID}", 14 "cloud_env": "${GLOBAL_INJECTED_CLOUD_ENV}", 15 "install_script_version": "${GLOBAL_INJECTED_SCRIPT_VERSION}" 16 } [demo.git] / heat / vFWCL / vPKG / base_vpkg.yaml 112 pub_key: 113 type: string 114 label: Public key 115 description: Public key to be installed on the compute instance 147 my_keypair: 148 type: OS::Nova::KeyPair 149 properties: 150 name: 151 str_replace: 152 template: vnfname_base_rand 153 params: 154 vnfname: { get_param: vnf_name } 155 base: { get_param: key_name } 156 rand: { get_resource: random-str } 157 public_key: { get_param: pub_key } 158 save_private_key: false -----Original Message----- From: FREEMAN, BRIAN D Sent: Wednesday, November 4, 2020 9:35 AM To: onap-discuss@lists.onap.org; FREEMAN, BRIAN D <bf1...@att.com>; Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; MALAKOV, YURIY <ym9...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue ssh -v should allow you to see any mismatch in key error messages. brian -----Original Message----- From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of FREEMAN, BRIAN D Sent: Wednesday, November 4, 2020 8:23 AM To: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; onap-discuss@lists.onap.org; MALAKOV, YURIY <ym9...@att.com> Subject: Re: [onap-discuss] [Frankfurt]vFWCL Verification Issue *** Security Advisory: This Message Originated Outside of AT&T ***. Reference http://cso.att.com/EmailSecurity/IDSP.html for more information. BTW the password prompt is occurring because the private and public ssh keys are not matching. brian -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Wednesday, November 4, 2020 3:49 AM To: onap-discuss@lists.onap.org; FREEMAN, BRIAN D <bf1...@att.com>; MALAKOV, YURIY <ym9...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian Upon digging further more we found that while VM is coming up it tried to access the metadata server and failed to get meta-data. Our openstack environment consists of two networks public and private. Public network is used to allocate floating ip, however during onap installation we provided the public network id 「openStackPublicNetId」 that is used for floating ips. On instantiating vFWCL the packet generator VM was instantiated with three networks one with public ip[172.27.16.92], second one with private ip[10.0.137.33] and last one with vFWSNK_vofwlsnk_unprotectedf152 network ip[192.168.10.200]. The public ip [172.27.16.92]generated is not a floating ip. So we detached public ip [172.27.16.92] interface, and vFWSNK_vofwlsnk_unprotectedf152 network interface ip[192.168.10.200] and created a floating ip[172.27.16.94] and associated the floating ip to the private ip[10.0.137.33] of the VM. After reboot the metadata was accessed and configured. After that we tried to ssh the vm using the private key used for generating vnfPubkey, but prompt for password was displayed. We used the image for ubuntu 14.04 from this url https://urldefense.com/v3/__https://cloud-images.ubuntu.com/trusty/current/trusty-server-cloudimg-amd64-disk1.img__;!!BhdT!zFKnJqudf QVIYqd8GaR5YHYQ6YBfJikQr4ldSVh8W7E3hnWgUsOUbZJ5tbd-LNk$ We were able to ssh to a test vm [ubuntu 14.04] using the same private key. ・Is there any tutorial to deploy vFWCL in Openstack Environment with floating ip for accessing public internet？ ・Is there any configuration to skip the password prompt while ssh to the VM？ We would be glad if you could guide us regarding this issue. Best Regards Santosh Thapa Magar -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Monday, November 2, 2020 12:06 PM To: 'onap-discuss@lists.onap.org' <onap-discuss@lists.onap.org>; 'bf1...@att.com' <bf1...@att.com>; 'MALAKOV, YURIY' <ym9...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian Thanks for the reply. We looked into the Openstack and found that the vnfPubkey has been correctly referenced in the stack parameters. We got following error when trying to ssh to packet generator VM. ubuntu@172.27.16.92: Permission denied (publickey). There was no password prompt message. We also tried to ssh using the key in the robot but we were unable to ssh to the VM. We got the similar error. ubuntu@172.27.16.94: Permission denied (publickey). We were able to ssh to the VM we created manually using the same vnfPubkey. Following is the logs in the Openstack GUI. We found that there are warnings on accessing metadata. Could you please guide us what to do next to resolve this issue? cloud-init-nonet[6.58]: static networking is now up * Starting configure network device[74G[ OK ] * Stopping Mount network filesystems[74G[ OK ] * Stopping cold plug devices[74G[ OK ] * Stopping log initial device creation[74G[ OK ] * Starting enable remaining boot-time encrypted block devices[74G[ OK ] Cloud-init v. 0.7.5 running 'init' at Fri, 30 Oct 2020 04:19:56 +0000. Up 6.81 seconds. ci-info: ++++++++++++++++++++++++++++Net device info++++++++++++++++++++++++++++ ci-info: +--------+-------+--------------+-----------------+-------------------+ ci-info: | Device | Up | Address | Mask | Hw-Address | ci-info: +--------+-------+--------------+-----------------+-------------------+ ci-info: | lo | True | 127.0.0.1 | 255.0.0.0 | . | ci-info: | eth2 | False | . | . | fa:16:3e:84:59:5a | ci-info: | eth1 | False | . | . | fa:16:3e:21:29:ea | ci-info: | eth0 | True | 172.27.16.92 | 255.255.255.224 | fa:16:3e:49:49:29 | ci-info: +--------+-------+--------------+-----------------+-------------------+ ci-info: +++++++++++++++++++++++++++++++++Route info++++++++++++++++++++++++++++++++++ ci-info: +-------+--------------+--------------+-----------------+-----------+-------+ ci-info: | Route | Destination | Gateway | Genmask | Interface | Flags | ci-info: +-------+--------------+--------------+-----------------+-----------+-------+ ci-info: | 0 | 0.0.0.0 | 172.27.16.94 | 0.0.0.0 | eth0 | UG | ci-info: | 1 | 172.27.16.64 | 0.0.0.0 | 255.255.255.224 | eth0 | U | ci-info: +-------+--------------+--------------+-----------------+-----------+-------+ 2020-10-30 04:21:06,842 - url_helper.py[WARNING]: Calling 'https://urldefense.com/v3/__http://169.254.169.254/2009-04-04/meta-data/instance-id__;!!BhdT!zFKnJqudfQVIYqd8GaR5YHYQ6YBfJikQr4ldSV h8W7E3hnWgUsOUbZJ505fAJCM$ ' failed [50/120s]: request error [(<urllib3.connectionpool.HTTPConnectionPool object at 0x7ff834e3be90>, 'Connection to 169.254.169.254 timed out. (connect timeout=50.0)')] 2020-10-30 04:21:57,900 - url_helper.py[WARNING]: Calling 'https://urldefense.com/v3/__http://169.254.169.254/2009-04-04/meta-data/instance-id__;!!BhdT!zFKnJqudfQVIYqd8GaR5YHYQ6YBfJikQr4ldSV h8W7E3hnWgUsOUbZJ505fAJCM$ ' failed [101/120s]: request error [(<urllib3.connectionpool.HTTPConnectionPool object at 0x7ff834e26850>, 'Connection to 169.254.169.254 timed out. (connect timeout=50.0)')] 2020-10-30 04:22:15,928 - url_helper.py[WARNING]: Calling 'https://urldefense.com/v3/__http://169.254.169.254/2009-04-04/meta-data/instance-id__;!!BhdT!zFKnJqudfQVIYqd8GaR5YHYQ6YBfJikQr4ldSV h8W7E3hnWgUsOUbZJ505fAJCM$ ' failed [119/120s]: request error [(<urllib3.connectionpool.HTTPConnectionPool object at 0x7ff834e3b710>, 'Connection to 169.254.169.254 timed out. (connect timeout=17.0)')] 2020-10-30 04:22:16,937 - DataSourceEc2.py[CRITICAL]: Giving up on md from ['https://urldefense.com/v3/__http://169.254.169.254/2009-04-04/meta-data/instance-id__;!!BhdT!zFKnJqudfQVIYqd8GaR5YHYQ6YBfJikQr4ldS Vh8W7E3hnWgUsOUbZJ505fAJCM$ '] after 120 seconds 2020-10-30 04:22:16,950 - url_helper.py[WARNING]: Calling 'https://urldefense.com/v3/__http://172.27.16.72/*latest/meta-data/instance-id__;Lw!!BhdT!zFKnJqudfQVIYqd8GaR5YHYQ6YBfJikQr4ldSVh8W7 E3hnWgUsOUbZJ5rzXSsgE$ ' failed [0/120s]: request error [HTTPConnectionPool(host='172.27.16.72', port=80): Max retries exceeded with url: //latest/meta-data/instance-id (Caused by <class 'socket.error'>: [Errno 111] Connection refused)] 2020-10-30 04:22:17,954 - url_helper.py[WARNING]: Calling 'https://urldefense.com/v3/__http://172.27.16.72/*latest/meta-data/instance-id__;Lw!!BhdT!zFKnJqudfQVIYqd8GaR5YHYQ6YBfJikQr4ldSVh8W7 E3hnWgUsOUbZJ5rzXSsgE$ ' failed [1/120s]: request error [HTTPConnectionPool(host='172.27.16.72', port=80): Max retries exceeded with url: //latest/meta-data/instance-id (Caused by <class 'socket.error'>: [Errno 111] Connection refused)] 2020-10-30 04:22:18,963 - url_helper.py[WARNING]: Calling 'https://urldefense.com/v3/__http://172.27.16.72/*latest/meta-data/instance-id__;Lw!!BhdT!zFKnJqudfQVIYqd8GaR5YHYQ6YBfJikQr4ldSVh8W7 E3hnWgUsOUbZJ5rzXSsgE$ ' failed [2/120s]: request error [HTTPConnectionPool(host='172.27.16.72', port=80): Max retries exceeded with url: //latest/meta-data/instance-id (Caused by <class 'socket.error'>: [Errno 111] Connection refused)] 2020-10-30 04:22:19,976 - url_helper.py[WARNING]: Calling 'https://urldefense.com/v3/__http://172.27.16.72/*latest/meta-data/instance-id__;Lw!!BhdT!zFKnJqudfQVIYqd8GaR5YHYQ6YBfJikQr4ldSVh8W7 E3hnWgUsOUbZJ5rzXSsgE$ ' failed [3/120s]: request error [HTTPConnectionPool(host='172.27.16.72', port=80): Max retries exceeded with url: //latest/meta-data/instance-id (Caused by <class 'socket.error'>: [Errno 111] Connection refused)] 2020-10-30 04:24:16,387 - url_helper.py[WARNING]: Calling 'https://urldefense.com/v3/__http://172.27.16.72/*latest/meta-data/instance-id__;Lw!!BhdT!zFKnJqudfQVIYqd8GaR5YHYQ6YBfJikQr4ldSVh8W7 E3hnWgUsOUbZJ5rzXSsgE$ ' failed [119/120s]: request error [HTTPConnectionPool(host='172.27.16.72', port=80): Max retries exceeded with url: //latest/meta-data/instance-id (Caused by <class 'socket.error'>: [Errno 115] Operation now in progress)] 2020-10-30 04:24:23,405 - DataSourceCloudStack.py[CRITICAL]: Giving up on waiting for the metadata from ['https://urldefense.com/v3/__http://172.27.16.72/*latest/meta-data/instance-id__;Lw!!BhdT!zFKnJqudfQVIYqd8GaR5YHYQ6YBfJikQr4ldSVh8W 7E3hnWgUsOUbZJ5rzXSsgE$ '] after 126 seconds * Starting Signal sysvinit that local filesystems are mounted[74G[ OK ] * Starting configure network device security[74G[ OK ] * Stopping Mount filesystems on boot[74G[ OK ] * Starting flush early job output to logs[74G[ OK ] * Stopping Failsafe Boot Delay[74G[ OK ] * Starting System V initialisation compatibility[74G[ OK ] * Stopping flush early job output to logs[74G[ OK ] * Starting configure virtual network devices[74G[ OK ] * Starting Pollinate to seed the pseudo random number generator[74G[ OK ] * Stopping Pollinate to seed the pseudo random number generator[74G[ OK ] * Starting Bridge file events into upstart[74G[ OK ] * Starting D-Bus system message bus[74G[ OK ] * Starting early crypto disks... [80G [74G[ OK ] * Starting SystemD login management service[74G[ OK ] * Starting system logging daemon[74G[ OK ] * Starting Handle applying cloud-config[74G[ OK ] Skipping profile in /etc/apparmor.d/disable: usr.sbin.rsyslogd * Starting AppArmor profiles [80G [74G[ OK ] * Stopping System V initialisation compatibility[74G[ OK ] * Starting System V runlevel compatibility[74G[ OK ] * Starting save kernel messages[74G[ OK ] * Starting regular background program processing daemon[74G[ OK ] * Starting deferred execution scheduler[74G[ OK ] * Starting ACPI daemon[74G[ OK ] * Stopping save kernel messages[74G[ OK ] * Starting OpenSSH server[74G[ OK ] * Starting CPU interrupts balancing daemon[74G[ OK ] * Starting automatic crash report generation[74G[ OK ] Cloud-init v. 0.7.5 running 'modules:config' at Fri, 30 Oct 2020 04:24:24 +0000. Up 295.00 seconds. open-vm-tools: not starting as this is not a VMware VM landscape-client is not configured, please run landscape-config. * Stopping Handle applying cloud-config[74G[ OK ] * Restoring resolver state... [80G [74G[ OK ] * Stopping System V runlevel compatibility[74G[ OK ] Cloud-init v. 0.7.5 running 'modules:final' at Fri, 30 Oct 2020 04:24:24 +0000. Up 295.41 seconds. Cloud-init v. 0.7.5 finished at Fri, 30 Oct 2020 04:24:25 +0000. Datasource DataSourceNone. Up 295.47 seconds 2020-10-30 04:24:25,018 - cc_final_message.py[WARNING]: Used fallback datasource Best Regards Santosh Thapa Magar -----Original Message----- From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of Brian Freeman Sent: Friday, October 30, 2020 9:18 PM To: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; onap-discuss@lists.onap.org; MALAKOV, YURIY <ym9...@att.com> Subject: Re: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hmmm. Check the resources used in the openstack GUI to make sure that the vnfPubkey was correctly referenced in the .env/parameter data passed to openstack for the packet generator stack/VM. What error did you get back from the packet generator - connection refused or it prompted for password ? If you can not ssh into the VM then you cant confirm that routing is letting the vFWCL VM's pull the data from the internet they need to boot (there is a cloud-init hook that does a wget to pull scripts down) but the first problem is why isn’t ssh letting you in. Cant hurt to try the public key in robot (you probably already did) Item #2 is simply a by product that there is no status code since the HTTP transaction in #1 failed. If you manually create a VM with your vnfPubKey can you get in via ssh ? Check the logs in the openstack GUI to see if there were errors on the boot of the pgn VM ? Brian -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Friday, October 30, 2020 2:37 AM To: onap-discuss@lists.onap.org; FREEMAN, BRIAN D <bf1...@att.com>; MALAKOV, YURIY <ym9...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian We were able to redeploy full ONAP in our Lab. All healthcheck and healthdist passed. We were able to instantiate vFWCL. All the VMs needed for vFWCL were created in our Openstack Environment. However on verifying the closed loop we get the following error. VFWCL Closed Loop Test | FAIL | ConnectionError: HTTPConnectionPool(host='172.27.16.92', port=8183): Max retries exceeded with url: /restconf/config/stream-count:stream-count/streams (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fe1f139bad0>: Failed to establish a new connection: [Errno 111] 0x7fe1f139bad0>Connection refused',)) Also teardown failed: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='172.27.16.92', port=8183): Max retries exceeded with url: /restconf/config/stream-count:stream-count/streams (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fe1f127fe90>: Failed to establish a new connection: [Errno 111] 0x7fe1f127fe90>Connection refused',)) 2) Resolving variable '${resp.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code' As you suggested that we should look up if pgn app actually came up in the VM. We tried to ssh to the VM, but we were unable to log on to the VM. For your information we are using our own vnfPubKey in integration-override-v3.yaml. In openstack keys are generated with the values assigned in vnfPubKey and associated to the VMs created by vFWCL. However we are unable to ssh to the VMs created by vFWCL. We would be glad if you could provide some insight regarding this issue. Best Regards, Santosh Thapa Magar -----Original Message----- From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of Brian Freeman Sent: Tuesday, October 20, 2020 9:04 PM To: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; onap-discuss@lists.onap.org; MALAKOV, YURIY <ym9...@att.com> Subject: Re: [onap-discuss] [Frankfurt]vFWCL Verification Issue Teardown phase tries to remove the model that was distributed so that we don’t fill up A&AI (I think) with models from health test of distribution. Since the model didn’t get distributed it fails on tear down so you can ignore the catalog_service_id not found since .... its not found. Healthdist failure usually requires looking into the robot logs in log.html on the robot web page and seeing who reported back DISTRIBUTION_ERROR instead of DISTRIBUTION_COMPLETE. Its tedious because of the polling but look for distribution details that is a query to SDC to show the results. This is also available on the SDC GUI for that model but sometimes its hard to find the particular model since they differ only by a timestamp when using healthdist. As a minimum for model distribution you need SO, SDNC , AAI and of course SDC, DMaaP, AAF all up. Also no one else sends DISTRIBUTION_ERROR. Sometimes you may need to restart a pod depending on which component issued the error. Brian -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Tuesday, October 20, 2020 3:37 AM To: onap-discuss@lists.onap.org; FREEMAN, BRIAN D <bf1...@att.com>; MALAKOV, YURIY <ym9...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian, About "FAIL Variable '${catalog_service_id}' not found." issue, I’m writing to follow up on my email. I didn’t hear back from you. I look forward to hearing from you! Best regards, Santosh Thapa Magar -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Thursday, October 8, 2020 5:06 PM To: 'onap-discuss@lists.onap.org' <onap-discuss@lists.onap.org>; 'bf1...@att.com' <bf1...@att.com>; 'MALAKOV, YURIY' <ym9...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian, Because of hardware failure, we have reinstalled ONAP. After execute healthdist check, error has occurred with this result. Could you please instruct us to resolve this issue? " Testsuites.Health-Check :: Test that ONAP components are available via basi... ============================================================================== Health Distribution Test | FAIL | FAIL != PASS Also keyword teardown failed: Variable '${catalog_service_id}' not found. ------------------------------------------------------------------------------ Testsuites.Health-Check :: Test that ONAP components are available... | FAIL | 1 critical test, 0 passed, 1 failed 1 test total, 0 passed, 1 failed ============================================================================== " There are some test cases failed in the log file log-after.html I confirmed the log file log-before.html before reinstall ONAP, and saw no failed test here. Please refer for detail at log-after.html, log-before.html Please look at the following snippet of the log. ＊healthdist error Log TEARDOWN model_test_template . Teardown Models ${catalog_service_id}, ${catalog_resource_ids} Documentation: Clean up at the end of the test Start / End / Elapsed: 20201001 17:31:14.987 / 20201001 17:31:14.996 / 00:00:00.009 17:31:14.996 TRACE Return: None 17:31:14.996 FAIL Variable '${catalog_service_id}' not found. 17:23:21.881 TRACE Arguments: [ ${service}='vFW' | ${catalog_service_name}='' | ${cds}='False' ] Best regards, Santosh Thapa Magar -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Friday, September 4, 2020 11:10 AM To: 'onap-discuss@lists.onap.org' <onap-discuss@lists.onap.org>; 'bf1...@att.com' <bf1...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian, Because of some reason we had to redeploy onap. After ONAP was deployed using helm command, we executed the healthcheck command and found that among 47 critical test, 45 passed, 2 failed. The failed test were 1. Basic OOF-Homing Health Check 2. Basic OOF-SNIRO Health Check We were not able to run robot srcipts needed for deploying vFWCL. In our lab we have deployed full onap. Does OOF is needed to run vFWCL and Scale Out use cases. We are trying to implement vFWCL and Scale Out use case in our lab. We would be grateful if you could tell us which onap components are not needed to run above mentioned use cases. Best Regards Santosh Thapa Magar -----Original Message----- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Sent: Tuesday, August 25, 2020 6:54 PM To: 'onap-discuss@lists.onap.org' <onap-discuss@lists.onap.org>; 'bf1...@att.com' <bf1...@att.com> Subject: RE: [onap-discuss] [Frankfurt]vFWCL Verification Issue Hi Brian, Thank you very much for the suggestion. We will have a look into it and let you know if there is any issue. Best Regards Santosh Thapa Magar -----Original Message----- From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of Brian Freeman Sent: Tuesday, August 25, 2020 12:44 PM To: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp>; onap-discuss@lists.onap.org Subject: Re: [onap-discuss] [Frankfurt]vFWCL Verification Issue Can you check that the pgn app actually came up ? The vm has installation scripts as part of cloud init that download a zip and run an install. The error seems like robot cant rwach the restconf interface on the pgn. Brian Sent via the Samsung Galaxy S8, an AT&T 5G Evolution capable smartphone -------- Original message -------- From: Santosh Thapa Magar <santosu.tapamagaru...@hco.ntt.co.jp> Date: 8/24/20 9:10 PM (GMT-05:00) To: onap-discuss@lists.onap.org, "FREEMAN, BRIAN D" <bf1...@att.com> Subject: [Frankfurt]vFWCL Verification Issue Hi Brian, We are trying to implement robot intantiation vFWCL in Frankfurt. We have been following link for implementing vFWCL. https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.onap.org_projects_onap-2Dintegration_en_frankfurt_docs-5Fvfw.html-23docs-2 Dvfw&d=DwICAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=e3d1ehx3DI5AoMgDmi2Fzw&m=Iv0yK235blYpJKmR21K9Z_vkstgJiXFOMDiFqVGEYpM&s=wRYGdLyQSVogKk_4IrlO KEmUAvWN2aUmMnOzGGHFLzU&e= https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_display_DW_Robot-2BinstantiateVFWCL&d=DwICAg&c=LFYZ-o9_HUMeMTSQic vjIg&r=e3d1ehx3DI5AoMgDmi2Fzw&m=Iv0yK235blYpJKmR21K9Z_vkstgJiXFOMDiFqVGEYpM&s=nAwXo5aLzpQpB9T_WiciKFQjhrny72uFsxESGjPZK_4&e= Note: We have not used CDS to implemnt vFWCL. After installing full onap we ran the robot scripts in onap-rke VM in following order. cd /root/onap/kubernetes/robot Step 1)./ete-k8s.sh onap health Step 2)./ete-k8s.sh onap healthdist Step 3)./demo-k8s.sh onap init Step 4)./demo-k8s.sh onap init_robot Step 5)./ete-k8s.sh onap instantiateVFWCL Step 6).demo-k8s.sh onap vfwclosedloop <pgn-ip-address> Step 5.instantiateVFWCL script ran with passed result. Stacks were created in the Openstack. For running the use case we ran the robot script mentioned in Step 6. for pgn-ip-address we used the public ip assigned to Packet Generator VM created in Openstack. We found following error in this step. 1) ConnectionError: HTTPConnectionPool(host='xx.xx.xx.xx', port=8183): Max retries exceeded with url: /restconf/config/stream-count:stream-count/streams (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb6643ca910>: Failed to establish a new connection: [Errno 111] 0x7fb6643ca910>Connection refused',)) 2) Resolving variable '${resp.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code' We would be thankful if you could guide us to sort out this issue. Best Regards, Santosh Thapa Magar -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#22456): https://lists.onap.org/g/onap-discuss/message/22456 Mute This Topic: https://lists.onap.org/mt/76398449/21656 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
