Hi Vijay & Srini, I apologize Vijay if I was unaware that rolling upgrades are now a part of Casablanca. That is fantastic news! So, am I now able to do the following to upgrade ONAP and if DCAE (or any of its components) have changed, they will be updated too?
helm deploy demo staging/onap --namespace onap -f ~/override.yaml Regarding the need for static and dynamic services. @Vijay, have you looked at using the Tiller API (server-side of Helm)? It can be used to dynamically deploy Helm charts and provide full Helm and k8s integration. It can also be used to spin up short-lived K8s Jobs that perform all sorts of different actions (eg. call remote server endpoint, update DB, etc.). As far as the dynamic policy configuration aspect is concerned, this is not an area we are familiar with. Perhaps this is a good delineation point where Helm and k8s handle LCM and DCAE Controller handles policy configuration? Worth discussing at the F2F I think. It definitely sounds like we have an opportunity to collaborate (and harmonize) on a single deployment solution that addresses all needs. With RC0 looming, it would seem that meeting before the architecture meeting to discuss such topics, may be unrealistic. At least for me 😉 A few OOM team members, including myself, will be present at the F2F in Montreal. Looking forward to some great discussions! Thanks, Mike From: "Addepalli, Srinivasa R" <srinivasa.r.addepa...@intel.com> Date: Friday, September 28, 2018 at 12:32 PM To: "VENKATESH KUMAR, VIJAY" <vv7...@att.com>, "onap-discuss@lists.onap.org" <onap-discuss@lists.onap.org>, Mike Elliott <mike.elli...@amdocs.com>, "fbroc...@cisco.com" <fbroc...@cisco.com>, "JI, LUSHENG" <l...@research.att.com>, "GUPTA, ALOK" <ag1...@att.com> Cc: "Fabien Andrieux (fandrieu)" <fandr...@cisco.com>, "Donald Hunter (donaldh)" <dona...@cisco.com>, "Trevor Smith (trsmith2)" <trsmi...@cisco.com>, "Cristina Precup (cprecup)" <cpre...@cisco.com>, "Chenxi Du (chenxdu)" <chen...@cisco.com>, Roger Maitland <roger.maitl...@amdocs.com> Subject: RE: [onap-discuss] #DCAEgen2 - DCAE - Adding ML based network analytics Hi Mike and Vijay, Good discussion. I plan to be Montreal. It would be great if Kubernetes is used for all kinds of services – Infrastructure Services and dynamic spark applications (analytics applications). With respect to OOM : So far, OOM is used to deploy services that live throughout ONAP life. Can OOM be used to deploy services that are ephemeral too. For example, spark-submit command internally communicates with Kubernetes API server to bring up spark applications on containers. Can that be used still? In this case, there could be multiple clients to the K8S API server – One is OOM via Helm, second one is spark-submit or some controller that bring up services dynamically. I don’t’ see any challenges on top of my head, but want to get that confirmed with respect to OOM. Hi Vijay, In your email, you mentioned this : “however for PNDA app services to be able to leverage SDC/Policy/CLAMP flows, I believe should be Tosca model driven” Can you elaborate on this? Please give an example of a flow. Trying to understand if TOSCA is helping on workload bring up or anything else? If it is only workload bring up, isn’t Helm/spark-submit/direct K8S yaml good enough? Thanks Srini From: VENKATESH KUMAR, VIJAY [mailto:vv7...@att.com] Sent: Friday, September 28, 2018 8:11 AM To: onap-discuss@lists.onap.org; mike.elli...@amdocs.com; fbroc...@cisco.com; Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com>; JI, LUSHENG <l...@research.att.com>; GUPTA, ALOK <ag1...@att.com> Cc: Fabien Andrieux (fandrieu) <fandr...@cisco.com>; Donald Hunter (donaldh) <dona...@cisco.com>; Trevor Smith (trsmith2) <trsmi...@cisco.com>; Cristina Precup (cprecup) <cpre...@cisco.com>; Chenxi Du (chenxdu) <chen...@cisco.com>; Roger Maitland <roger.maitl...@amdocs.com> Subject: RE: [onap-discuss] #DCAEgen2 - DCAE - Adding ML based network analytics Hi Mike, One of the main distinction for DCAE Controller is need for supporting both static and dynamic services. Besides LCM - the DCAE controller also provides dynamic policy configuration update capabilities for all the services deployed. If OOM Team has plans to extend any of these capabilities, it would be great to discuss any harmonization opportunity here. With regard to rolling upgrade of DCAE services – it is supported. This capabilities existed for some components in R2; in Casablanca – enhancement was done to support this feature for all services components as well (DCAEGEN2-543<https://jira.onap.org/browse/DCAEGEN2-543>). For PNDA, I would approach platform deployment and service differently. The platform deployment itself can be triggered via OOM, however for PNDA app services to be able to leverage SDC/Policy/CLAMP flows, I believe should be Tosca model driven. Being new integration - it will be great to discuss overall onboarding and deployment flow for PNDA and identify any optimization opportunities. We could possibly have this for discussion in one of the DCAE or OOM weekly meetings (post RC0) if not all are making for F2F meetup? Regards, Vijay From: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>> On Behalf Of Mike Elliott Sent: Friday, September 28, 2018 10:02 AM To: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>; fbroc...@cisco.com<mailto:fbroc...@cisco.com>; Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>>; VENKATESH KUMAR, VIJAY <vv7...@att.com<mailto:vv7...@att.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Cc: Fabien Andrieux (fandrieu) <fandr...@cisco.com<mailto:fandr...@cisco.com>>; Donald Hunter (donaldh) <dona...@cisco.com<mailto:dona...@cisco.com>>; Trevor Smith (trsmith2) <trsmi...@cisco.com<mailto:trsmi...@cisco.com>>; Cristina Precup (cprecup) <cpre...@cisco.com<mailto:cpre...@cisco.com>>; Chenxi Du (chenxdu) <chen...@cisco.com<mailto:chen...@cisco.com>>; Roger Maitland <roger.maitl...@amdocs.com<mailto:roger.maitl...@amdocs.com>> Subject: Re: [onap-discuss] #DCAEgen2 - DCAE - Adding ML based network analytics Hi Frank, It would be great to discuss options with you for deploying PNDA components in OOM/K8s. One thing that is missing right now from DCAE is the ability to perform an upgrade of DCAE components after its initial install. DCAE operates under a different controller environment. It’s kind of its own island that is treated special from the rest of the components within an ONAP deployment. It would be really great if we could have consistent behavior with the rest of ONAP. As of now, it is possible to perform a non-disruptive rolling upgrade of all components in ONAP, except for DCAE. If you (or anyone on this email thread) is going to the architecture meetup in Montreal, perhaps that would be a good time to meet F2F and discuss how we evolve to such a common deployment model? Otherwise, the OOM team is available at any time to discuss via Zoom. Thanks, Mike. -- Mike Elliott ONAP OOM PTL Senior Architect - Amdocs From: <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>> on behalf of "Frank Brockners via Lists.Onap.Org" <fbrockne=cisco....@lists.onap.org<mailto:fbrockne=cisco....@lists.onap.org>> Reply-To: "onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>" <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>>, "fbroc...@cisco.com<mailto:fbroc...@cisco.com>" <fbroc...@cisco.com<mailto:fbroc...@cisco.com>> Date: Thursday, September 27, 2018 at 2:31 AM To: "Addepalli, Srinivasa R" <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>>, "'VENKATESH KUMAR, VIJAY'" <vv7...@att.com<mailto:vv7...@att.com>>, "'JI, LUSHENG'" <l...@research.att.com<mailto:l...@research.att.com>>, "'GUPTA, ALOK'" <ag1...@att.com<mailto:ag1...@att.com>> Cc: "'onap-discuss@lists.onap.org'" <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>>, "Fabien Andrieux (fandrieu)" <fandr...@cisco.com<mailto:fandr...@cisco.com>>, "Donald Hunter (donaldh)" <dona...@cisco.com<mailto:dona...@cisco.com>>, "Trevor Smith (trsmith2)" <trsmi...@cisco.com<mailto:trsmi...@cisco.com>>, "Cristina Precup (cprecup)" <cpre...@cisco.com<mailto:cpre...@cisco.com>>, "Chenxi Du (chenxdu)" <chen...@cisco.com<mailto:chen...@cisco.com>> Subject: Re: [onap-discuss] #DCAEgen2 - DCAE - Adding ML based network analytics Hi Srini, sorry for the delay – ONS.EU got into our way. PNDA 5.0 – which is expected to come out later in October – will include HDP 2.6.5 which contains Spark 2.3, see https://wiki.onap.org/display/DW/Integrating+PNDA#IntegratingPNDA-PNDA5.0Componentsversions<https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_display_DW_Integrating-2BPNDA-23IntegratingPNDA-2DPNDA5.0Componentsversions&d=DwMGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=6WYcUG7NY-ZxfqWx5MmzVQ&m=PlAAwyYw0LXyTld5hKR5ms5YfqzVBcpVXpaCwKo3go4&s=ks73bHQAFk_lZKYrs9RiCJLxepKnN6k8uZ7PXYJ5XYE&e=>. There are various options to run applications on Spark – and containers are one option. PNDA apps are currently not deployed using containers – and integration of DCAE’s catalogue with PNDA’s deployment manager is targeted for post Casablanca. With the closer integration of DCAE and PNDA, we should also ask the question of how we deploy DCAE apps moving forward. Doing that as containers via OOM/K8s would be an interesting option to consider for DCAE as well. Cc’ing a few more folks. Cheers, Frank From: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>> Sent: Freitag, 21. September 2018 17:59 To: 'VENKATESH KUMAR, VIJAY' <vv7...@att.com<mailto:vv7...@att.com>>; 'JI, LUSHENG' <l...@research.att.com<mailto:l...@research.att.com>>; 'GUPTA, ALOK' <ag1...@att.com<mailto:ag1...@att.com>>; Frank Brockners (fbrockne) <fbroc...@cisco.com<mailto:fbroc...@cisco.com>> Cc: 'onap-discuss@lists.onap.org' <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>> Subject: RE: DCAE - Adding ML based network analytics +Frank Hi Vijay and Frank, Few basic questions on PNDA+DCAE. I see that PNDA supports both Spark batch and Spark streaming. Spark streaming is of interest. We also see that Kafka based streaming is supported by PNDA. 1. Does PNDA use spark version 2.3 or above to allow Kubernetes based scheduling of spark jobs? 2. If I had implemented my analytics application (with spark executor, MLlib, Kafka way of getting data stream and Kafka way of outputting the analysis output) as a container that work on Spark 2.3.0, does it require any changes to work with PNDA and DCAE? If it requires changes, what kind of changes are required? Thanks Srini From: Addepalli, Srinivasa R Sent: Wednesday, September 19, 2018 6:59 AM To: VENKATESH KUMAR, VIJAY <vv7...@att.com<mailto:vv7...@att.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Cc: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: RE: DCAE - Adding ML based network analytics Thanks Vijay. Understood. We are moving away from CDAP to PNDA and Apache Flink as big data platform. As I understand from PNDA website, it seems to be based on Spark. Since Spark supports Machine learning analytics (via MLlib as well as Bring your own models), I think PNDA/Spark may be what we need to look into. Thanks for pointers Vijay. Will go through the link you have provided and understand the onboarding of analytics micro-services. Thanks Srini From: VENKATESH KUMAR, VIJAY [mailto:vv7...@att.com] Sent: Tuesday, September 18, 2018 5:30 PM To: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Cc: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: RE: DCAE - Adding ML based network analytics Hi Srini – Thanks for your interest into DCAE. Apologize for the delay in response (was tied up with upcoming M4 delivery). As you might know, DCAE provides a platform for onboarding different type of mS (collectors, analytics, CE’s). The TCA instance was build to support the original OpenECOMP and ONAP usecases and it was chosen as CDAP application as that was the analytics platform supported then. However since Amsterdam release, based on community feedback (and lack of support in CDAP)- we are working toward integrating newer analytics platform into DCAE. PNDA is one such platform – there is work currently under way in R3 by Cisco team to integrate PNDA platform with DCAE (actual app’s on this platform will be scope of R4). Apache Flink was another platform approved by ARC team, but we seeking community support for building upon it in future release. As for building new analytics application - it will be better to have them targeted on either of new platform. If there are any specific usecase requiring ML application, we can discuss and target them in future release. And the development of new services as you noted can be done independent of DCAE Platform to start-with; subsequent integration and deployment into platform will require certain pre-requisite which are documented here - https://wiki.onap.org/pages/viewpage.action?pageId=36963506<https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_pages_viewpage.action-3FpageId-3D36963506&d=DwMGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=6WYcUG7NY-ZxfqWx5MmzVQ&m=PlAAwyYw0LXyTld5hKR5ms5YfqzVBcpVXpaCwKo3go4&s=DA25evu3tnCLubzpEReRS2fUl1rCACCL9Lqtbve3_4w&e=>. The application itself can be built on any languages – although java/python would be easier to integrate with LF CI/CD toolchains. As ONAP itself is moving toward containerized deployment through OOM, the expectation is newer service will be containerized as well. Please let me know if any further questions. Thanks, Vijay From: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>> Sent: Tuesday, September 18, 2018 2:15 PM To: VENKATESH KUMAR, VIJAY <vv7...@att.com<mailto:vv7...@att.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Subject: FW: DCAE - Adding ML based network analytics Hi Vijay, Lusheng and Alok, Need your help. Thanks Srini From: Addepalli, Srinivasa R Sent: Monday, September 17, 2018 10:57 AM To: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: DCAE - Adding ML based network analytics Hi DCAE team, As I understand, DCAE analytics applications that exist today such as TCA are non-ML based. Is there any plan to include ML based network analytics as an application in DCAE? If so, is anybody working on it? Some questions on DCAE: I started to dig little bit in DCAE on creating new analytics applications. I know little bit on how to add new analytics applications in CDAP. As I understand DCAE uses CDAP internally. In CDAP, any new analytics applications are expected to be developed in Java. Deployment of applications happen by deploying JAR files. I was told that DCAE allows analytics applications deployed as containers (Micro Service). Thereby, it provides choice of developing analytics applications in any language or using any ML framework etc… First of all, is that understanding correct? Is CDAP pipeline infrastructure modified (in DCAE) to allow micro service based chaining? Second, is there any tutorial to create new micro-service based analytics applications? I tried to search, but there are too many hits and could not nail down the right page ☹. Thanks Srini This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at https://www.amdocs.com/about/email-disclaimer<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.amdocs.com_about_email-2Ddisclaimer&d=DwMGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=6WYcUG7NY-ZxfqWx5MmzVQ&m=PlAAwyYw0LXyTld5hKR5ms5YfqzVBcpVXpaCwKo3go4&s=9xRQcxkh8eLM_a3yf3tkLD0b65nNqdkdu3JbTp4cs5Q&e=> This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at https://www.amdocs.com/about/email-disclaimer <https://www.amdocs.com/about/email-disclaimer> -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12738): https://lists.onap.org/g/onap-discuss/message/12738 Mute This Topic: https://lists.onap.org/mt/26329043/21656 Mute #dcaegen2: https://lists.onap.org/mk?hashtag=dcaegen2&subid=2740164 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
