Hi Frank, It would be great to discuss options with you for deploying PNDA components in OOM/K8s. One thing that is missing right now from DCAE is the ability to perform an upgrade of DCAE components after its initial install. DCAE operates under a different controller environment. It’s kind of its own island that is treated special from the rest of the components within an ONAP deployment. It would be really great if we could have consistent behavior with the rest of ONAP. As of now, it is possible to perform a non-disruptive rolling upgrade of all components in ONAP, except for DCAE.
If you (or anyone on this email thread) is going to the architecture meetup in Montreal, perhaps that would be a good time to meet F2F and discuss how we evolve to such a common deployment model? Otherwise, the OOM team is available at any time to discuss via Zoom. Thanks, Mike. -- Mike Elliott ONAP OOM PTL Senior Architect - Amdocs From: <onap-discuss@lists.onap.org> on behalf of "Frank Brockners via Lists.Onap.Org" <fbrockne=cisco....@lists.onap.org> Reply-To: "onap-discuss@lists.onap.org" <onap-discuss@lists.onap.org>, "fbroc...@cisco.com" <fbroc...@cisco.com> Date: Thursday, September 27, 2018 at 2:31 AM To: "Addepalli, Srinivasa R" <srinivasa.r.addepa...@intel.com>, "'VENKATESH KUMAR, VIJAY'" <vv7...@att.com>, "'JI, LUSHENG'" <l...@research.att.com>, "'GUPTA, ALOK'" <ag1...@att.com> Cc: "'onap-discuss@lists.onap.org'" <onap-discuss@lists.onap.org>, "Fabien Andrieux (fandrieu)" <fandr...@cisco.com>, "Donald Hunter (donaldh)" <dona...@cisco.com>, "Trevor Smith (trsmith2)" <trsmi...@cisco.com>, "Cristina Precup (cprecup)" <cpre...@cisco.com>, "Chenxi Du (chenxdu)" <chen...@cisco.com> Subject: Re: [onap-discuss] #DCAEgen2 - DCAE - Adding ML based network analytics Hi Srini, sorry for the delay – ONS.EU got into our way. PNDA 5.0 – which is expected to come out later in October – will include HDP 2.6.5 which contains Spark 2.3, see https://wiki.onap.org/display/DW/Integrating+PNDA#IntegratingPNDA-PNDA5.0Componentsversions. There are various options to run applications on Spark – and containers are one option. PNDA apps are currently not deployed using containers – and integration of DCAE’s catalogue with PNDA’s deployment manager is targeted for post Casablanca. With the closer integration of DCAE and PNDA, we should also ask the question of how we deploy DCAE apps moving forward. Doing that as containers via OOM/K8s would be an interesting option to consider for DCAE as well. Cc’ing a few more folks. Cheers, Frank From: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com> Sent: Freitag, 21. September 2018 17:59 To: 'VENKATESH KUMAR, VIJAY' <vv7...@att.com>; 'JI, LUSHENG' <l...@research.att.com>; 'GUPTA, ALOK' <ag1...@att.com>; Frank Brockners (fbrockne) <fbroc...@cisco.com> Cc: 'onap-discuss@lists.onap.org' <onap-discuss@lists.onap.org> Subject: RE: DCAE - Adding ML based network analytics +Frank Hi Vijay and Frank, Few basic questions on PNDA+DCAE. I see that PNDA supports both Spark batch and Spark streaming. Spark streaming is of interest. We also see that Kafka based streaming is supported by PNDA. 1. Does PNDA use spark version 2.3 or above to allow Kubernetes based scheduling of spark jobs? 2. If I had implemented my analytics application (with spark executor, MLlib, Kafka way of getting data stream and Kafka way of outputting the analysis output) as a container that work on Spark 2.3.0, does it require any changes to work with PNDA and DCAE? If it requires changes, what kind of changes are required? Thanks Srini From: Addepalli, Srinivasa R Sent: Wednesday, September 19, 2018 6:59 AM To: VENKATESH KUMAR, VIJAY <vv7...@att.com<mailto:vv7...@att.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Cc: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: RE: DCAE - Adding ML based network analytics Thanks Vijay. Understood. We are moving away from CDAP to PNDA and Apache Flink as big data platform. As I understand from PNDA website, it seems to be based on Spark. Since Spark supports Machine learning analytics (via MLlib as well as Bring your own models), I think PNDA/Spark may be what we need to look into. Thanks for pointers Vijay. Will go through the link you have provided and understand the onboarding of analytics micro-services. Thanks Srini From: VENKATESH KUMAR, VIJAY [mailto:vv7...@att.com] Sent: Tuesday, September 18, 2018 5:30 PM To: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Cc: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: RE: DCAE - Adding ML based network analytics Hi Srini – Thanks for your interest into DCAE. Apologize for the delay in response (was tied up with upcoming M4 delivery). As you might know, DCAE provides a platform for onboarding different type of mS (collectors, analytics, CE’s). The TCA instance was build to support the original OpenECOMP and ONAP usecases and it was chosen as CDAP application as that was the analytics platform supported then. However since Amsterdam release, based on community feedback (and lack of support in CDAP)- we are working toward integrating newer analytics platform into DCAE. PNDA is one such platform – there is work currently under way in R3 by Cisco team to integrate PNDA platform with DCAE (actual app’s on this platform will be scope of R4). Apache Flink was another platform approved by ARC team, but we seeking community support for building upon it in future release. As for building new analytics application - it will be better to have them targeted on either of new platform. If there are any specific usecase requiring ML application, we can discuss and target them in future release. And the development of new services as you noted can be done independent of DCAE Platform to start-with; subsequent integration and deployment into platform will require certain pre-requisite which are documented here - https://wiki.onap.org/pages/viewpage.action?pageId=36963506. The application itself can be built on any languages – although java/python would be easier to integrate with LF CI/CD toolchains. As ONAP itself is moving toward containerized deployment through OOM, the expectation is newer service will be containerized as well. Please let me know if any further questions. Thanks, Vijay From: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>> Sent: Tuesday, September 18, 2018 2:15 PM To: VENKATESH KUMAR, VIJAY <vv7...@att.com<mailto:vv7...@att.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Subject: FW: DCAE - Adding ML based network analytics Hi Vijay, Lusheng and Alok, Need your help. Thanks Srini From: Addepalli, Srinivasa R Sent: Monday, September 17, 2018 10:57 AM To: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: DCAE - Adding ML based network analytics Hi DCAE team, As I understand, DCAE analytics applications that exist today such as TCA are non-ML based. Is there any plan to include ML based network analytics as an application in DCAE? If so, is anybody working on it? Some questions on DCAE: I started to dig little bit in DCAE on creating new analytics applications. I know little bit on how to add new analytics applications in CDAP. As I understand DCAE uses CDAP internally. In CDAP, any new analytics applications are expected to be developed in Java. Deployment of applications happen by deploying JAR files. I was told that DCAE allows analytics applications deployed as containers (Micro Service). Thereby, it provides choice of developing analytics applications in any language or using any ML framework etc… First of all, is that understanding correct? Is CDAP pipeline infrastructure modified (in DCAE) to allow micro service based chaining? Second, is there any tutorial to create new micro-service based analytics applications? I tried to search, but there are too many hits and could not nail down the right page ☹. Thanks Srini This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at https://www.amdocs.com/about/email-disclaimer <https://www.amdocs.com/about/email-disclaimer> -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12731): https://lists.onap.org/g/onap-discuss/message/12731 Mute This Topic: https://lists.onap.org/mt/26329043/21656 Mute #dcaegen2: https://lists.onap.org/mk?hashtag=dcaegen2&subid=2740164 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-