Viswa You are correct. PNDA should be considered as extension to the DCAE platform (although current dcae controller function will have to be enhanced to LCM support on the new platform).
Frank – Were you considering PNDA application deployment through Helm? One of main driver in using Cloudify was to have unified onboarding flow based on TOSCA and leveraging interfaces with SDC, POLICY and CLAMP for dynamic instantiation/configuration management and topics provisioning. Under helm deployment, we don’t have these functions supported. For newer PNDA application – was thinking similar to CDAP approach, where a new PNDA plugin can be built and used for interfacing to PNDA deployment handler (while existing plugins remain for supporting other necessary function platform already support). If you have different suggestion, will be good to discuss. Regards, Vijay From: Kumar Skand Priya, Viswanath V <viswanath.kumarskandpr...@verizon.com> Sent: Thursday, September 27, 2018 4:45 AM To: onap-discuss <onap-discuss@lists.onap.org>; fbroc...@cisco.com Cc: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com>; VENKATESH KUMAR, VIJAY <vv7...@att.com>; JI, LUSHENG <l...@research.att.com>; GUPTA, ALOK <ag1...@att.com>; fandr...@cisco.com; dona...@cisco.com; trsmi...@cisco.com; cpre...@cisco.com; chen...@cisco.com; LANDO, MICHAEL <ml6...@intl.att.com> Subject: Re: [E] Re: [onap-discuss] #DCAEgen2 - DCAE - Adding ML based network analytics Hi Frank & All, My assumptions are as follows : 1. DCAE hosts both the infra ( platform ) and controller logic to perform SA aspects. 2. SDC's DCAE-DS ( when operational ) will be used to design / model TOSCA based SA templates ( blueprints ) and when we hit "distribute" in SDC, these SA templates will reach DCAE controller and it is then the controller's responsibility to onboard / schedule & operate those mS. 3. The movement of CDAP to PNDA in DCAE component, is all about making the change at the platform level, not at the controller level. Your latest answer is defeating my 3rd assumption. Could you shed more light here ? BR, Viswa [http://ss7.vzw.com/is/image/VerizonWireless/vz-sig-verizon?$defaultscale$]<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.verizon.com&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=6WYcUG7NY-ZxfqWx5MmzVQ&m=u4DJ0vGc9BwY9Qazzrhjtpou_sj8BTkKMUG4sl7aDas&s=-nQf9CR2I7oj9kxM9Z0LdqF4fXgwaW225Xw2zmHMGy8&e=> Viswanath Kumar Skand Priya Senior Architect Technology, Architecture & Planning On Thu, Sep 27, 2018 at 12:00 PM Frank Brockners via Lists.Onap.Org<https://urldefense.proofpoint.com/v2/url?u=http-3A__Lists.Onap.Org&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=6WYcUG7NY-ZxfqWx5MmzVQ&m=u4DJ0vGc9BwY9Qazzrhjtpou_sj8BTkKMUG4sl7aDas&s=2prORyJaIj3LU-loxEXB4S_KfGbGNBBXvEzN_Ct6MJo&e=> <fbrockne=cisco....@lists.onap.org<mailto:cisco....@lists.onap.org>> wrote: Hi Srini, sorry for the delay – ONS.EU<https://urldefense.proofpoint.com/v2/url?u=http-3A__ONS.EU&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=6WYcUG7NY-ZxfqWx5MmzVQ&m=u4DJ0vGc9BwY9Qazzrhjtpou_sj8BTkKMUG4sl7aDas&s=Cx8dqyHTwd-m7SxBXWEN_BBAorZOml4J2HFv3KyGLaU&e=> got into our way. PNDA 5.0 – which is expected to come out later in October – will include HDP 2.6.5 which contains Spark 2.3, see https://wiki.onap.org/display/DW/Integrating+PNDA#IntegratingPNDA-PNDA5.0Componentsversions<https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_display_DW_Integrating-2BPNDA-23IntegratingPNDA-2DPNDA5.0Componentsversions&d=DwMFAg&c=udBTRvFvXC5Dhqg7UHpJlPps3mZ3LRxpb6__0PomBTQ&r=9F3pNUkzjE-2v1eTClkRVakDRN8GH7Bm-wt1lWkxoUyyDORTqf5MxNO_GrMBs0gZ&m=nyk3QBlM7Tjn3NZ-6mcDFk-pNxwrj9y7Kqw7pRCPDCs&s=iDIEF1hJlPe6_stA472j4JzmmpbJ5eZiCMUzMXJR8UU&e=>. There are various options to run applications on Spark – and containers are one option. PNDA apps are currently not deployed using containers – and integration of DCAE’s catalogue with PNDA’s deployment manager is targeted for post Casablanca. With the closer integration of DCAE and PNDA, we should also ask the question of how we deploy DCAE apps moving forward. Doing that as containers via OOM/K8s would be an interesting option to consider for DCAE as well. Cc’ing a few more folks. Cheers, Frank From: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>> Sent: Freitag, 21. September 2018 17:59 To: 'VENKATESH KUMAR, VIJAY' <vv7...@att.com<mailto:vv7...@att.com>>; 'JI, LUSHENG' <l...@research.att.com<mailto:l...@research.att.com>>; 'GUPTA, ALOK' <ag1...@att.com<mailto:ag1...@att.com>>; Frank Brockners (fbrockne) <fbroc...@cisco.com<mailto:fbroc...@cisco.com>> Cc: 'onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>' <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>> Subject: RE: DCAE - Adding ML based network analytics +Frank Hi Vijay and Frank, Few basic questions on PNDA+DCAE. I see that PNDA supports both Spark batch and Spark streaming. Spark streaming is of interest. We also see that Kafka based streaming is supported by PNDA. 1. Does PNDA use spark version 2.3 or above to allow Kubernetes based scheduling of spark jobs? 2. If I had implemented my analytics application (with spark executor, MLlib, Kafka way of getting data stream and Kafka way of outputting the analysis output) as a container that work on Spark 2.3.0, does it require any changes to work with PNDA and DCAE? If it requires changes, what kind of changes are required? Thanks Srini From: Addepalli, Srinivasa R Sent: Wednesday, September 19, 2018 6:59 AM To: VENKATESH KUMAR, VIJAY <vv7...@att.com<mailto:vv7...@att.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Cc: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: RE: DCAE - Adding ML based network analytics Thanks Vijay. Understood. We are moving away from CDAP to PNDA and Apache Flink as big data platform. As I understand from PNDA website, it seems to be based on Spark. Since Spark supports Machine learning analytics (via MLlib as well as Bring your own models), I think PNDA/Spark may be what we need to look into. Thanks for pointers Vijay. Will go through the link you have provided and understand the onboarding of analytics micro-services. Thanks Srini From: VENKATESH KUMAR, VIJAY [mailto:vv7...@att.com] Sent: Tuesday, September 18, 2018 5:30 PM To: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Cc: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: RE: DCAE - Adding ML based network analytics Hi Srini – Thanks for your interest into DCAE. Apologize for the delay in response (was tied up with upcoming M4 delivery). As you might know, DCAE provides a platform for onboarding different type of mS (collectors, analytics, CE’s). The TCA instance was build to support the original OpenECOMP and ONAP usecases and it was chosen as CDAP application as that was the analytics platform supported then. However since Amsterdam release, based on community feedback (and lack of support in CDAP)- we are working toward integrating newer analytics platform into DCAE. PNDA is one such platform – there is work currently under way in R3 by Cisco team to integrate PNDA platform with DCAE (actual app’s on this platform will be scope of R4). Apache Flink was another platform approved by ARC team, but we seeking community support for building upon it in future release. As for building new analytics application - it will be better to have them targeted on either of new platform. If there are any specific usecase requiring ML application, we can discuss and target them in future release. And the development of new services as you noted can be done independent of DCAE Platform to start-with; subsequent integration and deployment into platform will require certain pre-requisite which are documented here - https://wiki.onap.org/pages/viewpage.action?pageId=36963506<https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_pages_viewpage.action-3FpageId-3D36963506&d=DwMFAg&c=udBTRvFvXC5Dhqg7UHpJlPps3mZ3LRxpb6__0PomBTQ&r=9F3pNUkzjE-2v1eTClkRVakDRN8GH7Bm-wt1lWkxoUyyDORTqf5MxNO_GrMBs0gZ&m=nyk3QBlM7Tjn3NZ-6mcDFk-pNxwrj9y7Kqw7pRCPDCs&s=H5u2eJaIAGejuvS4B0eKIj8bPYIkzBAbo9ZXm_6L5k4&e=>. The application itself can be built on any languages – although java/python would be easier to integrate with LF CI/CD toolchains. As ONAP itself is moving toward containerized deployment through OOM, the expectation is newer service will be containerized as well. Please let me know if any further questions. Thanks, Vijay From: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>> Sent: Tuesday, September 18, 2018 2:15 PM To: VENKATESH KUMAR, VIJAY <vv7...@att.com<mailto:vv7...@att.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Subject: FW: DCAE - Adding ML based network analytics Hi Vijay, Lusheng and Alok, Need your help. Thanks Srini From: Addepalli, Srinivasa R Sent: Monday, September 17, 2018 10:57 AM To: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: DCAE - Adding ML based network analytics Hi DCAE team, As I understand, DCAE analytics applications that exist today such as TCA are non-ML based. Is there any plan to include ML based network analytics as an application in DCAE? If so, is anybody working on it? Some questions on DCAE: I started to dig little bit in DCAE on creating new analytics applications. I know little bit on how to add new analytics applications in CDAP. As I understand DCAE uses CDAP internally. In CDAP, any new analytics applications are expected to be developed in Java. Deployment of applications happen by deploying JAR files. I was told that DCAE allows analytics applications deployed as containers (Micro Service). Thereby, it provides choice of developing analytics applications in any language or using any ML framework etc… First of all, is that understanding correct? Is CDAP pipeline infrastructure modified (in DCAE) to allow micro service based chaining? Second, is there any tutorial to create new micro-service based analytics applications? I tried to search, but there are too many hits and could not nail down the right page ☹. Thanks Srini -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12712): https://lists.onap.org/g/onap-discuss/message/12712 Mute This Topic: https://lists.onap.org/mt/26329564/21656 Mute #dcaegen2: https://lists.onap.org/mk?hashtag=dcaegen2&subid=2740164 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
