Hi Frank & All, My assumptions are as follows :
1. DCAE hosts both the infra ( platform ) and controller logic to perform SA aspects. 2. SDC's DCAE-DS ( when operational ) will be used to design / model TOSCA based SA templates ( blueprints ) and when we hit "distribute" in SDC, these SA templates will reach DCAE controller and it is then the controller's responsibility to onboard / schedule & operate those mS. 3. The movement of CDAP to PNDA in DCAE component, is all about making the change at the platform level, not at the controller level. Your latest answer is defeating my 3rd assumption. Could you shed more light here ? BR, Viswa <http://www.verizon.com> Viswanath Kumar Skand Priya Senior Architect Technology, Architecture & Planning On Thu, Sep 27, 2018 at 12:00 PM Frank Brockners via Lists.Onap.Org <fbrockne=cisco....@lists.onap.org> wrote: > > > Hi Srini, > > > > sorry for the delay – ONS.EU got into our way. PNDA 5.0 – which is > expected to come out later in October – will include HDP 2.6.5 which > contains Spark 2.3, see > https://wiki.onap.org/display/DW/Integrating+PNDA#IntegratingPNDA-PNDA5.0Componentsversions > <https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_display_DW_Integrating-2BPNDA-23IntegratingPNDA-2DPNDA5.0Componentsversions&d=DwMFAg&c=udBTRvFvXC5Dhqg7UHpJlPps3mZ3LRxpb6__0PomBTQ&r=9F3pNUkzjE-2v1eTClkRVakDRN8GH7Bm-wt1lWkxoUyyDORTqf5MxNO_GrMBs0gZ&m=nyk3QBlM7Tjn3NZ-6mcDFk-pNxwrj9y7Kqw7pRCPDCs&s=iDIEF1hJlPe6_stA472j4JzmmpbJ5eZiCMUzMXJR8UU&e=>. > There are various options to run applications on Spark – and containers are > one option. > PNDA apps are currently not deployed using containers – and integration of > DCAE’s catalogue with PNDA’s deployment manager is targeted for post > Casablanca. > With the closer integration of DCAE and PNDA, we should also ask the > question of how we deploy DCAE apps moving forward. > > Doing that as containers via OOM/K8s would be an interesting option to > consider for DCAE as well. > > Cc’ing a few more folks. > > > > Cheers, Frank > > > > *From:* Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com> > *Sent:* Freitag, 21. September 2018 17:59 > *To:* 'VENKATESH KUMAR, VIJAY' <vv7...@att.com>; 'JI, LUSHENG' < > l...@research.att.com>; 'GUPTA, ALOK' <ag1...@att.com>; Frank Brockners > (fbrockne) <fbroc...@cisco.com> > *Cc:* 'onap-discuss@lists.onap.org' <onap-discuss@lists.onap.org> > *Subject:* RE: DCAE - Adding ML based network analytics > > > > +Frank > > > > Hi Vijay and Frank, > > > > Few basic questions on PNDA+DCAE. > > > > I see that PNDA supports both Spark batch and Spark streaming. Spark > streaming is of interest. We also see that Kafka based streaming is > supported by PNDA. > > > > 1. Does PNDA use spark version 2.3 or above to allow Kubernetes > based scheduling of spark jobs? > > 2. If I had implemented my analytics application (with spark > executor, MLlib, Kafka way of getting data stream and Kafka way of > outputting the analysis output) as a container that work on Spark 2.3.0, > does it require any changes to work with PNDA and DCAE? If it requires > changes, what kind of changes are required? > > > > Thanks > > Srini > > > > > > *From:* Addepalli, Srinivasa R > *Sent:* Wednesday, September 19, 2018 6:59 AM > *To:* VENKATESH KUMAR, VIJAY <vv7...@att.com>; JI, LUSHENG < > l...@research.att.com>; GUPTA, ALOK <ag1...@att.com> > *Cc:* onap-discuss@lists.onap.org > *Subject:* RE: DCAE - Adding ML based network analytics > > > > Thanks Vijay. > > > > Understood. We are moving away from CDAP to PNDA and Apache Flink as big > data platform. > > As I understand from PNDA website, it seems to be based on Spark. Since > Spark supports Machine learning analytics (via MLlib as well as Bring your > own models), I think PNDA/Spark may be what we need to look into. > > > > Thanks for pointers Vijay. Will go through the link you have provided and > understand the onboarding of analytics micro-services. > > > > Thanks > > Srini > > > > > > > > *From:* VENKATESH KUMAR, VIJAY [mailto:vv7...@att.com <vv7...@att.com>] > *Sent:* Tuesday, September 18, 2018 5:30 PM > *To:* Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com>; JI, > LUSHENG <l...@research.att.com>; GUPTA, ALOK <ag1...@att.com> > *Cc:* onap-discuss@lists.onap.org > *Subject:* RE: DCAE - Adding ML based network analytics > > > > Hi Srini – Thanks for your interest into DCAE. Apologize for the delay in > response (was tied up with upcoming M4 delivery). > > > > As you might know, DCAE provides a platform for onboarding different type > of mS (collectors, analytics, CE’s). The TCA instance was build to support > the original OpenECOMP and ONAP usecases and it was chosen as CDAP > application as that was the analytics platform supported then. However > since Amsterdam release, based on community feedback (and lack of support > in CDAP)- we are working toward integrating newer analytics platform into > DCAE. PNDA is one such platform – there is work currently under way in R3 > by Cisco team to integrate PNDA platform with DCAE (actual app’s on this > platform will be scope of R4). Apache Flink was another platform approved > by ARC team, but we seeking community support for building upon it in > future release. As for building new analytics application - it will be > better to have them targeted on either of new platform. > > > > If there are any specific usecase requiring ML application, we can discuss > and target them in future release. > > > > And the development of new services as you noted can be done independent > of DCAE Platform to start-with; subsequent integration and deployment into > platform will require certain pre-requisite which are documented here - > https://wiki.onap.org/pages/viewpage.action?pageId=36963506 > <https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_pages_viewpage.action-3FpageId-3D36963506&d=DwMFAg&c=udBTRvFvXC5Dhqg7UHpJlPps3mZ3LRxpb6__0PomBTQ&r=9F3pNUkzjE-2v1eTClkRVakDRN8GH7Bm-wt1lWkxoUyyDORTqf5MxNO_GrMBs0gZ&m=nyk3QBlM7Tjn3NZ-6mcDFk-pNxwrj9y7Kqw7pRCPDCs&s=H5u2eJaIAGejuvS4B0eKIj8bPYIkzBAbo9ZXm_6L5k4&e=>. > The application itself can be built on any languages – although java/python > would be easier to integrate with LF CI/CD toolchains. As ONAP itself is > moving toward containerized deployment through OOM, the expectation is > newer service will be containerized as well. > > > > Please let me know if any further questions. > > > > Thanks, > > Vijay > > > > *From:* Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com> > *Sent:* Tuesday, September 18, 2018 2:15 PM > *To:* VENKATESH KUMAR, VIJAY <vv7...@att.com>; JI, LUSHENG < > l...@research.att.com>; GUPTA, ALOK <ag1...@att.com> > *Subject:* FW: DCAE - Adding ML based network analytics > > > > Hi Vijay, Lusheng and Alok, > > > > Need your help. > > > > Thanks > > Srini > > > > > > *From:* Addepalli, Srinivasa R > *Sent:* Monday, September 17, 2018 10:57 AM > *To:* onap-discuss@lists.onap.org > *Subject:* DCAE - Adding ML based network analytics > > > > Hi DCAE team, > > > > As I understand, DCAE analytics applications that exist today such as TCA > are non-ML based. > > Is there any plan to include ML based network analytics as an application > in DCAE? If so, is anybody working on it? > > > > Some questions on DCAE: > > I started to dig little bit in DCAE on creating new analytics applications. > > I know little bit on how to add new analytics applications in CDAP. As I > understand DCAE uses CDAP internally. > > In CDAP, any new analytics applications are expected to be developed in > Java. Deployment of applications happen by deploying JAR files. > > I was told that DCAE allows analytics applications deployed as containers > (Micro Service). Thereby, it provides choice of developing analytics > applications in any language or using any ML framework etc… > > First of all, is that understanding correct? Is CDAP pipeline > infrastructure modified (in DCAE) to allow micro service based chaining? > > Second, is there any tutorial to create new micro-service based analytics > applications? I tried to search, but there are too many hits and could not > nail down the right page L. > > > > Thanks > Srini > > > > > > > > > > > > > > -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12684): https://lists.onap.org/g/onap-discuss/message/12684 Mute This Topic: https://lists.onap.org/mt/26329564/21656 Mute #dcaegen2: https://lists.onap.org/mk?hashtag=dcaegen2&subid=2740164 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
