+Frank Hi Vijay and Frank,
Few basic questions on PNDA+DCAE. I see that PNDA supports both Spark batch and Spark streaming. Spark streaming is of interest. We also see that Kafka based streaming is supported by PNDA. 1. Does PNDA use spark version 2.3 or above to allow Kubernetes based scheduling of spark jobs? 2. If I had implemented my analytics application (with spark executor, MLlib, Kafka way of getting data stream and Kafka way of outputting the analysis output) as a container that work on Spark 2.3.0, does it require any changes to work with PNDA and DCAE? If it requires changes, what kind of changes are required? Thanks Srini From: Addepalli, Srinivasa R Sent: Wednesday, September 19, 2018 6:59 AM To: VENKATESH KUMAR, VIJAY <vv7...@att.com>; JI, LUSHENG <l...@research.att.com>; GUPTA, ALOK <ag1...@att.com> Cc: onap-discuss@lists.onap.org Subject: RE: DCAE - Adding ML based network analytics Thanks Vijay. Understood. We are moving away from CDAP to PNDA and Apache Flink as big data platform. As I understand from PNDA website, it seems to be based on Spark. Since Spark supports Machine learning analytics (via MLlib as well as Bring your own models), I think PNDA/Spark may be what we need to look into. Thanks for pointers Vijay. Will go through the link you have provided and understand the onboarding of analytics micro-services. Thanks Srini From: VENKATESH KUMAR, VIJAY [mailto:vv7...@att.com] Sent: Tuesday, September 18, 2018 5:30 PM To: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Cc: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: RE: DCAE - Adding ML based network analytics Hi Srini - Thanks for your interest into DCAE. Apologize for the delay in response (was tied up with upcoming M4 delivery). As you might know, DCAE provides a platform for onboarding different type of mS (collectors, analytics, CE's). The TCA instance was build to support the original OpenECOMP and ONAP usecases and it was chosen as CDAP application as that was the analytics platform supported then. However since Amsterdam release, based on community feedback (and lack of support in CDAP)- we are working toward integrating newer analytics platform into DCAE. PNDA is one such platform - there is work currently under way in R3 by Cisco team to integrate PNDA platform with DCAE (actual app's on this platform will be scope of R4). Apache Flink was another platform approved by ARC team, but we seeking community support for building upon it in future release. As for building new analytics application - it will be better to have them targeted on either of new platform. If there are any specific usecase requiring ML application, we can discuss and target them in future release. And the development of new services as you noted can be done independent of DCAE Platform to start-with; subsequent integration and deployment into platform will require certain pre-requisite which are documented here - https://wiki.onap.org/pages/viewpage.action?pageId=36963506. The application itself can be built on any languages - although java/python would be easier to integrate with LF CI/CD toolchains. As ONAP itself is moving toward containerized deployment through OOM, the expectation is newer service will be containerized as well. Please let me know if any further questions. Thanks, Vijay From: Addepalli, Srinivasa R <srinivasa.r.addepa...@intel.com<mailto:srinivasa.r.addepa...@intel.com>> Sent: Tuesday, September 18, 2018 2:15 PM To: VENKATESH KUMAR, VIJAY <vv7...@att.com<mailto:vv7...@att.com>>; JI, LUSHENG <l...@research.att.com<mailto:l...@research.att.com>>; GUPTA, ALOK <ag1...@att.com<mailto:ag1...@att.com>> Subject: FW: DCAE - Adding ML based network analytics Hi Vijay, Lusheng and Alok, Need your help. Thanks Srini From: Addepalli, Srinivasa R Sent: Monday, September 17, 2018 10:57 AM To: onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org> Subject: DCAE - Adding ML based network analytics Hi DCAE team, As I understand, DCAE analytics applications that exist today such as TCA are non-ML based. Is there any plan to include ML based network analytics as an application in DCAE? If so, is anybody working on it? Some questions on DCAE: I started to dig little bit in DCAE on creating new analytics applications. I know little bit on how to add new analytics applications in CDAP. As I understand DCAE uses CDAP internally. In CDAP, any new analytics applications are expected to be developed in Java. Deployment of applications happen by deploying JAR files. I was told that DCAE allows analytics applications deployed as containers (Micro Service). Thereby, it provides choice of developing analytics applications in any language or using any ML framework etc... First of all, is that understanding correct? Is CDAP pipeline infrastructure modified (in DCAE) to allow micro service based chaining? Second, is there any tutorial to create new micro-service based analytics applications? I tried to search, but there are too many hits and could not nail down the right page :(. Thanks Srini -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12572): https://lists.onap.org/g/onap-discuss/message/12572 Mute This Topic: https://lists.onap.org/mt/25727425/21656 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
