Re: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data production and consumption #dmaap
Thank you, Sunil! Best regards -- Cristina Precup -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12192): https://lists.onap.org/g/onap-discuss/message/12192 Mute This Topic: https://lists.onap.org/mt/24973111/21656 Mute #dmaap: https://lists.onap.org/mk?hashtag=dmaap=2740164 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data production and consumption #dmaap
Hi Cristina, It is available now. You can now use the Kafka API instead of the Message Router. Thanks, Sunil -Original Message- From: onap-discuss@lists.onap.org On Behalf Of Cristina Precup via Lists.Onap.Org Sent: Friday, August 31, 2018 9:43 AM To: onap-discuss@lists.onap.org Subject: Re: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data production and consumption #dmaap Hello Unnava, Sounds great! Do you have a commit reference for this change? Best regards, -- Cristina Precup -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12186): https://lists.onap.org/g/onap-discuss/message/12186 Mute This Topic: https://lists.onap.org/mt/24973111/21656 Mute #dmaap: https://lists.onap.org/mk?hashtag=dmaap=2740164 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data production and consumption #dmaap
Hello Unnava, Sounds great! Do you have a commit reference for this change? Best regards, -- Cristina Precup -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12184): https://lists.onap.org/g/onap-discuss/message/12184 Mute This Topic: https://lists.onap.org/mt/24973111/21656 Mute #dmaap: https://lists.onap.org/mk?hashtag=dmaap=2740164 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data production and consumption #dmaap
Sunil,
This is awesome. Thanks!
Lusheng
On 8/27/18, 12:18 PM, "UNNAVA, SUNIL" wrote:
Lusheng,
We are working on exposing the Kafka through the NodePort and it will be
available by end of this week. DMaaP will permit the mixed use between the MR
REST API and Kafka client API.
Thanks,
Sunil
-Original Message-
From: onap-discuss@lists.onap.org On Behalf
Of JI, LUSHENG
Sent: Monday, August 27, 2018 11:58 AM
To: onap-discuss@lists.onap.org; cpre...@cisco.com
Subject: Re: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data
production and consumption #dmaap
*** Security Advisory: This Message Originated Outside of AT ***.
Reference http://cso.att.com/EmailSecurity/IDSP.html for more information.
Christina,
The DMaaP team does have native Kafka API support included as part of
Casablanca scope per their release planning:
https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_display_DW_DMaaP-2BR3-2B-2D-2BM1-2BRelease-2BPlanning=DwIGaQ=LFYZ-o9_HUMeMTSQicvjIg=t27CRRmn7U12dnOvcSPfcQ=V6AWEk0l0CEkJqAxVOS_zsqZelKbkt_FYX4kA_VDeNI=FBCzMbBk1BGsCwIIHhND3rRpdfPMyD8OOcHcnNj-e74=
. We will need DMaaP team’s help understand exactly how to integrate.
I also have a question on whether this permits mixed uses between Rest API
and Kafka API, that is: one side (either pub or sub) uses Rest API while the
other side uses Kafka, or some subscribers/publishers use Rest while other
subscribers (of the same topics) use Kafka API. One of the uses that we may
encounter is whether we can have VES collector publishes to DMaaP Rest API
while PDNA receives over native Kafka.
BR,
Lusheng Ji
ONAP DCAE
On 8/27/18, 9:07 AM, "onap-discuss@lists.onap.org on behalf of Cristina
Precup via Lists.Onap.Org" wrote:
We are working on integrating PNDA applications with the DMaaP
component in ONAP:DCAE
(https://urldefense.proofpoint.com/v2/url?u=https-3A__jira.onap.org_browse_DCAEGEN2-2D371=DwIFaQ=LFYZ-o9_HUMeMTSQicvjIg=qiKb3LQBLje9oy8MjG3MEx1ia4mIocif7RoUY8WQWV8=Q2fEk4UfTZzeGrEHKItW2iL3uompH99ZAQ-A-vDoBDo=VX-anUpTDp7yXufccIzNT8gGYCH_dWDUFslnqydT2O0=).
In a first phase, we would like to cross-post topics between PNDA and DMaaP
and process the streams of messages. For this, we have created a test
environment where we are posting directly to the Kafka broker underneath the
DMaaP component. We understand that the DMaaP component is meant to be used
through its REST endpoint. As pointed by Donald in the Story above, we are
concerned about the performance impact of switching to the DMaaP REST endpoint
instead of directly using a Kafka endpoint. Could you detail your view on the
matter of performance and what the preferred method would be?
Alternatively, we propose having a Kafka endpoint exposed as a NodePort
or running a Kubernetes container as a Kafka forwarder.
Looking forward to your feedback!
Best regards,
--
Cristina Precup
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#12082): https://lists.onap.org/g/onap-discuss/message/12082
Mute This Topic: https://lists.onap.org/mt/24973111/21656
Mute #dmaap: https://lists.onap.org/mk?hashtag=dmaap=2740164
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
Re: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data production and consumption #dmaap
Lusheng, We are working on exposing the Kafka through the NodePort and it will be available by end of this week. DMaaP will permit the mixed use between the MR REST API and Kafka client API. Thanks, Sunil -Original Message- From: onap-discuss@lists.onap.org On Behalf Of JI, LUSHENG Sent: Monday, August 27, 2018 11:58 AM To: onap-discuss@lists.onap.org; cpre...@cisco.com Subject: Re: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data production and consumption #dmaap *** Security Advisory: This Message Originated Outside of AT ***. Reference http://cso.att.com/EmailSecurity/IDSP.html for more information. Christina, The DMaaP team does have native Kafka API support included as part of Casablanca scope per their release planning: https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_display_DW_DMaaP-2BR3-2B-2D-2BM1-2BRelease-2BPlanning=DwIGaQ=LFYZ-o9_HUMeMTSQicvjIg=t27CRRmn7U12dnOvcSPfcQ=V6AWEk0l0CEkJqAxVOS_zsqZelKbkt_FYX4kA_VDeNI=FBCzMbBk1BGsCwIIHhND3rRpdfPMyD8OOcHcnNj-e74= . We will need DMaaP team’s help understand exactly how to integrate. I also have a question on whether this permits mixed uses between Rest API and Kafka API, that is: one side (either pub or sub) uses Rest API while the other side uses Kafka, or some subscribers/publishers use Rest while other subscribers (of the same topics) use Kafka API. One of the uses that we may encounter is whether we can have VES collector publishes to DMaaP Rest API while PDNA receives over native Kafka. BR, Lusheng Ji ONAP DCAE On 8/27/18, 9:07 AM, "onap-discuss@lists.onap.org on behalf of Cristina Precup via Lists.Onap.Org" wrote: We are working on integrating PNDA applications with the DMaaP component in ONAP:DCAE (https://urldefense.proofpoint.com/v2/url?u=https-3A__jira.onap.org_browse_DCAEGEN2-2D371=DwIFaQ=LFYZ-o9_HUMeMTSQicvjIg=qiKb3LQBLje9oy8MjG3MEx1ia4mIocif7RoUY8WQWV8=Q2fEk4UfTZzeGrEHKItW2iL3uompH99ZAQ-A-vDoBDo=VX-anUpTDp7yXufccIzNT8gGYCH_dWDUFslnqydT2O0=). In a first phase, we would like to cross-post topics between PNDA and DMaaP and process the streams of messages. For this, we have created a test environment where we are posting directly to the Kafka broker underneath the DMaaP component. We understand that the DMaaP component is meant to be used through its REST endpoint. As pointed by Donald in the Story above, we are concerned about the performance impact of switching to the DMaaP REST endpoint instead of directly using a Kafka endpoint. Could you detail your view on the matter of performance and what the preferred method would be? Alternatively, we propose having a Kafka endpoint exposed as a NodePort or running a Kubernetes container as a Kafka forwarder. Looking forward to your feedback! Best regards, -- Cristina Precup -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12081): https://lists.onap.org/g/onap-discuss/message/12081 Mute This Topic: https://lists.onap.org/mt/24973111/21656 Mute #dmaap: https://lists.onap.org/mk?hashtag=dmaap=2740164 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data production and consumption #dmaap
Hi Cristina, We are working on creating the custom Kafka image(for AAF integration, which is not completed yet) and creating the Kubernetes service to expose the Kafka endpoint. We created the custom Kafka image and waiting for the CI-management team approve the JJB template. Once they approve the JJB template, we will create the Kubernetes service for the Kafka. Meanwhile to continue your work please use the image wurstmeister/kafka:0.11.0.1. Thanks, Sunil -Original Message- From: onap-discuss@lists.onap.org On Behalf Of Cristina Precup via Lists.Onap.Org Sent: Monday, August 27, 2018 9:08 AM To: onap-discuss@lists.onap.org Subject: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data production and consumption #dmaap We are working on integrating PNDA applications with the DMaaP component in ONAP:DCAE (https://urldefense.proofpoint.com/v2/url?u=https-3A__jira.onap.org_browse_DCAEGEN2-2D371=DwIFaQ=LFYZ-o9_HUMeMTSQicvjIg=t27CRRmn7U12dnOvcSPfcQ=jwpKfj1jccyiXIiVmq897Q-SMzd9SAy9R3RhKcv1VdY=GaLV_4C7ahaFlcTdzEVLQKdKTM5UJZNhV--GowMPtGk=). In a first phase, we would like to cross-post topics between PNDA and DMaaP and process the streams of messages. For this, we have created a test environment where we are posting directly to the Kafka broker underneath the DMaaP component. We understand that the DMaaP component is meant to be used through its REST endpoint. As pointed by Donald in the Story above, we are concerned about the performance impact of switching to the DMaaP REST endpoint instead of directly using a Kafka endpoint. Could you detail your view on the matter of performance and what the preferred method would be? Alternatively, we propose having a Kafka endpoint exposed as a NodePort or running a Kubernetes container as a Kafka forwarder. Looking forward to your feedback! Best regards, -- Cristina Precup -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12080): https://lists.onap.org/g/onap-discuss/message/12080 Mute This Topic: https://lists.onap.org/mt/24973111/21656 Mute #dmaap: https://lists.onap.org/mk?hashtag=dmaap=2740164 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [onap-discuss] PNDA - DCAE:DMaaP integration - inquiry on data production and consumption #dmaap
Christina, The DMaaP team does have native Kafka API support included as part of Casablanca scope per their release planning: https://wiki.onap.org/display/DW/DMaaP+R3+-+M1+Release+Planning . We will need DMaaP team’s help understand exactly how to integrate. I also have a question on whether this permits mixed uses between Rest API and Kafka API, that is: one side (either pub or sub) uses Rest API while the other side uses Kafka, or some subscribers/publishers use Rest while other subscribers (of the same topics) use Kafka API. One of the uses that we may encounter is whether we can have VES collector publishes to DMaaP Rest API while PDNA receives over native Kafka. BR, Lusheng Ji ONAP DCAE On 8/27/18, 9:07 AM, "onap-discuss@lists.onap.org on behalf of Cristina Precup via Lists.Onap.Org" wrote: We are working on integrating PNDA applications with the DMaaP component in ONAP:DCAE (https://urldefense.proofpoint.com/v2/url?u=https-3A__jira.onap.org_browse_DCAEGEN2-2D371=DwIFaQ=LFYZ-o9_HUMeMTSQicvjIg=qiKb3LQBLje9oy8MjG3MEx1ia4mIocif7RoUY8WQWV8=Q2fEk4UfTZzeGrEHKItW2iL3uompH99ZAQ-A-vDoBDo=VX-anUpTDp7yXufccIzNT8gGYCH_dWDUFslnqydT2O0=). In a first phase, we would like to cross-post topics between PNDA and DMaaP and process the streams of messages. For this, we have created a test environment where we are posting directly to the Kafka broker underneath the DMaaP component. We understand that the DMaaP component is meant to be used through its REST endpoint. As pointed by Donald in the Story above, we are concerned about the performance impact of switching to the DMaaP REST endpoint instead of directly using a Kafka endpoint. Could you detail your view on the matter of performance and what the preferred method would be? Alternatively, we propose having a Kafka endpoint exposed as a NodePort or running a Kubernetes container as a Kafka forwarder. Looking forward to your feedback! Best regards, -- Cristina Precup -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12078): https://lists.onap.org/g/onap-discuss/message/12078 Mute This Topic: https://lists.onap.org/mt/24973111/21656 Mute #dmaap: https://lists.onap.org/mk?hashtag=dmaap=2740164 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
