Re: [onap-discuss][policy]CCVPN Integration testing - exception when I execute create-cl-casablanca script

[Vidyashree Rama]

This problem got resolved after adding maven-surefire-plugin plugin in
/tmp/amsterdam/pom.xml

   
org.apache.maven.plugins
maven-surefire-plugin
2.19.1

  false

  

Thanks,
Vidya



On Thu, Nov 22, 2018 at 9:30 AM Vidyashree Rama 
wrote:

> Hi All,
>
> Kindly help to resolve this issue
>
> I am getting exception when I execute create-cl-casablanca script in OOM
> based depoyment.
>
> policy@dev-policy-drools-0:/tmp/amsterdam$ mvn install -DskipTests
> [INFO] Scanning for projects...
> [INFO]
>
> [INFO]
> 
> [INFO] Building amsterdam 1.3.3
> [INFO]
> 
> [INFO]
> [INFO] --- maven-resources-plugin:3.1.0:resources (default-resources) @
> amsterdam ---
> [WARNING] Using platform encoding (ANSI_X3.4-1968 actually) to copy
> filtered resources, i.e. build is platform dependent!
> [INFO] Copying 2 resources
> [INFO]
> [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @
> amsterdam ---
> [INFO] No sources to compile
> [INFO]
> [INFO] --- kie-maven-plugin:6.5.0.Final:build (default-build) @ amsterdam
> ---
> [main] INFO org.drools.compiler.kie.builder.impl.KieRepositoryImpl -
> Adding KieModule from resource:
> FileResource[file=/tmp/amsterdam/src/main/resources]
> [main] WARN org.drools.compiler.kie.builder.impl.ClasspathKieProject -
> Unable to find pom.properties in /tmp/amsterdam/src/main/resources
> [main] INFO org.drools.compiler.kie.builder.impl.ClasspathKieProject -
> Recursed up folders, found and used pom.xml /tmp/amsterdam/pom.xml
> [main] INFO org.drools.compiler.kie.builder.impl.KieRepositoryImpl -
> KieModule was added:
> FileKieModule[releaseId=org.onap.policy.rules.amsterdam:amsterdam:1.3.3,file=/tmp/amsterdam/src/main/resources]
> [INFO] KieModule successfully built!
> [INFO]
> [INFO] --- maven-resources-plugin:3.1.0:testResources
> (default-testResources) @ amsterdam ---
> [WARNING] Using platform encoding (ANSI_X3.4-1968 actually) to copy
> filtered resources, i.e. build is platform dependent!
> [INFO] skip non existing resourceDirectory
> /tmp/amsterdam/src/test/resources
> [INFO]
> [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @
> amsterdam ---
> [INFO] No sources to compile
> [INFO]
> [INFO] --- maven-surefire-plugin:3.0.0-M1:test (default-test) @ amsterdam
> ---
> Nov 22, 2018 3:35:48 AM org.sonatype.guice.bean.reflect.Logs$JULSink warn
> WARNING: Error injecting: org.apache.maven.plugin.surefire.SurefirePlugin
> com.google.inject.ProvisionException: Guice provision errors:
>
> 1) No implementation for
> org.codehaus.plexus.languages.java.jpms.LocationManager was bound.
>   while locating org.apache.maven.plugin.surefire.SurefirePlugin
>
> 1 error
> at com.google.inject.internal.InjectorImpl$3.get(InjectorImpl.java:999)
> at
> com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1025)
> at
> org.sonatype.guice.bean.reflect.AbstractDeferredClass.get(AbstractDeferredClass.java:45)
> at
> com.google.inject.internal.ProviderInternalFactory.provision(ProviderInternalFactory.java:84)
> at
> com.google.inject.internal.InternalFactoryToInitializableAdapter.provision(InternalFactoryToInitializableAdapter.java:52)
> at
> com.google.inject.internal.ProviderInternalFactory$1.call(ProviderInternalFactory.java:70)
> at
> com.google.inject.internal.ProvisionListenerStackCallback$Provision.provision(ProvisionListenerStackCallback.java:100)
> at
> org.sonatype.guice.plexus.lifecycles.PlexusLifecycleManager.onProvision(PlexusLifecycleManager.java:138)
> at
> com.google.inject.internal.ProvisionListenerStackCallback$Provision.provision(ProvisionListenerStackCallback.java:108)
> at
> com.google.inject.internal.ProvisionListenerStackCallback.provision(ProvisionListenerStackCallback.java:55)
> at
> com.google.inject.internal.ProviderInternalFactory.circularGet(ProviderInternalFactory.java:68)
> at
> com.google.inject.internal.InternalFactoryToInitializableAdapter.get(InternalFactoryToInitializableAdapter.java:45)
> at com.google.inject.internal.InjectorImpl$3$1.call(InjectorImpl.java:990)
> at
> com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1036)
> at com.google.inject.internal.InjectorImpl$3.get(InjectorImpl.java:986)
> at com.google.inject.Scopes$1$1.get(Scopes.java:59)
> at
> org.sonatype.guice.bean.locators.LazyBeanEntry.getValue(LazyBeanEntry.java:83)
> at
> org.sonatype.guice.plexus.locators.LazyPlexusBean.getValue(LazyPlexusBean.java:49)
> at
> org.codehaus.plexus.DefaultPlexusContainer.lookup(DefaultPlexusContainer.java:253)
> at
> org.codehaus.plexus.DefaultPlexusContainer.lookup(DefaultPlexusContainer.java:245)
> at
> org.apache.maven.plugin.internal.DefaultMavenPluginManager.getConfiguredMojo(DefaultMavenPluginManager.java:455)
> at
> 

[onap-discuss] Jenkins helm verify failure due to stopped helm repo - reran "sudo helm serve &" to restart on the jenkins vm - move helm serv line above make line

[Michael O'Brien]

Jessica,
   Noticed a job failure - cause is a missing helm repo instance like 
https://git.onap.org/logging-analytics/tree/deploy/rancher/oom_rancher_setup.sh#n223

  sudo helm serve &

https://gerrit.onap.org/r/#/c/73431/
https://jenkins.onap.org/job/oom-master-verify-helm/1321/console


15:49:41 Error: Looks like "http://127.0.0.1:8879" is 
not a valid chart repository or cannot be reached: Get 
http://127.0.0.1:8879/index.yaml: dial tcp 127.0.0.1:8879: getsockopt: 
connection refused

15:49:41 Makefile:59: recipe for target 'repo' failed

15:49:41 make: *** [repo] Error 1

15:49:41 Regenerating index. This may take a moment.





Although this looks like a proper rerun of the serve

15:49:41 Now serving you on 127.0.0.1:8879

The restart of the helm server was OK - verified it in a new review

The issue is that it looks like we may want to move the helm serve line before 
the make so that periodic helm verify jobs fail to complete - but a 2nd run 
fixes the helm server.
https://gerrit.onap.org/r/#/c/73440/
https://jenkins.onap.org/job/oom-master-verify-helm/1324/console

/michael

This email and the information contained herein is proprietary and confidential 
and subject to the Amdocs Email Terms of Service, which you may review at 
https://www.amdocs.com/about/email-terms-of-service 


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14021): https://lists.onap.org/g/onap-discuss/message/14021
Mute This Topic: https://lists.onap.org/mt/28296750/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] [Onap-release] OOM resources limits

[gildas.lani...@huawei.com]

Definitely important but not critical at this time (1 day left) for Casablanca 
Release.

Thanks,
Gildas
ONAP Release Manager
1 415 238 6287

From: onap-rele...@lists.onap.org [mailto:onap-rele...@lists.onap.org] On 
Behalf Of Michael O'Brien
Sent: Friday, November 23, 2018 9:42 AM
To: Eric Debeau ; onap-rele...@lists.onap.org; Gildas 
Lanilis ; Mike Elliott ; 
onap-discuss@lists.onap.org
Cc: DESBUREAUX Sylvain TGI/OLN ; David Stangl 

Subject: Re: [Onap-release] OOM resources limits

Eric,
   Thanks for the work/triage - we will address the POMBA and also review the 
LOG resource limits (11+3) - raised tracking epic
   Are we doing this for Casablanca for the morning of the 27th  (there is only 
1.5 days left) or doing it in the Dublin branch when it is ready?

https://jira.onap.org/browse/LOG-858
and we have James's kibana specific
https://jira.onap.org/browse/LOG-855

for

  *   onap-pomba-pomba-data-router
  *   onap-policy-policy-distribution


adding onap-discuss - not everyone is on onap-release
/michael
From: onap-rele...@lists.onap.org 
mailto:onap-rele...@lists.onap.org>> On Behalf Of 
Eric Debeau
Sent: Friday, November 23, 2018 12:24 PM
To: onap-rele...@lists.onap.org; 
gildas.lani...@huawei.com; Mike Elliott 
mailto:mike.elli...@amdocs.com>>
Cc: DESBUREAUX Sylvain TGI/OLN 
mailto:sylvain.desbure...@orange.com>>
Subject: [Onap-release] OOM resources limits

Hello

For Casablanca, it was decided to fix resource limits for every container 
deployed
https://wiki.onap.org/pages/viewpage.action?pageId=45285850

Some  Helm charts does not include resource requirements and others only 
include resource requirements for unlimited flavor and not taken into account 
when deploying OOM using small or large flavor.

Can you please have a look on your Helm charts to fix resource requirements ?

The following PODs have only resources fixed to unlimited {} or defined  with 
no flavor :


  *   onap-vnfsdk-vnfsdk-postgres-xxx --> pb common/postgres
  *   onap-vnfsdk-vnfsdk-pgpool --> pb common/postgres/pgpool
  *   onap-sniro-emulator-sniro-emulator
  *   onap-sdnc-sdnc-dgbuilder --> pb common/dgbuilder
  *   onap-sdnc-sdnc-db --> pb common/mysql
  *   onap-sdnc-network-name-gen --> pb Common/network-name-gen
  *   onap-sdnc-nengdb-0 --> pb common/galera
  *   onap-sdnc-controller-blueprints-db-0 --> pb common/galera
  *   onap-sdnc-controller-blueprints  --> pb common/controller-blueprints
  *   onap-sdc-sdc-wfd-fe
  *   onap-sdc-sdc-wfd-be
  *   onap-pomba-pomba-data-router
  *   onap-policy-policy-distribution
  *   onap-oof-oof-cmso-service --> https://gerrit.onap.org/r/#/c/73423/
  *   onap-oof-music-tomcat
  *   onap-oof-cmso-db --> pb common/galera
  *   onap-nbi-nbi-mongo --> pb common/mongo
  *   onap-esr-esr-server
  *   onap-esr-esr-gui
  *   onap-dmaap-dbc-pgpool --> pb common/postgres/pgpool
  *   onap-dmaap-dbc-pg --> pb common/postgres
  *   onap-dcaegen2-dcae-pgpool --> pb common/postgres/pgpool
  *   onap-dcaegen2-dcae-db --> pb common/postgres
  *   onap-contrib-netbox-postgres --> resources set to {}
  *   onap-contrib-netbox-nginx --> resources set to  {}
  *   onap-contrib-netbox-app --> resources set to {}
  *   onap-consul-consul-server
  *   onap-clamp-clampdb --> https://gerrit.onap.org/r/#/c/73413
  *   onap-clamp-clamp-dash-logstash --> https://gerrit.onap.org/r/#/c/73413
  *   onap-clamp-clamp-dash-kibana --> https://gerrit.onap.org/r/#/c/73413
  *   onap-clamp-clamp-dash-es --> https://gerrit.onap.org/r/#/c/73413
  *   onap-clamp-clamp --> https://gerrit.onap.org/r/#/c/73413
  *   onap-appc-appc-dgbuilder --> pb dgbuilder
  *   onap-appc-appc-db --> pb common/galera
  *   onap-appc-appc-ansible-server --> https://gerrit.onap.org/r/73427
  *   onap-aai-aai-cassandra  --> pb common/cassandra
  *   dep-policy-handler --> (managed by  DCAE, and not OOM)
  *   dep-inventory --> (managed by  DCAE, and not OOM)
  *   dep-holmes-rule-mgmt --> (managed by  DCAE, and not OOM)
  *   dep-holmes-engine-mgmt --> (managed by  DCAE, and not OOM)
  *   dep-deployment-handler --> (managed by  DCAE, and not OOM)
  *   dep-dcae-ves-collector --> (managed by  DCAE, and not OOM)
  *   dep-dcae-tca-analytics --> (managed by  DCAE, and not OOM)
  *   dep-dcae-snmptrap-collector (managed by  DCAE, and not OOM)
  *   dep-dcae-prh (managed by  DCAE, and not OOM)
  *   dep-dcae-hv-ves-collector (managed by  DCAE, and not OOM)
  *   dep-dcae-datafile-collector (managed by  DCAE, and not OOM)

Best Regards

Eric

_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire 

Re: [onap-discuss] OOM resources limits

[Michael O'Brien]

Eric,
   Thanks for the work/triage - we will address the POMBA and also review the 
LOG resource limits (11+3) - raised tracking epic
   Are we doing this for Casablanca for the morning of the 27th  (there is only 
1.5 days left) or doing it in the Dublin branch when it is ready?

https://jira.onap.org/browse/LOG-858
and we have James's kibana specific
https://jira.onap.org/browse/LOG-855

for

  *   onap-pomba-pomba-data-router
  *   onap-policy-policy-distribution


adding onap-discuss - not everyone is on onap-release
/michael
From: onap-rele...@lists.onap.org  On Behalf Of 
Eric Debeau
Sent: Friday, November 23, 2018 12:24 PM
To: onap-rele...@lists.onap.org; gildas.lani...@huawei.com; Mike Elliott 

Cc: DESBUREAUX Sylvain TGI/OLN 
Subject: [Onap-release] OOM resources limits

Hello

For Casablanca, it was decided to fix resource limits for every container 
deployed
https://wiki.onap.org/pages/viewpage.action?pageId=45285850

Some  Helm charts does not include resource requirements and others only 
include resource requirements for unlimited flavor and not taken into account 
when deploying OOM using small or large flavor.

Can you please have a look on your Helm charts to fix resource requirements ?

The following PODs have only resources fixed to unlimited {} or defined  with 
no flavor :


  *   onap-vnfsdk-vnfsdk-postgres-xxx --> pb common/postgres
  *   onap-vnfsdk-vnfsdk-pgpool --> pb common/postgres/pgpool
  *   onap-sniro-emulator-sniro-emulator
  *   onap-sdnc-sdnc-dgbuilder --> pb common/dgbuilder
  *   onap-sdnc-sdnc-db --> pb common/mysql
  *   onap-sdnc-network-name-gen --> pb Common/network-name-gen
  *   onap-sdnc-nengdb-0 --> pb common/galera
  *   onap-sdnc-controller-blueprints-db-0 --> pb common/galera
  *   onap-sdnc-controller-blueprints  --> pb common/controller-blueprints
  *   onap-sdc-sdc-wfd-fe
  *   onap-sdc-sdc-wfd-be
  *   onap-pomba-pomba-data-router
  *   onap-policy-policy-distribution
  *   onap-oof-oof-cmso-service --> https://gerrit.onap.org/r/#/c/73423/
  *   onap-oof-music-tomcat
  *   onap-oof-cmso-db --> pb common/galera
  *   onap-nbi-nbi-mongo --> pb common/mongo
  *   onap-esr-esr-server
  *   onap-esr-esr-gui
  *   onap-dmaap-dbc-pgpool --> pb common/postgres/pgpool
  *   onap-dmaap-dbc-pg --> pb common/postgres
  *   onap-dcaegen2-dcae-pgpool --> pb common/postgres/pgpool
  *   onap-dcaegen2-dcae-db --> pb common/postgres
  *   onap-contrib-netbox-postgres --> resources set to {}
  *   onap-contrib-netbox-nginx --> resources set to  {}
  *   onap-contrib-netbox-app --> resources set to {}
  *   onap-consul-consul-server
  *   onap-clamp-clampdb --> https://gerrit.onap.org/r/#/c/73413
  *   onap-clamp-clamp-dash-logstash --> https://gerrit.onap.org/r/#/c/73413
  *   onap-clamp-clamp-dash-kibana --> https://gerrit.onap.org/r/#/c/73413
  *   onap-clamp-clamp-dash-es --> https://gerrit.onap.org/r/#/c/73413
  *   onap-clamp-clamp --> https://gerrit.onap.org/r/#/c/73413
  *   onap-appc-appc-dgbuilder --> pb dgbuilder
  *   onap-appc-appc-db --> pb common/galera
  *   onap-appc-appc-ansible-server --> https://gerrit.onap.org/r/73427
  *   onap-aai-aai-cassandra  --> pb common/cassandra
  *   dep-policy-handler --> (managed by  DCAE, and not OOM)
  *   dep-inventory --> (managed by  DCAE, and not OOM)
  *   dep-holmes-rule-mgmt --> (managed by  DCAE, and not OOM)
  *   dep-holmes-engine-mgmt --> (managed by  DCAE, and not OOM)
  *   dep-deployment-handler --> (managed by  DCAE, and not OOM)
  *   dep-dcae-ves-collector --> (managed by  DCAE, and not OOM)
  *   dep-dcae-tca-analytics --> (managed by  DCAE, and not OOM)
  *   dep-dcae-snmptrap-collector (managed by  DCAE, and not OOM)
  *   dep-dcae-prh (managed by  DCAE, and not OOM)
  *   dep-dcae-hv-ves-collector (managed by  DCAE, and not OOM)
  *   dep-dcae-datafile-collector (managed by  DCAE, and not OOM)

Best Regards

Eric

_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

This email and the information contained herein is proprietary and confidential 
and subject to the 

Re: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

[Michael O'Brien]

Sylvain,
Thanks for the heads up, I verified behavior on a couple environments – the 
AWS CD system and a dev VMware deploy on my laptop are OK.
Like James states the timing may be off depending on what is on that 
particular VM in the 1+13 cluster – bringing up only POMBA is fine for example 
but not realistic – LOG-845 raised by James should fix this thanks for the 
triage  Sylvain.

2 different deployments
CD
16:34:15 onap  onap-pomba-pomba-kibana-849cb74588-2k2hv 
  1/1   Running   0  13m
Dev vm
onap  onap-pomba-pomba-kibana-64f8788bbd-zkq69   
1/1   Running0  1h


CD system: OK
http://jenkins.onap.info/job/oom-cd-master/4700/console
16:34:14 kube-system   heapster-7b48b696fc-hbb86
  1/1   Running   0  2h
16:34:15 kube-system   kube-dns-6655f78c68-zqnkh
  3/3   Running   0  2h
16:34:15 kube-system   kubernetes-dashboard-6f54f7c4b-b9phq 
  1/1   Running   0  2h
16:34:15 kube-system   monitoring-grafana-7877679464-6jxbk  
  1/1   Running   0  2h
16:34:15 kube-system   monitoring-influxdb-64664c6cf5-6swxb 
  1/1   Running   0  2h
16:34:15 kube-system   tiller-deploy-6f4745cbcf-247xx   
  1/1   Running   0  2h
16:34:15 onap  onap-dmaap-dbc-pg-0  
  1/1   Running   0  13m
16:34:15 onap  onap-dmaap-dbc-pg-1  
  1/1   Running   0  11m
16:34:15 onap  onap-dmaap-dbc-pgpool-c5f8498-n9xc5  
  1/1   Running   0  13m
16:34:15 onap  onap-dmaap-dbc-pgpool-c5f8498-wwskh  
  1/1   Running   0  13m
16:34:15 onap  onap-dmaap-dmaap-bus-controller-557dc8c59c-rr5pr 
  1/1   Running   0  13m
16:34:15 onap  onap-dmaap-dmaap-dr-db-576f7968b8-z474s  
  1/1   Running   0  13m
16:34:15 onap  onap-dmaap-dmaap-dr-node-7647f9d6d8-bp796
  1/1   Running   0  13m
16:34:15 onap  onap-dmaap-dmaap-dr-prov-f4d84869f-zlpwq 
  1/1   Running   0  13m
16:34:15 onap  onap-dmaap-message-router-76f4799d-h44dm 
  1/1   Running   0  13m
16:34:15 onap  onap-dmaap-message-router-kafka-757cf5cfb5-h8cpj 
  1/1   Running   0  13m
16:34:15 onap  onap-dmaap-message-router-zookeeper-5fb67dfdb5-tlhc4 
  1/1   Running   0  13m
16:34:15 onap  onap-log-log-elasticsearch-9798b655f-szr9j   
  1/1   Running   0  13m
16:34:15 onap  onap-log-log-kibana-6b89fd4858-22brs 
  1/1   Running   0  13m
16:34:15 onap  onap-log-log-logstash-8676887cd4-7nff7   
  1/1   Running   0  13m
16:34:15 onap  onap-log-log-logstash-8676887cd4-f5xkj   
  1/1   Running   0  13m
16:34:15 onap  onap-log-log-logstash-8676887cd4-fg8b9   
  1/1   Running   0  13m
16:34:15 onap  onap-log-log-logstash-8676887cd4-xt289   
  1/1   Running   0  13m
16:34:15 onap  onap-log-log-logstash-8676887cd4-zpt9t   
  1/1   Running   0  13m
16:34:15 onap  onap-pomba-pomba-aaictxbuilder-8565f7d75c-6rfn5  
  2/2   Running   0  13m
16:34:15 onap  onap-pomba-pomba-contextaggregator-d9f888c4-7bkrs
  1/1   Running   0  13m
16:34:15 onap  onap-pomba-pomba-data-router-66c556-526hc
  1/1   Running   0  13m
16:34:15 onap  onap-pomba-pomba-elasticsearch-5c4f8c6b5b-w5t49  
  1/1   Running   0  13m
16:34:15 onap  onap-pomba-pomba-kibana-849cb74588-2k2hv 
  1/1   Running   0  13m
16:34:15 onap  onap-pomba-pomba-networkdiscovery-556bb9d7b8-59vnn   
  2/2   Running   0  13m
16:34:15 onap  
onap-pomba-pomba-networkdiscoveryctxbuilder-6ff7d49464-s5wrv   2/2   
Running   0  13m
16:34:15 onap  onap-pomba-pomba-sdcctxbuilder-7799ffccc9-qz5tq  
  1/1   Running   0  13m
16:34:15 onap  onap-pomba-pomba-search-data-9896cf798-7kfdt 
  2/2   Running   0  13m
16:34:15 onap  onap-pomba-pomba-servicedecomposition-5f8bb9d6f6-wxzsw   
  2/2   Running   0  13m
16:34:15 onap  onap-pomba-pomba-validation-service-79b8d5cb9f-zstqr 
  1/1   Running   0  

Re: [onap-discuss] PNDA Demo - Few Questions Answered #dcaegen2

[Srini]

Thank you Donald.

Understood. But, I  need to dig deeper myself in Gobblin and Kafka connector to 
understanding their capabilities.

You mentioned about HDFS and how Gobblin can be used to ingest the data from 
Kafka topic to HDFS. As I understand from your explanation, PNDA with Gobblin 
can even normalize the incoming data encoding to Avro before storing in HDFS.  
In case of HDFS, does it work in the same fashion as spark-streaming in terms 
of micro batching and writing each micro batch as a separate file in HDFS?

Another question:  Can PNDA+Gobblin be used to ingest the data from Kafka in 
OpenTSDB too?

Thanks
Srini


From: onap-discuss@lists.onap.org [mailto:onap-discuss@lists.onap.org] On 
Behalf Of Donald Hunter via Lists.Onap.Org
Sent: Monday, November 19, 2018 3:56 AM
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] PNDA Demo - Few Questions Answered #dcaegen2

Reposting to add #dcaegen2 hashtag
Hi Cristina and Frank,

In the demo meeting, I heard you mentioning Gobblin project.

In the demo, you are using logstash to
-Kafka as input
-Transform the data to Avro format
-Using Kafka as output

Is the intention of mentioning Gobblin project is to indicate the replacement 
of logstash with Gobblin?

Thanks
Srini

Hi Srini,

PNDA uses gobblin to ingest data from kafka topics into the HDFS datastore. 
Prior to version 5.0, PNDA would only recognise data encapsulated in the PNDA 
AVRO schema so the data had to be encoded externally – either at source, or 
using an intermediary like Logstash. The AVRO fields provide dataset metadata, 
to provide the dataset name, where and when received. So, as you mentioned, 
logstash was being used to relay messages from DMaaP to PNDA-kafka _and_ 
encapsulate the data in AVRO – i.e. Kafka –> AVRO.encode –> Kafka.

With PNDA 5.0 it is possible to configure gobblin to recognise kafka messages 
that are not AVRO encoded. For example, it can understand protobuf encoded 
messages so is able to directly ingest protobuf encoded telemetry messages. It 
can also directly ingest JSON, with some additional configuration to allow 
gobblin to identify the metadata, i.e. dataset name, source and timestamp.

Gobblin configuration is described here:

http://pnda.io/pnda-guide/streamingest/topic-preparation.html#gobblin-topic-configuration

We could configure gobblin to directly recognise VES events either by topic 
name, or by reading the VES messages. This has the effect of moving the AVRO 
encoding step to be internal to the PNDA platform, but would still require a 
bridge from DMaaP-kafka to PNDA-kafka. We should be able to use the Kafka 
Mirror Maker for this but should evaluate this solution in a Kubernetes 
deployment environment.

Topics we need to cover in more detail are:

  *   Which data from DMaaP should be ingested into PNDA HDFS – working 
assumption is the VES topic.
  *   What is the best technical solution for transferring data from DMaaP to 
PNDA – assumption is Kafka Mirror Maker.
  *   What assumptions can we make about encoding of data that gets delivered 
to PNDA – answer depends on first bullet point.
Cheers,
Donald.


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14017): https://lists.onap.org/g/onap-discuss/message/14017
Mute This Topic: https://lists.onap.org/mt/28240683/21656
Mute #dcaegen2: https://lists.onap.org/mk?hashtag=dcaegen2=2740164
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

[James MacNider]

Kibana uses a lot of resources when it is initializing and creating indices.  
When idle, the utilization does drop, but our experience has shown that using 
Kibana when there’s actual data in ElasticSearch can be resource intensive.

From: sylvain.desbure...@orange.com 
Sent: Friday, November 23, 2018 10:53 AM
To: James MacNider ; onap-discuss@lists.onap.org
Subject: Re: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled 
all the time

James,
I moved to limits to 1.6G and it works now:
onap   onap-pomba-pomba-kibana-dbf869f9b-9cgs2  
   1 (12%)   2 (25%) 600Mi (3%)   1600Mi (10%)

the weird stuff is that we don’t use that much as you can see…

---
Sylvain Desbureaux

De : James MacNider 
mailto:james.macni...@amdocs.com>>
Date : vendredi 23 novembre 2018 à 16:23
À : "onap-discuss@lists.onap.org" 
mailto:onap-discuss@lists.onap.org>>, DESBUREAUX 
Sylvain TGI/OLN 
mailto:sylvain.desbure...@orange.com>>
Objet : RE: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled 
all the time

Hi Sylvain,

If it’s not too much trouble could you try with 1.6Gi?  Should that fail I’d 
step up to 1.8Gi.

Thanks,
James

From: onap-discuss@lists.onap.org 
mailto:onap-discuss@lists.onap.org>> On Behalf Of 
Sylvain Desbureaux
Sent: Friday, November 23, 2018 8:45 AM
To: James MacNider 
mailto:james.macni...@amdocs.com>>; 
onap-discuss@lists.onap.org
Subject: Re: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled 
all the time

Helllo James,

That’s why I said the other kibana were workins as one as higher resources 
limits (logging) and the other is not using resources limits (see 
https://jira.onap.org/browse/CLAMP-250).

I can test with higher values if you want.

Regards,

---
Sylvain Desbureaux

De : James MacNider 
mailto:james.macni...@amdocs.com>>
Date : vendredi 23 novembre 2018 à 14:18
À : "onap-discuss@lists.onap.org" 
mailto:onap-discuss@lists.onap.org>>, DESBUREAUX 
Sylvain TGI/OLN 
mailto:sylvain.desbure...@orange.com>>
Objet : RE: [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

Hi Sylvain,

There have been occasional reports of this problem with this pod but it’s not 
been readily repeatable.  Believe it or not, it is probably due to the resource 
limits being too conservative.  The other ONAP kibana instances you mention 
both have higher resource limits (2Gi for clamp, 4Gi for logging).  I’ve raised 
https://jira.onap.org/browse/LOG-855 to track this issue.

Thanks,
James

From: onap-discuss@lists.onap.org 
mailto:onap-discuss@lists.onap.org>> On Behalf Of 
Sylvain Desbureaux
Sent: Friday, November 23, 2018 5:27 AM
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all 
the time

Hello,

I’m doing a daily deployment of a full ONAP (using 
https://gitlab.com/Orange-OpenSource/lfn/onap/onap_oom_automatic_installation).
Most of the deployment is working but  I keep getting some errors.

In particular, I’ve got pomba-kibana pods which gets “OOMKilled” at every 
deployment on the last week.
I’m deploying a “small” flavor with request at 1 Cpu (which is HUGE by the way) 
and 600M RAM and limits at 2 Cpu, 1.2G RAM.

The 2 other kibana (from log and clamp) are working fine.

Am I the only one having this issue?

--
[cid:image001.png@01D33D23.D1353070]

Sylvain Desbureaux
Senior Automation Architect
ORANGE/IMT/OLN/CNC/NCA/SINA

Fixe : +33 2 96 07 13 80 

Mobile : +33 6 71 17 25 57 

sylvain.desbure...@orange.com


_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have 

Re: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

[Sylvain Desbureaux]

James,
I moved to limits to 1.6G and it works now:
onap   onap-pomba-pomba-kibana-dbf869f9b-9cgs2  
   1 (12%)   2 (25%) 600Mi (3%)   1600Mi (10%)

the weird stuff is that we don’t use that much as you can see…

---
Sylvain Desbureaux

De : James MacNider 
Date : vendredi 23 novembre 2018 à 16:23
À : "onap-discuss@lists.onap.org" , DESBUREAUX 
Sylvain TGI/OLN 
Objet : RE: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled 
all the time

Hi Sylvain,

If it’s not too much trouble could you try with 1.6Gi?  Should that fail I’d 
step up to 1.8Gi.

Thanks,
James

From: onap-discuss@lists.onap.org  On Behalf Of 
Sylvain Desbureaux
Sent: Friday, November 23, 2018 8:45 AM
To: James MacNider ; onap-discuss@lists.onap.org
Subject: Re: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled 
all the time

Helllo James,

That’s why I said the other kibana were workins as one as higher resources 
limits (logging) and the other is not using resources limits (see 
https://jira.onap.org/browse/CLAMP-250).

I can test with higher values if you want.

Regards,

---
Sylvain Desbureaux

De : James MacNider 
mailto:james.macni...@amdocs.com>>
Date : vendredi 23 novembre 2018 à 14:18
À : "onap-discuss@lists.onap.org" 
mailto:onap-discuss@lists.onap.org>>, DESBUREAUX 
Sylvain TGI/OLN 
mailto:sylvain.desbure...@orange.com>>
Objet : RE: [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

Hi Sylvain,

There have been occasional reports of this problem with this pod but it’s not 
been readily repeatable.  Believe it or not, it is probably due to the resource 
limits being too conservative.  The other ONAP kibana instances you mention 
both have higher resource limits (2Gi for clamp, 4Gi for logging).  I’ve raised 
https://jira.onap.org/browse/LOG-855 to track this issue.

Thanks,
James

From: onap-discuss@lists.onap.org 
mailto:onap-discuss@lists.onap.org>> On Behalf Of 
Sylvain Desbureaux
Sent: Friday, November 23, 2018 5:27 AM
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all 
the time

Hello,

I’m doing a daily deployment of a full ONAP (using 
https://gitlab.com/Orange-OpenSource/lfn/onap/onap_oom_automatic_installation).
Most of the deployment is working but  I keep getting some errors.

In particular, I’ve got pomba-kibana pods which gets “OOMKilled” at every 
deployment on the last week.
I’m deploying a “small” flavor with request at 1 Cpu (which is HUGE by the way) 
and 600M RAM and limits at 2 Cpu, 1.2G RAM.

The 2 other kibana (from log and clamp) are working fine.

Am I the only one having this issue?

--
[cid:image001.png@01D33D23.D1353070]

Sylvain Desbureaux
Senior Automation Architect
ORANGE/IMT/OLN/CNC/NCA/SINA

Fixe : +33 2 96 07 13 80 

Mobile : +33 6 71 17 25 57 

sylvain.desbure...@orange.com


_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

This email and the information contained herein is proprietary and confidential 
and subject to the Amdocs Email Terms of Service, which you may review at 
https://www.amdocs.com/about/email-terms-of-service

_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 

Re: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

[James MacNider]

Hi Sylvain,

If it’s not too much trouble could you try with 1.6Gi?  Should that fail I’d 
step up to 1.8Gi.

Thanks,
James

From: onap-discuss@lists.onap.org  On Behalf Of 
Sylvain Desbureaux
Sent: Friday, November 23, 2018 8:45 AM
To: James MacNider ; onap-discuss@lists.onap.org
Subject: Re: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled 
all the time

Helllo James,

That’s why I said the other kibana were workins as one as higher resources 
limits (logging) and the other is not using resources limits (see 
https://jira.onap.org/browse/CLAMP-250).

I can test with higher values if you want.

Regards,

---
Sylvain Desbureaux

De : James MacNider 
mailto:james.macni...@amdocs.com>>
Date : vendredi 23 novembre 2018 à 14:18
À : "onap-discuss@lists.onap.org" 
mailto:onap-discuss@lists.onap.org>>, DESBUREAUX 
Sylvain TGI/OLN 
mailto:sylvain.desbure...@orange.com>>
Objet : RE: [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

Hi Sylvain,

There have been occasional reports of this problem with this pod but it’s not 
been readily repeatable.  Believe it or not, it is probably due to the resource 
limits being too conservative.  The other ONAP kibana instances you mention 
both have higher resource limits (2Gi for clamp, 4Gi for logging).  I’ve raised 
https://jira.onap.org/browse/LOG-855 to track this issue.

Thanks,
James

From: onap-discuss@lists.onap.org 
mailto:onap-discuss@lists.onap.org>> On Behalf Of 
Sylvain Desbureaux
Sent: Friday, November 23, 2018 5:27 AM
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all 
the time

Hello,

I’m doing a daily deployment of a full ONAP (using 
https://gitlab.com/Orange-OpenSource/lfn/onap/onap_oom_automatic_installation).
Most of the deployment is working but  I keep getting some errors.

In particular, I’ve got pomba-kibana pods which gets “OOMKilled” at every 
deployment on the last week.
I’m deploying a “small” flavor with request at 1 Cpu (which is HUGE by the way) 
and 600M RAM and limits at 2 Cpu, 1.2G RAM.

The 2 other kibana (from log and clamp) are working fine.

Am I the only one having this issue?

--
[cid:image001.png@01D33D23.D1353070]

Sylvain Desbureaux
Senior Automation Architect
ORANGE/IMT/OLN/CNC/NCA/SINA

Fixe : +33 2 96 07 13 80 

Mobile : +33 6 71 17 25 57 

sylvain.desbure...@orange.com


_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

This email and the information contained herein is proprietary and confidential 
and subject to the Amdocs Email Terms of Service, which you may review at 
https://www.amdocs.com/about/email-terms-of-service

_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please 

Re: [onap-discuss] [appc] [Casablanca] Error while Submitting Configure request via DMaaP (Rule executor not available, initialization of RequestValidationPolicy failed)

[BALAJI, RAMYA P]

Hello Adam, Viresh:
Please use version 1.4.3 of App C Docker. This has the resolution to the issue 
that causes this error to be thrown. Ensure before you run the test again, that 
the TRANSACTIONS table is empty, if database was not re-installed.
Thanks.
Ramya

From: onap-discuss@lists.onap.org  On Behalf Of 
Krysiak, Adam (Nokia - PL/Wroclaw)
Sent: Friday, November 23, 2018 6:52 AM
To: onap-discuss@lists.onap.org; vn00569...@techmahindra.com; MAHER, RANDA 

Cc: Chandrashekhar Thakare 
Subject: Re: [onap-discuss] [appc] [Casablanca] Error while Submitting 
Configure request via DMaaP (Rule executor not available, initialization of 
RequestValidationPolicy failed)


Hi,



I've configured CL using APPC as actor in operational policy and also have this 
issue.

I'm using Casablanca lab created with oom procedure.


2018-11-23T11:34:28,727 | INFO  | sshd-SshServer[12c914ed]-nio2-thread-3 | 
ServerUserAuthService| 154 - org.apache.sshd.core - 1.6.0 | Session 
karaf@/127.0.0.1:42728 authenticated
2018-11-23T11:34:30,424 | INFO  | sshd-SshServer[12c914ed]-nio2-thread-8 | 
ServerUserAuthService| 154 - org.apache.sshd.core - 1.6.0 | Session 
karaf@/127.0.0.1:42784 authenticated
2018-11-23T11:34:38,770 | INFO  | sshd-SshServer[12c914ed]-nio2-thread-5 | 
ServerUserAuthService| 154 - org.apache.sshd.core - 1.6.0 | Session 
karaf@/127.0.0.1:43056 authenticated
2018-11-23T11:34:40,350 | INFO  | sshd-SshServer[12c914ed]-nio2-thread-11 | 
ServerUserAuthService| 154 - org.apache.sshd.core - 1.6.0 | Session 
karaf@/127.0.0.1:43096 authenticated
2018-11-23T11:34:45,100 | INFO  | Appc-Listener-2  | HttpDmaapConsumerImpl  
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | Got 1 messages from DMaaP
2018-11-23T11:34:45,101 | INFO  | Appc-Listener-2  | EventHandlerImpl   
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | Read 1 messages from 
APPC-LCM-READ as APPC-EVENT-LISTENER-TEST/369.
2018-11-23T11:34:45,117 | INFO  | Appc-Listener-2  | ListenerImpl   
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | Acknowledging Message: 
0781f3cc-6e99-464f-8f43-28abcc88c62d-1
2018-11-23T11:34:45,117 | INFO  | Appc-Listener-2  | ListenerImpl   
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | Adding DMaaP message to 
pool queue [0781f3cc-6e99-464f-8f43-28abcc88c62d-1]
2018-11-23T11:34:45,119 | INFO  | Appc-Listener-2  | EventHandlerImpl   
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | Getting up to 10 incoming 
events
2018-11-23T11:34:45,120 | INFO  | Appc-Listener-2  | HttpDmaapConsumerImpl  
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | GET 
http://message-router.onap:3904/events/APPC-LCM-READ/APPC-EVENT-LISTENER-TEST/369?timeout=6=10
2018-11-23T11:34:45,326 | INFO  | qtp1590925566-435 | RequestValidatorImpl  
   | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | AAIService from 
bundlecontext
2018-11-23T11:34:45,330 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | AAI 
Deprecation - the format of request key is no longer supported. Please rewrite 
this key : vnf-id = 'a99463b5-d84d-4740-9afe-358a191cbaf2'
2018-11-23T11:34:45,331 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | Input 
- vnf-id : a99463b5-d84d-4740-9afe-358a191cbaf2
2018-11-23T11:34:45,331 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | A 
transaction :
2018-11-23T11:34:45,332 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | 
Request Time : 2018-11-23T11:34:45.331Z, Method : GET
2018-11-23T11:34:45,332 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | 
Request URL : 
https://aai.onap:8443/aai/v14/network/generic-vnfs/generic-vnf/a99463b5-d84d-4740-9afe-358a191cbaf2
2018-11-23T11:34:45,332 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | 

Re: [onap-discuss] [DMAAP] DMD

[Dominic Lunanuova]

Re: "DMD"
As far as I know, the DMD service is not included in DMaaP Message Router in 
ONAP.
This reference is likely left in by accident due to pasting from an internal 
AT doc.
(Sunil can confirm)

...and it definitely does not apply to DMaaP Data Router.

-Dom

From: onap-discuss@lists.onap.org [mailto:onap-discuss@lists.onap.org] On 
Behalf Of Fiachra Corcoran
Sent: Friday, November 23, 2018 9:27 AM
To: onap-discuss@lists.onap.org; prakas...@verizon.com
Subject: Re: [onap-discuss] [DMAAP] DMD


Hi Prakash,



DMaaP DR was added to OOM on 2018-08-29. (Cassablanca)

Use the latest OOM revision.



//Fiachra




From: onap-discuss@lists.onap.org 
mailto:onap-discuss@lists.onap.org>> on behalf of 
Prakash via Lists.Onap.Org 
mailto:prakash.p=verizon@lists.onap.org>>
Sent: 23 November 2018 05:15:14
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] [DMAAP] DMD

Hi Team,
Good Day!
  Kindly clarify me below.
  1. I could see DMD and DMC in the architecture but i don't see it in the 
GIT/onap or in the OOM running setup
  2. What is the DR pod name, i don't see DR pod running in my setup 
brought up using OOM Beijin

Is there any slack or whatsapp group where i can have these questions anyswered 
handy.

Thanks,
Prakash P

--
Regards,
Prakas P,
Network and Technology IT,
VDSI - Olympia - Chennai
VoIP: 72184 | Direct: +91 44 4394 2184
Mailto  | prakas...@verizon.com

We Are 
VERIZON

INTEGRITY . RESPECT . PERFORMANCE EXCELLENCE . 
ACCOUNTABILITY


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14012): https://lists.onap.org/g/onap-discuss/message/14012
Mute This Topic: https://lists.onap.org/mt/28291168/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [E] RE: [onap-discuss] [DMAAP] Kafka

[Fiachra Corcoran]

Hi Prakesh,


No partitioning involved in DMaaP DR.

Data is published to specific "feeds" which subscribers can consume from.


See arch diagram here 
https://onap.readthedocs.io/en/latest/submodules/dmaap/datarouter.git/docs/data-router/architecture.html


Have a quick read through the API also.


//Fiachra


From: onap-discuss@lists.onap.org  on behalf of 
Prakash via Lists.Onap.Org 
Sent: 23 November 2018 08:13:42
To: d...@research.att.com; onap-discuss@lists.onap.org
Subject: Re: [E] RE: [onap-discuss] [DMAAP] Kafka

Hi Team,

1.   Is kafka used in DR as well?
[dgl: No kafka in DR.  DR uses local file system to store client date until its 
delivered.  It also uses mariadb to store provisioning data]


Kindly assist me understand the below

If DR doesn't use kafka then how the partitioning of data and topics happens in 
DR? Kindly provide more info.

Can you explain the internal call flow that DR does for a single file.txt 
transfer between two applications?

On Tue, Nov 20, 2018 at 7:56 PM LUNANUOVA, DOMINIC (DOMINIC) 
mailto:d...@research.att.com>> wrote:

Some answers below.

Others will need to answer the rest.

-Dom



From: onap-discuss@lists.onap.org 
[mailto:onap-discuss@lists.onap.org] On 
Behalf Of Prakash via Lists.Onap.Org
Sent: Tuesday, November 20, 2018 4:49 AM
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] [DMAAP] Kafka



Hello Team,

 As i could see a demo video on MR but i just want to know how DR works 
internally and looking for more documentation. Let me know where i can find.

[dgl: see 
https://onap.readthedocs.io/en/latest/submodules/dmaap/datarouter.git/docs/index.html]

 Also kindly clarify me on the below

1.   Is kafka used in DR as well?

[dgl: No kafka in DR.  DR uses local file system to store client date until its 
delivered.  It also uses mariadb to store provisioning data]

2.   What is the exact use of DMD and Bus Controller? Need an example use case.

[dgl: example use cases for Bus Controller:

a)   Application X publishes to DR and creates Feed X via Bus Controller /feeds 
API.  Analytic Function AF can subscribe to Feed X via Bus Controller /dr_subs 
API.  Bus Controller provisions DR accordingly.

b)   Designer specifies authenticated topic T.  Topic is provisioned using Bus 
Controller /topics API.  Application P can add itself as a publisher to topic T 
using the Bus Controller /mr_clients API.  Application S can add itself as a 
subscriber to topic T using the same API.  Bus Controller will create the topic 
T on MR, and also create and grant the AAF perms associated with the client 
actions.

3.   Is it possible to replace other models instead of kafka in MR and use it?

[Sunil?]

4.   Which component of DMAAP does the Data translation and API translation?

[dgl: no DMaaP component does data translation at this time.  The DR team is 
considering a feature in Dublin that will offer some degree of provisioning 
coordination for a registered data translation service  (e.g. reformat a data 
file).  Please provide more info on a use case you have in mind.





--

Regards,
Prakas P,
Network and Technology IT,


--
Regards,
Prakas P,
Network and Technology IT,
VDSI - Olympia – Chennai
VoIP: 72184 | Direct: +91 44 4394 2184
Mailto  | prakas...@verizon.com

We Are VERIZON

INTEGRITY . RESPECT . PERFORMANCE EXCELLENCE . 
ACCOUNTABILITY



-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14010): https://lists.onap.org/g/onap-discuss/message/14010
Mute This Topic: https://lists.onap.org/mt/28291595/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] [DMAAP] DMD

[Fiachra Corcoran]

Hi Prakash,


DMaaP DR was added to OOM on 2018-08-29. (Cassablanca)

Use the latest OOM revision.


//Fiachra



From: onap-discuss@lists.onap.org  on behalf of 
Prakash via Lists.Onap.Org 
Sent: 23 November 2018 05:15:14
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] [DMAAP] DMD

Hi Team,
Good Day!
  Kindly clarify me below.
  1. I could see DMD and DMC in the architecture but i don't see it in the 
GIT/onap or in the OOM running setup
  2. What is the DR pod name, i don't see DR pod running in my setup 
brought up using OOM Beijin

Is there any slack or whatsapp group where i can have these questions anyswered 
handy.

Thanks,
Prakash P

--
Regards,
Prakas P,
Network and Technology IT,
VDSI - Olympia – Chennai
VoIP: 72184 | Direct: +91 44 4394 2184
Mailto  | prakas...@verizon.com

We Are VERIZON

INTEGRITY . RESPECT . PERFORMANCE EXCELLENCE . 
ACCOUNTABILITY



-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14009): https://lists.onap.org/g/onap-discuss/message/14009
Mute This Topic: https://lists.onap.org/mt/28291168/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

[Sylvain Desbureaux]

Helllo James,

That’s why I said the other kibana were workins as one as higher resources 
limits (logging) and the other is not using resources limits (see 
https://jira.onap.org/browse/CLAMP-250).

I can test with higher values if you want.

Regards,

---
Sylvain Desbureaux

De : James MacNider 
Date : vendredi 23 novembre 2018 à 14:18
À : "onap-discuss@lists.onap.org" , DESBUREAUX 
Sylvain TGI/OLN 
Objet : RE: [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

Hi Sylvain,

There have been occasional reports of this problem with this pod but it’s not 
been readily repeatable.  Believe it or not, it is probably due to the resource 
limits being too conservative.  The other ONAP kibana instances you mention 
both have higher resource limits (2Gi for clamp, 4Gi for logging).  I’ve raised 
https://jira.onap.org/browse/LOG-855 to track this issue.

Thanks,
James

From: onap-discuss@lists.onap.org  On Behalf Of 
Sylvain Desbureaux
Sent: Friday, November 23, 2018 5:27 AM
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all 
the time

Hello,

I’m doing a daily deployment of a full ONAP (using 
https://gitlab.com/Orange-OpenSource/lfn/onap/onap_oom_automatic_installation).
Most of the deployment is working but  I keep getting some errors.

In particular, I’ve got pomba-kibana pods which gets “OOMKilled” at every 
deployment on the last week.
I’m deploying a “small” flavor with request at 1 Cpu (which is HUGE by the way) 
and 600M RAM and limits at 2 Cpu, 1.2G RAM.

The 2 other kibana (from log and clamp) are working fine.

Am I the only one having this issue?

--
[cid:image001.png@01D33D23.D1353070]

Sylvain Desbureaux
Senior Automation Architect
ORANGE/IMT/OLN/CNC/NCA/SINA

Fixe : +33 2 96 07 13 80 

Mobile : +33 6 71 17 25 57 

sylvain.desbure...@orange.com


_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

This email and the information contained herein is proprietary and confidential 
and subject to the Amdocs Email Terms of Service, which you may review at 
https://www.amdocs.com/about/email-terms-of-service

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14008): https://lists.onap.org/g/onap-discuss/message/14008
Mute This Topic: https://lists.onap.org/mt/28292082/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

[James MacNider]

Hi Sylvain,

There have been occasional reports of this problem with this pod but it’s not 
been readily repeatable.  Believe it or not, it is probably due to the resource 
limits being too conservative.  The other ONAP kibana instances you mention 
both have higher resource limits (2Gi for clamp, 4Gi for logging).  I’ve raised 
https://jira.onap.org/browse/LOG-855 to track this issue.

Thanks,
James

From: onap-discuss@lists.onap.org  On Behalf Of 
Sylvain Desbureaux
Sent: Friday, November 23, 2018 5:27 AM
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all 
the time

Hello,

I’m doing a daily deployment of a full ONAP (using 
https://gitlab.com/Orange-OpenSource/lfn/onap/onap_oom_automatic_installation).
Most of the deployment is working but  I keep getting some errors.

In particular, I’ve got pomba-kibana pods which gets “OOMKilled” at every 
deployment on the last week.
I’m deploying a “small” flavor with request at 1 Cpu (which is HUGE by the way) 
and 600M RAM and limits at 2 Cpu, 1.2G RAM.

The 2 other kibana (from log and clamp) are working fine.

Am I the only one having this issue?

--
[cid:image001.png@01D33D23.D1353070]

Sylvain Desbureaux
Senior Automation Architect
ORANGE/IMT/OLN/CNC/NCA/SINA

Fixe : +33 2 96 07 13 80 

Mobile : +33 6 71 17 25 57 

sylvain.desbure...@orange.com


_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

This email and the information contained herein is proprietary and confidential 
and subject to the Amdocs Email Terms of Service, which you may review at 
https://www.amdocs.com/about/email-terms-of-service 


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14007): https://lists.onap.org/g/onap-discuss/message/14007
Mute This Topic: https://lists.onap.org/mt/28292082/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] Update S3P for TSC

[Catherine LEFEVRE]

I am adding the Security Subcommittee to this thread who is currently reviewing 
these requests.

Envoyé de mon iPad 

Le 22 nov. 2018 à 22:35, OBRIEN, FRANK MICHAEL 
mailto:frank.obr...@amdocs.com>> a écrit :

Gildas,
   Yes, I knew about the Sonatype nexus-iq licensing terms – that single 
commercial tool is dictating how we work in public.
   There is a couple TSC issues we need to move forward on these I raised in 
the past – I’ll repost and get opinions from the other PTLs – in the case we 
proceed or keep the status quo

Discuss open source alternatives to NIST CVE search/identification – avoiding 
Sonatype
https://jira.onap.org/browse/TSC-32

Expand access to private CLM pages
https://jira.onap.org/browse/TSC-59

Expand access to nexus-iq
https://jira.onap.org/browse/TSC-49


Just an fyi – there are discrepancies between the private and public spaces – 
just checking in case this is for some criteria and this 6/8 diff means 
something.

6 projects that have no public scrubbed versions including mine – hence the 
possible confusion below
8 have a public scrubbed version but no private detailed version

Exists privately but not publicly
AAI
Logging
MSB
POMBA
SDC
SDNC

Exists publicly but not privately
DMaaP
CLAMP
DCAE
MultiVIM
MUSIC
OOF
VNFSDK
VVP

I’ll create Logging and POMBA on the public side and leave the rest to the 
other PTL’s

Thank you
/michael




From: Gildas Lanilis 
mailto:gildas.lani...@huawei.com>>
Sent: Wednesday, November 21, 2018 4:53 PM
To: Michael O'Brien mailto:frank.obr...@amdocs.com>>; 
ZWARICO, AMY mailto:az9...@att.com>>; 
onap-discuss@lists.onap.org
Cc: Stephen Terrill 
mailto:stephen.terr...@ericsson.com>>; 
pawel.pawl...@orange.com; Kenny Paul 
mailto:kp...@linuxfoundation.org>>
Subject: RE: Update S3P for TSC

Hi Michael,

We has some licensing compliance with the tool we are using for the scan.
To circumvent the issue, we had to create a restricted to committers wiki space 
that embeds the “Artifact”, “Version”, and “Problem Code”. This helps committer 
to track exactly their issue.

For general audience, SECCOM team created an open to everyone, curated wiki 
page without the labeled “Artifact”, “Version”, and “Problem Code”. RN is 
ReadTheDocs will point toward the curated wiki page.

Hope this help.

Thanks,
Gildas
ONAP Release Manager
1 415 238 6287

From: Michael O'Brien [mailto:frank.obr...@amdocs.com]
Sent: Wednesday, November 21, 2018 4:48 AM
To: ZWARICO, AMY mailto:az9...@att.com>>; Gildas Lanilis 
mailto:gildas.lani...@huawei.com>>; 
onap-discuss@lists.onap.org
Cc: Stephen Terrill 
mailto:stephen.terr...@ericsson.com>>; 
pawel.pawl...@orange.com; Kenny Paul 
mailto:kp...@linuxfoundation.org>>
Subject: RE: Update S3P for TSC

Still a wip in my queue along with other work – I have almost finished details 
on the last couple ones for sdnc-context-builder – I find copying from the 
nexus-iq sections to this security page extremely tedious – figuring out each 
exploit and recommending a compensating control not in (upgrade to the latest, 
use an alternate) is going to take some time – especially with the pomba code 
and with re-integration testing - in hind sight I should have just labeled 
everything with an ignore action like some of the other teams.


I don’t understand what this issue is with the columns and links – the security 
page is not accessible to the public – hence why no one except committers can 
access the page.

  1.  Remove the columns labeled “Artifact”, “Version”, and “Problem Code”. 
This are fields that cannot be publicly accessible per the license.

I followed the existing template – there are other pages like a random pick 
below that contain these columns and links.
Are you saying that the logging page needs to be different from the rest of onap

https://wiki.onap.org/pages/viewpage.action?pageId=43387665

Re: [onap-discuss] [appc] [Casablanca] Error while Submitting Configure request via DMaaP (Rule executor not available, initialization of RequestValidationPolicy failed)

[Krysiak, Adam (Nokia - PL/Wroclaw)]

Hi,


I've configured CL using APPC as actor in operational policy and also have this 
issue.

I'm using Casablanca lab created with oom procedure.


2018-11-23T11:34:28,727 | INFO  | sshd-SshServer[12c914ed]-nio2-thread-3 | 
ServerUserAuthService| 154 - org.apache.sshd.core - 1.6.0 | Session 
karaf@/127.0.0.1:42728 authenticated
2018-11-23T11:34:30,424 | INFO  | sshd-SshServer[12c914ed]-nio2-thread-8 | 
ServerUserAuthService| 154 - org.apache.sshd.core - 1.6.0 | Session 
karaf@/127.0.0.1:42784 authenticated
2018-11-23T11:34:38,770 | INFO  | sshd-SshServer[12c914ed]-nio2-thread-5 | 
ServerUserAuthService| 154 - org.apache.sshd.core - 1.6.0 | Session 
karaf@/127.0.0.1:43056 authenticated
2018-11-23T11:34:40,350 | INFO  | sshd-SshServer[12c914ed]-nio2-thread-11 | 
ServerUserAuthService| 154 - org.apache.sshd.core - 1.6.0 | Session 
karaf@/127.0.0.1:43096 authenticated
2018-11-23T11:34:45,100 | INFO  | Appc-Listener-2  | HttpDmaapConsumerImpl  
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | Got 1 messages from DMaaP
2018-11-23T11:34:45,101 | INFO  | Appc-Listener-2  | EventHandlerImpl   
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | Read 1 messages from 
APPC-LCM-READ as APPC-EVENT-LISTENER-TEST/369.
2018-11-23T11:34:45,117 | INFO  | Appc-Listener-2  | ListenerImpl   
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | Acknowledging Message: 
0781f3cc-6e99-464f-8f43-28abcc88c62d-1
2018-11-23T11:34:45,117 | INFO  | Appc-Listener-2  | ListenerImpl   
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | Adding DMaaP message to 
pool queue [0781f3cc-6e99-464f-8f43-28abcc88c62d-1]
2018-11-23T11:34:45,119 | INFO  | Appc-Listener-2  | EventHandlerImpl   
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | Getting up to 10 incoming 
events
2018-11-23T11:34:45,120 | INFO  | Appc-Listener-2  | HttpDmaapConsumerImpl  
  | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | GET 
http://message-router.onap:3904/events/APPC-LCM-READ/APPC-EVENT-LISTENER-TEST/369?timeout=6=10
2018-11-23T11:34:45,326 | INFO  | qtp1590925566-435 | RequestValidatorImpl  
   | 447 - appc-common-bundle - 1.4.1.SNAPSHOT | AAIService from 
bundlecontext
2018-11-23T11:34:45,330 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | AAI 
Deprecation - the format of request key is no longer supported. Please rewrite 
this key : vnf-id = 'a99463b5-d84d-4740-9afe-358a191cbaf2'
2018-11-23T11:34:45,331 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | Input 
- vnf-id : a99463b5-d84d-4740-9afe-358a191cbaf2
2018-11-23T11:34:45,331 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | A 
transaction :
2018-11-23T11:34:45,332 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | 
Request Time : 2018-11-23T11:34:45.331Z, Method : GET
2018-11-23T11:34:45,332 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | 
Request URL : 
https://aai.onap:8443/aai/v14/network/generic-vnfs/generic-vnf/a99463b5-d84d-4740-9afe-358a191cbaf2
2018-11-23T11:34:45,332 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | 
Missing requestID. Assigned 343cd087-46d1-4857-873f-049aee2a6e74
2018-11-23T11:34:45,469 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | 
HttpURLConnection result: 200 : OK
2018-11-23T11:34:45,470 | INFO  | qtp1590925566-435 | metric
   | 213 - org.onap.ccsdk.sli.core.sli-common - 0.3.0 |
2018-11-23T11:34:45,476 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | 
Response code : 200, OK
2018-11-23T11:34:45,476 | INFO  | qtp1590925566-435 | AAIService
   | 205 - org.onap.ccsdk.sli.adaptors.aai-service-provider - 0.3.0 | 
Response data : 
{"vnf-id":"a99463b5-d84d-4740-9afe-358a191cbaf2","vnf-name":"dp-cl-vnf","vnf-type":"dp-cl-service/dp-vsp
 

Re: [onap-discuss] Meaning of empty value in JIRA fixVersion?

[Catherine LEFEVRE]

Good morning Keong,



The affectedversion is a mandatory field because it determines when the 
Epic/Task/User Story/Bug/Sub-Task has been created/identified.

The fixversion is optional because it will depend on when the project team will 
plan its implementation.



Nevertheless I agree with you that any remaining "Highest/High" defect should 
have a fixversion.

I understand that our ONAP Release Manager is currently tracking any bug with 
no fix version and with a fixversion set to Amsterdam/Beijing or Casablanca 
Release.



I would recommend that each PTL review their JIRA backlog (Epic/Task/User 
Story/Bug/Sub-Task).

They should make an assessment if any Epic/Task/User Story/Bug/Sub-Task is 
still relevant in the context of the Dublin release or any future release.



Remaining Items – JIRA Query:

status != Closed AND status != Done AND project != "Sandbox Project" AND 
project != CI-Management AND project != "ONAP TSC"  ORDER BY priority DESC, 
updated DESC



Please note that we have already closed 16802 JIRA Items (Epic/Task/User 
Story/Bug/Sub-Task) since ONAP inception !



Best regards

Catherine



-Original Message-
From: onap-discuss@lists.onap.org [mailto:onap-discuss@lists.onap.org] On 
Behalf Of Keong Lim
Sent: Friday, November 23, 2018 2:05 AM
To: onap-discuss@lists.onap.org
Subject: [onap-discuss] Meaning of empty value in JIRA fixVersion?



Hi all,



While browsing through open cases in JIRA, it seems that for unresolved cases, 
the fixVersion is used as a forward-looking plan / prediction for when it will 
be closed and, for resolved cases, it is documentation of the actual version 
when it was closed.



But sometimes the fixVersion field is left empty. What is the meaning of 
fixVersion that is empty?



When building the JIRA query, the UI will prompt with some potential values 
which includes "Future" (apparently nothing has been defined yet for releases 
beyond "El Alto"), so is an empty value synonymous with "Future"?



Are these cases being accidentally ignored? There are over 1000 unresolved 
cases with empty fixVersion, including some Bugs that are "Highest" and "High".



Should fixVersion be a mandatory field in JIRA, i.e. not left as empty value?



The wiki 
https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_display_DW_Tracking-2BIssues-2Bwith-2BJIRA=DwIFaQ=LFYZ-o9_HUMeMTSQicvjIg=ZglJ8LOeAfevY7wWaSximhFMAzXaMdza5QYCg-DW6SU=ZKi9UZYxSu9ew7aKav4i41YrwmLPPoaLE1ymxqlNalM=wZLk9t5WdQ0Wem33SBmEIGDKfXcRegVBZbzsOSmK7zI=
 does not cover this case of fixVersion left empty.





Thanks,

Keong







-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14004): https://lists.onap.org/g/onap-discuss/message/14004
Mute This Topic: https://lists.onap.org/mt/28290136/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[onap-discuss] [DCAE] Does pnda cli supports only keystone v2.0

[Bharath Thiruveedula via Lists.Onap.Org]

Dear DCAE team,

I am trying to bring PNDA using OOM (master). I face issues while pnda-cli
trying to fetch tokens from keystone. Seems like URL formed is of keystone
v2.0 version. Can I assume it won't support keystone v3 as of now?

As per the PNDA demo we need to setup logstash in between PNDA and DCAE
service components. But I didn't any instruction to set up. Mainly I am
looking for configuration that takes input and output topic name of DMAAP.
Can you give some pointers regarding this?


Best Regards
Bharath T

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14003): https://lists.onap.org/g/onap-discuss/message/14003
Mute This Topic: https://lists.onap.org/mt/28292264/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] [portal] problem with starting portal-portal-app

[Donald Hunter via Lists.Onap.Org]

Hi Marcin,

I have seen the exact same problem where the portal-db container reported it is 
running but actually failed to initialise correctly. In order to debug it, I 
needed to watch the logs as it started up:

kubectl -n onap logs -f dev-portal-db-?-? 

Initializing database
[...]
Database initialized
MySQL init process in progress...
2018-11-16 16:40:58 0 [Note] mysqld (mysqld 
10.3.10-MariaDB-1:10.3.10+maria~bionic) starting as process 101 ...
MySQL init process in progress...
MySQL init process in progress...
2018-11-16 16:41:01 0 [Note] InnoDB: Using Linux native AIO
2018-11-16 16:41:01 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic 
builtins
2018-11-16 16:41:01 0 [Note] InnoDB: Uses event mutexes
2018-11-16 16:41:01 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2018-11-16 16:41:01 0 [Note] InnoDB: Number of pools: 1
2018-11-16 16:41:01 0 [Note] InnoDB: Using SSE2 crc32 instructions
2018-11-16 16:41:01 0 [Note] InnoDB: Initializing buffer pool, total size = 
256M, instances = 1, chunk size = 128M
2018-11-16 16:41:01 0 [Note] InnoDB: Completed initialization of buffer pool
2018-11-16 16:41:01 0 [Note] InnoDB: If the mysqld execution user is 
authorized, page cleaner thread priority can be changed. See the man page of 
setpriority().
MySQL init process in progress...
2018-11-16 16:41:01 0 [Note] InnoDB: 128 out of 128 rollback segments are 
active.
2018-11-16 16:41:01 0 [Note] InnoDB: Creating shared tablespace for temporary 
tables
2018-11-16 16:41:01 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. 
Physically writing the file full; Please wait ...
MySQL init process in progress...
MySQL init process in progress...
MySQL init process in progress...
[...]
MySQL init process in progress...
MySQL init process failed.

When I looked at the portal-db log after the fact, the stdout messages are no 
longer present. The mariadb docker-entrypoint.sh script was failing here:

https://github.com/docker-library/mariadb/blob/7384b25a0196d8a7e62173781df5a5bed1eb88d2/10.4/docker-entrypoint.sh#L103-L113

As you can see the script has failed before running any of the SQL from 
/docker-entrypoint-initdb.d/* so it was taking longer than 30s to perform the 
database init and writing 12MB to ibtmpl.

The root cause for me was very slow performance of the NFS share for 
/dockerdata-nfs/ – which for me was hosted by another VM that was backed with 
Openstack block storage. I wasn't able to isolate the root cause of the poor 
performance, but I guess it could have been due to block storage latency or 
openstack networking latency.

Note that the portal-db readiness probe waits for 450s (7.5 minutes) before it 
starts. Even when the db initialisation fails, the portal-db will be marked 
"running" and ready "1/1" after 7.5 minutes and then the portal-db-config job 
will start (and then fail).

Hope this helps you.
Donald.

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14002): https://lists.onap.org/g/onap-discuss/message/14002
Mute This Topic: https://lists.onap.org/mt/28285637/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[onap-discuss] [OOM][Casablanca][POMBA] pomba kibana is OOMKilled all the time

[Sylvain Desbureaux]

Hello,

I’m doing a daily deployment of a full ONAP (using 
https://gitlab.com/Orange-OpenSource/lfn/onap/onap_oom_automatic_installation).
Most of the deployment is working but  I keep getting some errors.

In particular, I’ve got pomba-kibana pods which gets “OOMKilled” at every 
deployment on the last week.
I’m deploying a “small” flavor with request at 1 Cpu (which is HUGE by the way) 
and 600M RAM and limits at 2 Cpu, 1.2G RAM.

The 2 other kibana (from log and clamp) are working fine.

Am I the only one having this issue?

--
[cid:image001.png@01D33D23.D1353070]

Sylvain Desbureaux
Senior Automation Architect
ORANGE/IMT/OLN/CNC/NCA/SINA

Fixe : +33 2 96 07 13 80 

Mobile : +33 6 71 17 25 57 

sylvain.desbure...@orange.com


_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#14001): https://lists.onap.org/g/onap-discuss/message/14001
Mute This Topic: https://lists.onap.org/mt/28292082/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] VF Module Creation Says Successful but stack not created in Openstack

[Yang Bin]

I am not expert of helm chart , neither SO. I was not suggesting any practice, 
I was just trying to understand Eric’s instruction …


Best Regards,
Bin Yang,Solution Engineering Team,Wind River
ONAP Multi-VIM/Cloud PTL
Direct +86,10,84777126Mobile +86,13811391682Fax +86,10,64398189
Skype: yangbincs993

From: onap-discuss@lists.onap.org [mailto:onap-discuss@lists.onap.org] On 
Behalf Of Ukponmwan, Itohan
Sent: Friday, November 23, 2018 4:13 PM
To: Yang, Bin; Addepalli, Srinivasa R
Cc: onap-discuss@lists.onap.org; Multanen, Eric W; bf1...@att.com; Mishra, 
Sharad D; Deng, Yipan; Williams, Marcus; Ranganathan, Dileep
Subject: Re: [onap-discuss] VF Module Creation Says Successful but stack not 
created in Openstack

What changes do I need to make to the oom override file?

-Itohan?

From: Yang, Bin [mailto:bin.y...@windriver.com]
Sent: Thursday, November 22, 2018 5:12 PM
To: Ukponmwan, Itohan ; Addepalli, Srinivasa R 

Cc: onap-discuss@lists.onap.org; Multanen, Eric W ; 
bf1...@att.com; Mishra, Sharad D ; Deng, Yipan 
; Williams, Marcus ; 
Ranganathan, Dileep 
Subject: RE: [onap-discuss] VF Module Creation Says Successful but stack not 
created in Openstack

Hi Itohan,

I don’t know the internal logic of SO adaptor , I believe the overrides files 
is the source of truth which might populate your SO database? Eric mentioned he 
had changed the database manually and it work, so that might be some hacking  I 
am not aware of .

I might be wondering if you could change the oom override file and restart the 
SO adaptor pod…

Best Regards,
Bin Yang,Solution Engineering Team,Wind River
ONAP Multi-VIM/Cloud PTL
Direct +86,10,84777126Mobile +86,13811391682Fax +86,10,64398189
Skype: yangbincs993

From: Ukponmwan, Itohan [mailto:itohan.ukponm...@intel.com]
Sent: Friday, November 23, 2018 8:36 AM
To: Yang, Bin; Addepalli, Srinivasa R
Cc: onap-discuss@lists.onap.org; Multanen, 
Eric W; bf1...@att.com; Mishra, Sharad D; Deng, Yipan; 
Williams, Marcus; Ranganathan, Dileep
Subject: RE: [onap-discuss] VF Module Creation Says Successful but stack not 
created in Openstack

Hi Bin,

I have these configured already. I see the values when I query the database and 
confirmed the values are correct.
I also confirmed the I had modified the v2 adapter. Do you have any ideas on 
why no cloudsites show up in config overrides file?

Please find attached a screen shot of the values I see when I query the 
database.

Regards,
Itohan

From: Yang, Bin [mailto:bin.y...@windriver.com]
Sent: Thursday, November 22, 2018 7:48 AM
To: Addepalli, Srinivasa R 
mailto:srinivasa.r.addepa...@intel.com>>
Cc: onap-discuss@lists.onap.org; Ukponmwan, 
Itohan mailto:itohan.ukponm...@intel.com>>; 
Multanen, Eric W mailto:eric.w.multa...@intel.com>>; 
bf1...@att.com; Mishra, Sharad D 
mailto:sharad.d.mis...@intel.com>>; Deng, Yipan 
mailto:yipan.d...@intel.com>>; Williams, Marcus 
mailto:marcus.willi...@intel.com>>; Ranganathan, 
Dileep mailto:dileep.ranganat...@intel.com>>
Subject: Re: [onap-discuss] VF Module Creation Says Successful but stack not 
created in Openstack

Hi Srini, Itohan,

The log and configuration files indicated so was not provisioned properly.

I just forward Eric's email to you for your reference: Configuring SO with 
multi-VIM

Bin

在 2018年11月22日，23:19，Addepalli, Srinivasa R 
mailto:srinivasa.r.addepa...@intel.com>> 写道：
Hi Bin,

Itohan is trying to test vFW with HPA. For this to work, instantiation request 
from SO should go to Multi-Cloud. Based on your analysis of logs, is the 
request going to Multi-Cloud? I remember you saying that there is some 
configuration that makes SO to talk to Multi-Cloud. Can you point that out to 
Itohan?


Thanks
Srini


From: Yang, Bin [mailto:bin.y...@windriver.com]
Sent: Wednesday, November 21, 2018 10:22 PM
To: onap-discuss@lists.onap.org; Ukponmwan, 
Itohan mailto:itohan.ukponm...@intel.com>>; 
Multanen, Eric W mailto:eric.w.multa...@intel.com>>; 
bf1...@att.com
Cc: Mishra, Sharad D 
mailto:sharad.d.mis...@intel.com>>; Addepalli, 
Srinivasa R 
mailto:srinivasa.r.addepa...@intel.com>>; 
Deng, Yipan mailto:yipan.d...@intel.com>>; Williams, 
Marcus mailto:marcus.willi...@intel.com>>; 
Ranganathan, Dileep 
mailto:dileep.ranganat...@intel.com>>
Subject: RE: [onap-discuss] VF Module Creation Says Successful but stack not 
created in Openstack

If you are working on Integration-SB-06, the latest log I can dump from 
multicloud-windriver is captured on Nov. 19:

2018-11-19 
18:04:12|newton_base.registration.registration||140080103589696||_get_list_resources||INFO||making
 request with URI:/snapshots/detail,{'service_type': 'volumev3', 'interface': 
'public', 'region_name': 
u'ONAP-POD-01-Rail-06'}requestID=766690fd-ccb8-3135-82b2-678e9825c2ba 
invocationID=13b7eb69-4e8a-4b8a-b1c7-9b809b59657b 

Re: [E] RE: [onap-discuss] [DMAAP] Kafka

[Prakash via Lists.Onap.Org]

Hi Team,

1.   Is kafka used in DR as well?
> [dgl: No kafka in DR.  DR uses local file system to store client date
> until its delivered.  It also uses mariadb to store provisioning data]


Kindly assist me understand the below

If DR doesn't use kafka then how the partitioning of data and topics
happens in DR? Kindly provide more info.

Can you explain the internal call flow that DR does for a single file.txt
transfer between two applications?

On Tue, Nov 20, 2018 at 7:56 PM LUNANUOVA, DOMINIC (DOMINIC) <
d...@research.att.com> wrote:

> Some answers below.
>
> Others will need to answer the rest.
>
> -Dom
>
>
>
> *From:* onap-discuss@lists.onap.org [mailto:onap-discuss@lists.onap.org] *On
> Behalf Of *Prakash via Lists.Onap.Org
> *Sent:* Tuesday, November 20, 2018 4:49 AM
> *To:* onap-discuss@lists.onap.org
> *Subject:* [onap-discuss] [DMAAP] Kafka
>
>
>
> Hello Team,
>
>  As i could see a demo video on MR but i just want to know how DR
> works internally and looking for more documentation. Let me know where i
> can find.
>
> [dgl: see
> https://onap.readthedocs.io/en/latest/submodules/dmaap/datarouter.git/docs/index.html
> 
> ]
>
>  Also kindly clarify me on the below
>
> 1.   Is kafka used in DR as well?
>
> [dgl: No kafka in DR.  DR uses local file system to store client date
> until its delivered.  It also uses mariadb to store provisioning data]
>
> 2.   What is the exact use of DMD and Bus Controller? Need an example use
> case.
>
> [dgl: example use cases for Bus Controller:
>
> a)   Application X publishes to DR and creates Feed X via Bus Controller
> /feeds API.  Analytic Function AF can subscribe to Feed X via Bus
> Controller /dr_subs API.  Bus Controller provisions DR accordingly.
>
> b)   Designer specifies authenticated topic T.  Topic is provisioned
> using Bus Controller /topics API.  Application P can add itself as a
> publisher to topic T using the Bus Controller /mr_clients API.  Application
> S can add itself as a subscriber to topic T using the same API.  Bus
> Controller will create the topic T on MR, and also create and grant the AAF
> perms associated with the client actions.
>
> 3.   Is it possible to replace other models instead of kafka in MR and
> use it?
>
> [Sunil?]
>
> 4.   Which component of DMAAP does the Data translation and API
> translation?
>
> [dgl: no DMaaP component does data translation at this time.  The DR team
> is considering a feature in Dublin that will offer some degree of
> provisioning coordination for a registered data translation service  (e.g.
> reformat a data file).  Please provide more info on a use case you have in
> mind.
>
>
>
>
>
> --
>
> *Regards,*
> Prakas P,
> Network and Technology IT,
>
> 
>


-- 
*Regards,*
Prakas P,
Network and Technology IT,
VDSI - Olympia – Chennai
*VoIP: *72184* | Direct: *+91 44 4394 2184

*Mailto * *|* prakas...@verizon.com 

*We Are VERIZON *

*INTEGRITY . RESPECT . PERFORMANCE EXCELLENCE . ACCOUNTABILITY
*

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#13999): https://lists.onap.org/g/onap-discuss/message/13999
Mute This Topic: https://lists.onap.org/mt/28291595/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] VF Module Creation Says Successful but stack not created in Openstack

[Ukponmwan, Itohan]

What changes do I need to make to the oom override file?

-Itohan?

From: Yang, Bin [mailto:bin.y...@windriver.com]
Sent: Thursday, November 22, 2018 5:12 PM
To: Ukponmwan, Itohan ; Addepalli, Srinivasa R 

Cc: onap-discuss@lists.onap.org; Multanen, Eric W ; 
bf1...@att.com; Mishra, Sharad D ; Deng, Yipan 
; Williams, Marcus ; 
Ranganathan, Dileep 
Subject: RE: [onap-discuss] VF Module Creation Says Successful but stack not 
created in Openstack

Hi Itohan,

I don’t know the internal logic of SO adaptor , I believe the overrides files 
is the source of truth which might populate your SO database? Eric mentioned he 
had changed the database manually and it work, so that might be some hacking  I 
am not aware of .

I might be wondering if you could change the oom override file and restart the 
SO adaptor pod…

Best Regards,
Bin Yang,Solution Engineering Team,Wind River
ONAP Multi-VIM/Cloud PTL
Direct +86,10,84777126Mobile +86,13811391682Fax +86,10,64398189
Skype: yangbincs993

From: Ukponmwan, Itohan [mailto:itohan.ukponm...@intel.com]
Sent: Friday, November 23, 2018 8:36 AM
To: Yang, Bin; Addepalli, Srinivasa R
Cc: onap-discuss@lists.onap.org; Multanen, 
Eric W; bf1...@att.com; Mishra, Sharad D; Deng, Yipan; 
Williams, Marcus; Ranganathan, Dileep
Subject: RE: [onap-discuss] VF Module Creation Says Successful but stack not 
created in Openstack

Hi Bin,

I have these configured already. I see the values when I query the database and 
confirmed the values are correct.
I also confirmed the I had modified the v2 adapter. Do you have any ideas on 
why no cloudsites show up in config overrides file?

Please find attached a screen shot of the values I see when I query the 
database.

Regards,
Itohan

From: Yang, Bin [mailto:bin.y...@windriver.com]
Sent: Thursday, November 22, 2018 7:48 AM
To: Addepalli, Srinivasa R 
mailto:srinivasa.r.addepa...@intel.com>>
Cc: onap-discuss@lists.onap.org; Ukponmwan, 
Itohan mailto:itohan.ukponm...@intel.com>>; 
Multanen, Eric W mailto:eric.w.multa...@intel.com>>; 
bf1...@att.com; Mishra, Sharad D 
mailto:sharad.d.mis...@intel.com>>; Deng, Yipan 
mailto:yipan.d...@intel.com>>; Williams, Marcus 
mailto:marcus.willi...@intel.com>>; Ranganathan, 
Dileep mailto:dileep.ranganat...@intel.com>>
Subject: Re: [onap-discuss] VF Module Creation Says Successful but stack not 
created in Openstack

Hi Srini, Itohan,

The log and configuration files indicated so was not provisioned properly.

I just forward Eric's email to you for your reference: Configuring SO with 
multi-VIM

Bin

在 2018年11月22日，23:19，Addepalli, Srinivasa R 
mailto:srinivasa.r.addepa...@intel.com>> 写道：
Hi Bin,

Itohan is trying to test vFW with HPA. For this to work, instantiation request 
from SO should go to Multi-Cloud. Based on your analysis of logs, is the 
request going to Multi-Cloud? I remember you saying that there is some 
configuration that makes SO to talk to Multi-Cloud. Can you point that out to 
Itohan?


Thanks
Srini


From: Yang, Bin [mailto:bin.y...@windriver.com]
Sent: Wednesday, November 21, 2018 10:22 PM
To: onap-discuss@lists.onap.org; Ukponmwan, 
Itohan mailto:itohan.ukponm...@intel.com>>; 
Multanen, Eric W mailto:eric.w.multa...@intel.com>>; 
bf1...@att.com
Cc: Mishra, Sharad D 
mailto:sharad.d.mis...@intel.com>>; Addepalli, 
Srinivasa R 
mailto:srinivasa.r.addepa...@intel.com>>; 
Deng, Yipan mailto:yipan.d...@intel.com>>; Williams, 
Marcus mailto:marcus.willi...@intel.com>>; 
Ranganathan, Dileep 
mailto:dileep.ranganat...@intel.com>>
Subject: RE: [onap-discuss] VF Module Creation Says Successful but stack not 
created in Openstack

If you are working on Integration-SB-06, the latest log I can dump from 
multicloud-windriver is captured on Nov. 19:

2018-11-19 
18:04:12|newton_base.registration.registration||140080103589696||_get_list_resources||INFO||making
 request with URI:/snapshots/detail,{'service_type': 'volumev3', 'interface': 
'public', 'region_name': 
u'ONAP-POD-01-Rail-06'}requestID=766690fd-ccb8-3135-82b2-678e9825c2ba 
invocationID=13b7eb69-4e8a-4b8a-b1c7-9b809b59657b 
serviceName=multicloud-titaniumcloud serviceIP=10.42.172.198
2018-11-19 
18:04:13|newton_base.registration.registration||140080103589696||_get_list_resources||INFO||request
 returns with status 200requestID=766690fd-ccb8-3135-82b2-678e9825c2ba 
invocationID=13b7eb69-4e8a-4b8a-b1c7-9b809b59657b 
serviceName=multicloud-titaniumcloud serviceIP=10.42.172.198
2018-11-19 
18:04:13|newton_base.registration.registration||140080103589696||_get_list_resources||DEBUG||with
 content:{u'snapshots': []}requestID=766690fd-ccb8-3135-82b2-678e9825c2ba 
invocationID=13b7eb69-4e8a-4b8a-b1c7-9b809b59657b 
serviceName=multicloud-titaniumcloud serviceIP=10.42.172.198

I checked the so openstack adaptor, there is no cloud site for