Hi I am following updates on onap oom(master/frankfurt) after elalto certificates has been failed(april 5) . Until the may 15 , all pods are deployed successfully. But in these days both master and frankfurt branch deployment is failed . Today I have deleted all kubernetes / helm setup and have installed everything again. But problem still continues. I request help to workaround these fails.
Today pod fails : # kubectl get pods | grep -v Running | grep -v Complete NAME READY STATUS RESTARTS AGE dev-cds-blueprints-processor-79784d44bf-6wl8g 0/1 Init:1/3 0 34m dev-cds-command-executor-5c9d8bd7d5-l8hz7 0/1 Init:0/1 3 34m dev-cds-sdc-listener-58f75cc97f-fbvvs 0/1 Init:0/1 1 34m dev-dcae-servicechange-handler-787d59c5cd-gmzjg 0/1 Init:0/2 0 33m dev-oof-6b4f448cb9-v7267 0/1 Init:0/2 3 32m dev-policy-xacml-pdp-55c6d744b-lxf7q 0/1 CrashLoopBackOff 11 31m dev-sdc-be-config-backend-t6nfg 0/1 Init:Error 0 31m dev-sdc-dcae-be-tools-p8mhn 0/1 Init:Error 0 31m dev-sdc-dcae-be-tools-smjmk 0/1 Init:Error 0 21m dev-sdnc-dmaap-listener-85b46ccf7d-qlfpf 0/1 Init:1/2 0 30m dev-sdnc-ueb-listener-55d64d9496-rnxx7 0/1 Init:1/2 0 30m dev-so-ve-vnfm-adapter-7db7f945fc-5cfxx 0/1 Init:1/2 0 29m ------------------------------------------------------------------------------------------------------- # kubectl describe pod dev-policy-xacml-pdp-55c6d744b-lxf7q Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 32m default-scheduler Successfully assigned onap/dev-policy-xacml-pdp-55c6d744b-lxf7q to onap-k8s-1 Warning FailedMount 32m kubelet, onap-k8s-1 MountVolume.SetUp failed for volume "pdpxconfig" : couldn't propagate object cache: timed out waiting for the condition Normal Pulled 32m kubelet, onap-k8s-1 Container image "oomk8s/readiness-check:2.2.1" already present on machine Normal Created 32m kubelet, onap-k8s-1 Created container policy-xacml-pdp-readiness Normal Started 32m kubelet, onap-k8s-1 Started container policy-xacml-pdp-readiness Normal Pulled 31m kubelet, onap-k8s-1 Container image "dibi/envsubst" already present on machine Normal Created 31m kubelet, onap-k8s-1 Created container policy-xacml-pdp-update-config Normal Started 31m kubelet, onap-k8s-1 Started container policy-xacml-pdp-update-config Normal Killing 31m kubelet, onap-k8s-1 Container policy-xacml-pdp failed liveness probe, will be restarted Normal Pulled 30m (x2 over 31m) kubelet, onap-k8s-1 Container image "192.168.240.251:10001/onap/policy-xacml-pdp:2.2.2" already present on machine Normal Created 30m (x2 over 31m) kubelet, onap-k8s-1 Created container policy-xacml-pdp Normal Started 30m (x2 over 31m) kubelet, onap-k8s-1 Started container policy-xacml-pdp Warning Unhealthy 27m (x10 over 31m) kubelet, onap-k8s-1 Liveness probe failed: dial tcp 10.42.3.32:6969: connect: connection refused Warning Unhealthy 12m (x52 over 31m) kubelet, onap-k8s-1 Readiness probe failed: dial tcp 10.42.3.32:6969: connect: connection refused Warning BackOff 2m31s (x72 over 22m) kubelet, onap-k8s-1 Back-off restarting failed container ------------------------------------------------------------------------------------------------------------------- #kubectl get services | grep 6969 drools ClusterIP 10.43.116.67 <none> 6969/TCP,9696/TCP 33m policy-apex-pdp ClusterIP 10.43.164.207 <none> 6969/TCP 33m policy-api ClusterIP 10.43.230.187 <none> 6969/TCP 33m policy-distribution ClusterIP 10.43.103.171 <none> 6969/TCP 33m policy-pap ClusterIP 10.43.5.127 <none> 6969/TCP 33m policy-xacml-pdp ClusterIP 10.43.202.177 <none> 6969/TCP 33m Regards , Nebi Volkan ÜNLENEN -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21388): https://lists.onap.org/g/onap-discuss/message/21388 Mute This Topic: https://lists.onap.org/mt/74937209/21656 Mute #oom: https://lists.onap.org/g/onap+onap-discuss/mutehashtag/oom Mute #frankfurt: https://lists.onap.org/g/onap+onap-discuss/mutehashtag/frankfurt Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-