Hi All
We tried to bounce the failed SDNC PODs the same behaviour exists. I am
attaching herewith is the logs for *dev-sdnc-controller-blueprints* &
*sdnc-controller-blueprints-db-0* for your reference.
Could someone throw some pointers to debug this one would be of great
Thanks & Regards
Vivek
*POD sdnc-controller-blueprints-db-0 Log snippet from *
2019-03-05 13:41:07 140693469132544 [Note] InnoDB: Dumping buffer pool(s)
not yet started
2019-03-05 13:41:07 140694477551872 [Note] Plugin 'FEEDBACK' is disabled.
2019-03-05 13:41:07 140694477551872 [Note] Server socket created on IP:
'0.0.0.0'.
2019-03-05 13:41:08 140694477551872 [Note] mysqld: ready for connections.
Version: '10.1.24-MariaDB' socket: '/var/lib/mysql/mysql.sock' port:
3306 MariaDB Server
2019-03-05 13:41:08 140694476184320 [Note] WSREP: wsrep_notify_cmd is not
defined, skipping notification.
2019-03-05 13:41:08 140694476184320 [Note] WSREP: REPL Protocols: 7 (3, 2)
2019-03-05 13:41:08 140694476184320 [Note] WSREP: Assign initial position
for certification: 0, protocol version: 3
2019-03-05 13:41:08 140694211520256 [Note] WSREP: Service thread queue
flushed.
2019-03-05 13:41:08 140694476184320 [Note] WSREP: Synchronized with group,
ready for connections
2019-03-05 13:41:08 140694476184320 [Note] WSREP: wsrep_notify_cmd is not
defined, skipping notification.
On Sun, Mar 3, 2019 at 4:10 PM Vivekanandan Muthukrishnan via Lists.Onap.Org
<[email protected]> wrote:
> Hi All,
>
> We deployed ONAP Casablanca and we see that SDNC health check is failing
> for dev-sdnc-controller-blueprints-db-0.
>
> Kindly note that all SNDC PODs came up except sdnc-controller-blueprints
> and sdnc-controller-blueprints-db-0.
>
> Did any one face this issue? Please let me know, If you have any
> workaround for this one.
>
> Regards
> Vivek
>
> $ kubectl describe pod -n onap dev-sdnc-controller-blueprints-db-0
> Events:
> Type Reason Age From Message
> ---- ------ ---- ---- -------
> Warning Unhealthy 1m (x680 over 1h) kubelet, casablanca02 Readiness
> probe failed: ERROR 1045 (28000): Access denied for user
> 'readinessProbe'@'localhost'
> (using password: YES)
>
>
>
> $ kubectl get pods -n onap | grep sdnc
> dev-sdnc-controller-blueprints-54dc68ddcd-76vjz 0/1
> Init:0/1 7 1h
> dev-sdnc-controller-blueprints-db-0 0/1
> Running 1 1h
> dev-sdnc-nengdb-0 1/1
> Running 4 1h
> dev-sdnc-network-name-gen-64fbd6cdfb-gxc7w 1/1
> Running 0 1h
> dev-sdnc-sdnc-0 2/2
> Running 0 1h
> dev-sdnc-sdnc-ansible-server-7fc98c97f4-64wfv 1/1
> Running 0 1h
> dev-sdnc-sdnc-db-0 2/2
> Running 0 1h
> dev-sdnc-sdnc-dgbuilder-754b86c668-jnj9v 1/1
> Running 0 1h
> dev-sdnc-sdnc-dmaap-listener-75f6b78686-ckkgx 1/1
> Running 0 1h
> dev-sdnc-sdnc-portal-794556b78d-72wmf 1/1
> Running 0 1h
> dev-sdnc-sdnc-ueb-listener-857dffb89b-khqzl 1/1
> Running 2 1h
> dev-so-so-sdnc-adapter-568b59d568-nrx94 1/1
> Running 0 1h
> dev-vfc-vfc-zte-sdnc-driver-dbcf67f5b-z658s 1/1
> Running 0 1h
>
>
>
>
>
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#15871): https://lists.onap.org/g/onap-discuss/message/15871
Mute This Topic: https://lists.onap.org/mt/30194482/21656
Group Owner: [email protected]
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-
$ kubectl describe pod -n onap dev-sdnc-controller-blueprints-54dc68ddcd-5mn44
Name: dev-sdnc-controller-blueprints-54dc68ddcd-5mn44
Namespace: onap
Node: casablanca02/192.168.122.232
Start Time: Tue, 05 Mar 2019 13:39:56 +0000
Labels: app=controller-blueprints
pod-template-hash=1087248878
release=dev-sdnc
Annotations: <none>
Status: Pending
IP: 10.42.97.178
Controlled By: ReplicaSet/dev-sdnc-controller-blueprints-54dc68ddcd
Init Containers:
controller-blueprints-readiness:
Container ID:
docker://90bfada0844e3c424ce1b0037a82b62dfd9ff1b8ccfb100710467ec24d325d3e
Image: oomk8s/readiness-check:2.0.0
Image ID:
docker://sha256:867cb038e1d2445a6e5aedc3b5f970dacc8249ab119d6c2e088e10df886ff51f
Port: <none>
Host Port: <none>
Command:
/root/ready.py
Args:
--container-name
controller-blueprints-db
State: Running
Started: Tue, 05 Mar 2019 13:40:02 +0000
Ready: False
Restart Count: 0
Environment:
NAMESPACE: onap (v1:metadata.namespace)
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from default-token-lw9wt
(ro)
Containers:
controller-blueprints:
Container ID:
Image: nexus3.onap.org:10001/onap/ccsdk-controllerblueprints:0.3.3
Image ID:
Port: 8080/TCP
Host Port: 0/TCP
State: Waiting
Reason: PodInitializing
Ready: False
Restart Count: 0
Liveness: tcp-socket :8080 delay=10s timeout=1s period=10s #success=1
#failure=3
Readiness: tcp-socket :8080 delay=10s timeout=1s period=10s #success=1
#failure=3
Environment:
APPLICATIONNAME: ControllerBluePrints
BUNDLEVERSION: 1.0.0
APP_CONFIG_HOME: /opt/app/onap/config
DB_URL: jdbc:mysql://controller-blueprints-db:3306/sdnctl
DB_USER: sdnctl
DB_PASSWORD: <set to the key 'db-root-password' in secret
'dev-sdnc-controller-blueprints'> Optional: false
MS_USER: <set to the key 'restUser' in secret
'dev-sdnc-controller-blueprints'> Optional: false
MS_PASSWORD: <set to the key 'restPassword' in secret
'dev-sdnc-controller-blueprints'> Optional: false
INIT_DATA_LOAD: true
STICKYSELECTORKEY:
ENVCONTEXT: DEV
Mounts:
/etc/localtime from localtime (ro)
/opt/app/onap/config/application.properties from
dev-sdnc-controller-blueprints-config (rw)
/opt/app/onap/config/logback.xml from
dev-sdnc-controller-blueprints-config (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-lw9wt
(ro)
Conditions:
Type Status
Initialized False
Ready False
ContainersReady False
PodScheduled True
Volumes:
localtime:
Type: HostPath (bare host directory volume)
Path: /etc/localtime
HostPathType:
dev-sdnc-controller-blueprints-config:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: dev-sdnc-controller-blueprints-configmap
Optional: false
default-token-lw9wt:
Type: Secret (a volume populated by a Secret)
SecretName: default-token-lw9wt
Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m default-scheduler Successfully assigned
onap/dev-sdnc-controller-blueprints-54dc68ddcd-5mn44 to casablanca02
Normal Pulled 9m kubelet, casablanca02 Container image
"oomk8s/readiness-check:2.0.0" already present on machine
Normal Created 9m kubelet, casablanca02 Created container
Normal Started 9m kubelet, casablanca02 Started container
=== logs ===
aarna@casablanca01:~/ONAP_Kubernetes/oom/kubernetes$ kubectl logs -n onap
dev-sdnc-controller-blueprints-db-0
+ CONTAINER_SCRIPTS_DIR=/usr/share/container-scripts/mysql
+ EXTRA_DEFAULTS_FILE=/etc/my.cnf.d/galera.cnf
Galera: Finding peers
+ '[' -z onap ']'
+ echo 'Galera: Finding peers'
++ cut -d. -f2
++ hostname -f
+ K8S_SVC_NAME=controller-blueprints-db
+ echo 'Using service name: controller-blueprints-db'
+ cp /usr/share/container-scripts/mysql/galera.cnf /etc/my.cnf.d/galera.cnf
Using service name: controller-blueprints-db
+ /usr/bin/peer-finder
-on-start=/usr/share/container-scripts/mysql/configure-galera.sh
-service=controller-blueprints-db
2019/03/05 13:41:05 Peer list updated
was []
now
[dev-sdnc-controller-blueprints-db-0.controller-blueprints-db.onap.svc.cluster.local]
2019/03/05 13:41:05 execing:
/usr/share/container-scripts/mysql/configure-galera.sh with stdin:
dev-sdnc-controller-blueprints-db-0.controller-blueprints-db.onap.svc.cluster.local
2019/03/05 13:41:05
2019/03/05 13:41:06 Peer finder exiting
+ '[' '!' -d /var/lib/mysql/mysql ']'
+ exec mysqld
2019-03-05 13:41:07 140694477551872 [Note] mysqld (mysqld 10.1.24-MariaDB)
starting as process 1 ...
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Read nil XID from storage
engines, skipping position init
2019-03-05 13:41:07 140694477551872 [Note] WSREP: wsrep_load(): loading
provider library '/usr/lib64/galera/libgalera_smm.so'
2019-03-05 13:41:07 140694477551872 [Note] WSREP: wsrep_load(): Galera
25.3.20(r3703) by Codership Oy <[email protected]> loaded successfully.
2019-03-05 13:41:07 140694477551872 [Note] WSREP: CRC-32C: using hardware
acceleration.
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Found saved state:
03cb89b0-3d90-11e9-a1a2-d2703012ca4c:0, safe_to_bootsrap: 1
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Passing config to GCS:
base_dir = /var/lib/mysql/; base_host =
dev-sdnc-controller-blueprints-db-0.controller-blueprints-db.onap.svc.cluster.local;
base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0;
evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S;
evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S;
evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window =
4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S;
evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir =
/var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name =
/var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no;
gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor =
1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500;
gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807;
gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gm
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Assign initial position for
certification: 0, protocol version: -1
2019-03-05 13:41:07 140694477551872 [Note] WSREP: wsrep_sst_grab()
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Start replication
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Setting initial position to
03cb89b0-3d90-11e9-a1a2-d2703012ca4c:0
2019-03-05 13:41:07 140694477551872 [Note] WSREP: protonet asio version 0
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Using CRC-32C for message
checksums.
2019-03-05 13:41:07 140694477551872 [Note] WSREP: backend: asio
2019-03-05 13:41:07 140694477551872 [Note] WSREP: gcomm thread scheduling
priority set to other:0
2019-03-05 13:41:07 140694477551872 [Warning] WSREP: access
file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory)
2019-03-05 13:41:07 140694477551872 [Note] WSREP: restore pc from disk failed
2019-03-05 13:41:07 140694477551872 [Note] WSREP: GMCast version 0
2019-03-05 13:41:07 140694477551872 [Note] WSREP: (542456b7,
'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2019-03-05 13:41:07 140694477551872 [Note] WSREP: (542456b7,
'tcp://0.0.0.0:4567') multicast: , ttl: 1
2019-03-05 13:41:07 140694477551872 [Note] WSREP: EVS version 0
2019-03-05 13:41:07 140694477551872 [Note] WSREP: gcomm: connecting to group
'controller-blueprints-db', peer ''
2019-03-05 13:41:07 140694477551872 [Note] WSREP: start_prim is enabled, turn
off pc_recovery
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Node 542456b7 state prim
2019-03-05 13:41:07 140694477551872 [Note] WSREP: view(view_id(PRIM,542456b7,1)
memb {
542456b7,0
} joined {
} left {
} partitioned {
})
2019-03-05 13:41:07 140694477551872 [Note] WSREP: save pc into disk
2019-03-05 13:41:07 140694477551872 [Note] WSREP: gcomm: connected
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Changing maximum packet size
to 64500, resulting msg size: 32636
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Shifting CLOSED -> OPEN (TO:
0)
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Opened channel
'controller-blueprints-db'
2019-03-05 13:41:07 140694477551872 [Note] WSREP: Waiting for SST to complete.
2019-03-05 13:41:07 140694152800000 [Note] WSREP: New COMPONENT: primary = yes,
bootstrap = no, my_idx = 0, memb_num = 1
2019-03-05 13:41:07 140694152800000 [Note] WSREP: STATE_EXCHANGE: sent state
UUID: 542b72f8-3f4c-11e9-b27c-a6996bdab86c
2019-03-05 13:41:07 140694152800000 [Note] WSREP: STATE EXCHANGE: sent state
msg: 542b72f8-3f4c-11e9-b27c-a6996bdab86c
2019-03-05 13:41:07 140694152800000 [Note] WSREP: STATE EXCHANGE: got state
msg: 542b72f8-3f4c-11e9-b27c-a6996bdab86c from 0
(dev-sdnc-controller-blueprints-db-0)
2019-03-05 13:41:07 140694152800000 [Note] WSREP: Quorum results:
version = 4,
component = PRIMARY,
conf_id = 0,
members = 1/1 (joined/total),
act_id = 0,
last_appl. = -1,
protocols = 0/7/3 (gcs/repl/appl),
group UUID = 03cb89b0-3d90-11e9-a1a2-d2703012ca4c
2019-03-05 13:41:07 140694152800000 [Note] WSREP: Flow-control interval: [16,
16]
2019-03-05 13:41:07 140694152800000 [Note] WSREP: Restored state OPEN -> JOINED
(0)
2019-03-05 13:41:07 140694152800000 [Note] WSREP: Member 0.0
(dev-sdnc-controller-blueprints-db-0) synced with group.
2019-03-05 13:41:07 140694152800000 [Note] WSREP: Shifting JOINED -> SYNCED
(TO: 0)
2019-03-05 13:41:07 140694476184320 [Note] WSREP: New cluster view: global
state: 03cb89b0-3d90-11e9-a1a2-d2703012ca4c:0, view# 1: Primary, number of
nodes: 1, my index: 0, protocol version 3
2019-03-05 13:41:07 140694477551872 [Note] WSREP: SST complete, seqno: 0
2019-03-05 13:41:07 140694477551872 [Note] InnoDB:
innodb_empty_free_list_algorithm has been changed to legacy because of small
buffer pool size. In order to use backoff, increase buffer pool at least up to
20MB.
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: Using mutexes to ref count
buffer pool pages
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: The InnoDB memory heap is
disabled
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: Mutexes and rw_locks use GCC
atomic builtins
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: GCC builtin
__atomic_thread_fence() is used for memory barrier
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: Compressed tables use zlib
1.2.7
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: Using Linux native AIO
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: Using SSE crc32 instructions
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: Initializing buffer pool,
size = 128.0M
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: Completed initialization of
buffer pool
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: Highest supported file
format is Barracuda.
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: 128 rollback segment(s) are
active.
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: Waiting for purge to start
2019-03-05 13:41:07 140694477551872 [Note] InnoDB: Percona XtraDB
(http://www.percona.com) 5.6.36-82.0 started; log sequence number 1617009
2019-03-05 13:41:07 140693469132544 [Note] InnoDB: Dumping buffer pool(s) not
yet started
2019-03-05 13:41:07 140694477551872 [Note] Plugin 'FEEDBACK' is disabled.
2019-03-05 13:41:07 140694477551872 [Note] Server socket created on IP:
'0.0.0.0'.
2019-03-05 13:41:08 140694477551872 [Note] mysqld: ready for connections.
Version: '10.1.24-MariaDB' socket: '/var/lib/mysql/mysql.sock' port: 3306
MariaDB Server
2019-03-05 13:41:08 140694476184320 [Note] WSREP: wsrep_notify_cmd is not
defined, skipping notification.
2019-03-05 13:41:08 140694476184320 [Note] WSREP: REPL Protocols: 7 (3, 2)
2019-03-05 13:41:08 140694476184320 [Note] WSREP: Assign initial position for
certification: 0, protocol version: 3
2019-03-05 13:41:08 140694211520256 [Note] WSREP: Service thread queue flushed.
2019-03-05 13:41:08 140694476184320 [Note] WSREP: Synchronized with group,
ready for connections
2019-03-05 13:41:08 140694476184320 [Note] WSREP: wsrep_notify_cmd is not
defined, skipping notification.
$ kubectl get pods -n onap | grep sdnc
dev-sdnc-controller-blueprints-54dc68ddcd-5mn44 0/1
Init:0/1 0 8m
dev-sdnc-controller-blueprints-db-0 0/1 Running
0 7m
dev-sdnc-nengdb-0 1/1 Running
4 2d
dev-sdnc-network-name-gen-64fbd6cdfb-gxc7w 1/1 Running
0 2d
dev-sdnc-sdnc-0 2/2 Running
0 2d
dev-sdnc-sdnc-ansible-server-7fc98c97f4-64wfv 1/1 Running
0 2d
dev-sdnc-sdnc-db-0 2/2 Running
0 2d
dev-sdnc-sdnc-dgbuilder-754b86c668-jnj9v 1/1 Running
0 2d
dev-sdnc-sdnc-dmaap-listener-75f6b78686-ckkgx 1/1 Running
0 2d
dev-sdnc-sdnc-portal-794556b78d-72wmf 1/1 Running
0 2d
dev-sdnc-sdnc-ueb-listener-857dffb89b-khqzl 1/1 Running
2 2d
dev-so-so-sdnc-adapter-54947779dc-g59v8 1/1 Running
0 1d
dev-vfc-vfc-zte-sdnc-driver-dbcf67f5b-z658s 1/1 Running
0 2d
$ kubectl describe pod -n onap dev-sdnc-controller-blueprints-db-0
Name: dev-sdnc-controller-blueprints-db-0
Namespace: onap
Node: casablanca03/192.168.122.233
Start Time: Tue, 05 Mar 2019 13:40:51 +0000
Labels: app=dev-sdnc-controller-blueprints-db
controller-revision-hash=dev-sdnc-controller-blueprints-db-55b98d484d
statefulset.kubernetes.io/pod-name=dev-sdnc-controller-blueprints-db-0
Annotations: pod.alpha.kubernetes.io/initialized=true
Status: Running
IP: 10.42.117.91
Controlled By: StatefulSet/dev-sdnc-controller-blueprints-db
Init Containers:
mariadb-galera-prepare:
Container ID:
docker://fcdd48752756f348b85adf7e4c1198779e8d5fe274069e6bbd44bc15e120c73a
Image: nexus3.onap.org:10001/busybox
Image ID:
docker-pullable://nexus3.onap.org:10001/busybox@sha256:4415a904b1aca178c2450fd54928ab362825e863c0ad5452fd020e92f7a6a47e
Port: <none>
Host Port: <none>
Command:
sh
-c
chown -R 27:27 /var/lib/mysql
State: Terminated
Reason: Completed
Exit Code: 0
Started: Tue, 05 Mar 2019 13:41:01 +0000
Finished: Tue, 05 Mar 2019 13:41:02 +0000
Ready: True
Restart Count: 0
Environment: <none>
Mounts:
/var/lib/mysql from dev-sdnc-controller-blueprints-db-data (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-lw9wt
(ro)
Containers:
controller-blueprints-db:
Container ID:
docker://edb9ceedee472e3a30e8eda741453a61043c56aa12a741056fab9faba35b2417
Image:
nexus3.onap.org:10001/adfinissygroup/k8s-mariadb-galera-centos:v002
Image ID:
docker://sha256:51d21fcdb9f2f3d90c02f744c4dfcd7fa8b511dc49a604fc03459297a6dacde4
Ports: 3306/TCP, 4444/TCP, 4567/TCP, 4568/TCP
Host Ports: 0/TCP, 0/TCP, 0/TCP, 0/TCP
State: Running
Started: Tue, 05 Mar 2019 13:41:05 +0000
Ready: False
Restart Count: 0
Liveness: exec [mysqladmin ping] delay=30s timeout=5s period=10s
#success=1 #failure=3
Readiness: exec
[/usr/share/container-scripts/mysql/readiness-probe.sh] delay=15s timeout=1s
period=10s #success=1 #failure=3
Environment:
POD_NAMESPACE: onap (v1:metadata.namespace)
MYSQL_USER: sdnctl
MYSQL_PASSWORD: <set to the key 'user-password' in secret
'dev-sdnc-controller-blueprints-db'> Optional: false
MYSQL_DATABASE: sdnctl
MYSQL_ROOT_PASSWORD: <set to the key 'db-root-password' in secret
'dev-sdnc-controller-blueprints-db'> Optional: false
Mounts:
/etc/localtime from localtime (ro)
/var/lib/mysql from dev-sdnc-controller-blueprints-db-data (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-lw9wt
(ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
dev-sdnc-controller-blueprints-db-data:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim
in the same namespace)
ClaimName:
dev-sdnc-controller-blueprints-db-data-dev-sdnc-controller-blueprints-db-0
ReadOnly: false
localtime:
Type: HostPath (bare host directory volume)
Path: /etc/localtime
HostPathType:
default-token-lw9wt:
Type: Secret (a volume populated by a Secret)
SecretName: default-token-lw9wt
Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 7m default-scheduler Successfully
assigned onap/dev-sdnc-controller-blueprints-db-0 to casablanca03
Normal Pulling 7m kubelet, casablanca03 pulling image
"nexus3.onap.org:10001/busybox"
Normal Pulled 7m kubelet, casablanca03 Successfully
pulled image "nexus3.onap.org:10001/busybox"
Normal Created 7m kubelet, casablanca03 Created container
Normal Started 7m kubelet, casablanca03 Started container
Normal Pulled 7m kubelet, casablanca03 Container image
"nexus3.onap.org:10001/adfinissygroup/k8s-mariadb-galera-centos:v002" already
present on machine
Normal Created 7m kubelet, casablanca03 Created container
Normal Started 7m kubelet, casablanca03 Started container
Warning Unhealthy 2m (x29 over 7m) kubelet, casablanca03 Readiness probe
failed: ERROR 1045 (28000): Access denied for user 'readinessProbe'@'localhost'
(using password: YES)
