Dec  8 03:40:38 xen-a cib: [31171]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.VAT4Hk (digest: /var/lib/heartbeat/crm/cib.N5gRKd)
Dec  8 03:43:21 xen-a cib: [728]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-9.raw
Dec  8 03:43:21 xen-a cib: [728]: info: write_cib_contents: Wrote version 0.106.0 of the CIB to disk (digest: fd7eedae4ee7f7202c5e8c4fbe191749)
Dec  8 03:43:21 xen-a cib: [728]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.RSnYq4 (digest: /var/lib/heartbeat/crm/cib.HV9nbs)
Dec  8 03:43:22 xen-a crmd: [29965]: info: do_lrm_rsc_op: Performing key=18:24:0:63e0f558-fb92-44a6-8958-5e912ed092ae op=base_stop_0 )
Dec  8 03:43:22 xen-a lrmd: [29962]: info: rsc:base:61: stop
Dec  8 03:43:22 xen-a crmd: [29965]: info: do_lrm_rsc_op: Performing key=21:24:0:63e0f558-fb92-44a6-8958-5e912ed092ae op=core-101_stop_0 )
Dec  8 03:43:22 xen-a lrmd: [29962]: info: rsc:core-101:62: stop
Dec  8 03:43:22 xen-a crmd: [29965]: info: do_lrm_rsc_op: Performing key=24:24:0:63e0f558-fb92-44a6-8958-5e912ed092ae op=core-200_stop_0 )
Dec  8 03:43:22 xen-a lrmd: [29962]: info: rsc:core-200:63: stop
Dec  8 03:43:22 xen-a crmd: [29965]: info: do_lrm_rsc_op: Performing key=27:24:0:63e0f558-fb92-44a6-8958-5e912ed092ae op=db_migrate_to_0 )
Dec  8 03:43:22 xen-a lrmd: [29962]: info: rsc:db:64: migrate_to
Dec  8 03:43:22 xen-a crmd: [29965]: info: do_lrm_rsc_op: Performing key=30:24:0:63e0f558-fb92-44a6-8958-5e912ed092ae op=sysadmin_stop_0 )
Dec  8 03:43:22 xen-a crmd: [29965]: info: do_lrm_rsc_op: Performing key=33:24:0:63e0f558-fb92-44a6-8958-5e912ed092ae op=edge_stop_0 )
Dec  8 03:43:22 xen-a crmd: [29965]: info: do_lrm_rsc_op: Performing key=36:24:0:63e0f558-fb92-44a6-8958-5e912ed092ae op=dbreplica_stop_0 )
Dec  8 03:43:22 xen-a crmd: [29965]: info: do_lrm_rsc_op: Performing key=39:24:0:63e0f558-fb92-44a6-8958-5e912ed092ae op=Email_Alerting_stop_0 )
Dec  8 03:43:22 xen-a crmd: [29965]: info: process_lrm_event: LRM operation base_monitor_10000 (call=60, status=1, cib-update=0, confirmed=true) Cancelled
Dec  8 03:43:22 xen-a crmd: [29965]: info: process_lrm_event: LRM operation core-101_monitor_10000 (call=52, status=1, cib-update=0, confirmed=true) Cancelled
Dec  8 03:43:22 xen-a crmd: [29965]: info: process_lrm_event: LRM operation core-200_monitor_10000 (call=54, status=1, cib-update=0, confirmed=true) Cancelled
Dec  8 03:43:22 xen-a crmd: [29965]: info: process_lrm_event: LRM operation db_monitor_10000 (call=48, status=1, cib-update=0, confirmed=true) Cancelled
Dec  8 03:43:22 xen-a crmd: [29965]: info: process_lrm_event: LRM operation sysadmin_monitor_10000 (call=56, status=1, cib-update=0, confirmed=true) Cancelled
Dec  8 03:43:22 xen-a crmd: [29965]: info: process_lrm_event: LRM operation edge_monitor_10000 (call=59, status=1, cib-update=0, confirmed=true) Cancelled
Dec  8 03:43:22 xen-a crmd: [29965]: info: process_lrm_event: LRM operation dbreplica_monitor_10000 (call=51, status=1, cib-update=0, confirmed=true) Cancelled
Dec  8 03:43:22 xen-a crmd: [29965]: info: process_lrm_event: LRM operation Email_Alerting_monitor_10000 (call=46, status=1, cib-update=0, confirmed=true) Cancelled
Dec  8 03:43:22 xen-a Xen[730]: INFO: Xen domain base will be stopped (timeout: 200s)
Dec  8 03:43:22 xen-a Xen[753]: INFO: Xen domain core-200 will be stopped (timeout: 200s)
Dec  8 03:43:23 xen-a Xen[743]: INFO: Xen domain core-101 will be stopped (timeout: 200s)
Dec  8 03:43:23 xen-a Xen[761]: INFO: db: Starting xm migrate to xen-b
Dec  8 03:43:35 xen-a logger: /etc/xen/scripts/vif-bridge: offline XENBUS_PATH=backend/vif/20/0
Dec  8 03:43:35 xen-a logger: /etc/xen/scripts/vif-bridge: offline XENBUS_PATH=backend/vif/23/1
Dec  8 03:43:36 xen-a logger: /etc/xen/scripts/vif-bridge: Successful vif-bridge offline for vif20.0, bridge br1.
Dec  8 03:43:36 xen-a logger: /etc/xen/scripts/vif-bridge: offline XENBUS_PATH=backend/vif/19/0
Dec  8 03:43:37 xen-a logger: /etc/xen/scripts/vif-bridge: Successful vif-bridge offline for vif23.1, bridge br1.
Dec  8 03:43:37 xen-a logger: /etc/xen/scripts/vif-bridge: offline XENBUS_PATH=backend/vif/23/0
Dec  8 03:43:38 xen-a logger: /etc/xen/scripts/vif-bridge: Successful vif-bridge offline for vif19.0, bridge br1.
Dec  8 03:43:38 xen-a logger: /etc/xen/scripts/vif-bridge: Successful vif-bridge offline for vif23.0, bridge br2.
Dec  8 03:43:39 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/23/51713
Dec  8 03:43:39 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vif/23/1
Dec  8 03:43:39 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/23/51714
Dec  8 03:43:39 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vif/23/0
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/console/20/0
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/23/51713
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/23/51714
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/20/51713
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/23/51713
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/23/51714
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vif/19/0
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/console/19/0
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/20/51714
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/20/51713
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/19/51714
Dec  8 03:43:40 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/console/23/0
Dec  8 03:43:41 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/19/51713
Dec  8 03:43:41 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/20/51714
Dec  8 03:43:41 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/19/51714
Dec  8 03:43:41 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vif/20/0
Dec  8 03:43:41 xen-a Xen[743]: INFO: Xen domain core-101 stopped.
Dec  8 03:43:41 xen-a crmd: [29965]: info: process_lrm_event: LRM operation core-101_stop_0 (call=62, rc=0, cib-update=75, confirmed=true) ok
Dec  8 03:43:41 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/20/51714
Dec  8 03:43:41 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/20/51713
Dec  8 03:43:41 xen-a Xen[753]: INFO: Xen domain core-200 stopped.
Dec  8 03:43:41 xen-a crmd: [29965]: info: process_lrm_event: LRM operation core-200_stop_0 (call=63, rc=0, cib-update=76, confirmed=true) ok
Dec  8 03:43:41 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/19/51714
Dec  8 03:43:41 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/19/51713
Dec  8 03:43:42 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/19/51713
Dec  8 03:43:42 xen-a Xen[730]: INFO: Xen domain base stopped.
Dec  8 03:43:42 xen-a crmd: [29965]: info: process_lrm_event: LRM operation base_stop_0 (call=61, rc=0, cib-update=77, confirmed=true) ok
Dec  8 03:43:42 xen-a lrmd: [29962]: info: rsc:sysadmin:65: stop
Dec  8 03:43:42 xen-a lrmd: [29962]: WARN: perform_ra_op: the operation operation stop[65] on ocf::Xen::sysadmin for client 29965, its parameters: xmfile=[/etc/xen/sysadmin.cfg] CRM_meta_timeout=[300000] name=[sysadmin] crm_feature_set=[3.0.1] CRM_meta_name=[stop]  stayed in operation list for 20010 ms (longer than 10000 ms)
Dec  8 03:43:42 xen-a lrmd: [29962]: info: rsc:edge:66: stop
Dec  8 03:43:42 xen-a lrmd: [29962]: WARN: perform_ra_op: the operation operation stop[66] on ocf::Xen::edge for client 29965, its parameters: xmfile=[/etc/xen/edge.cfg] CRM_meta_timeout=[300000] name=[edge] crm_feature_set=[3.0.1] CRM_meta_name=[stop]  stayed in operation list for 20020 ms (longer than 10000 ms)
Dec  8 03:43:42 xen-a lrmd: [29962]: info: rsc:dbreplica:67: stop
Dec  8 03:43:42 xen-a lrmd: [29962]: WARN: perform_ra_op: the operation operation stop[67] on ocf::Xen::dbreplica for client 29965, its parameters: xmfile=[/etc/xen/dbreplica.cfg] CRM_meta_timeout=[300000] name=[dbreplica] crm_feature_set=[3.0.1] CRM_meta_name=[stop]  stayed in operation list for 20030 ms (longer than 10000 ms)
Dec  8 03:43:42 xen-a Xen[2435]: INFO: Xen domain sysadmin will be stopped (timeout: 200s)
Dec  8 03:43:42 xen-a Xen[2447]: INFO: Xen domain dbreplica will be stopped (timeout: 200s)
Dec  8 03:43:43 xen-a Xen[2437]: INFO: Xen domain edge will be stopped (timeout: 200s)
Dec  8 03:43:50 xen-a logger: /etc/xen/scripts/vif-bridge: offline XENBUS_PATH=backend/vif/18/0
Dec  8 03:43:51 xen-a logger: /etc/xen/scripts/vif-bridge: Successful vif-bridge offline for vif18.0, bridge br1.
Dec  8 03:43:51 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/console/18/0
Dec  8 03:43:51 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/18/51713
Dec  8 03:43:51 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vif/18/0
Dec  8 03:43:51 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/18/51714
Dec  8 03:43:51 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/18/51714
Dec  8 03:43:51 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/18/51714
Dec  8 03:43:51 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/18/51713
Dec  8 03:43:51 xen-a Xen[2447]: INFO: Xen domain dbreplica stopped.
Dec  8 03:43:51 xen-a crmd: [29965]: info: process_lrm_event: LRM operation dbreplica_stop_0 (call=67, rc=0, cib-update=78, confirmed=true) ok
Dec  8 03:43:51 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/18/51713
Dec  8 03:43:52 xen-a lrmd: [29962]: info: rsc:Email_Alerting:68: stop
Dec  8 03:43:52 xen-a lrmd: [29962]: WARN: perform_ra_op: the operation operation stop[68] on ocf::MailTo::Email_Alerting for client 29965, its parameters: CRM_meta_timeout=[20000] email=[gerben@daybyday.nl] crm_feature_set=[3.0.1]  stayed in operation list for 30050 ms (longer than 10000 ms)
Dec  8 03:43:52 xen-a crmd: [29965]: info: process_lrm_event: LRM operation Email_Alerting_stop_0 (call=68, rc=0, cib-update=79, confirmed=true) ok
Dec  8 03:43:56 xen-a logger: /etc/xen/scripts/vif-bridge: offline XENBUS_PATH=backend/vif/22/0
Dec  8 03:43:56 xen-a logger: /etc/xen/scripts/vif-bridge: Successful vif-bridge offline for vif22.0, bridge br2.
Dec  8 03:43:56 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/22/51714
Dec  8 03:43:56 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vif/22/0
Dec  8 03:43:56 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/22/51714
Dec  8 03:43:56 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/console/22/0
Dec  8 03:43:56 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/22/51714
Dec  8 03:43:56 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/22/51713
Dec  8 03:43:57 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/22/51713
Dec  8 03:43:57 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/22/51713
Dec  8 03:43:57 xen-a Xen[2437]: INFO: Xen domain edge stopped.
Dec  8 03:43:57 xen-a crmd: [29965]: info: process_lrm_event: LRM operation edge_stop_0 (call=66, rc=0, cib-update=80, confirmed=true) ok
Dec  8 03:44:10 xen-a logger: /etc/xen/scripts/vif-bridge: offline XENBUS_PATH=backend/vif/21/0
Dec  8 03:44:11 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/console/21/0
Dec  8 03:44:11 xen-a logger: /etc/xen/scripts/vif-bridge: Successful vif-bridge offline for vif21.0, bridge br1.
Dec  8 03:44:11 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/21/51713
Dec  8 03:44:11 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vif/21/0
Dec  8 03:44:11 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/21/51714
Dec  8 03:44:11 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/21/51713
Dec  8 03:44:11 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/21/51714
Dec  8 03:44:11 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/21/51713
Dec  8 03:44:11 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/21/51714
Dec  8 03:44:11 xen-a Xen[2435]: INFO: Xen domain sysadmin stopped.
Dec  8 03:44:11 xen-a crmd: [29965]: info: process_lrm_event: LRM operation sysadmin_stop_0 (call=65, rc=0, cib-update=81, confirmed=true) ok
Dec  8 03:44:17 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/17/51729
Dec  8 03:44:17 xen-a logger: /etc/xen/scripts/vif-bridge: offline XENBUS_PATH=backend/vif/17/0
Dec  8 03:44:17 xen-a Xen[761]: INFO: db: xm migrate to xen-b succeeded.
Dec  8 03:44:17 xen-a crmd: [29965]: info: process_lrm_event: LRM operation db_migrate_to_0 (call=64, rc=0, cib-update=82, confirmed=true) ok
Dec  8 03:44:17 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/17/51729
Dec  8 03:44:17 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/17/51729
Dec  8 03:44:17 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/console/17/0
Dec  8 03:44:17 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/17/51713
Dec  8 03:44:17 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/17/51713
Dec  8 03:44:17 xen-a logger: /etc/xen/scripts/vif-bridge: Successful vif-bridge offline for vif17.0, bridge br1.
Dec  8 03:44:18 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vif/17/0
Dec  8 03:44:18 xen-a logger: /etc/xen/scripts/block: remove XENBUS_PATH=backend/vbd/17/51714
Dec  8 03:44:18 xen-a logger: /etc/xen/scripts/block-drbd: remove XENBUS_PATH=backend/vbd/17/51714
Dec  8 03:44:18 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/17/51713
Dec  8 03:44:18 xen-a logger: /etc/xen/scripts/xen-hotplug-cleanup: XENBUS_PATH=backend/vbd/17/51714
Dec  8 03:44:19 xen-a crmd: [29965]: info: do_lrm_rsc_op: Performing key=17:24:0:63e0f558-fb92-44a6-8958-5e912ed092ae op=xen-b-fencing_stop_0 )
Dec  8 03:44:19 xen-a lrmd: [29962]: info: rsc:xen-b-fencing:69: stop
Dec  8 03:44:19 xen-a crmd: [29965]: info: process_lrm_event: LRM operation xen-b-fencing_monitor_60000 (call=41, status=1, cib-update=0, confirmed=true) Cancelled
Dec  8 03:44:19 xen-a lrmd: [4271]: info: Try to stop STONITH resource <rsc_id=xen-b-fencing> : Device=external/ipmi
Dec  8 03:44:19 xen-a crmd: [29965]: info: process_lrm_event: LRM operation xen-b-fencing_stop_0 (call=69, rc=0, cib-update=83, confirmed=true) ok
Dec  8 03:45:03 xen-a root: Mark:HB_REPORT:1260240303
