May 19 10:50:57 ldirector1 crmd: [3398]: notice: crmd_ha_status_callback: Status update: Node ldirector2 now has status [init]
May 19 10:50:57 ldirector1 cib: [3394]: info: cib_client_status_callback: Status update: Client ldirector2/cib now has status [join]
May 19 10:51:02 ldirector1 crmd: [3398]: notice: crmd_ha_status_callback: Status update: Node ldirector2 now has status [up]
May 19 10:51:02 ldirector1 crmd: [3398]: notice: crmd_ha_status_callback: Status update: Node ldirector2 now has status [active]
May 19 10:51:02 ldirector1 crmd: [3398]: notice: crmd_client_status_callback: Status update: Client ldirector2/crmd now has status [online]
May 19 10:51:02 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:02 ldirector1 haclient: on_event: from message queue: evt:cib_changed
May 19 10:51:03 ldirector1 ccm: [3393]: debug: quorum plugin: majority
May 19 10:51:03 ldirector1 ccm: [3393]: debug: cluster:linux-ha, member_count=2, member_quorum_votes=200
May 19 10:51:03 ldirector1 ccm: [3393]: debug: total_node_count=2, total_quorum_votes=200
May 19 10:51:03 ldirector1 cib: [3394]: info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm
May 19 10:51:03 ldirector1 cib: [3394]: info: mem_handle_event: no mbr_track info
May 19 10:51:03 ldirector1 cib: [3394]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
May 19 10:51:03 ldirector1 cib: [3394]: info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4
May 19 10:51:03 ldirector1 cib: [3394]: info: cib_ccm_msg_callback: PEER: ldirector1
May 19 10:51:03 ldirector1 cib: [3394]: info: cib_ccm_msg_callback: PEER: ldirector2
May 19 10:51:03 ldirector1 crmd: [3398]: info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm
May 19 10:51:03 ldirector1 crmd: [3398]: info: mem_handle_event: no mbr_track info
May 19 10:51:03 ldirector1 crmd: [3398]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
May 19 10:51:03 ldirector1 crmd: [3398]: info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4
May 19 10:51:03 ldirector1 crmd: [3398]: info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2)
May 19 10:51:03 ldirector1 crmd: [3398]: info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=1, lost=0 n_idx=0, new_idx=2, old_idx=4
May 19 10:51:03 ldirector1 crmd: [3398]: info: ccm_event_detail: 	CURRENT: ldirector1 [nodeid=0, born=1]
May 19 10:51:03 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:03 ldirector1 crmd: [3398]: info: ccm_event_detail: 	CURRENT: ldirector2 [nodeid=1, born=2]
May 19 10:51:03 ldirector1 crmd: [3398]: info: ccm_event_detail: 	NEW:     ldirector2 [nodeid=1, born=2]
May 19 10:51:06 ldirector1 crmd: [3398]: info: do_state_transition: State transition S_IDLE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_HA_MESSAGE origin=route_message ]
May 19 10:51:06 ldirector1 crmd: [3398]: info: update_dc: Unset DC ldirector1
May 19 10:51:06 ldirector1 crmd: [3398]: info: join_make_offer: Making join offers based on membership 2
May 19 10:51:06 ldirector1 crmd: [3398]: info: do_dc_join_offer_all: join-2: Waiting on 2 outstanding join acks
May 19 10:51:06 ldirector1 tengine: [3470]: info: update_abort_priority: Abort priority upgraded to 1000000
May 19 10:51:07 ldirector1 crmd: [3398]: info: update_dc: Set DC to ldirector1 (2.0)
May 19 10:51:07 ldirector1 crmd: [3398]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
May 19 10:51:07 ldirector1 crmd: [3398]: info: do_state_transition: All 2 cluster nodes responded to the join offer.
May 19 10:51:07 ldirector1 cib: [3394]: info: sync_our_cib: Syncing CIB to all peers
May 19 10:51:07 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:07 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:07 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:07 ldirector1 attrd: [3397]: info: attrd_local_callback: Sending full refresh
May 19 10:51:08 ldirector1 crmd: [3398]: info: update_dc: Set DC to ldirector1 (2.0)
May 19 10:51:08 ldirector1 crmd: [3398]: info: do_dc_join_ack: join-2: Updating node state to member for ldirector1
May 19 10:51:08 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:09 ldirector1 cib: [3394]: info: sync_our_cib: Syncing CIB to ldirector2
May 19 10:51:09 ldirector1 crmd: [3398]: info: do_dc_join_ack: join-2: Updating node state to member for ldirector2
May 19 10:51:09 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:09 ldirector1 crmd: [3398]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
May 19 10:51:09 ldirector1 crmd: [3398]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 19 10:51:09 ldirector1 pengine: [3471]: info: determine_online_status: Node ldirector1 is online
May 19 10:51:09 ldirector1 pengine: [3471]: info: determine_online_status: Node ldirector2 is online
May 19 10:51:09 ldirector1 pengine: [3471]: notice: group_print: Resource Group: load_balancer
May 19 10:51:09 ldirector1 pengine: [3471]: notice: native_print:     vip	(ocf::heartbeat:IPaddr2):	Started ldirector1
May 19 10:51:09 ldirector1 pengine: [3471]: notice: native_print:     ldirector	(ocf::heartbeat:ldirectord):	Started ldirector1
May 19 10:51:09 ldirector1 pengine: [3471]: notice: clone_print: Clone Set: stonith_group
May 19 10:51:09 ldirector1 pengine: [3471]: notice: native_print:     stonith:0	(stonith:external/ssh):	Started ldirector1
May 19 10:51:09 ldirector1 pengine: [3471]: notice: native_print:     stonith:1	(stonith:external/ssh):	Stopped 
May 19 10:51:09 ldirector1 pengine: [3471]: notice: NoRoleChange: Leave resource vip	(ldirector1)
May 19 10:51:09 ldirector1 pengine: [3471]: notice: NoRoleChange: Leave resource ldirector	(ldirector1)
May 19 10:51:09 ldirector1 pengine: [3471]: notice: NoRoleChange: Leave resource stonith:0	(ldirector1)
May 19 10:51:09 ldirector1 pengine: [3471]: notice: StartRsc:  ldirector2	Start stonith:1
May 19 10:51:09 ldirector1 crmd: [3398]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
May 19 10:51:09 ldirector1 tengine: [3470]: info: unpack_graph: Unpacked transition 2: 9 actions in 9 synapses
May 19 10:51:09 ldirector1 tengine: [3470]: info: send_rsc_command: Initiating action 6: vip_monitor_0 on ldirector2
May 19 10:51:09 ldirector1 tengine: [3470]: info: send_rsc_command: Initiating action 7: ldirector_monitor_0 on ldirector2
May 19 10:51:09 ldirector1 tengine: [3470]: info: send_rsc_command: Initiating action 8: stonith:0_monitor_0 on ldirector2
May 19 10:51:09 ldirector1 tengine: [3470]: info: send_rsc_command: Initiating action 9: stonith:1_monitor_0 on ldirector2
May 19 10:51:09 ldirector1 pengine: [3471]: info: process_pe_message: Transition 2: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-116.bz2
May 19 10:51:11 ldirector1 tengine: [3470]: info: match_graph_event: Action stonith:0_monitor_0 (8) confirmed on ldirector2 (rc=0)
May 19 10:51:11 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:11 ldirector1 tengine: [3470]: info: match_graph_event: Action stonith:1_monitor_0 (9) confirmed on ldirector2 (rc=0)
May 19 10:51:11 ldirector1 tengine: [3470]: info: match_graph_event: Action vip_monitor_0 (6) confirmed on ldirector2 (rc=0)
May 19 10:51:11 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:11 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:11 ldirector1 tengine: [3470]: info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=1
May 19 10:51:11 ldirector1 tengine: [3470]: WARN: status_from_rc: Action monitor on ldirector2 failed (target: 7 vs. rc: 1): Error
May 19 10:51:11 ldirector1 tengine: [3470]: info: update_abort_priority: Abort priority upgraded to 1
May 19 10:51:11 ldirector1 tengine: [3470]: info: update_abort_priority: Abort action 0 superceeded by 2
May 19 10:51:11 ldirector1 tengine: [3470]: info: match_graph_event: Action ldirector_monitor_0 (7) confirmed on ldirector2 (rc=4)
May 19 10:51:11 ldirector1 tengine: [3470]: info: run_graph: ====================================================
May 19 10:51:11 ldirector1 tengine: [3470]: notice: run_graph: Transition 2: (Complete=4, Pending=0, Fired=0, Skipped=3, Incomplete=2)
May 19 10:51:11 ldirector1 crmd: [3398]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
May 19 10:51:11 ldirector1 crmd: [3398]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 19 10:51:11 ldirector1 pengine: [3471]: info: determine_online_status: Node ldirector1 is online
May 19 10:51:11 ldirector1 pengine: [3471]: info: determine_online_status: Node ldirector2 is online
May 19 10:51:11 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:11 ldirector1 pengine: [3471]: ERROR: unpack_rsc_op: Remapping ldirector_monitor_0 (rc=1) on ldirector2 to an ERROR
May 19 10:51:11 ldirector1 pengine: [3471]: WARN: unpack_rsc_op: Processing failed op ldirector_monitor_0 on ldirector2: Error
May 19 10:51:11 ldirector1 pengine: [3471]: ERROR: native_add_running: Resource ocf::ldirectord:ldirector appears to be active on 2 nodes.
May 19 10:51:11 ldirector1 pengine: [3471]: ERROR: See http://linux-ha.org/v2/faq/resource_too_active for more information.
May 19 10:51:11 ldirector1 pengine: [3471]: notice: group_print: Resource Group: load_balancer
May 19 10:51:11 ldirector1 pengine: [3471]: notice: native_print:     vip	(ocf::heartbeat:IPaddr2):	Started ldirector1
May 19 10:51:11 ldirector1 pengine: [3471]: notice: native_print:     ldirector	(ocf::heartbeat:ldirectord)
May 19 10:51:11 ldirector1 pengine: [3471]: notice: native_print: 	0 : ldirector1
May 19 10:51:11 ldirector1 pengine: [3471]: notice: native_print: 	1 : ldirector2
May 19 10:51:11 ldirector1 pengine: [3471]: notice: clone_print: Clone Set: stonith_group
May 19 10:51:11 ldirector1 pengine: [3471]: notice: native_print:     stonith:0	(stonith:external/ssh):	Started ldirector1
May 19 10:51:11 ldirector1 pengine: [3471]: notice: native_print:     stonith:1	(stonith:external/ssh):	Stopped 
May 19 10:51:11 ldirector1 pengine: [3471]: WARN: native_assign_node: 2 nodes with equal score (+INFINITY) for running the listed resources (chose ldirector2):
May 19 10:51:11 ldirector1 pengine: [3471]: notice: NoRoleChange: Move  resource vip	(ldirector1 -> ldirector2)
May 19 10:51:12 ldirector1 pengine: [3471]: notice: StopRsc:   ldirector1	Stop vip
May 19 10:51:12 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op: Remapping ldirector_monitor_0 (rc=1) on ldirector2 to an ERROR
May 19 10:51:12 ldirector1 pengine: [3471]: notice: StartRsc:  ldirector2	Start vip
May 19 10:51:12 ldirector1 mgmtd: [3399]: ERROR: native_add_running: Resource ocf::ldirectord:ldirector appears to be active on 2 nodes.
May 19 10:51:12 ldirector1 pengine: [3471]: notice: RecurringOp: ldirector2	   vip_monitor_20000
May 19 10:51:12 ldirector1 mgmtd: [3399]: ERROR: See http://linux-ha.org/v2/faq/resource_too_active for more information.
May 19 10:51:12 ldirector1 pengine: [3471]: ERROR: native_create_actions: Attempting recovery of resource ldirector
May 19 10:51:12 ldirector1 pengine: [3471]: notice: StopRsc:   ldirector1	Stop ldirector
May 19 10:51:12 ldirector1 pengine: [3471]: notice: StopRsc:   ldirector2	Stop ldirector
May 19 10:51:12 ldirector1 pengine: [3471]: notice: StartRsc:  ldirector2	Start ldirector
May 19 10:51:12 ldirector1 pengine: [3471]: notice: RecurringOp: ldirector2	   ldirector_monitor_20000
May 19 10:51:12 ldirector1 pengine: [3471]: notice: NoRoleChange: Leave resource stonith:0	(ldirector1)
May 19 10:51:12 ldirector1 pengine: [3471]: notice: StartRsc:  ldirector2	Start stonith:1
May 19 10:51:12 ldirector1 crmd: [3398]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
May 19 10:51:12 ldirector1 tengine: [3470]: info: unpack_graph: Unpacked transition 3: 16 actions in 16 synapses
May 19 10:51:12 ldirector1 tengine: [3470]: info: te_pseudo_action: Pseudo action 16 fired and confirmed
May 19 10:51:12 ldirector1 tengine: [3470]: info: send_rsc_command: Initiating action 3: ldirector_stop_0 on ldirector2
May 19 10:51:12 ldirector1 tengine: [3470]: info: send_rsc_command: Initiating action 11: ldirector_stop_0 on ldirector1
May 19 10:51:12 ldirector1 tengine: [3470]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
May 19 10:51:12 ldirector1 crmd: [3398]: info: do_lrm_rsc_op: Performing op=ldirector_stop_0 key=11:3:9573d5bf-3bfa-4068-9c1e-83ca1004435e)
May 19 10:51:12 ldirector1 tengine: [3470]: info: send_rsc_command: Initiating action 6: probe_complete on ldirector2
May 19 10:51:12 ldirector1 lrmd: [3395]: info: rsc:ldirector: stop
May 19 10:51:12 ldirector1 tengine: [3470]: info: send_rsc_command: Initiating action 20: stonith:1_start_0 on ldirector2
May 19 10:51:12 ldirector1 crmd: [3398]: info: process_lrm_event: LRM operation ldirector_monitor_20000 (call=10, rc=-2) Cancelled 
May 19 10:51:13 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:13 ldirector1 crmd: [3398]: info: process_lrm_event: LRM operation ldirector_stop_0 (call=11, rc=0) complete 
May 19 10:51:13 ldirector1 tengine: [3470]: info: match_graph_event: Action ldirector_stop_0 (11) confirmed on ldirector1 (rc=0)
May 19 10:51:13 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op: Remapping ldirector_monitor_0 (rc=1) on ldirector2 to an ERROR
May 19 10:51:13 ldirector1 haclient: on_event: from message queue: evt:cib_changed
May 19 10:51:14 ldirector1 tengine: [3470]: info: extract_event: Aborting on transient_attributes changes for 2994bf5d-eafe-457a-8595-c4c129187c49
May 19 10:51:14 ldirector1 tengine: [3470]: info: update_abort_priority: Abort priority upgraded to 1000000
May 19 10:51:14 ldirector1 tengine: [3470]: info: update_abort_priority: Abort action 0 superceeded by 2
May 19 10:51:14 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op: Remapping ldirector_monitor_0 (rc=1) on ldirector2 to an ERROR
May 19 10:51:14 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op: Hard error: ldirector_stop_0 failed with rc=2.
May 19 10:51:14 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op:   Preventing ldirector from re-starting anywhere in the cluster
May 19 10:51:14 ldirector1 tengine: [3470]: info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=2
May 19 10:51:14 ldirector1 tengine: [3470]: WARN: status_from_rc: Action stop on ldirector2 failed (target: <null> vs. rc: 2): Error
May 19 10:51:14 ldirector1 tengine: [3470]: WARN: update_failcount: Updating failcount for ldirector on 2994bf5d-eafe-457a-8595-c4c129187c49 after failed stop: rc=2
May 19 10:51:14 ldirector1 tengine: [3470]: info: match_graph_event: Action ldirector_stop_0 (3) confirmed on ldirector2 (rc=4)
May 19 10:51:14 ldirector1 tengine: [3470]: info: extract_event: Aborting on transient_attributes changes for 2994bf5d-eafe-457a-8595-c4c129187c49
May 19 10:51:14 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op: Remapping ldirector_monitor_0 (rc=1) on ldirector2 to an ERROR
May 19 10:51:14 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op: Hard error: ldirector_stop_0 failed with rc=2.
May 19 10:51:14 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op:   Preventing ldirector from re-starting anywhere in the cluster
May 19 10:51:14 ldirector1 pengine: [3471]: ERROR: process_pe_message: Transition 3: ERRORs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-error-11.bz2
May 19 10:51:14 ldirector1 haclient: on_event: from message queue: evt:cib_changed
May 19 10:51:14 ldirector1 haclient: on_event: from message queue: evt:cib_changed
May 19 10:51:14 ldirector1 haclient: on_event: from message queue: evt:cib_changed
May 19 10:51:15 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:15 ldirector1 tengine: [3470]: info: match_graph_event: Action stonith:1_start_0 (20) confirmed on ldirector2 (rc=0)
May 19 10:51:15 ldirector1 tengine: [3470]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
May 19 10:51:15 ldirector1 tengine: [3470]: info: run_graph: ====================================================
May 19 10:51:15 ldirector1 tengine: [3470]: notice: run_graph: Transition 3: (Complete=7, Pending=0, Fired=0, Skipped=9, Incomplete=0)
May 19 10:51:15 ldirector1 crmd: [3398]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
May 19 10:51:15 ldirector1 crmd: [3398]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 19 10:51:15 ldirector1 pengine: [3471]: info: determine_online_status: Node ldirector1 is online
May 19 10:51:15 ldirector1 pengine: [3471]: info: determine_online_status: Node ldirector2 is online
May 19 10:51:15 ldirector1 pengine: [3471]: info: common_apply_stickiness: Setting failure stickiness for ldirector on ldirector2: -100000000
May 19 10:51:15 ldirector1 pengine: [3471]: ERROR: unpack_rsc_op: Remapping ldirector_monitor_0 (rc=1) on ldirector2 to an ERROR
May 19 10:51:15 ldirector1 pengine: [3471]: WARN: unpack_rsc_op: Processing failed op ldirector_monitor_0 on ldirector2: Error
May 19 10:51:15 ldirector1 pengine: [3471]: ERROR: unpack_rsc_op: Hard error: ldirector_stop_0 failed with rc=2.
May 19 10:51:15 ldirector1 pengine: [3471]: ERROR: unpack_rsc_op:   Preventing ldirector from re-starting anywhere in the cluster
May 19 10:51:15 ldirector1 pengine: [3471]: WARN: unpack_rsc_op: Processing failed op ldirector_stop_0 on ldirector2: Error
May 19 10:51:15 ldirector1 pengine: [3471]: notice: group_print: Resource Group: load_balancer
May 19 10:51:15 ldirector1 pengine: [3471]: notice: native_print:     vip	(ocf::heartbeat:IPaddr2):	Started ldirector1
May 19 10:51:15 ldirector1 pengine: [3471]: notice: native_print:     ldirector	(ocf::heartbeat:ldirectord):	Started ldirector2 FAILED
May 19 10:51:15 ldirector1 pengine: [3471]: notice: clone_print: Clone Set: stonith_group
May 19 10:51:15 ldirector1 pengine: [3471]: notice: native_print:     stonith:0	(stonith:external/ssh):	Started ldirector1
May 19 10:51:15 ldirector1 pengine: [3471]: notice: native_print:     stonith:1	(stonith:external/ssh):	Started ldirector2
May 19 10:51:15 ldirector1 pengine: [3471]: WARN: native_color: Resource ldirector cannot run anywhere
May 19 10:51:15 ldirector1 pengine: [3471]: WARN: native_color: Resource stonith:1 cannot run anywhere
May 19 10:51:15 ldirector1 pengine: [3471]: notice: NoRoleChange: Leave resource vip	(ldirector1)
May 19 10:51:15 ldirector1 pengine: [3471]: notice: StopRsc:   ldirector2	Stop ldirector
May 19 10:51:15 ldirector1 pengine: [3471]: notice: NoRoleChange: Leave resource stonith:0	(ldirector1)
May 19 10:51:15 ldirector1 pengine: [3471]: notice: StopRsc:   ldirector2	Stop stonith:1
May 19 10:51:15 ldirector1 pengine: [3471]: WARN: stage6: Scheduling Node ldirector2 for STONITH
May 19 10:51:15 ldirector1 pengine: [3471]: WARN: native_stop_constraints: Stop of failed resource ldirector is implicit after ldirector2 is fenced
May 19 10:51:15 ldirector1 pengine: [3471]: info: native_stop_constraints: Re-creating actions for load_balancer
May 19 10:51:15 ldirector1 pengine: [3471]: notice: NoRoleChange: Leave resource vip	(ldirector1)
May 19 10:51:15 ldirector1 pengine: [3471]: notice: StopRsc:   ldirector2	Stop ldirector
May 19 10:51:15 ldirector1 pengine: [3471]: info: native_stop_constraints: stonith:1_stop_0 is implicit after ldirector2 is fenced
May 19 10:51:15 ldirector1 pengine: [3471]: info: native_stop_constraints: Re-creating actions for stonith_group
May 19 10:51:15 ldirector1 pengine: [3471]: notice: NoRoleChange: Leave resource stonith:0	(ldirector1)
May 19 10:51:15 ldirector1 pengine: [3471]: notice: StopRsc:   ldirector2	Stop stonith:1
May 19 10:51:15 ldirector1 crmd: [3398]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
May 19 10:51:15 ldirector1 tengine: [3470]: info: unpack_graph: Unpacked transition 4: 7 actions in 7 synapses
May 19 10:51:15 ldirector1 tengine: [3470]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
May 19 10:51:15 ldirector1 tengine: [3470]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
May 19 10:51:15 ldirector1 tengine: [3470]: info: te_fence_node: Executing reboot fencing operation (20) on ldirector2 (timeout=30000)
May 19 10:51:15 ldirector1 stonithd: [3396]: info: client tengine [pid: 3470] want a STONITH operation RESET to node ldirector2.
May 19 10:51:15 ldirector1 stonithd: [3396]: info: stonith_operate_locally::2368: sending fencing op (RESET) for ldirector2 to device external (rsc_id=stonith:0, pid=4556)
May 19 10:51:15 ldirector1 tengine: [3470]: info: te_pseudo_action: Pseudo action 14 fired and confirmed
May 19 10:51:15 ldirector1 tengine: [3470]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
May 19 10:51:15 ldirector1 pengine: [3471]: WARN: process_pe_message: Transition 4: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-274.bz2
May 19 10:51:15 ldirector1 pengine: [3471]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
May 19 10:51:16 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op: Remapping ldirector_monitor_0 (rc=1) on ldirector2 to an ERROR
May 19 10:51:16 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op: Hard error: ldirector_stop_0 failed with rc=2.
May 19 10:51:16 ldirector1 mgmtd: [3399]: ERROR: unpack_rsc_op:   Preventing ldirector from re-starting anywhere in the cluster
May 19 10:51:21 ldirector1 stonithd: [3396]: info: Succeeded to STONITH the node ldirector2: optype=RESET. whodoit: ldirector1
May 19 10:51:21 ldirector1 tengine: [3470]: info: tengine_stonith_callback: call=4556, optype=1, node_name=ldirector2, result=0, node_list=ldirector1, action=20:4:9573d5bf-3bfa-4068-9c1e-83ca1004435e
May 19 10:51:21 ldirector1 tengine: [3470]: info: te_pseudo_action: Pseudo action 2 fired and confirmed
May 19 10:51:21 ldirector1 tengine: [3470]: info: te_pseudo_action: Pseudo action 3 fired and confirmed
May 19 10:51:21 ldirector1 tengine: [3470]: info: run_graph: Transition 4: (Complete=7, Pending=0, Fired=0, Skipped=0, Incomplete=0)
May 19 10:51:21 ldirector1 tengine: [3470]: WARN: notify_crmd: Delaying completion until all CIB updates complete
May 19 10:51:21 ldirector1 tengine: [3470]: WARN: notify_crmd: Delaying completion until all CIB updates complete
May 19 10:51:21 ldirector1 tengine: [3470]: info: notify_crmd: Transition 4 status: te_complete - <null>
May 19 10:51:21 ldirector1 crmd: [3398]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
May 19 10:51:21 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:51:48 ldirector1 lrmd: [3395]: debug: stonithRA plugin: provider attribute is not needed and will be ignored.
May 19 10:51:49 ldirector1 crmd: [3398]: notice: crmd_ha_status_callback: Status update: Node ldirector2 now has status [dead]
May 19 10:51:49 ldirector1 ccm: [3393]: debug: quorum plugin: majority
May 19 10:51:49 ldirector1 ccm: [3393]: debug: cluster:linux-ha, member_count=1, member_quorum_votes=100
May 19 10:51:49 ldirector1 ccm: [3393]: debug: total_node_count=2, total_quorum_votes=200
May 19 10:51:49 ldirector1 ccm: [3393]: debug: quorum plugin: twonodes
May 19 10:51:49 ldirector1 ccm: [3393]: debug: cluster:linux-ha, member_count=1, member_quorum_votes=100
May 19 10:51:49 ldirector1 ccm: [3393]: debug: total_node_count=2, total_quorum_votes=200
May 19 10:51:49 ldirector1 ccm: [3393]: info: Break tie for 2 nodes cluster
May 19 10:51:49 ldirector1 crmd: [3398]: info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm
May 19 10:51:49 ldirector1 crmd: [3398]: info: mem_handle_event: no mbr_track info
May 19 10:51:49 ldirector1 crmd: [3398]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
May 19 10:51:49 ldirector1 crmd: [3398]: info: mem_handle_event: instance=3, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3
May 19 10:51:49 ldirector1 crmd: [3398]: info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=3)
May 19 10:51:49 ldirector1 crmd: [3398]: info: ccm_event_detail: NEW MEMBERSHIP: trans=3, nodes=1, new=0, lost=1 n_idx=0, new_idx=1, old_idx=3
May 19 10:51:49 ldirector1 crmd: [3398]: info: ccm_event_detail: 	CURRENT: ldirector1 [nodeid=0, born=3]
May 19 10:51:49 ldirector1 crmd: [3398]: info: ccm_event_detail: 	LOST:    ldirector2 [nodeid=1, born=2]
May 19 10:51:49 ldirector1 cib: [3394]: info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm
May 19 10:51:49 ldirector1 cib: [3394]: info: mem_handle_event: no mbr_track info
May 19 10:51:49 ldirector1 cib: [3394]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
May 19 10:51:49 ldirector1 cib: [3394]: info: mem_handle_event: instance=3, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3
May 19 10:51:49 ldirector1 cib: [3394]: info: cib_ccm_msg_callback: LOST: ldirector2
May 19 10:51:49 ldirector1 cib: [3394]: info: cib_ccm_msg_callback: PEER: ldirector1
May 19 10:51:50 ldirector1 haclient: on_event:evt:cib_changed
May 19 10:54:04 ldirector1 cib: [3394]: info: cib_stats: Processed 75 operations (4666.00us average, 0% utilization) in the last 10min
