Hi!
The problem seems to be this:
Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: WARN: unpack_rsc_op:
Processing failed op apache_start_0 on prod-hb-nmn-002: unknown error (1)
Check why apache won't start.
Regards,
Ulrich
>>> Parkirat schrieb am 15.06.2013 um 22:24 in
>>> Nachricht
<1371327853299-14687.p...@n3.nabble.com>:
> Also adding the log while it tries to do the failover from master node to
> slave node:
>
>
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: notice:
> crmd_ha_status_callback: Status update: Node prod-hb-nmn-001 now has status
> [dead] (DC=true)
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: crm_update_peer_proc:
> prod-hb-nmn-001.ais is now offline
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: WARN: match_down_event: No
> match for shutdown action on 7910c4de-718d-45d7-b4da-24b3b65b9855
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: te_update_diff:
> Stonith/shutdown of 7910c4de-718d-45d7-b4da-24b3b65b9855 not matched
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: abort_transition_graph:
> te_update_diff:191 - Triggered transition abort (complete=1, tag=node_state,
> id=7910c4de-718d-45d7-b4da-24b3b65b9855, magic=NA, cib=0.80.18) : Node
> failure
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: do_state_transition:
> State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC
> cause=C_FSA_INTERNAL origin=abort_transition_graph ]
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: do_state_transition: All
> 1 cluster nodes are eligible to run resources.
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: do_pe_invoke: Query 163:
> Requesting the current CIB: S_POLICY_ENGINE
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: do_pe_invoke_callback:
> Invoking the PE: query=163, ref=pe_calc-dc-1371327387-113, seq=5, quorate=1
> Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: notice: unpack_config: On
> loss of CCM Quorum: Ignore
> Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: info: unpack_config: Node
> scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
> Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: info:
> determine_online_status: Node prod-hb-nmn-002 is online
> Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: WARN: unpack_rsc_op:
> Processing failed op apache_start_0 on prod-hb-nmn-002: unknown error (1)
> Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: notice: native_print:
> apache#011(ocf::heartbeat:apache):#011Stopped
> Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: info: get_failcount: apache
> has failed INFINITY times on prod-hb-nmn-002
> Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: WARN:
> common_apply_stickiness: Forcing apache away from prod-hb-nmn-002 after
> 100 failures (max=100)
> Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: info: native_color:
> Resource apache cannot run anywhere
> Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: notice: LogActions: Leave
> resource apache#011(Stopped)
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: do_state_transition:
> State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS
> cause=C_IPC_MESSAGE origin=handle_response ]
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: unpack_graph: Unpacked
> transition 48: 0 actions in 0 synapses
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: do_te_invoke: Processing
> graph 48 (ref=pe_calc-dc-1371327387-113) derived from
> /var/lib/pengine/pe-input-452.bz2
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: run_graph:
>
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: notice: run_graph: Transition
> 48 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0,
> Source=/var/lib/pengine/pe-input-452.bz2): Complete
> Jun 15 20:16:27 prod-hb-nmn-002 pengine: [4401]: info: process_pe_message:
> Transition 48: PEngine Input stored in: /var/lib/pengine/pe-input-452.bz2
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: te_graph_trigger:
> Transition 48 is now complete
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: notify_crmd: Transition
> 48 status: done -
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: do_state_transition:
> State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS
> cause=C_FSA_INTERNAL origin=notify_crmd ]
> Jun 15 20:16:27 prod-hb-nmn-002 crmd: [4395]: info: do_state_transition:
> Starting PEngine Recheck Timer
> Jun 15 20:17:17 prod-hb-nmn-002 cibadmin: [5427]: info: Invoked: cibadmin
> -Ql
> Jun 15 20:17:17 prod-hb-nmn-002 cibadmin: [5428]: info: Invoked: cibadmin
> -Ql
> Jun 15 20:17:17 prod-hb-nmn-002 crm_shadow: [5437]: info: Invoked:
> crm_shadow -c __crmshell.5404
> Jun 15 20:17:17 prod-hb-nmn-002 cibadmin: [5438]: info: Invoked: cibadmin -p
> -R -o crm_config
> Jun 15 20:17:17 prod-hb-nmn-002 crm_shadow: [5440]: info: Invoked:
> crm_shadow -C __crmshell.5404 --force
> Jun 15 20:17:17 prod-hb-nmn-002 cib: [4391]: info: cib_process
