Hi,

On Thu, Jan 13, 2011 at 01:41:30PM +0100, RaSca wrote:
> Il giorno Gio 13 Gen 2011 13:22:26 CET, Dejan Muhamedagic ha scritto:
> >Hi,
> 
> Hi Dej and thanks as usual for you precious support.
> 
> [...]
> >iscsiadm fails in probe with the following messages:
> >>Jan 13 12:15:19 debian-squeeze-nodo2 lrmd: [12063]: info: RA output: 
> >>(www_db-iscsi:probe:stderr) iscsiadm:
> >>Jan 13 12:15:19 debian-squeeze-nodo2 lrmd: [12063]: info: RA output: 
> >>(www_db-iscsi:probe:stderr) cannot make connection to 10.0.0.100:3260 (113)
> >>Jan 13 12:15:19 debian-squeeze-nodo2 lrmd: [12063]: info: RA output: 
> >>(www_db-iscsi:probe:stderr)
> >>Jan 13 12:15:19 debian-squeeze-nodo2 lrmd: [12063]: info: RA output: 
> >>(www_db-iscsi:probe:stderr) iscsiadm: connection to discovery address 
> >>10.0.0.100 failed
> >>Jan 13 12:15:22 debian-squeeze-nodo2 lrmd: [12063]: info: RA output: 
> >>(www_db-iscsi:probe:stderr) iscsiadm: cannot make connection to 
> >>10.0.0.100:3260 (113)#012iscsiadm: connection to discovery address 
> >>10.0.0.100 failed
> >>Jan 13 12:15:26 debian-squeeze-nodo2 lrmd: [12063]: info: RA output: 
> >>(www_db-iscsi:probe:stderr) iscsiadm: cannot make connection to 
> >>10.0.0.100:3260 (113)#012iscsiadm: connection to discovery address 
> >>10.0.0.100 failed
> >>Jan 13 12:15:29 debian-squeeze-nodo2 lrmd: [12063]: info: RA output: 
> >>(www_db-iscsi:probe:stderr) iscsiadm: cannot make connection to 
> >>10.0.0.100:3260 (113)#012iscsiadm: connection to discovery address 
> >>10.0.0.100 failed
> >>Jan 13 12:15:33 debian-squeeze-nodo2 lrmd: [12063]: info: RA output: 
> >>(www_db-iscsi:probe:stderr) iscsiadm: cannot make connection to 
> >>10.0.0.100:3260 (113)#012iscsiadm: connection to discovery address 
> >>10.0.0.100 failed#012iscsiadm: connection login retries (reopen_max) 5 
> >>exceeded#012iscsiadm: Could not perform SendTargets discovery.
> >The ip (10.0.0.100) is not up yet at that point. Are you sure
> >that your configuration is sane. Looks somewhat strange to me.
> 
> My configuration looks to me (!) fine. As I said, the problems comes
> up only in the startup and not with normal failovers. What
> particularly is strange to you?

Can't say exactly, but it seemed to me that it would be better
as two clusters.

> >Anyway, iscsi (the RA) should be more forgiving in probes. Can
> >you please try the attached patch.
> 
> The patch applies, but the resource fails to startup with:
> 
> Failed actions:
>     www_db-iscsi_monitor_0 (node=debian-squeeze-nodo1, call=39,
> rc=4, status=complete): insufficient privileges

+/usr/lib/ocf/resource.d//heartbeat/iscsi: Permission denied

Try chmod +x /usr/lib/ocf/resource.d//heartbeat/iscsi :)

> the current log is attached, even if I try a cleanup it ends again
> with the insufficient privilege message.
> 
> >Hmm, couldn't find that in the logs. The first action on the
> >iscsi resource is probe and that fails.
> >Thanks,
> >Dejan
> 
> And this is the strange thing for me: Why iscsi is probed if db
> group is not yet active?

All resources are probed at startup regardless of dependencies.
It's up to the resource agents to manage such situations.

Thanks,

Dejan

> -- 
> Raoul Scarazzini
> Mia Mamma Usa Linux: Niente รจ impossibile da capire, se lo spieghi bene!
> ra...@miamammausalinux.org

> Jan 13 14:37:19 debian-squeeze-nodo1 cibadmin: [1601]: info: Invoked: 
> cibadmin -Ql -o resources 
> Jan 13 14:37:19 debian-squeeze-nodo1 cibadmin: [1603]: info: Invoked: 
> cibadmin -Ql -o resources 
> Jan 13 14:37:19 debian-squeeze-nodo1 crm_resource: [1605]: info: Invoked: 
> crm_resource -C -r www -H debian-squeeze-nodo1 
> Jan 13 14:37:19 debian-squeeze-nodo1 crm_resource: [1605]: ERROR: 
> unpack_rsc_op: Hard error - www_db-iscsi_monitor_0 failed with rc=4: 
> Preventing www_db-iscsi from re-starting on debian-squeeze-nodo1
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_invoke: 
> Removing resource www_db-iscsi from the LRM
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_invoke: 
> Resource 'www_db-iscsi' deleted for 1605_crm_resource on debian-squeeze-nodo1
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: notify_deleted: 
> Notifying 1605_crm_resource on debian-squeeze-nodo1 that www_db-iscsi was 
> deleted
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: cib_process_request: 
> Operation complete: op cib_delete for section 
> //node_state[@uname='debian-squeeze-nodo1']//lrm_resource[@id='www_db-iscsi'] 
> (origin=local/crmd/175, version=0.303.9): ok (rc=0)
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: send_direct_ack: 
> ACK'ing resource op www_db-iscsi_delete_60000 from 0:0:crm-resource-1605: 
> lrm_invoke-lrmd-1294925839-103
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: 
> abort_transition_graph: te_update_diff:267 - Triggered transition abort 
> (complete=1, tag=lrm_rsc_op, id=www_db-iscsi_monitor_0, 
> magic=0:4;8:14:7:63667b9f-9576-4a57-b9b9-1f53d01ca8b7, cib=0.303.9) : 
> Resource op removal
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ 
> input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_state_transition: All 1 cluster nodes are eligible to run resources.
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: do_pe_invoke: Query 
> 178: Requesting the current CIB: S_POLICY_ENGINE
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_invoke: 
> Removing resource www_db-fs from the LRM
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_invoke: 
> Resource 'www_db-fs' deleted for 1605_crm_resource on debian-squeeze-nodo1
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: notify_deleted: 
> Notifying 1605_crm_resource on debian-squeeze-nodo1 that www_db-fs was deleted
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: send_direct_ack: 
> ACK'ing resource op www_db-fs_delete_60000 from 0:0:crm-resource-1605: 
> lrm_invoke-lrmd-1294925839-104
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: - <cib admin_epoch="0" epoch="303" num_updates="9" >
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: -   <configuration >
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: -     <crm_config >
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: -         <nvpair value="1294925631" 
> id="cib-bootstrap-options-last-lrm-refresh" />
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: -       </cluster_property_set>
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: -     </crm_config>
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: -   </configuration>
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: - </cib>
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: + <cib admin_epoch="0" epoch="304" num_updates="1" >
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: +   <configuration >
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: +     <crm_config >
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: +         <nvpair value="1294925839" 
> id="cib-bootstrap-options-last-lrm-refresh" />
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: +       </cluster_property_set>
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: +     </crm_config>
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: +   </configuration>
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: log_data_element: 
> cib:diff: + </cib>
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: cib_process_request: 
> Operation complete: op cib_modify for section crm_config 
> (origin=local/crmd/177, version=0.304.1): ok (rc=0)
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: cib_process_request: 
> Operation complete: op cib_delete for section 
> //node_state[@uname='debian-squeeze-nodo1']//lrm_resource[@id='www_db-fs'] 
> (origin=local/crmd/179, version=0.304.2): ok (rc=0)
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_invoke: 
> Removing resource www_fs from the LRM
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_invoke: 
> Resource 'www_fs' deleted for 1605_crm_resource on debian-squeeze-nodo1
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: notify_deleted: 
> Notifying 1605_crm_resource on debian-squeeze-nodo1 that www_fs was deleted
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: send_direct_ack: 
> ACK'ing resource op www_fs_delete_60000 from 0:0:crm-resource-1605: 
> lrm_invoke-lrmd-1294925839-105
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: cib_process_request: 
> Operation complete: op cib_modify for section crm_config 
> (origin=local/crmd/181, version=0.304.2): ok (rc=0)
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: cib_process_request: 
> Operation complete: op cib_delete for section 
> //node_state[@uname='debian-squeeze-nodo1']//lrm_resource[@id='www_fs'] 
> (origin=local/crmd/182, version=0.304.3): ok (rc=0)
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_invoke: 
> Removing resource www_ip from the LRM
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_invoke: 
> Resource 'www_ip' deleted for 1605_crm_resource on debian-squeeze-nodo1
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: notify_deleted: 
> Notifying 1605_crm_resource on debian-squeeze-nodo1 that www_ip was deleted
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: send_direct_ack: 
> ACK'ing resource op www_ip_delete_60000 from 0:0:crm-resource-1605: 
> lrm_invoke-lrmd-1294925839-106
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: cib_process_request: 
> Operation complete: op cib_modify for section crm_config 
> (origin=local/crmd/184, version=0.304.3): ok (rc=0)
> Jan 13 14:37:19 debian-squeeze-nodo1 cib: [30073]: info: cib_process_request: 
> Operation complete: op cib_delete for section 
> //node_state[@uname='debian-squeeze-nodo1']//lrm_resource[@id='www_ip'] 
> (origin=local/crmd/185, version=0.304.4): ok (rc=0)
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: 
> abort_transition_graph: need_abort:59 - Triggered transition abort 
> (complete=1) : Non-status change
> Jan 13 14:37:19 debian-squeeze-nodo1 crmd: [30077]: info: need_abort: 
> Aborting on change to admin_epoch
> Jan 13 14:37:20 debian-squeeze-nodo1 cib: [30073]: info: cib_process_request: 
> Operation complete: op cib_modify for section crm_config 
> (origin=local/crmd/187, version=0.304.4): ok (rc=0)
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_pe_invoke_callback: Invoking the PE: query=178, 
> ref=pe_calc-dc-1294925840-107, seq=1, quorate=1
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: 
> abort_transition_graph: te_update_diff:267 - Triggered transition abort 
> (complete=1, tag=lrm_rsc_op, id=www_db-fs_monitor_0, 
> magic=0:7;9:14:7:63667b9f-9576-4a57-b9b9-1f53d01ca8b7, cib=0.304.2) : 
> Resource op removal
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: 
> abort_transition_graph: te_update_diff:267 - Triggered transition abort 
> (complete=1, tag=lrm_rsc_op, id=www_fs_monitor_0, 
> magic=0:7;10:14:7:63667b9f-9576-4a57-b9b9-1f53d01ca8b7, cib=0.304.3) : 
> Resource op removal
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: unpack_config: 
> On loss of CCM Quorum: Ignore
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: unpack_config: 
> Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: 
> determine_online_status: Node debian-squeeze-nodo1 is online
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: clone_print:  
> Clone Set: ping_clone
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: 
> abort_transition_graph: te_update_diff:267 - Triggered transition abort 
> (complete=1, tag=lrm_rsc_op, id=www_ip_monitor_0, 
> magic=0:7;11:14:7:63667b9f-9576-4a57-b9b9-1f53d01ca8b7, cib=0.304.4) : 
> Resource op removal
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Started: [ debian-squeeze-nodo1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: do_pe_invoke: Query 
> 188: Requesting the current CIB: S_POLICY_ENGINE
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Stopped: [ ping:1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: do_pe_invoke: Query 
> 189: Requesting the current CIB: S_POLICY_ENGINE
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: group_print:  
> Resource Group: db
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: do_pe_invoke: Query 
> 190: Requesting the current CIB: S_POLICY_ENGINE
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     db_iscsi-target#011(ocf::heartbeat:iSCSITarget):#011Started 
> debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: do_pe_invoke: Query 
> 191: Requesting the current CIB: S_POLICY_ENGINE
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     db_iscsi-lun#011(ocf::heartbeat:iSCSILogicalUnit):#011Started 
> debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     db_ip#011(ocf::heartbeat:IPaddr2):#011Started debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: group_print:  
> Resource Group: www
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_db-iscsi#011(ocf::heartbeat:iscsi):#011Stopped 
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_db-fs#011(ocf::heartbeat:Filesystem):#011Stopped 
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_fs#011(ocf::heartbeat:Filesystem):#011Stopped 
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_ip#011(ocf::heartbeat:IPaddr2):#011Stopped 
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: handle_response: 
> pe_calc calculation pe_calc-dc-1294925840-107 is obsolete
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: clone_print:  
> Master/Slave Set: db_ms-r1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Masters: [ debian-squeeze-nodo1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Stopped: [ db_r1:1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: clone_print:  
> Master/Slave Set: www_ms-r0
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Masters: [ debian-squeeze-nodo1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Stopped: [ www_r0:1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource ping:1 cannot run anywhere
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource db_r1:1 cannot run anywhere
> Jan 13 14:37:20 debian-squeeze-nodo1 cib: [1606]: info: write_cib_contents: 
> Archived previous version as /var/lib/heartbeat/crm/cib-55.raw
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting db_r1:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> db_ms-r1: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource www_r0:1 cannot run anywhere
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting www_r0:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> www_ms-r0: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:20 debian-squeeze-nodo1 cib: [1606]: info: write_cib_contents: 
> Wrote version 0.304.0 of the CIB to disk (digest: 
> be2b879389c26ef9f95f99c5ece26e30)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting db_r1:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 cib: [1606]: info: retrieveCib: Reading 
> cluster configuration from: /var/lib/heartbeat/crm/cib.vhPSDE (digest: 
> /var/lib/heartbeat/crm/cib.RmBD8J)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> db_ms-r1: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting www_r0:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> www_ms-r0: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: RecurringOp:  
> Start recurring monitor (10s) for www_db-iscsi on debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: RecurringOp:  
> Start recurring monitor (20s) for www_db-fs on debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: RecurringOp:  
> Start recurring monitor (20s) for www_fs on debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: RecurringOp:  
> Start recurring monitor (20s) for www_ip on debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource ping:0#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource ping:1#011(Stopped)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_iscsi-target#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_iscsi-lun#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_ip#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Start www_db-iscsi#011(debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Start www_db-fs#011(debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Start www_fs#011(debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Start www_ip#011(debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_r1:0#011(Master debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_r1:1#011(Stopped)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource www_r0:0#011(Master debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource www_r0:1#011(Stopped)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: 
> process_pe_message: Transition 16: PEngine Input stored in: 
> /var/lib/pengine/pe-input-1136.bz2
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_pe_invoke_callback: Invoking the PE: query=191, 
> ref=pe_calc-dc-1294925840-108, seq=1, quorate=1
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: 
> config_query_callback: Checking for expired actions every 900000ms
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: unpack_config: 
> On loss of CCM Quorum: Ignore
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: unpack_config: 
> Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: 
> determine_online_status: Node debian-squeeze-nodo1 is online
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: clone_print:  
> Clone Set: ping_clone
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Started: [ debian-squeeze-nodo1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Stopped: [ ping:1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: group_print:  
> Resource Group: db
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     db_iscsi-target#011(ocf::heartbeat:iSCSITarget):#011Started 
> debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     db_iscsi-lun#011(ocf::heartbeat:iSCSILogicalUnit):#011Started 
> debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     db_ip#011(ocf::heartbeat:IPaddr2):#011Started debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: group_print:  
> Resource Group: www
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_db-iscsi#011(ocf::heartbeat:iscsi):#011Stopped 
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_db-fs#011(ocf::heartbeat:Filesystem):#011Stopped 
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_fs#011(ocf::heartbeat:Filesystem):#011Stopped 
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_ip#011(ocf::heartbeat:IPaddr2):#011Stopped 
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: clone_print:  
> Master/Slave Set: db_ms-r1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Masters: [ debian-squeeze-nodo1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Stopped: [ db_r1:1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: clone_print:  
> Master/Slave Set: www_ms-r0
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Masters: [ debian-squeeze-nodo1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Stopped: [ www_r0:1 ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource ping:1 cannot run anywhere
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource db_r1:1 cannot run anywhere
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting db_r1:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> db_ms-r1: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource www_r0:1 cannot run anywhere
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE 
> [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting www_r0:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: unpack_graph: 
> Unpacked transition 17: 23 actions in 23 synapses
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> www_ms-r0: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: do_te_invoke: 
> Processing graph 17 (ref=pe_calc-dc-1294925840-108) derived from 
> /var/lib/pengine/pe-input-1137.bz2
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting db_r1:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: te_rsc_command: 
> Initiating action 8: monitor www_db-iscsi_monitor_0 on debian-squeeze-nodo1 
> (local)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> db_ms-r1: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting www_r0:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_rsc_op: 
> Performing key=8:17:7:63667b9f-9576-4a57-b9b9-1f53d01ca8b7 
> op=www_db-iscsi_monitor_0 )
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> www_ms-r0: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:20 debian-squeeze-nodo1 lrmd: [30074]: info: 
> rsc:www_db-iscsi:51: probe
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: RecurringOp:  
> Start recurring monitor (10s) for www_db-iscsi on debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: te_rsc_command: 
> Initiating action 9: monitor www_db-fs_monitor_0 on debian-squeeze-nodo1 
> (local)
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: RecurringOp:  
> Start recurring monitor (20s) for www_db-fs on debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: RecurringOp:  
> Start recurring monitor (20s) for www_fs on debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: notice: RecurringOp:  
> Start recurring monitor (20s) for www_ip on debian-squeeze-nodo1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:20 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_rsc_op: 
> Performing key=9:17:7:63667b9f-9576-4a57-b9b9-1f53d01ca8b7 
> op=www_db-fs_monitor_0 )
> Jan 13 14:37:20 debian-squeeze-nodo1 lrmd: [1607]: ERROR: 
> socket_resume_io_read: unknown recv error, peerpid=1005: Bad file descriptor
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:20 debian-squeeze-nodo1 lrmd: [30074]: info: rsc:www_db-fs:52: 
> probe
> Jan 13 14:37:20 debian-squeeze-nodo1 lrmd: [1607]: ERROR: 
> (raexecocf.c:execra:178) execl failed for 
> /usr/lib/ocf/resource.d//heartbeat/iscsi: Permission denied
> Jan 13 14:37:20 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:21 debian-squeeze-nodo1 crmd: [30077]: info: te_rsc_command: 
> Initiating action 10: monitor www_fs_monitor_0 on debian-squeeze-nodo1 (local)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource ping:0#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource ping:1#011(Stopped)
> Jan 13 14:37:21 debian-squeeze-nodo1 lrmd: [30074]: info: rsc:www_fs:53: probe
> Jan 13 14:37:21 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_rsc_op: 
> Performing key=10:17:7:63667b9f-9576-4a57-b9b9-1f53d01ca8b7 
> op=www_fs_monitor_0 )
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_iscsi-target#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_iscsi-lun#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_ip#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:21 debian-squeeze-nodo1 crmd: [30077]: info: te_rsc_command: 
> Initiating action 11: monitor www_ip_monitor_0 on debian-squeeze-nodo1 (local)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Start www_db-iscsi#011(debian-squeeze-nodo1)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Start www_db-fs#011(debian-squeeze-nodo1)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Start www_fs#011(debian-squeeze-nodo1)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Start www_ip#011(debian-squeeze-nodo1)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_r1:0#011(Master debian-squeeze-nodo1)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_r1:1#011(Stopped)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource www_r0:0#011(Master debian-squeeze-nodo1)
> Jan 13 14:37:21 debian-squeeze-nodo1 lrmd: [30074]: info: rsc:www_ip:54: probe
> Jan 13 14:37:21 debian-squeeze-nodo1 crmd: [30077]: info: do_lrm_rsc_op: 
> Performing key=11:17:7:63667b9f-9576-4a57-b9b9-1f53d01ca8b7 
> op=www_ip_monitor_0 )
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource www_r0:1#011(Stopped)
> Jan 13 14:37:21 debian-squeeze-nodo1 pengine: [30079]: info: 
> process_pe_message: Transition 17: PEngine Input stored in: 
> /var/lib/pengine/pe-input-1137.bz2
> Jan 13 14:37:21 debian-squeeze-nodo1 crmd: [30077]: info: process_lrm_event: 
> LRM operation www_db-iscsi_monitor_0 (call=51, rc=4, cib-update=193, 
> confirmed=true) insufficient privileges
> Jan 13 14:37:21 debian-squeeze-nodo1 crmd: [30077]: WARN: status_from_rc: 
> Action 8 (www_db-iscsi_monitor_0) on debian-squeeze-nodo1 failed (target: 7 
> vs. rc: 4): Error
> Jan 13 14:37:21 debian-squeeze-nodo1 crmd: [30077]: info: 
> abort_transition_graph: match_graph_event:272 - Triggered transition abort 
> (complete=0, tag=lrm_rsc_op, id=www_db-iscsi_monitor_0, 
> magic=0:4;8:17:7:63667b9f-9576-4a57-b9b9-1f53d01ca8b7, cib=0.304.5) : Event 
> failed
> Jan 13 14:37:21 debian-squeeze-nodo1 crmd: [30077]: info: 
> update_abort_priority: Abort priority upgraded from 0 to 1
> Jan 13 14:37:21 debian-squeeze-nodo1 crmd: [30077]: info: 
> update_abort_priority: Abort action done superceeded by restart
> Jan 13 14:37:21 debian-squeeze-nodo1 crmd: [30077]: info: match_graph_event: 
> Action www_db-iscsi_monitor_0 (8) confirmed on debian-squeeze-nodo1 (rc=4)
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: process_lrm_event: 
> LRM operation www_ip_monitor_0 (call=54, rc=7, cib-update=194, 
> confirmed=true) not running
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: match_graph_event: 
> Action www_ip_monitor_0 (11) confirmed on debian-squeeze-nodo1 (rc=0)
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: process_lrm_event: 
> LRM operation www_db-fs_monitor_0 (call=52, rc=7, cib-update=195, 
> confirmed=true) not running
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: match_graph_event: 
> Action www_db-fs_monitor_0 (9) confirmed on debian-squeeze-nodo1 (rc=0)
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: process_lrm_event: 
> LRM operation www_fs_monitor_0 (call=53, rc=7, cib-update=196, 
> confirmed=true) not running
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: match_graph_event: 
> Action www_fs_monitor_0 (10) confirmed on debian-squeeze-nodo1 (rc=0)
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: te_rsc_command: 
> Initiating action 7: probe_complete probe_complete on debian-squeeze-nodo1 
> (local) - no waiting
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: run_graph: 
> ====================================================
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: notice: run_graph: 
> Transition 17 (Complete=5, Pending=0, Fired=0, Skipped=18, Incomplete=0, 
> Source=/var/lib/pengine/pe-input-1137.bz2): Stopped
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: te_graph_trigger: 
> Transition 17 is now complete
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE 
> [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_state_transition: All 1 cluster nodes are eligible to run resources.
> Jan 13 14:37:22 debian-squeeze-nodo1 crmd: [30077]: info: do_pe_invoke: Query 
> 197: Requesting the current CIB: S_POLICY_ENGINE
> Jan 13 14:37:23 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_pe_invoke_callback: Invoking the PE: query=197, 
> ref=pe_calc-dc-1294925843-114, seq=1, quorate=1
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: unpack_config: 
> On loss of CCM Quorum: Ignore
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: unpack_config: 
> Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: 
> determine_online_status: Node debian-squeeze-nodo1 is online
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: ERROR: unpack_rsc_op: 
> Hard error - www_db-iscsi_monitor_0 failed with rc=4: Preventing www_db-iscsi 
> from re-starting on debian-squeeze-nodo1
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: clone_print:  
> Clone Set: ping_clone
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Started: [ debian-squeeze-nodo1 ]
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Stopped: [ ping:1 ]
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: group_print:  
> Resource Group: db
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     db_iscsi-target#011(ocf::heartbeat:iSCSITarget):#011Started 
> debian-squeeze-nodo1
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     db_iscsi-lun#011(ocf::heartbeat:iSCSILogicalUnit):#011Started 
> debian-squeeze-nodo1
> Jan 13 14:37:23 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE 
> [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     db_ip#011(ocf::heartbeat:IPaddr2):#011Started debian-squeeze-nodo1
> Jan 13 14:37:23 debian-squeeze-nodo1 crmd: [30077]: info: unpack_graph: 
> Unpacked transition 18: 0 actions in 0 synapses
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: group_print:  
> Resource Group: www
> Jan 13 14:37:23 debian-squeeze-nodo1 crmd: [30077]: info: do_te_invoke: 
> Processing graph 18 (ref=pe_calc-dc-1294925843-114) derived from 
> /var/lib/pengine/pe-input-1138.bz2
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_db-iscsi#011(ocf::heartbeat:iscsi):#011Stopped 
> Jan 13 14:37:23 debian-squeeze-nodo1 crmd: [30077]: info: run_graph: 
> ====================================================
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_db-fs#011(ocf::heartbeat:Filesystem):#011Stopped 
> Jan 13 14:37:23 debian-squeeze-nodo1 crmd: [30077]: notice: run_graph: 
> Transition 18 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, 
> Source=/var/lib/pengine/pe-input-1138.bz2): Complete
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_fs#011(ocf::heartbeat:Filesystem):#011Stopped 
> Jan 13 14:37:23 debian-squeeze-nodo1 crmd: [30077]: info: te_graph_trigger: 
> Transition 18 is now complete
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: native_print:  
>     www_ip#011(ocf::heartbeat:IPaddr2):#011Stopped 
> Jan 13 14:37:23 debian-squeeze-nodo1 crmd: [30077]: info: notify_crmd: 
> Transition 18 status: done - <null>
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: clone_print:  
> Master/Slave Set: db_ms-r1
> Jan 13 14:37:23 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ 
> input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Masters: [ debian-squeeze-nodo1 ]
> Jan 13 14:37:23 debian-squeeze-nodo1 crmd: [30077]: info: 
> do_state_transition: Starting PEngine Recheck Timer
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Stopped: [ db_r1:1 ]
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: clone_print:  
> Master/Slave Set: www_ms-r0
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Masters: [ debian-squeeze-nodo1 ]
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: short_print:   
>    Stopped: [ www_r0:1 ]
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource ping:1 cannot run anywhere
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource db_r1:1 cannot run anywhere
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting db_r1:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> db_ms-r1: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: 
> native_merge_weights: www_ms-r0: Rolling back scores from www_db-iscsi
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource www_r0:1 cannot run anywhere
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: 
> native_merge_weights: www_ms-r0: Rolling back scores from www_db-iscsi
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting www_r0:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> www_ms-r0: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: 
> native_merge_weights: www_db-iscsi: Rolling back scores from www_db-fs
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource www_db-iscsi cannot run anywhere
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: 
> native_merge_weights: www_db-fs: Rolling back scores from www_fs
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource www_db-fs cannot run anywhere
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: 
> native_merge_weights: www_fs: Rolling back scores from www_ip
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource www_fs cannot run anywhere
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: native_color: 
> Resource www_ip cannot run anywhere
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting db_r1:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> db_ms-r1: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> Promoting www_r0:0 (Master debian-squeeze-nodo1)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: master_color: 
> www_ms-r0: Promoted 1 instances of a possible 1 to master
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for db_ms-r1
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: ERROR: 
> create_notification_boundaries: Creating boundaries for www_ms-r0
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource ping:0#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource ping:1#011(Stopped)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_iscsi-target#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_iscsi-lun#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_ip#011(Started debian-squeeze-nodo1)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource www_db-iscsi#011(Stopped)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource www_db-fs#011(Stopped)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource www_fs#011(Stopped)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource www_ip#011(Stopped)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_r1:0#011(Master debian-squeeze-nodo1)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource db_r1:1#011(Stopped)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource www_r0:0#011(Master debian-squeeze-nodo1)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: notice: LogActions: 
> Leave resource www_r0:1#011(Stopped)
> Jan 13 14:37:23 debian-squeeze-nodo1 pengine: [30079]: info: 
> process_pe_message: Transition 18: PEngine Input stored in: 
> /var/lib/pengine/pe-input-1138.bz2
> 

> _______________________________________________
> Linux-HA mailing list
> Linux-HA@lists.linux-ha.org
> http://lists.linux-ha.org/mailman/listinfo/linux-ha
> See also: http://linux-ha.org/ReportingProblems

_______________________________________________
Linux-HA mailing list
Linux-HA@lists.linux-ha.org
http://lists.linux-ha.org/mailman/listinfo/linux-ha
See also: http://linux-ha.org/ReportingProblems

Reply via email to