Hello everyone. Long post, sorry.
I've been trying to get SLES11 with Pacemaker 1.0 / OpenAIS working for most of this week without success so far. I thought I may as well bundle my problems into one mail to see if anyone can offer any advice. Goal: I'm trying to get a 2 node Active/Passive cluster working with DRBD replication, an ext3 FS on top of DRBD and a virtual IP. I want the active node to have a mounted FS that I can serve requests from using ProFTPD or another FTP daemon. If the active node fails I want the cluster to migrate all 4 resources (DRBD, FS, ProFTPD, Virtual IP) across to the other node. I don't have any STONITH devices at the moment. Approach: We are going with SLES11 with Pacemaker 1.0.3 and OpenAIS 0.80.3, after already using SLES10SP2 with Heartbeat 2.1.4 and ldirectord in a live running 2-node Active/Active cluster. We are using LVM under DRBD for future disk expansion. Problem1 - Using DRBD OCF RA: I wanted to use the latest and greatest for the approaches, so tried the DRBD OCF RA following this howto: http://www.clusterlabs.org/wiki/DRBD_HowTo_1.0 . The configuration works and I can manually migrate resources but if I just reboot the node that has the drbd resource on it I see the resource gets migrated to the other node for about 2 seconds then is stopped: Normal operation: ============ Last updated: Fri May 1 16:33:00 2009 Current DC: gihub2 - partition with quorum Version: 1.0.3-0080ec086ae9c20ad5c4c3562000c0ad68374f0a 2 Nodes configured, 2 expected votes 1 Resources configured. ============ Online: [ gihub1 gihub2 ] drbd0 (ocf::heartbeat:drbd): Started gihub1 Reboot gihub1: ============ Last updated: Fri May 1 16:35:34 2009 Current DC: gihub2 - partition with quorum Version: 1.0.3-0080ec086ae9c20ad5c4c3562000c0ad68374f0a 2 Nodes configured, 2 expected votes 1 Resources configured. ============ Online: [ gihub2 ] OFFLINE: [ gihub1 ] drbd0 (ocf::heartbeat:drbd): Started gihub2 Then after a couple of seconds: ============ Last updated: Fri May 1 16:37:11 2009 Current DC: gihub2 - partition WITHOUT quorum Version: 1.0.3-0080ec086ae9c20ad5c4c3562000c0ad68374f0a 2 Nodes configured, 2 expected votes 1 Resources configured. ============ Online: [ gihub2 ] OFFLINE: [ gihub1 ] /var/log/messages says: May 1 16:46:33 gihub2 openais[5362]: [TOTEM] The token was lost in the OPERATIONAL state. May 1 16:46:33 gihub2 openais[5362]: [TOTEM] Receive multicast socket recv buffer size (262142 bytes). May 1 16:46:33 gihub2 openais[5362]: [TOTEM] Transmit multicast socket send buffer size (262142 bytes). May 1 16:46:33 gihub2 openais[5362]: [TOTEM] entering GATHER state from 2. May 1 16:46:36 gihub2 kernel: drbd0: conn( WFConnection -> Disconnecting ) May 1 16:46:36 gihub2 kernel: drbd0: Discarding network configuration. May 1 16:46:36 gihub2 kernel: drbd0: Connection closed May 1 16:46:36 gihub2 kernel: drbd0: conn( Disconnecting -> StandAlone ) May 1 16:46:36 gihub2 kernel: drbd0: receiver terminated May 1 16:46:36 gihub2 kernel: drbd0: Terminating receiver thread May 1 16:46:36 gihub2 kernel: drbd0: disk( UpToDate -> Diskless ) May 1 16:46:36 gihub2 kernel: drbd0: drbd_bm_resize called with capacity == 0 May 1 16:46:36 gihub2 kernel: drbd0: worker terminated May 1 16:46:36 gihub2 kernel: drbd0: Terminating worker thread May 1 16:46:36 gihub2 openais[5362]: [TOTEM] entering GATHER state from 0. May 1 16:46:36 gihub2 openais[5362]: [TOTEM] Creating commit token because I am the rep. May 1 16:46:36 gihub2 openais[5362]: [TOTEM] Saving state aru 6b high seq received 6b May 1 16:46:36 gihub2 lrmd: [5370]: info: rsc:drbd0: stop May 1 16:46:36 gihub2 cib: [5369]: notice: ais_dispatch: Membership 400: quorum lost May 1 16:46:36 gihub2 openais[5362]: [TOTEM] Storing new sequence id for ring 190 May 1 16:46:36 gihub2 openais[5362]: [TOTEM] entering COMMIT state. May 1 16:46:36 gihub2 openais[5362]: [TOTEM] entering RECOVERY state. May 1 16:46:36 gihub2 openais[5362]: [TOTEM] position [0] member 2.21.4.41: May 1 16:46:36 gihub2 openais[5362]: [TOTEM] previous ring seq 396 rep 2.21.4.40 May 1 16:46:36 gihub2 openais[5362]: [TOTEM] aru 6b high delivered 6b received flag 1 May 1 16:46:36 gihub2 openais[5362]: [TOTEM] Did not need to originate any messages in recovery. May 1 16:46:36 gihub2 openais[5362]: [TOTEM] Sending initial ORF token May 1 16:46:36 gihub2 pengine: [5372]: WARN: cluster_status: We do not have quorum - fencing and resource management disabled May 1 16:46:36 gihub2 crmd: [5373]: notice: ais_dispatch: Membership 400: quorum lost May 1 16:46:36 gihub2 crm_master: [6329]: info: Invoked: /usr/sbin/crm_master -l reboot -D May 1 16:46:36 gihub2 lrmd: [5370]: info: RA output: (drbd0:stop:stdout) 1 Trying master-drbd0=(null) delete via attrd May 1 16:46:36 gihub2 cib: [5369]: info: crm_update_peer: Node gihub1: id=671356162 state=lost (new) addr=r(0) ip(2.21.4.40) votes=1 born=396 seen=396 proc=00000000000000000000000000000002 May 1 16:46:36 gihub2 pengine: [5372]: WARN: unpack_resources: No STONITH resources have been defined May 1 16:46:36 gihub2 crmd: [5373]: info: ais_status_callback: status: gihub1 is now lost (was member) May 1 16:46:36 gihub2 cib: [5369]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/199, version=0.91.12): ok (rc=0) May 1 16:46:36 gihub2 openais[5362]: [CLM ] CLM CONFIGURATION CHANGE May 1 16:46:36 gihub2 openais[5362]: [CLM ] New Configuration: May 1 16:46:36 gihub2 openais[5362]: [CLM ] r(0) ip(2.21.4.41) May 1 16:46:36 gihub2 openais[5362]: [CLM ] Members Left: May 1 16:46:36 gihub2 pengine: [5372]: info: determine_online_status: Node gihub2 is online May 1 16:46:36 gihub2 crmd: [5373]: info: crm_update_peer: Node gihub1: id=671356162 state=lost (new) addr=r(0) ip(2.21.4.40) votes=1 born=396 seen=396 proc=00000000000000000000000000000002 May 1 16:46:36 gihub2 cib: [5369]: info: log_data_element: cib:diff: - <cib have-quorum="1" admin_epoch="0" epoch="91" num_updates="13" /> May 1 16:46:36 gihub2 pengine: [5372]: info: determine_online_status_fencing: Node gihub1 is down May 1 16:46:36 gihub2 crmd: [5373]: info: erase_node_from_join: Removed node gihub1 from join calculations: welcomed=0 itegrated=0 finalized=0 confirmed=1 May 1 16:46:36 gihub2 cib: [5369]: info: log_data_element: cib:diff: + <cib have-quorum="0" admin_epoch="0" epoch="92" num_updates="1" /> May 1 16:46:36 gihub2 pengine: [5372]: notice: native_print: drbd0 (ocf::heartbeat:drbd): Started gihub2 May 1 16:46:36 gihub2 crmd: [5373]: info: crm_update_quorum: Updating quorum status to false (call=201) May 1 16:46:36 gihub2 cib: [5369]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/201, version=0.92.1): ok (rc=0) May 1 16:46:36 gihub2 pengine: [5372]: notice: LogActions: Stop resource drbd0 (gihub2) May 1 16:46:36 gihub2 crmd: [5373]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change May 1 16:46:36 gihub2 cib: [5369]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/203, version=0.92.1): ok (rc=0) May 1 16:46:36 gihub2 crmd: [5373]: info: need_abort: Aborting on change to have-quorum May 1 16:46:36 gihub2 crmd: [5373]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] May 1 16:46:36 gihub2 openais[5362]: [CLM ] r(0) ip(2.21.4.40) May 1 16:46:36 gihub2 openais[5362]: [CLM ] Members Joined: May 1 16:46:36 gihub2 openais[5362]: [crm ] notice: pcmk_peer_update: Transitional membership event on ring 400: memb=1, new=0, lost=1 May 1 16:46:36 gihub2 openais[5362]: [crm ] info: pcmk_peer_update: memb: gihub2 688133378 May 1 16:46:36 gihub2 crmd: [5373]: info: do_state_transition: All 1 cluster nodes are eligible to run resources. May 1 16:46:36 gihub2 crmd: [5373]: info: do_pe_invoke: Query 204: Requesting the current CIB: S_POLICY_ENGINE May 1 16:46:36 gihub2 crmd: [5373]: info: te_graph_trigger: Transition 14 is now complete May 1 16:46:36 gihub2 openais[5362]: [crm ] info: pcmk_peer_update: lost: gihub1 671356162 May 1 16:46:36 gihub2 openais[5362]: [CLM ] CLM CONFIGURATION CHANGE May 1 16:46:36 gihub2 crmd: [5373]: info: notify_crmd: Transition 14 status: done - <null> May 1 16:46:36 gihub2 crmd: [5373]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1241192796-111, seq=400, quorate=0 May 1 16:46:36 gihub2 openais[5362]: [CLM ] New Configuration: May 1 16:46:36 gihub2 openais[5362]: [CLM ] r(0) ip(2.21.4.41) May 1 16:46:36 gihub2 openais[5362]: [CLM ] Members Left: May 1 16:46:36 gihub2 crmd: [5373]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] May 1 16:46:36 gihub2 crmd: [5373]: info: unpack_graph: Unpacked transition 15: 2 actions in 2 synapses May 1 16:46:36 gihub2 crmd: [5373]: info: do_te_invoke: Processing graph 15 (ref=pe_calc-dc-1241192796-111) derived from /var/lib/pengine/pe-input-86.bz2 May 1 16:46:36 gihub2 crmd: [5373]: info: te_rsc_command: Initiating action 4: stop drbd0_stop_0 on gihub2 (local) May 1 16:46:36 gihub2 crmd: [5373]: info: do_lrm_rsc_op: Performing key=4:15:0:5e0c32fb-7963-4f0e-a7ce-f96f825ba724 op=drbd0_stop_0 ) May 1 16:46:36 gihub2 cib: [6292]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-88.raw May 1 16:46:36 gihub2 pengine: [5372]: info: process_pe_message: Transition 15: PEngine Input stored in: /var/lib/pengine/pe-input-86.bz2 May 1 16:46:36 gihub2 openais[5362]: [CLM ] Members Joined: May 1 16:46:36 gihub2 openais[5362]: [crm ] notice: pcmk_peer_update: Stable membership event on ring 400: memb=1, new=0, lost=0 May 1 16:46:36 gihub2 pengine: [5372]: info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. May 1 16:46:36 gihub2 lrmd: [5370]: info: RA output: (drbd0:stop:stdout) May 1 16:46:36 gihub2 crmd: [5373]: info: process_lrm_event: LRM operation drbd0_stop_0 (call=12, rc=0, cib-update=205, confirmed=true) complete ok May 1 16:46:36 gihub2 crmd: [5373]: info: match_graph_event: Action drbd0_stop_0 (4) confirmed on gihub2 (rc=0) May 1 16:46:36 gihub2 crmd: [5373]: info: te_pseudo_action: Pseudo action 1 fired and confirmed May 1 16:46:36 gihub2 crmd: [5373]: info: run_graph: ==================================================== May 1 16:46:36 gihub2 crmd: [5373]: notice: run_graph: Transition 15 (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-86.bz2): Complete May 1 16:46:36 gihub2 openais[5362]: [crm ] info: pcmk_peer_update: MEMB: gihub2 688133378 May 1 16:46:36 gihub2 openais[5362]: [crm ] info: ais_mark_unseen_peer_dead: Node gihub1 was not seen in the previous transition May 1 16:46:36 gihub2 openais[5362]: [MAIN ] info: update_member: Node 671356162/gihub1 is now: lost May 1 16:46:36 gihub2 openais[5362]: [crm ] info: send_member_notification: Sending membership update 400 to 2 children The drbd worker processes are present only on one node at the same time. I'm not yet experienced enough to understand what could be wrong but it seems as if the OCF RA for DRBD is only able to run on one node at a time. This would lead me to think that it needs to be a clone but this isn't in the howto. Problem 2 - Using heartbeat1 style drbddisk RA: As I read that Linbit devs recommend to use the old heartbeat-1 style drbddisk RA I decided to go that route. I found the haresources2cib.py script, used it and got the XML into the CIB. crm_mon showed lots and lots of errors. The XML generated is: <?xml version="1.0" ?> <cib admin_epoch="0" epoch="0" num_updates="0"> <configuration> <crm_config> <cluster_property_set id="cib-bootstrap-options"> <attributes> <nvpair id="cib-bootstrap-options-symmetric-cluster" name="symmetric-cluster" value="true"/> <nvpair id="cib-bootstrap-options-no-quorum-policy" name="no-quorum-policy" value="stop"/> <nvpair id="cib-bootstrap-options-default-resource-stickiness" name="default-resource-stickiness" value="0"/> <nvpair id="cib-bootstrap-options-default-resource-failure-stickiness" name="default-resource-failure-stickiness" value="0"/> <nvpair id="cib-bootstrap-options-stonith-enabled" name="stonith-enabled" value="false"/> <nvpair id="cib-bootstrap-options-stonith-action" name="stonith-action" value="reboot"/> <nvpair id="cib-bootstrap-options-startup-fencing" name="startup-fencing" value="true"/> <nvpair id="cib-bootstrap-options-stop-orphan-resources" name="stop-orphan-resources" value="true"/> <nvpair id="cib-bootstrap-options-stop-orphan-actions" name="stop-orphan-actions" value="true"/> <nvpair id="cib-bootstrap-options-remove-after-stop" name="remove-after-stop" value="false"/> <nvpair id="cib-bootstrap-options-short-resource-names" name="short-resource-names" value="true"/> <nvpair id="cib-bootstrap-options-transition-idle-timeout" name="transition-idle-timeout" value="5min"/> <nvpair id="cib-bootstrap-options-default-action-timeout" name="default-action-timeout" value="20s"/> <nvpair id="cib-bootstrap-options-is-managed-default" name="is-managed-default" value="true"/> <nvpair id="cib-bootstrap-options-cluster-delay" name="cluster-delay" value="60s"/> <nvpair id="cib-bootstrap-options-pe-error-series-max" name="pe-error-series-max" value="-1"/> <nvpair id="cib-bootstrap-options-pe-warn-series-max" name="pe-warn-series-max" value="-1"/> <nvpair id="cib-bootstrap-options-pe-input-series-max" name="pe-input-series-max" value="-1"/> </attributes> </cluster_property_set> </crm_config> <nodes/> <resources> <group id="group_1"> <primitive class="ocf" id="IPaddr_2_21_4_45" provider="heartbeat" type="IPaddr"> <operations> <op id="IPaddr_2_21_4_45_mon" interval="5s" name="monitor" timeout="5s"/> </operations> <instance_attributes id="IPaddr_2_21_4_45_inst_attr"> <attributes> <nvpair id="IPaddr_2_21_4_45_attr_0" name="ip" value="2.21.4.45"/> <nvpair id="IPaddr_2_21_4_45_attr_2" name="cidr_netmask" value="8"/> </attributes> </instance_attributes> </primitive> <primitive class="heartbeat" id="drbddisk_2" provider="heartbeat" type="drbddisk"> <operations> <op id="drbddisk_2_mon" interval="120s" name="monitor" timeout="60s"/> </operations> <instance_attributes id="drbddisk_2_inst_attr"> <attributes> <nvpair id="drbddisk_2_attr_1" name="1" value="gihub_disk"/> </attributes> </instance_attributes> </primitive> <primitive class="ocf" id="Filesystem_3" provider="heartbeat" type="Filesystem"> <operations> <op id="Filesystem_3_mon" interval="120s" name="monitor" timeout="60s"/> </operations> <instance_attributes id="Filesystem_3_inst_attr"> <attributes> <nvpair id="Filesystem_3_attr_0" name="device" value="/dev/drbd0"/> <nvpair id="Filesystem_3_attr_1" name="directory" value="/www/a/home"/> <nvpair id="Filesystem_3_attr_2" name="fstype" value="ext3"/> <nvpair id="Filesystem_3_attr_3" name="options" value="defaults"/> </attributes> </instance_attributes> </primitive> </group> </resources> <constraints> <rsc_location id="rsc_location_group_1" rsc="group_1"> <rule id="prefered_location_group_1" score="100"> <expression attribute="#uname" id="prefered_location_group_1_expr" operation="eq" value="gihub1"/> </rule> </rsc_location> </constraints> </configuration> <status/> </cib> >From this haresources file: gihub1 IPaddr::2.21.4.45/8 drbddisk::gihub_disk \ Filesystem::/dev/drbd0::/www/a/home::ext3::defaults When I try to import it into the CIB I get: Call cib_create failed (-45): Update was older than existing configuration <null> I edit the admin_epoch to be 1 (not sure if this is correct) and then try to create the CIB again: gihub1:~ # cibadmin -C -x cib.xml Call cib_create failed (-47): Update does not conform to the configured schema/DTD <null> So after googling I find you have to replace the CIB rather than create it even though I had already run cibadmin -E --force . Now it goes in but the following happens: gihub1:~ # crm_mon -1 element cib: validity error : No declaration for attribute have-quorum of element cib element cib: validity error : No declaration for attribute dc-uuid of element cib element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute transition_magic element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute call_id element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute rc_code element lrm_rsc_op: validity error : Element lrm_rsc_op does not carry attribute op_status element lrm_rsc_op: validity error : No declaration for attribute transition-key of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute transition-magic of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute call-id of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute rc-code of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-status of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-run of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute last-rc-change of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute exec-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute queue-time of element lrm_rsc_op element lrm_rsc_op: validity error : No declaration for attribute op-digest of element lrm_rsc_op ============ Last updated: Fri May 1 17:13:00 2009 Current DC: gihub2 - partition with quorum 2 Nodes configured, unknown expected votes 1 Resources configured. ============ Online: [ gihub1 gihub2 ] Resource Group: group_1 IPaddr_2_21_4_45 (ocf::heartbeat:IPaddr): Started gihub1 drbddisk_2 (heartbeat:drbddisk): Stopped Filesystem_3 (ocf::heartbeat:Filesystem): Stopped Failed actions: drbddisk_2_start_0 (node=gihub1, call=110, rc=1, status=complete): unknown error Does this mean haresources2cib.py doesn't work with pacemaker 1? If anyone has any suggestions about either issue, or can point to some docs on how to set up DRBD with Pacemaker 1 that would be very helpful. Thanks. Darren Mansell _______________________________________________ Linux-HA mailing list Linux-HA@lists.linux-ha.org http://lists.linux-ha.org/mailman/listinfo/linux-ha See also: http://linux-ha.org/ReportingProblems
