heartbeat[19246]: 2007/11/01_13:03:19 WARN: Logging daemon is disabled --enabling logging daemon is recommended
heartbeat[19246]: 2007/11/01_13:03:19 info: **************************
heartbeat[19246]: 2007/11/01_13:03:19 info: Configuration validated. Starting heartbeat 2.1.3
heartbeat[19247]: 2007/11/01_13:03:19 info: heartbeat: version 2.1.3
heartbeat[19247]: 2007/11/01_13:03:19 info: Heartbeat generation: 1193886508
heartbeat[19247]: 2007/11/01_13:03:19 info: G_main_add_TriggerHandler: Added signal manual handler
heartbeat[19247]: 2007/11/01_13:03:19 info: G_main_add_TriggerHandler: Added signal manual handler
heartbeat[19247]: 2007/11/01_13:03:19 info: Removing /var/run/heartbeat/rsctmp failed, recreating.
heartbeat[19247]: 2007/11/01_13:03:19 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth1
heartbeat[19247]: 2007/11/01_13:03:19 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth1 - Status: 1
heartbeat[19247]: 2007/11/01_13:03:19 info: G_main_add_SignalHandler: Added signal handler for signal 17
heartbeat[19247]: 2007/11/01_13:03:19 info: Local status now set to: 'up'
heartbeat[19247]: 2007/11/01_13:03:20 info: Link rh44-1:eth1 up.
heartbeat[19247]: 2007/11/01_13:03:25 info: Link rh44-2:eth1 up.
heartbeat[19247]: 2007/11/01_13:03:25 info: Status update for node rh44-2: status up
heartbeat[19247]: 2007/11/01_13:03:25 debug: get_delnodelist: delnodelist= 
heartbeat[19247]: 2007/11/01_13:03:26 info: Comm_now_up(): updating status to active
heartbeat[19247]: 2007/11/01_13:03:26 info: Local status now set to: 'active'
heartbeat[19247]: 2007/11/01_13:03:26 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90)
heartbeat[19247]: 2007/11/01_13:03:26 info: Starting child client "/usr/lib/heartbeat/cib" (90,90)
heartbeat[19247]: 2007/11/01_13:03:26 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0)
heartbeat[19247]: 2007/11/01_13:03:26 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0)
heartbeat[19247]: 2007/11/01_13:03:26 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90)
heartbeat[19247]: 2007/11/01_13:03:26 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90)
heartbeat[19247]: 2007/11/01_13:03:26 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0)
heartbeat[19247]: 2007/11/01_13:03:26 WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 80 ms (> 50 ms) (GSource: 0x9ba1ce8)
heartbeat[19247]: 2007/11/01_13:03:26 info: Status update for node rh44-2: status active
heartbeat[19258]: 2007/11/01_13:03:26 info: Starting "/usr/lib/heartbeat/ccm" as uid 90  gid 90 (pid 19258)
heartbeat[19259]: 2007/11/01_13:03:26 info: Starting "/usr/lib/heartbeat/cib" as uid 90  gid 90 (pid 19259)
heartbeat[19261]: 2007/11/01_13:03:26 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0  gid 0 (pid 19261)
stonithd[19261]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 10
stonithd[19261]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 12
heartbeat[19262]: 2007/11/01_13:03:26 info: Starting "/usr/lib/heartbeat/attrd" as uid 90  gid 90 (pid 19262)
heartbeat[19263]: 2007/11/01_13:03:26 info: Starting "/usr/lib/heartbeat/crmd" as uid 90  gid 90 (pid 19263)
heartbeat[19264]: 2007/11/01_13:03:26 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0  gid 0 (pid 19264)
cib[19259]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 15
cib[19259]: 2007/11/01_13:03:26 info: G_main_add_TriggerHandler: Added signal manual handler
cib[19259]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 17
cib[19259]: 2007/11/01_13:03:26 info: main: Retrieval of a per-action CIB: disabled
heartbeat[19260]: 2007/11/01_13:03:26 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0  gid 0 (pid 19260)
ccm[19258]: 2007/11/01_13:03:26 info: Hostname: rh44-1
lrmd[19260]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 15
lrmd[19260]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 17
lrmd[19260]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 10
lrmd[19260]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 12
lrmd[19260]: 2007/11/01_13:03:26 info: Started.
stonithd[19261]: 2007/11/01_13:03:26 info: Signing in with heartbeat.
crmd[19263]: 2007/11/01_13:03:26 info: main: CRM Hg Version: node: 0f41ec29aef5cdeccdb630ac34f09cee666ce771

crmd[19263]: 2007/11/01_13:03:26 info: crmd_init: Starting crmd
crmd[19263]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 15
crmd[19263]: 2007/11/01_13:03:26 info: G_main_add_TriggerHandler: Added signal manual handler
cib[19259]: 2007/11/01_13:03:26 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk] <cib generated="false" admin_epoch="0" epoch="6" num_updates="1" have_quorum="false" ignore_dtd="false" num_peers="2" cib-last-written="Thu Nov  1 12:09:02 2007" cib_feature_revision="1.3" ccm_transition="2">
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk]   <configuration>
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk]     <crm_config>
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk]       <cluster_property_set id="cib-bootstrap-options">
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk]         <attributes>
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="symmetric-cluster" name="symmetric-cluster" value="true"/>
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="no-quorum-policy" name="no-quorum-policy" value="ignore"/>
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="stonith-enabled" name="stonith-enabled" value="false"/>
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="short-resource-names" name="short-resource-names" value="true"/>
attrd[19262]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 15
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="is-managed-default" name="is-managed-default" value="true"/>
stonithd[19261]: 2007/11/01_13:03:26 notice: /usr/lib/heartbeat/stonithd start up successfully.
attrd[19262]: 2007/11/01_13:03:26 info: register_with_ha: Hostname: rh44-1
stonithd[19261]: 2007/11/01_13:03:26 info: G_main_add_SignalHandler: Added signal handler for signal 17
cib[19259]: 2007/11/01_13:03:26 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="default-resource-stickiness" name="default-resource-stickiness" value="INFINITY"/>
crmd[19263]: 2007/11/01_13:03:27 info: G_main_add_SignalHandler: Added signal handler for signal 17
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="stop-orphan-resources" name="stop-orphan-resources" value="true"/>
mgmtd[19264]: 2007/11/01_13:03:27 info: G_main_add_SignalHandler: Added signal handler for signal 15
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="stop-orphan-actions" name="stop-orphan-actions" value="true"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="remove-after-stop" name="remove-after-stop" value="false"/>
mgmtd[19264]: 2007/11/01_13:03:27 debug: Enabling coredumps
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="default-resource-failure-stickiness" name="default-resource-failure-stickiness" value="-INFINITY"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="stonith-action" name="stonith-action" value="reboot"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="default-action-timeout" name="default-action-timeout" value="120s"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="dc-deadtime" name="dc-deadtime" value="10s"/>
mgmtd[19264]: 2007/11/01_13:03:27 info: G_main_add_SignalHandler: Added signal handler for signal 10
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="cluster-recheck-interval" name="cluster-recheck-interval" value="0"/>
mgmtd[19264]: 2007/11/01_13:03:27 info: G_main_add_SignalHandler: Added signal handler for signal 12
attrd[19262]: 2007/11/01_13:03:27 info: register_with_ha: UUID: 1b983d2a-c2eb-4dbd-a07b-061974558ace
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="election-timeout" name="election-timeout" value="2min"/>
mgmtd[19264]: 2007/11/01_13:03:27 info: init_crm
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="shutdown-escalation" name="shutdown-escalation" value="20min"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="crmd-integration-timeout" name="crmd-integration-timeout" value="3min"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="crmd-finalization-timeout" name="crmd-finalization-timeout" value="10min"/>
mgmtd[19264]: 2007/11/01_13:03:27 info: login to cib: 0, ret:-10
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="cluster-delay" name="cluster-delay" value="180s"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="pe-error-series-max" name="pe-error-series-max" value="-1"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="pe-warn-series-max" name="pe-warn-series-max" value="-1"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="pe-input-series-max" name="pe-input-series-max" value="-1"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="startup-fencing" name="startup-fencing" value="true"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="2.1.3-node: 0f41ec29aef5cdeccdb630ac34f09cee666ce771"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         </attributes>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       </cluster_property_set>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]     </crm_config>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]     <nodes>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       <node id="1b983d2a-c2eb-4dbd-a07b-061974558ace" uname="rh44-1" type="normal"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       <node id="fe50e16b-3592-4d85-9aec-5e32b08b2afd" uname="rh44-2" type="normal"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]     </nodes>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]     <resources>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       <group id="test">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         <primitive id="resource_3" class="ocf" type="IPaddr" provider="heartbeat">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <instance_attributes id="resource_3_instance_attrs">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             <attributes>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]               <nvpair id="24e2ce9b-e49b-462c-9453-69e860161a1e" name="ip" value="192.168.40.92"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]               <nvpair id="86033e50-bd56-4789-b1ec-9ad0d4bae6f4" name="nic" value="eth0"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]               <nvpair id="ca3d8bb6-17eb-40f8-8192-c2d69a115bde" name="cidr_netmask" value="24"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             </attributes>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           </instance_attributes>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <operations>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             <op id="ipPostgreSQLDB_start" name="start" timeout="60s" on_fail="fence"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             <op id="ipPostgreSQLDB_monitor" name="monitor" interval="10s" timeout="60s" on_fail="fence"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             <op id="ipPostgreSQLDB_stop" name="stop" timeout="60s" on_fail="fence"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           </operations>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         </primitive>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       </group>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       <clone id="clone1">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         <meta_attributes id="clone1_meta_attrs">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <attributes>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             <nvpair id="clone1_metaattr_target_role" name="target_role" value="started"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             <nvpair id="clone1_metaattr_clone_max" name="clone_max" value="2"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             <nvpair id="clone1_metaattr_clone_node_max" name="clone_node_max" value="1"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           </attributes>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         </meta_attributes>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         <primitive id="resource_dummy" class="ocf" type="Dummy" provider="heartbeat">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <operations>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             <op id="clone0-diskcheck_start" name="start" timeout="60s" on_fail="fence" start_delay="0" disabled="false" role="Started"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             <op id="clone0-diskcheck_monitor" name="monitor" interval="10s" timeout="60s" on_fail="fence" start_delay="0" disabled="false" role="Started"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]             <op id="clone0-diskcheck_stop" name="stop" timeout="60s" on_fail="fence" start_delay="0" disabled="false" role="Started"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           </operations>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         </primitive>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       </clone>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]     </resources>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]     <constraints>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       <rsc_location id="rlcPostgreSQLDB" rsc="test">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         <rule id="rulPostgreSQLDB_node01" score="200">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <expression id="expPostgreSQLDB_node01" attribute="#uname" operation="eq" value="rh44-1"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         </rule>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         <rule id="rulPostgreSQLDB_node02" score="100">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <expression id="expPostgreSQLDB_node02" attribute="#uname" operation="eq" value="rh44-2"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         </rule>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       </rsc_location>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       <rsc_location id="diskcheck0:grpPostgreSQLDB" rsc="test">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         <rule id="diskcheck0:rule0" score="-INFINITY" boolean_op="and">
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <expression id="diskcheck0:rule0-0" attribute="diskcheck_status" operation="defined"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]           <expression id="diskcheck0:rule0-1" attribute="diskcheck_status" operation="eq" value="ERROR"/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]         </rule>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]       </rsc_location>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]     </constraints>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]   </configuration>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk]   <status/>
cib[19259]: 2007/11/01_13:03:27 info: log_data_element: readCibXmlFile: [on-disk] </cib>
cib[19259]: 2007/11/01_13:03:27 info: startCib: CIB Initialization completed successfully
cib[19259]: 2007/11/01_13:03:27 info: cib_register_ha: Signing in with Heartbeat
cib[19259]: 2007/11/01_13:03:27 info: cib_register_ha: FSA Hostname: rh44-1
cib[19259]: 2007/11/01_13:03:27 info: ccm_connect: Registering with CCM...
cib[19259]: 2007/11/01_13:03:27 WARN: ccm_connect: CCM Activation failed
cib[19259]: 2007/11/01_13:03:27 WARN: ccm_connect: CCM Connection failed 1 times (30 max)
ccm[19258]: 2007/11/01_13:03:28 info: G_main_add_SignalHandler: Added signal handler for signal 15
cib[19259]: 2007/11/01_13:03:30 info: ccm_connect: Registering with CCM...
heartbeat[19247]: 2007/11/01_13:03:30 WARN: 1 lost packet(s) for [rh44-2] [15:17]
heartbeat[19247]: 2007/11/01_13:03:30 info: No pkts missing from rh44-2!
cib[19259]: 2007/11/01_13:03:30 info: cib_init: Starting cib mainloop
crmd[19263]: 2007/11/01_13:03:30 info: do_cib_control: CIB connection established
crmd[19263]: 2007/11/01_13:03:30 info: register_with_ha: Hostname: rh44-1
cib[19259]: 2007/11/01_13:03:30 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on
cib[19259]: 2007/11/01_13:03:30 info: cib_client_status_callback: Status update: Client rh44-1/cib now has status [join]
cib[19259]: 2007/11/01_13:03:30 info: cib_client_status_callback: Status update: Client rh44-1/cib now has status [online]
cib[19259]: 2007/11/01_13:03:30 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on
cib[19265]: 2007/11/01_13:03:31 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
cib[19265]: 2007/11/01_13:03:31 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
cib[19265]: 2007/11/01_13:03:31 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last)
cib[19265]: 2007/11/01_13:03:31 info: write_cib_contents: Wrote version 0.6.1 of the CIB to disk (digest: 52a598a64e8caed46fe4a9bc49d38225)
cib[19265]: 2007/11/01_13:03:31 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
cib[19265]: 2007/11/01_13:03:31 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last)
crmd[19263]: 2007/11/01_13:03:31 info: register_with_ha: UUID: 1b983d2a-c2eb-4dbd-a07b-061974558ace
cib[19259]: 2007/11/01_13:03:31 info: cib_client_status_callback: Status update: Client rh44-2/cib now has status [online]
crmd[19263]: 2007/11/01_13:03:31 info: populate_cib_nodes: Requesting the list of configured nodes
heartbeat[19247]: 2007/11/01_13:03:32 WARN: 1 lost packet(s) for [rh44-2] [22:24]
heartbeat[19247]: 2007/11/01_13:03:32 info: No pkts missing from rh44-2!
mgmtd[19264]: 2007/11/01_13:03:32 debug: main: run the loop...
mgmtd[19264]: 2007/11/01_13:03:32 info: Started.
crmd[19263]: 2007/11/01_13:03:32 notice: populate_cib_nodes: Node: rh44-2 (uuid: fe50e16b-3592-4d85-9aec-5e32b08b2afd)
crmd[19263]: 2007/11/01_13:03:33 notice: populate_cib_nodes: Node: rh44-1 (uuid: 1b983d2a-c2eb-4dbd-a07b-061974558ace)
crmd[19263]: 2007/11/01_13:03:33 info: do_ha_control: Connected to Heartbeat
crmd[19263]: 2007/11/01_13:03:33 info: do_ccm_control: CCM connection established... waiting for first callback
crmd[19263]: 2007/11/01_13:03:33 info: do_started: Delaying start, CCM (0000000000100000) not connected
crmd[19263]: 2007/11/01_13:03:33 info: crmd_init: Starting crmd's mainloop
crmd[19263]: 2007/11/01_13:03:33 notice: crmd_client_status_callback: Status update: Client rh44-1/crmd now has status [online]
crmd[19263]: 2007/11/01_13:03:33 notice: crmd_client_status_callback: Status update: Client rh44-1/crmd now has status [online]
cib[19259]: 2007/11/01_13:03:33 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
cib[19259]: 2007/11/01_13:03:33 info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
cib[19259]: 2007/11/01_13:03:33 info: cib_ccm_msg_callback: PEER: rh44-2
cib[19259]: 2007/11/01_13:03:33 info: cib_ccm_msg_callback: PEER: rh44-1
crmd[19263]: 2007/11/01_13:03:33 notice: crmd_client_status_callback: Status update: Client rh44-2/crmd now has status [online]
crmd[19263]: 2007/11/01_13:03:34 info: do_started: Delaying start, CCM (0000000000100000) not connected
crmd[19263]: 2007/11/01_13:03:34 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
crmd[19263]: 2007/11/01_13:03:34 info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
crmd[19263]: 2007/11/01_13:03:34 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2)
crmd[19263]: 2007/11/01_13:03:34 info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
crmd[19263]: 2007/11/01_13:03:34 info: ccm_event_detail: 	CURRENT: rh44-2 [nodeid=1, born=1]
crmd[19263]: 2007/11/01_13:03:34 info: ccm_event_detail: 	CURRENT: rh44-1 [nodeid=0, born=2]
crmd[19263]: 2007/11/01_13:03:34 info: ccm_event_detail: 	NEW:     rh44-2 [nodeid=1, born=1]
crmd[19263]: 2007/11/01_13:03:34 info: ccm_event_detail: 	NEW:     rh44-1 [nodeid=0, born=2]
crmd[19263]: 2007/11/01_13:03:34 info: do_started: The local CRM is operational
crmd[19263]: 2007/11/01_13:03:34 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ]
crmd[19263]: 2007/11/01_13:03:34 info: update_dc: Set DC to <null> (<null>)
attrd[19262]: 2007/11/01_13:03:37 info: main: Starting mainloop...
crmd[19263]: 2007/11/01_13:03:45 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped!
crmd[19263]: 2007/11/01_13:03:45 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING)
crmd[19263]: 2007/11/01_13:03:45 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
crmd[19263]: 2007/11/01_13:03:45 info: update_dc: Set DC to <null> (<null>)
crmd[19263]: 2007/11/01_13:03:45 info: do_election_count_vote: Election check: vote from rh44-2
crmd[19263]: 2007/11/01_13:03:45 info: update_dc: Set DC to <null> (<null>)
crmd[19263]: 2007/11/01_13:03:45 info: do_election_check: Still waiting on 2 non-votes (2 total)
crmd[19263]: 2007/11/01_13:03:45 info: do_election_count_vote: Updated voted hash for rh44-1 to vote
crmd[19263]: 2007/11/01_13:03:45 info: do_election_count_vote: Election ignore: our vote (rh44-1)
crmd[19263]: 2007/11/01_13:03:45 info: do_election_check: Still waiting on 1 non-votes (2 total)
crmd[19263]: 2007/11/01_13:03:45 info: do_state_transition: State transition S_ELECTION -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
crmd[19263]: 2007/11/01_13:03:45 info: update_dc: Set DC to <null> (<null>)
crmd[19263]: 2007/11/01_13:03:45 info: do_dc_release: DC role released
crmd[19263]: 2007/11/01_13:03:46 info: do_election_count_vote: Election check: vote from rh44-2
crmd[19263]: 2007/11/01_13:03:46 info: update_dc: Set DC to <null> (<null>)
crmd[19263]: 2007/11/01_13:03:47 info: update_dc: Set DC to rh44-2 (2.0)
cib[19259]: 2007/11/01_13:03:47 WARN: cib_process_diff: Diff 0.5.3 -> 0.5.4 not applied to 0.6.1: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:03:47 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:47 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:47 WARN: cib_process_diff: Diff 0.5.4 -> 0.5.5 not applied to 0.6.1: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:03:47 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:47 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:48 info: sync_our_cib: Syncing CIB to all peers
cib[19259]: 2007/11/01_13:03:50 WARN: cib_process_diff: Diff 0.5.5 -> 0.5.6 not applied to 0.6.1: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:03:50 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:50 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
crmd[19263]: 2007/11/01_13:03:50 info: update_dc: Set DC to rh44-2 (2.0)
cib[19259]: 2007/11/01_13:03:50 WARN: cib_process_diff: Diff 0.5.6 -> 0.5.7 not applied to 0.6.1: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:03:50 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:50 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:50 WARN: cib_process_diff: Diff 0.5.7 -> 0.5.8 not applied to 0.6.1: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:03:50 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:50 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
crmd[19263]: 2007/11/01_13:03:50 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
cib[19259]: 2007/11/01_13:03:50 WARN: cib_process_diff: Diff 0.5.8 -> 0.5.9 not applied to 0.6.1: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:03:50 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:50 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:51 WARN: cib_process_diff: Diff 0.5.9 -> 0.5.10 not applied to 0.6.1: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:03:51 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:03:51 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
crmd[19263]: 2007/11/01_13:03:51 info: do_lrm_rsc_op: Performing op=resource_3_monitor_0 key=3:0:cc38e5bc-2350-413d-9d9a-97e70aba8796)
lrmd[19260]: 2007/11/01_13:03:51 info: rsc:resource_3: monitor
crmd[19263]: 2007/11/01_13:03:51 info: do_lrm_rsc_op: Performing op=resource_dummy:0_monitor_0 key=4:0:cc38e5bc-2350-413d-9d9a-97e70aba8796)
lrmd[19260]: 2007/11/01_13:03:51 info: rsc:resource_dummy:0: monitor
crmd[19263]: 2007/11/01_13:03:51 info: do_lrm_rsc_op: Performing op=resource_dummy:1_monitor_0 key=5:0:cc38e5bc-2350-413d-9d9a-97e70aba8796)
lrmd[19260]: 2007/11/01_13:03:51 info: rsc:resource_dummy:1: monitor
Dummy[19273]:	2007/11/01_13:03:51 DEBUG: resource_dummy:0 monitor : 7
crmd[19263]: 2007/11/01_13:03:51 info: process_lrm_event: LRM operation resource_dummy:0_monitor_0 (call=3, rc=7) complete 
Dummy[19274]:	2007/11/01_13:03:52 DEBUG: resource_dummy:1 monitor : 7
crmd[19263]: 2007/11/01_13:03:52 info: process_lrm_event: LRM operation resource_dummy:1_monitor_0 (call=4, rc=7) complete 
crmd[19263]: 2007/11/01_13:03:52 info: process_lrm_event: LRM operation resource_3_monitor_0 (call=2, rc=7) complete 
heartbeat[19247]: 2007/11/01_13:03:52 WARN: 1 lost packet(s) for [rh44-2] [57:59]
heartbeat[19247]: 2007/11/01_13:03:52 WARN: 1 lost packet(s) for [rh44-2] [59:61]
heartbeat[19247]: 2007/11/01_13:03:53 WARN: 2 lost packet(s) for [rh44-2] [63:66]
crmd[19263]: 2007/11/01_13:03:53 info: do_election_count_vote: Election check: vote from rh44-2
crmd[19263]: 2007/11/01_13:03:53 info: update_dc: Set DC to <null> (<null>)
crmd[19263]: 2007/11/01_13:03:53 info: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
crmd[19263]: 2007/11/01_13:03:53 info: update_dc: Set DC to <null> (<null>)
crmd[19263]: 2007/11/01_13:03:54 info: update_dc: Set DC to rh44-2 (2.0)
heartbeat[19247]: 2007/11/01_13:03:55 WARN: 1 lost packet(s) for [rh44-2] [75:77]
crmd[19263]: 2007/11/01_13:03:55 info: update_dc: Set DC to rh44-2 (2.0)
crmd[19263]: 2007/11/01_13:03:55 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
heartbeat[19247]: 2007/11/01_13:03:56 WARN: 1 lost packet(s) for [rh44-2] [82:84]
heartbeat[19247]: 2007/11/01_13:03:57 WARN: 1 lost packet(s) for [rh44-2] [84:86]
crmd[19263]: 2007/11/01_13:03:57 info: do_lrm_rsc_op: Performing op=resource_3_start_0 key=5:1:cc38e5bc-2350-413d-9d9a-97e70aba8796)
lrmd[19260]: 2007/11/01_13:03:57 info: rsc:resource_3: start
crmd[19263]: 2007/11/01_13:03:57 info: do_lrm_rsc_op: Performing op=resource_dummy:1_start_0 key=13:1:cc38e5bc-2350-413d-9d9a-97e70aba8796)
lrmd[19260]: 2007/11/01_13:03:57 info: rsc:resource_dummy:1: start
Dummy[19298]:	2007/11/01_13:03:57 DEBUG: resource_dummy:1 start : 0
crmd[19263]: 2007/11/01_13:03:57 info: process_lrm_event: LRM operation resource_dummy:1_start_0 (call=6, rc=0) complete 
IPaddr[19297]:	2007/11/01_13:03:57 INFO: Using calculated netmask for 192.168.40.92: 255.255.255.0
IPaddr[19297]:	2007/11/01_13:03:57 DEBUG: Using calculated broadcast for 192.168.40.92: 192.168.40.255
IPaddr[19297]:	2007/11/01_13:03:57 INFO: eval ifconfig eth0:0 192.168.40.92 netmask 255.255.255.0 broadcast 192.168.40.255
IPaddr[19297]:	2007/11/01_13:03:57 DEBUG: Sending Gratuitous Arp for 192.168.40.92 on eth0:0 [eth0]
cib[19259]: 2007/11/01_13:03:57 info: cib_replace_notify: Replaced: 0.6.1 -> 0.6.8 from <null>
crmd[19263]: 2007/11/01_13:03:57 info: populate_cib_nodes: Requesting the list of configured nodes
crmd[19263]: 2007/11/01_13:03:57 notice: populate_cib_nodes: Node: rh44-2 (uuid: fe50e16b-3592-4d85-9aec-5e32b08b2afd)
crmd[19263]: 2007/11/01_13:03:58 notice: populate_cib_nodes: Node: rh44-1 (uuid: 1b983d2a-c2eb-4dbd-a07b-061974558ace)
crmd[19263]: 2007/11/01_13:03:58 info: process_lrm_event: LRM operation resource_3_start_0 (call=5, rc=0) complete 
heartbeat[19247]: 2007/11/01_13:03:58 WARN: 1 lost packet(s) for [rh44-2] [88:90]
heartbeat[19247]: 2007/11/01_13:03:58 WARN: 1 lost packet(s) for [rh44-2] [90:92]
crmd[19263]: 2007/11/01_13:03:58 info: do_lrm_rsc_op: Performing op=resource_3_monitor_10000 key=7:2:cc38e5bc-2350-413d-9d9a-97e70aba8796)
crmd[19263]: 2007/11/01_13:03:58 info: process_lrm_event: LRM operation resource_3_monitor_10000 (call=7, rc=0) complete 
crmd[19263]: 2007/11/01_13:03:59 info: do_lrm_rsc_op: Performing op=resource_dummy:1_monitor_10000 key=17:2:cc38e5bc-2350-413d-9d9a-97e70aba8796)
Dummy[19428]:	2007/11/01_13:03:59 DEBUG: resource_dummy:1 monitor : 0
crmd[19263]: 2007/11/01_13:03:59 info: process_lrm_event: LRM operation resource_dummy:1_monitor_10000 (call=8, rc=0) complete 
heartbeat[19247]: 2007/11/01_13:04:00 WARN: 2 lost packet(s) for [rh44-2] [95:98]
heartbeat[19247]: 2007/11/01_13:04:04 info: No pkts missing from rh44-2!
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.5.10 -> 0.5.11 not applied to 0.6.8: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.5.11 -> 0.5.12 not applied to 0.6.8: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.5.12 -> 0.5.13 not applied to 0.6.8: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.5.13 -> 0.5.14 not applied to 0.6.8: current "epoch" is greater than required
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.6.1 -> 0.6.2 not applied to 0.6.8: current "num_updates" is greater than required
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.6.2 -> 0.6.3 not applied to 0.6.8: current "num_updates" is greater than required
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
crmd[19263]: 2007/11/01_13:04:04 ERROR: cib_rsc_callback: Resource update 14 failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
crmd[19263]: 2007/11/01_13:04:04 ERROR: cib_rsc_callback: Resource update 15 failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.6.3 -> 0.6.4 not applied to 0.6.8: current "num_updates" is greater than required
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.6.4 -> 0.6.5 not applied to 0.6.8: current "num_updates" is greater than required
crmd[19263]: 2007/11/01_13:04:04 ERROR: cib_rsc_callback: Resource update 16 failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.6.5 -> 0.6.6 not applied to 0.6.8: current "num_updates" is greater than required
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.6.6 -> 0.6.7 not applied to 0.6.8: current "num_updates" is greater than required
crmd[19263]: 2007/11/01_13:04:04 WARN: cib_native_callback: CIB command failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Diff 0.6.7 -> 0.6.8 not applied to 0.6.8: current "num_updates" is greater than required
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed
cib[19259]: 2007/11/01_13:04:04 info: apply_xml_diff: Digest mis-match: expected 707bd1aade37b833935e0ee1fde8260e, calculated 93fd3cb0bdd67e66de0656928f43e506
cib[19259]: 2007/11/01_13:04:04 info: cib_process_diff: Diff 0.6.11 -> 0.6.12 not applied to 0.6.11: Failed application of a global update.  Requesting full refresh.
cib[19259]: 2007/11/01_13:04:04 info: cib_process_diff: Requesting re-sync from peer: Failed application of a global update.  Requesting full refresh.
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Not applying diff 0.6.12 -> 0.6.13 (sync in progress)
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Not applying diff 0.6.13 -> 0.6.14 (sync in progress)
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Not applying diff 0.6.14 -> 0.6.15 (sync in progress)
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Not applying diff 0.6.15 -> 0.6.16 (sync in progress)
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Not applying diff 0.6.16 -> 0.6.17 (sync in progress)
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 info: cib_process_diff: Diff 0.6.17 -> 0.6.18 not applied to 0.6.11: current "num_updates" is less than required
cib[19259]: 2007/11/01_13:04:04 info: cib_process_diff: Requesting re-sync from peer: current "num_updates" is less than required
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Not applying diff 0.6.18 -> 0.6.19 (sync in progress)
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_diff: Not applying diff 0.6.19 -> 0.6.20 (sync in progress)
cib[19259]: 2007/11/01_13:04:04 WARN: do_cib_notify: cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
cib[19259]: 2007/11/01_13:04:04 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
heartbeat[19247]: 2007/11/01_13:04:05 WARN: 1 lost packet(s) for [rh44-2] [100:102]
heartbeat[19247]: 2007/11/01_13:04:05 WARN: 1 lost packet(s) for [rh44-2] [102:104]
Dummy[19456]:	2007/11/01_13:04:09 DEBUG: resource_dummy:1 monitor : 0
heartbeat[19247]: 2007/11/01_13:04:10 info: No pkts missing from rh44-2!
cib[19259]: 2007/11/01_13:04:10 info: cib_replace_notify: Replaced: 0.6.11 -> 0.6.20 from <null>
crmd[19263]: 2007/11/01_13:04:10 info: populate_cib_nodes: Requesting the list of configured nodes
crmd[19263]: 2007/11/01_13:04:11 notice: populate_cib_nodes: Node: rh44-2 (uuid: fe50e16b-3592-4d85-9aec-5e32b08b2afd)
crmd[19263]: 2007/11/01_13:04:11 notice: populate_cib_nodes: Node: rh44-1 (uuid: 1b983d2a-c2eb-4dbd-a07b-061974558ace)
Dummy[19484]:	2007/11/01_13:04:19 DEBUG: resource_dummy:1 monitor : 0
Dummy[19492]:	2007/11/01_13:04:29 DEBUG: resource_dummy:1 monitor : 0
Dummy[19520]:	2007/11/01_13:04:39 DEBUG: resource_dummy:1 monitor : 0
Dummy[19548]:	2007/11/01_13:04:49 DEBUG: resource_dummy:1 monitor : 0
Dummy[19576]:	2007/11/01_13:04:59 DEBUG: resource_dummy:1 monitor : 0
Dummy[19604]:	2007/11/01_13:05:09 DEBUG: resource_dummy:1 monitor : 0
Dummy[19632]:	2007/11/01_13:05:19 DEBUG: resource_dummy:1 monitor : 0
Dummy[19660]:	2007/11/01_13:05:29 DEBUG: resource_dummy:1 monitor : 0
Dummy[19689]:	2007/11/01_13:05:39 DEBUG: resource_dummy:1 monitor : 0
Dummy[19718]:	2007/11/01_13:05:49 DEBUG: resource_dummy:1 monitor : 0
Dummy[19746]:	2007/11/01_13:05:59 DEBUG: resource_dummy:1 monitor : 0
Dummy[19774]:	2007/11/01_13:06:09 DEBUG: resource_dummy:1 monitor : 0
Dummy[19802]:	2007/11/01_13:06:20 DEBUG: resource_dummy:1 monitor : 0
Dummy[19830]:	2007/11/01_13:06:30 DEBUG: resource_dummy:1 monitor : 0
Dummy[19858]:	2007/11/01_13:06:40 DEBUG: resource_dummy:1 monitor : 0
Dummy[19886]:	2007/11/01_13:06:50 DEBUG: resource_dummy:1 monitor : 0
Dummy[19914]:	2007/11/01_13:07:00 DEBUG: resource_dummy:1 monitor : 0
Dummy[19942]:	2007/11/01_13:07:10 DEBUG: resource_dummy:1 monitor : 0
Dummy[19974]:	2007/11/01_13:07:20 DEBUG: resource_dummy:1 monitor : 0
crmd[19263]: 2007/11/01_13:07:21 info: process_lrm_event: LRM operation resource_3_monitor_10000 (call=7, rc=7) complete 
crmd[19263]: 2007/11/01_13:07:22 info: do_lrm_rsc_op: Performing op=resource_3_stop_0 key=3:4:cc38e5bc-2350-413d-9d9a-97e70aba8796)
lrmd[19260]: 2007/11/01_13:07:22 info: rsc:resource_3: stop
crmd[19263]: 2007/11/01_13:07:22 info: process_lrm_event: LRM operation resource_3_monitor_10000 (call=7, rc=-2) Cancelled 
lrmd[19260]: 2007/11/01_13:07:22 info: RA output: (resource_3:stop:stdout) In IP Stop

crmd[19263]: 2007/11/01_13:07:22 info: process_lrm_event: LRM operation resource_3_stop_0 (call=9, rc=0) complete 
heartbeat[19247]: 2007/11/01_13:07:24 WARN: 1 lost packet(s) for [rh44-2] [207:209]
heartbeat[19247]: 2007/11/01_13:07:28 info: No pkts missing from rh44-2!
Dummy[20010]:	2007/11/01_13:07:30 DEBUG: resource_dummy:1 monitor : 0
Dummy[20018]:	2007/11/01_13:07:40 DEBUG: resource_dummy:1 monitor : 0
Dummy[20026]:	2007/11/01_13:07:50 DEBUG: resource_dummy:1 monitor : 0
Dummy[20034]:	2007/11/01_13:08:00 DEBUG: resource_dummy:1 monitor : 0
Dummy[20042]:	2007/11/01_13:08:10 DEBUG: resource_dummy:1 monitor : 0
Dummy[20050]:	2007/11/01_13:08:20 DEBUG: resource_dummy:1 monitor : 0
Dummy[20058]:	2007/11/01_13:08:30 DEBUG: resource_dummy:1 monitor : 0
Dummy[20066]:	2007/11/01_13:08:40 DEBUG: resource_dummy:1 monitor : 0
Dummy[20074]:	2007/11/01_13:08:50 DEBUG: resource_dummy:1 monitor : 0
Dummy[20082]:	2007/11/01_13:09:01 DEBUG: resource_dummy:1 monitor : 0
Dummy[20090]:	2007/11/01_13:09:11 DEBUG: resource_dummy:1 monitor : 0
Dummy[20098]:	2007/11/01_13:09:21 DEBUG: resource_dummy:1 monitor : 0
Dummy[20106]:	2007/11/01_13:09:31 DEBUG: resource_dummy:1 monitor : 0
Dummy[20114]:	2007/11/01_13:09:41 DEBUG: resource_dummy:1 monitor : 0
Dummy[20122]:	2007/11/01_13:09:51 DEBUG: resource_dummy:1 monitor : 0
Dummy[20130]:	2007/11/01_13:10:01 DEBUG: resource_dummy:1 monitor : 0
Dummy[20138]:	2007/11/01_13:10:11 DEBUG: resource_dummy:1 monitor : 0
Dummy[20146]:	2007/11/01_13:10:21 DEBUG: resource_dummy:1 monitor : 0
Dummy[20154]:	2007/11/01_13:10:31 DEBUG: resource_dummy:1 monitor : 0
Dummy[20162]:	2007/11/01_13:10:41 DEBUG: resource_dummy:1 monitor : 0
Dummy[20170]:	2007/11/01_13:10:51 DEBUG: resource_dummy:1 monitor : 0
Dummy[20178]:	2007/11/01_13:11:01 DEBUG: resource_dummy:1 monitor : 0
Dummy[20186]:	2007/11/01_13:11:11 DEBUG: resource_dummy:1 monitor : 0
Dummy[20194]:	2007/11/01_13:11:21 DEBUG: resource_dummy:1 monitor : 0
Dummy[20262]:	2007/11/01_13:11:32 DEBUG: resource_dummy:1 monitor : 0
Dummy[20270]:	2007/11/01_13:11:42 DEBUG: resource_dummy:1 monitor : 0
ccm[19258]: 2007/11/01_13:11:49 info: client (pid=20481) removed from ccm
Dummy[20544]:	2007/11/01_13:11:52 DEBUG: resource_dummy:1 monitor : 0
Dummy[20648]:	2007/11/01_13:12:02 DEBUG: resource_dummy:1 monitor : 0
Dummy[20658]:	2007/11/01_13:12:12 DEBUG: resource_dummy:1 monitor : 0
Dummy[20667]:	2007/11/01_13:12:22 DEBUG: resource_dummy:1 monitor : 0
Dummy[20747]:	2007/11/01_13:12:32 DEBUG: resource_dummy:1 monitor : 0
Dummy[20827]:	2007/11/01_13:12:42 DEBUG: resource_dummy:1 monitor : 0
Dummy[20839]:	2007/11/01_13:12:52 DEBUG: resource_dummy:1 monitor : 0
