Good Day, We had a node failure and we had to rebuild the whole server from scratch. After rebuilding Asterisk01 and rejoining it to the cluster something isn't working 100%.
It does fail over but the corosync.log file on the second node is growing at 1Gb every 15min. I have attached a piece of the log file and you can see the logs get filled with the same set of messages. Something isn't working properly but can figure out what exactly. Should I rather rebuild the cluster? Thank You in Advance Mark
Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178295: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178295: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356648) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356648, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178296 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178296 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178296: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178296 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178296: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178296 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178296: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178296 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178296 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178296: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178296: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178296: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356650) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356650, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178297 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178297 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178297: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178297 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178297: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178297 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178297: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178297 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178297 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178297: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178297: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178297: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356652) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356652, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178298 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178298 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178298: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178298 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178298: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178298 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178298: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178298 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178298 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178298: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178298: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178298: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356654) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356654, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178299 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178299 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178299: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178299 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178299: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178299 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178299: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178299 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178299 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178299: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178299: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178299: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356656) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356656, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178300 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178300 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178300: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178300 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178300: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178300 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178300: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178300 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178300 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178300: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178300: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178300: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356658) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356658, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178301 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178301 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178301: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178301 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178301: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178301 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178301: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178301 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178301 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178301: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178301: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178301: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356660) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356660, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178302 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178302 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178302: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178302 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178302: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178302 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178302: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178302 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178302 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178302: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178302: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178302: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356662) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356662, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178303 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178303 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178303: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178303 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178303: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178303 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178303: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178303 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178303 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178303: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178303: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178303: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356664) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356664, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178304 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178304 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178304: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178304 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178304: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178304 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178304: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178304 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178304 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178304: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178304: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178304: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356666) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356666, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178305 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178305 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178305: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178305 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178305: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178305 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178305: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178305 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178305 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178305: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178305: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178305: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356668) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356668, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178306 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178306 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178306: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178306 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178306: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178306 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178306: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178306 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178306 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178306: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178306: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178306: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356670) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356670, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178307 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178307 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178307: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178307 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178307: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178307 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178307: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178307 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178307 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178307: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178307: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178307: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356672) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356672, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178308 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178308 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178308: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178308 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178308: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178308 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178308: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178308 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178308 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178308: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178308: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178308: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356674) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356674, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178309 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178309 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178309: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178309 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178309: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178309 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178309: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178309 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178309 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178309: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178309: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178309: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356676) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356676, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178310 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178310 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178310: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178310 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178310: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178310 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178310: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178310 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178310 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178310: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178310: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178310: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356678) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356678, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178311 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178311 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178311: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178311 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178311: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178311 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178311: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178311 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178311 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178311: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178311: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178311: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356680) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356680, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178312 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178312 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178312: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178312 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178312: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178312 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178312: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178312 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178312 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178312: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178312: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178312: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356682) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356682, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178313 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178313 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178313: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178313 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178313: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178313 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178313: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178313 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178313 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178313: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178313: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178313: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356684) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha Jun 20 13:09:45 [19771] kpasterisk02 cib: info: __xml_diff_object: Moved node_state@crmd (3 -> 2) Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_perform_op: Discarding update with feature set '3.0.14' greater than our own '3.0.10' Jun 20 13:09:45 [19771] kpasterisk02 cib: error: cib_process_request: Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356684, version=0.45.44) Jun 20 13:09:45 [19776] kpasterisk02 crmd: error: finalize_sync_callback: Sync from kpasterisk01-ha failed: Protocol not supported Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: register_fsa_error_adv: Resetting the current action list Jun 20 13:09:45 [19776] kpasterisk02 crmd: warning: do_log: FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk02-ha[2] - join-17178314 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: initialize_join: Node kpasterisk01-ha[1] - join-17178314 phase 2 -> 0 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Unset DC. Was kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178314: Sending offer to kpasterisk02-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk02-ha[2] - join-17178314 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: join_make_offer: join-17178314: Sending offer to kpasterisk01-ha Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: join_make_offer: Node kpasterisk01-ha[1] - join-17178314 phase 0 -> 1 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_dc_join_offer_all: join-17178314: Waiting on 2 outstanding join acks Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: update_dc: Set DC to kpasterisk02-ha (3.0.10) Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178314 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crm_update_peer_join: do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178314 phase 1 -> 2 Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178314: kpasterisk02-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: info: crmd_join_phase_log: join-17178314: kpasterisk01-ha=integrated Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: join-17178314: Syncing the CIB from kpasterisk01-ha to the rest of the cluster Jun 20 13:09:45 [19776] kpasterisk02 crmd: notice: do_dc_join_finalize: Requested version <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/> Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_request: Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356686) Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289 Jun 20 13:09:45 [19771] kpasterisk02 cib: info: cib_process_replace: Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
_______________________________________________ Users mailing list: Users@clusterlabs.org https://lists.clusterlabs.org/mailman/listinfo/users Project Home: http://www.clusterlabs.org Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf Bugs: http://bugs.clusterlabs.org
