Hi all, we have just installed the latest versions of pacemaker/corosync software:
cluster-glue-1.0.3-1.el5.x86_64 cluster-glue-libs-1.0.3-1.el5.x86_64 corosync-1.2.0-1.el5.x86_64 corosynclib-1.2.0-1.el5.x86_64 heartbeat-3.0.2-2.el5.x86_64 heartbeat-libs-3.0.2-2.el5.x86_64 pacemaker-1.0.7-4.el5.x86_64 pacemaker-libs-1.0.7-4.el5.x86_64 resource-agents-1.0.1-1.el5.x86_64 on a Scientific Linux SL 5.4 box (kernel 2.6.18-128.7.1.el5). The configuration file corosync.conf is attached. The problem is that we get segfault of cib and attrd processes as soon as we start the corosync service (see the attached messages.log file). Can anybody help us, please? Thanks in advance Ale -- All work and no play makes Jack a dull boy. All work and no play makes Jack a dull boy. All work and no play makes Jack...
corosync.conf
Description: Binary data
Feb 16 16:25:55 zion02 corosync[12962]: [MAIN ] Corosync Cluster Engine ('1.2.0'): started and ready to provide service.
Feb 16 16:25:55 zion02 corosync[12962]: [MAIN ] Corosync built-in features: nss rdma
Feb 16 16:25:55 zion02 corosync[12962]: [MAIN ] Successfully read main configuration file '/etc/corosync/corosync.conf'.
Feb 16 16:25:55 zion02 corosync[12962]: [TOTEM ] Initializing transport (UDP/IP).
Feb 16 16:25:55 zion02 corosync[12962]: [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
Feb 16 16:25:55 zion02 corosync[12962]: [TOTEM ] Initializing transport (UDP/IP).
Feb 16 16:25:55 zion02 corosync[12962]: [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
Feb 16 16:25:55 zion02 corosync[12962]: [MAIN ] Compatibility mode set to whitetank. Using V1 and V2 of the synchronization engine.
Feb 16 16:25:55 zion02 corosync[12962]: [TOTEM ] The network interface [10.141.1.74] is now up.
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: process_ais_conf: Reading configure
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: config_find_init: Local handle: 5650605097994944514 for logging
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: config_find_next: Processing additional logging options...
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: get_config_opt: Found 'on' for option: debug
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: get_config_opt: Defaulting to 'off' for option: to_file
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: get_config_opt: Found 'daemon' for option: syslog_facility
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: config_find_init: Local handle: 2730409743423111171 for service
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: config_find_next: Processing additional service options...
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: get_config_opt: Defaulting to 'pcmk' for option: clustername
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_logd
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_mgmtd
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: pcmk_startup: CRM: Initialized
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] Logging: Initialized pcmk_startup
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: pcmk_startup: Maximum core file size is: 18446744073709551615
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: pcmk_startup: Service: 9
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: pcmk_startup: Local hostname: zion02
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: pcmk_update_nodeid: Local node id: 1241615626
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: update_member: Creating entry for node 1241615626 born on 0
Feb 16 16:25:55 zion02 lrmd: [12970]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: update_member: 0x2aaab0001b60 Node 1241615626 now known as zion02 (was: (null))
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: update_member: Node zion02 now has 1 quorum votes (was 0)
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: update_member: Node 1241615626/zion02 is now: member
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12968 for process stonithd
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12969 for process cib
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12970 for process lrmd
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12971 for process attrd
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12972 for process pengine
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12973 for process crmd
Feb 16 16:25:55 zion02 corosync[12962]: [SERV ] Service engine loaded: Pacemaker Cluster Manager 1.0.7
Feb 16 16:25:55 zion02 lrmd: [12970]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 16 16:25:55 zion02 lrmd: [12970]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 16 16:25:55 zion02 cib: [12969]: info: Invoked: /usr/lib64/heartbeat/cib
Feb 16 16:25:55 zion02 lrmd: [12970]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 16 16:25:55 zion02 lrmd: [12970]: info: Started.
Feb 16 16:25:55 zion02 stonithd: [12968]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 16 16:25:55 zion02 stonithd: [12968]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 16 16:25:55 zion02 cib: [12969]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 16 16:25:55 zion02 cib: [12969]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 16 16:25:55 zion02 cib: [12969]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 16 16:25:55 zion02 cib: [12969]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Feb 16 16:25:55 zion02 stonithd: [12968]: info: Stack hogger failed 0xffffffff
Feb 16 16:25:55 zion02 cib: [12969]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Feb 16 16:25:55 zion02 cib: [12969]: WARN: readCibXmlFile: Continuing with an empty configuration.
Feb 16 16:25:55 zion02 stonithd: [12968]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:55 zion02 stonithd: [12968]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:55 zion02 attrd: [12971]: info: Invoked: /usr/lib64/heartbeat/attrd
Feb 16 16:25:55 zion02 corosync[12962]: [SERV ] Service engine loaded: corosync extended virtual synchrony service
Feb 16 16:25:55 zion02 corosync[12962]: [SERV ] Service engine loaded: corosync configuration service
Feb 16 16:25:55 zion02 attrd: [12971]: info: main: Starting up
Feb 16 16:25:55 zion02 corosync[12962]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01
Feb 16 16:25:55 zion02 corosync[12962]: [SERV ] Service engine loaded: corosync cluster config database access v1.01
Feb 16 16:25:55 zion02 attrd: [12971]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:55 zion02 attrd: [12971]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:55 zion02 corosync[12962]: [SERV ] Service engine loaded: corosync profile loading service
Feb 16 16:25:55 zion02 kernel: attrd[12971]: segfault at 0000000000000008 rip 00002afe5f647f48 rsp 00007fffe5a07bc8 error 6
Feb 16 16:25:55 zion02 corosync[12962]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1
Feb 16 16:25:55 zion02 pengine: [12972]: info: Invoked: /usr/lib64/heartbeat/pengine
Feb 16 16:25:55 zion02 pengine: [12972]: info: main: Starting pengine
Feb 16 16:25:55 zion02 crmd: [12973]: info: Invoked: /usr/lib64/heartbeat/crmd
Feb 16 16:25:55 zion02 crmd: [12973]: info: main: CRM Hg Version: d3fa20fc76c7947d6de66db7e52526dc6bd7d782
Feb 16 16:25:55 zion02 crmd: [12973]: info: crmd_init: Starting crmd
Feb 16 16:25:55 zion02 crmd: [12973]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 16 16:25:55 zion02 cib: [12969]: info: startCib: CIB Initialization completed successfully
Feb 16 16:25:55 zion02 cib: [12969]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:55 zion02 cib: [12969]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:55 zion02 kernel: cib[12969]: segfault at 0000000000000008 rip 00002abc6d4a4f48 rsp 00007ffffcc616d8 error 6
Feb 16 16:25:55 zion02 corosync[12962]: [TOTEM ] The network interface [10.142.1.74] is now up.
Feb 16 16:25:55 zion02 stonithd: [12968]: info: init_ais_connection: AIS connection established
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: pcmk_ipc: Recorded connection 0x1930cee0 for stonithd/12968
Feb 16 16:25:55 zion02 stonithd: [12968]: info: get_ais_nodeid: Server details: id=1241615626 uname=zion02 cname=pcmk
Feb 16 16:25:55 zion02 stonithd: [12968]: info: crm_new_peer: Node zion02 now has id: 1241615626
Feb 16 16:25:55 zion02 stonithd: [12968]: info: crm_new_peer: Node 1241615626 is now known as zion02
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 16: memb=0, new=0, lost=0
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 16: memb=1, new=1, lost=0
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: pcmk_peer_update: NEW: zion02 1241615626
Feb 16 16:25:55 zion02 stonithd: [12968]: notice: /usr/lib64/heartbeat/stonithd start up successfully.
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: pcmk_peer_update: MEMB: zion02 1241615626
Feb 16 16:25:55 zion02 stonithd: [12968]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 16 16:25:55 zion02 corosync[12962]: [pcmk ] info: update_member: Node zion02 now has process list: 00000000000000000000000000013312 (78610)
Feb 16 16:25:55 zion02 corosync[12962]: [TOTEM ] A processor joined or left the membership and a new membership was formed.
Feb 16 16:25:55 zion02 corosync[12962]: [MAIN ] Completed service synchronization, ready to provide service.
Feb 16 16:25:56 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process cib terminated with signal 11 (pid=12969, core=false)
Feb 16 16:25:56 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: cib
Feb 16 16:25:56 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12975 for process cib
Feb 16 16:25:56 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process attrd terminated with signal 11 (pid=12971, core=false)
Feb 16 16:25:56 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: attrd
Feb 16 16:25:56 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12976 for process attrd
Feb 16 16:25:56 zion02 cib: [12975]: info: Invoked: /usr/lib64/heartbeat/cib
Feb 16 16:25:56 zion02 cib: [12975]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 16 16:25:56 zion02 cib: [12975]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 16 16:25:56 zion02 attrd: [12976]: info: Invoked: /usr/lib64/heartbeat/attrd
Feb 16 16:25:56 zion02 attrd: [12976]: info: main: Starting up
Feb 16 16:25:56 zion02 attrd: [12976]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:56 zion02 cib: [12975]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 16 16:25:56 zion02 attrd: [12976]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:56 zion02 cib: [12975]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Feb 16 16:25:56 zion02 cib: [12975]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Feb 16 16:25:56 zion02 kernel: attrd[12976]: segfault at 0000000000000008 rip 00002ac34114bf48 rsp 00007ffff74bbcc8 error 6
Feb 16 16:25:56 zion02 cib: [12975]: WARN: readCibXmlFile: Continuing with an empty configuration.
Feb 16 16:25:56 zion02 crmd: [12973]: info: do_cib_control: Could not connect to the CIB service: connection failed
Feb 16 16:25:56 zion02 crmd: [12973]: WARN: do_cib_control: Couldn't complete CIB registration 1 times... pause and retry
Feb 16 16:25:56 zion02 crmd: [12973]: info: crmd_init: Starting crmd's mainloop
Feb 16 16:25:56 zion02 cib: [12975]: info: startCib: CIB Initialization completed successfully
Feb 16 16:25:56 zion02 cib: [12975]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:56 zion02 cib: [12975]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:56 zion02 kernel: cib[12975]: segfault at 0000000000000008 rip 00002b940d874f48 rsp 00007fffcce016c8 error 6
Feb 16 16:25:57 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process cib terminated with signal 11 (pid=12975, core=false)
Feb 16 16:25:57 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: cib
Feb 16 16:25:57 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12981 for process cib
Feb 16 16:25:57 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process attrd terminated with signal 11 (pid=12976, core=false)
Feb 16 16:25:57 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: attrd
Feb 16 16:25:57 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12982 for process attrd
Feb 16 16:25:57 zion02 attrd: [12982]: info: Invoked: /usr/lib64/heartbeat/attrd
Feb 16 16:25:57 zion02 cib: [12981]: info: Invoked: /usr/lib64/heartbeat/cib
Feb 16 16:25:57 zion02 attrd: [12982]: info: main: Starting up
Feb 16 16:25:57 zion02 attrd: [12982]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:57 zion02 attrd: [12982]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:57 zion02 cib: [12981]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 16 16:25:57 zion02 cib: [12981]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 16 16:25:57 zion02 kernel: attrd[12982]: segfault at 0000000000000008 rip 00002ba351541f48 rsp 00007fff891b38e8 error 6
Feb 16 16:25:57 zion02 cib: [12981]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 16 16:25:57 zion02 cib: [12981]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Feb 16 16:25:57 zion02 cib: [12981]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Feb 16 16:25:57 zion02 cib: [12981]: WARN: readCibXmlFile: Continuing with an empty configuration.
Feb 16 16:25:57 zion02 cib: [12981]: info: startCib: CIB Initialization completed successfully
Feb 16 16:25:57 zion02 cib: [12981]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:57 zion02 cib: [12981]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:57 zion02 kernel: cib[12981]: segfault at 0000000000000008 rip 00002b6ef5abbf48 rsp 00007fffe12acab8 error 6
Feb 16 16:25:58 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process cib terminated with signal 11 (pid=12981, core=false)
Feb 16 16:25:58 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: cib
Feb 16 16:25:58 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12983 for process cib
Feb 16 16:25:58 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process attrd terminated with signal 11 (pid=12982, core=false)
Feb 16 16:25:58 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: attrd
Feb 16 16:25:58 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12984 for process attrd
Feb 16 16:25:58 zion02 crmd: [12973]: info: crm_timer_popped: Wait Timer (I_NULL) just popped!
Feb 16 16:25:58 zion02 cib: [12983]: info: Invoked: /usr/lib64/heartbeat/cib
Feb 16 16:25:58 zion02 cib: [12983]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 16 16:25:58 zion02 cib: [12983]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 16 16:25:58 zion02 cib: [12983]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 16 16:25:58 zion02 cib: [12983]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Feb 16 16:25:58 zion02 cib: [12983]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Feb 16 16:25:58 zion02 attrd: [12984]: info: Invoked: /usr/lib64/heartbeat/attrd
Feb 16 16:25:58 zion02 cib: [12983]: WARN: readCibXmlFile: Continuing with an empty configuration.
Feb 16 16:25:58 zion02 attrd: [12984]: info: main: Starting up
Feb 16 16:25:58 zion02 attrd: [12984]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:58 zion02 attrd: [12984]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:58 zion02 kernel: attrd[12984]: segfault at 0000000000000008 rip 00002ac71b24af48 rsp 00007fff42d5fe78 error 6
Feb 16 16:25:58 zion02 cib: [12983]: info: startCib: CIB Initialization completed successfully
Feb 16 16:25:58 zion02 cib: [12983]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:58 zion02 cib: [12983]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:58 zion02 kernel: cib[12983]: segfault at 0000000000000008 rip 00002b4e2fb42f48 rsp 00007fff363d10d8 error 6
Feb 16 16:25:59 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process cib terminated with signal 11 (pid=12983, core=false)
Feb 16 16:25:59 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: cib
Feb 16 16:25:59 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12985 for process cib
Feb 16 16:25:59 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process attrd terminated with signal 11 (pid=12984, core=false)
Feb 16 16:25:59 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: attrd
Feb 16 16:25:59 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12986 for process attrd
Feb 16 16:25:59 zion02 crmd: [12973]: info: do_cib_control: Could not connect to the CIB service: connection failed
Feb 16 16:25:59 zion02 crmd: [12973]: WARN: do_cib_control: Couldn't complete CIB registration 2 times... pause and retry
Feb 16 16:25:59 zion02 cib: [12985]: info: Invoked: /usr/lib64/heartbeat/cib
Feb 16 16:25:59 zion02 cib: [12985]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 16 16:25:59 zion02 cib: [12985]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 16 16:25:59 zion02 cib: [12985]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 16 16:25:59 zion02 attrd: [12986]: info: Invoked: /usr/lib64/heartbeat/attrd
Feb 16 16:25:59 zion02 cib: [12985]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Feb 16 16:25:59 zion02 cib: [12985]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Feb 16 16:25:59 zion02 attrd: [12986]: info: main: Starting up
Feb 16 16:25:59 zion02 attrd: [12986]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:59 zion02 attrd: [12986]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:59 zion02 cib: [12985]: WARN: readCibXmlFile: Continuing with an empty configuration.
Feb 16 16:25:59 zion02 kernel: attrd[12986]: segfault at 0000000000000008 rip 00002b6ec3dcdf48 rsp 00007fff839be6a8 error 6
Feb 16 16:25:59 zion02 cib: [12985]: info: startCib: CIB Initialization completed successfully
Feb 16 16:25:59 zion02 cib: [12985]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:25:59 zion02 cib: [12985]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:25:59 zion02 kernel: cib[12985]: segfault at 0000000000000008 rip 00002ab25b45bf48 rsp 00007fffe944a2c8 error 6
Feb 16 16:26:00 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process cib terminated with signal 11 (pid=12985, core=false)
Feb 16 16:26:00 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: cib
Feb 16 16:26:00 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12987 for process cib
Feb 16 16:26:00 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process attrd terminated with signal 11 (pid=12986, core=false)
Feb 16 16:26:00 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: attrd
Feb 16 16:26:00 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12988 for process attrd
Feb 16 16:26:00 zion02 cib: [12987]: info: Invoked: /usr/lib64/heartbeat/cib
Feb 16 16:26:00 zion02 cib: [12987]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 16 16:26:00 zion02 cib: [12987]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 16 16:26:00 zion02 cib: [12987]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 16 16:26:00 zion02 cib: [12987]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Feb 16 16:26:00 zion02 cib: [12987]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Feb 16 16:26:00 zion02 attrd: [12988]: info: Invoked: /usr/lib64/heartbeat/attrd
Feb 16 16:26:00 zion02 cib: [12987]: WARN: readCibXmlFile: Continuing with an empty configuration.
Feb 16 16:26:00 zion02 attrd: [12988]: info: main: Starting up
Feb 16 16:26:00 zion02 attrd: [12988]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:26:00 zion02 attrd: [12988]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:26:00 zion02 kernel: attrd[12988]: segfault at 0000000000000008 rip 00002b3e13edff48 rsp 00007fff209436b8 error 6
Feb 16 16:26:00 zion02 cib: [12987]: info: startCib: CIB Initialization completed successfully
Feb 16 16:26:00 zion02 cib: [12987]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:26:00 zion02 cib: [12987]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:26:00 zion02 kernel: cib[12987]: segfault at 0000000000000008 rip 00002b1b674b3f48 rsp 00007fff9b5905d8 error 6
Feb 16 16:26:01 zion02 crmd: [12973]: info: crm_timer_popped: Wait Timer (I_NULL) just popped!
Feb 16 16:26:01 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process cib terminated with signal 11 (pid=12987, core=false)
Feb 16 16:26:01 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: cib
Feb 16 16:26:01 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12989 for process cib
Feb 16 16:26:01 zion02 corosync[12962]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process attrd terminated with signal 11 (pid=12988, core=false)
Feb 16 16:26:01 zion02 corosync[12962]: [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: attrd
Feb 16 16:26:01 zion02 corosync[12962]: [pcmk ] info: spawn_child: Forked child 12990 for process attrd
Feb 16 16:26:01 zion02 cib: [12989]: info: Invoked: /usr/lib64/heartbeat/cib
Feb 16 16:26:01 zion02 cib: [12989]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 16 16:26:01 zion02 cib: [12989]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 16 16:26:01 zion02 cib: [12989]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 16 16:26:01 zion02 cib: [12989]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Feb 16 16:26:01 zion02 cib: [12989]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Feb 16 16:26:01 zion02 cib: [12989]: WARN: readCibXmlFile: Continuing with an empty configuration.
Feb 16 16:26:01 zion02 attrd: [12990]: info: Invoked: /usr/lib64/heartbeat/attrd
Feb 16 16:26:01 zion02 attrd: [12990]: info: main: Starting up
Feb 16 16:26:01 zion02 attrd: [12990]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:26:01 zion02 attrd: [12990]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:26:01 zion02 kernel: attrd[12990]: segfault at 0000000000000008 rip 00002b0958fa7f48 rsp 00007fff9be73e08 error 6
Feb 16 16:26:01 zion02 cib: [12989]: info: startCib: CIB Initialization completed successfully
Feb 16 16:26:01 zion02 cib: [12989]: info: crm_cluster_connect: Connecting to OpenAIS
Feb 16 16:26:01 zion02 cib: [12989]: info: init_ais_connection: Creating connection to our AIS plugin
Feb 16 16:26:01 zion02 kernel: cib[12989]: segfault at 0000000000000008 rip 00002b0f36720f48 rsp 00007fff6800fc58 error 6
Feb 16 16:26:02 zion02 corosync[12962]: [SERV ] Unloading all Corosync service engines.
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: pcmk_shutdown: Shuting down Pacemaker
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: stop_child: Sent -15 to crmd: [12973]
Feb 16 16:26:02 zion02 crmd: [12973]: info: do_cib_control: Could not connect to the CIB service: connection failed
Feb 16 16:26:02 zion02 crmd: [12973]: WARN: do_cib_control: Couldn't complete CIB registration 3 times... pause and retry
Feb 16 16:26:02 zion02 crmd: [12973]: info: crm_signal_dispatch: Invoking handler for signal 15: Terminated
Feb 16 16:26:02 zion02 crmd: [12973]: info: crm_shutdown: Requesting shutdown
Feb 16 16:26:02 zion02 crmd: [12973]: info: crm_shutdown: Using default shutdown escalation: 1200000ms
Feb 16 16:26:02 zion02 crmd: [12973]: WARN: do_log: FSA: Input I_SHUTDOWN from crm_shutdown() received in state S_STARTING
Feb 16 16:26:02 zion02 crmd: [12973]: info: do_state_transition: State transition S_STARTING -> S_STOPPING [ input=I_SHUTDOWN cause=C_SHUTDOWN origin=crm_shutdown ]
Feb 16 16:26:02 zion02 crmd: [12973]: info: do_ha_control: Disconnected from OpenAIS
Feb 16 16:26:02 zion02 crmd: [12973]: info: do_cib_control: Disconnecting CIB
Feb 16 16:26:02 zion02 crmd: [12973]: info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd
Feb 16 16:26:02 zion02 crmd: [12973]: info: free_mem: Dropping I_TERMINATE: [ state=S_STOPPING cause=C_FSA_INTERNAL origin=do_stop ]
Feb 16 16:26:02 zion02 crmd: [12973]: info: do_exit: [crmd] stopped (0)
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: pcmk_shutdown: crmd confirmed stopped
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: stop_child: Sent -15 to pengine: [12972]
Feb 16 16:26:02 zion02 pengine: [12972]: info: crm_signal_dispatch: Invoking handler for signal 15: Terminated
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: pcmk_shutdown: pengine confirmed stopped
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: stop_child: Sent -15 to attrd: [12990]
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: pcmk_shutdown: attrd confirmed stopped
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: stop_child: Sent -15 to lrmd: [12970]
Feb 16 16:26:02 zion02 lrmd: [12970]: info: lrmd is shutting down
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: pcmk_shutdown: lrmd confirmed stopped
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: stop_child: Sent -15 to cib: [12989]
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: pcmk_shutdown: cib confirmed stopped
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: stop_child: Sent -15 to stonithd: [12968]
Feb 16 16:26:02 zion02 stonithd: [12968]: notice: /usr/lib64/heartbeat/stonithd normally quit.
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] info: pcmk_ipc_exit: Client stonithd (conn=0x1930cee0, async-conn=0x1930cee0) left
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: pcmk_shutdown: stonithd confirmed stopped
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] info: update_member: Node zion02 now has process list: 00000000000000000000000000000002 (2)
Feb 16 16:26:02 zion02 corosync[12962]: [pcmk ] notice: pcmk_shutdown: Shutdown complete
Feb 16 16:26:02 zion02 corosync[12962]: [SERV ] Service engine unloaded: Pacemaker Cluster Manager 1.0.7
Feb 16 16:26:02 zion02 corosync[12962]: [SERV ] Service engine unloaded: corosync extended virtual synchrony service
Feb 16 16:26:02 zion02 corosync[12962]: [SERV ] Service engine unloaded: corosync configuration service
Feb 16 16:26:02 zion02 corosync[12962]: [SERV ] Service engine unloaded: corosync cluster closed process group service v1.01
Feb 16 16:26:02 zion02 corosync[12962]: [SERV ] Service engine unloaded: corosync cluster config database access v1.01
Feb 16 16:26:02 zion02 corosync[12962]: [SERV ] Service engine unloaded: corosync profile loading service
Feb 16 16:26:02 zion02 corosync[12962]: [SERV ] Service engine unloaded: corosync cluster quorum service v0.1
Feb 16 16:26:02 zion02 corosync[12962]: [MAIN ] Corosync Cluster Engine exiting with status -1 at main.c:158.
_______________________________________________ Pacemaker mailing list Pacemaker@oss.clusterlabs.org http://oss.clusterlabs.org/mailman/listinfo/pacemaker
