Greetings,
I've just started playing with pacemaker/corosync on a two node setup.
At this point I'm just experimenting, and trying to get a good feel
of how things work. Eventually I'd like to start using this in a
production environment. I'm running Fedora16-x86_64 with
pacemaker-1.1.7 & corosync-1.4.3. I have DRBD setup and working fine
with two resources. I've verified that pacemaker is doing the right
thing when initially configured. Specifically:
* the floating static IP is brought up
* DRBD is brought up correctly with a master & slave
* the local DRBD backed mount points are mounted correctly
Here's the configuration:
#########
node farm-ljf0 \
attributes standby="off"
node farm-ljf1
primitive ClusterIP ocf:heartbeat:IPaddr2 \
params ip="10.31.97.100" cidr_netmask="22" nic="eth1" \
op monitor interval="10s"
primitive FS0 ocf:linbit:drbd \
params drbd_resource="r0" \
op monitor interval="10" role="Master" \
op monitor interval="30" role="Slave"
primitive FS0_drbd ocf:heartbeat:Filesystem \
params device="/dev/drbd0" directory="/mnt/sdb1" fstype="xfs"
primitive FS1 ocf:linbit:drbd \
params drbd_resource="r1" \
op monitor interval="10s" role="Master" \
op monitor interval="30s" role="Slave"
primitive FS1_drbd ocf:heartbeat:Filesystem \
params device="/dev/drbd1" directory="/mnt/sdb2" fstype="xfs"
ms FS0_Clone FS0 \
meta master-max="1" master-node-max="1" clone-max="2"
clone-node-max="1" notify="true"
ms FS1_Clone FS1 \
meta master-max="1" master-node-max="1" clone-max="2"
clone-node-max="1" notify="true"
location cli-prefer-ClusterIP ClusterIP \
rule $id="cli-prefer-rule-ClusterIP" inf: #uname eq farm-ljf1
colocation fs0_on_drbd inf: FS0_drbd FS0_Clone:Master
colocation fs1_on_drbd inf: FS1_drbd FS1_Clone:Master
order FS0_drbd-after-FS0 inf: FS0_Clone:promote FS0_drbd
order FS1_drbd-after-FS1 inf: FS1_Clone:promote FS1_drbd
property $id="cib-bootstrap-options" \
dc-version="1.1.7-2.fc16-ee0730e13d124c3d58f00016c3376a1de5323cff" \
cluster-infrastructure="openais" \
expected-quorum-votes="2" \
stonith-enabled="false" \
no-quorum-policy="ignore"
#########
However, when I attempted to simulate a failover situation (I shutdown
the current master/primary node completely), not everything failed
over correctly. Specifically, the mount points did not get mounted,
even though the other two elements did failover correctly.
'farm-ljf1' is the node that I shutdown, farm-ljf0 is the node that I
expected to inherit all of the resources. Here's the status:
#########
[root@farm-ljf0 ~]# crm status
============
Last updated: Thu Sep 27 15:00:19 2012
Last change: Thu Sep 27 13:59:42 2012 via cibadmin on farm-ljf1
Stack: openais
Current DC: farm-ljf0 - partition WITHOUT quorum
Version: 1.1.7-2.fc16-ee0730e13d124c3d58f00016c3376a1de5323cff
2 Nodes configured, 2 expected votes
7 Resources configured.
============
Online: [ farm-ljf0 ]
OFFLINE: [ farm-ljf1 ]
ClusterIP (ocf::heartbeat:IPaddr2): Started farm-ljf0
Master/Slave Set: FS0_Clone [FS0]
Masters: [ farm-ljf0 ]
Stopped: [ FS0:0 ]
Master/Slave Set: FS1_Clone [FS1]
Masters: [ farm-ljf0 ]
Stopped: [ FS1:0 ]
Failed actions:
FS1_drbd_start_0 (node=farm-ljf0, call=23, rc=1, status=complete):
unknown error
FS0_drbd_start_0 (node=farm-ljf0, call=24, rc=1, status=complete):
unknown error
#########
I eventually brought up the shut down node (farm-ljf1) again, hoping
that might at least bring things back into a good state, but its not
working either, and is showing up as OFFLINE:
##########
[root@farm-ljf1 ~]# crm status
============
Last updated: Thu Sep 27 15:06:54 2012
Last change: Thu Sep 27 14:49:06 2012 via cibadmin on farm-ljf1
Stack: openais
Current DC: NONE
2 Nodes configured, 2 expected votes
7 Resources configured.
============
OFFLINE: [ farm-ljf0 farm-ljf1 ]
##########
So at this point, I've got two problems:
0) FS mount failover isn't working. I'm hoping this is some silly
configuration issue that can be easily resolved.
1) bringing the "failed" farm-ljf1 node back online doesn't seem to
work automatically, and I can't figure out what kind of magic is
needed.
If this stuff is documented somewhere, I'll gladly read it, if someone
can point me in the right direction.
thanks!
_______________________________________________
Pacemaker mailing list: Pacemaker@oss.clusterlabs.org
http://oss.clusterlabs.org/mailman/listinfo/pacemaker
Project Home: http://www.clusterlabs.org
Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
Bugs: http://bugs.clusterlabs.org
