# Demonstration of fence_scsi fencing a node:

(k)rafaeldtinoco@clubionic03:~/.../upstream$ cat /etc/network/interfaces
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet dhcp

# iscsi
auto eth1
iface eth1 inet static
    address 10.250.1.12/24

# private
auto eth2
iface eth2 inet static
    address 10.250.3.12/24

# public
auto eth3
iface eth3 inet static
    address 10.250.98.12/24

(k)rafaeldtinoco@clubionic03:~/.../upstream$ sudo iptables -A INPUT -i
eth2 -j DROP

(k)rafaeldtinoco@clubionic01:~$ crm_mon -1
Stack: corosync
Current DC: clubionic01.private (version 1.1.19-1.1.19) - partition with quorum
Last updated: Tue Mar  3 21:24:55 2020
Last change: Tue Mar  3 20:25:56 2020 by root via cibadmin on 
clubionic01.private

3 nodes configured
1 resource configured

Online: [ clubionic01.private clubionic02.private ]
OFFLINE: [ clubionic03.private ]

Active resources:

 fence_clubionic        (stonith:fence_scsi):   Started
clubionic01.private


(k)rafaeldtinoco@clubionic03:~/.../upstream$ sudo sg_persist --in --read-keys 
--device=/dev/sda
  LIO-ORG   cluster.bionic.   4.0
  Peripheral device type: disk
  PR generation=0x4, 2 registered reservation keys follow:
    0x3abe0000
    0x3abe0001

(k)rafaeldtinoco@clubionic03:~/.../upstream$ sudo dd if=/dev/zero of=/dev/sda 
bs=1M count=1
[ 3301.867294] print_req_error: critical nexus error, dev sda, sector 0
[ 3301.868543] Buffer I/O error on dev sda, logical block 0, lost async page 
write
[ 3301.869956] Buffer I/O error on dev sda, logical block 1, lost async page 
write
[ 3301.871430] Buffer I/O error on dev sda, logical block 2, lost async page 
write
[ 3301.872929] Buffer I/O error on dev sda, logical block 3, lost async page 
write
[ 3301.874448] Buffer I/O error on dev sda, logical block 4, lost async page 
write
[ 3301.875963] Buffer I/O error on dev sda, logical block 5, lost async page 
write
[ 3301.877486] Buffer I/O error on dev sda, logical block 6, lost async page 
write
[ 3301.879000] Buffer I/O error on dev sda, logical block 7, lost async page 
write
[ 3301.880481] Buffer I/O error on dev sda, logical block 8, lost async page 
write
[ 3301.882014] Buffer I/O error on dev sda, logical block 9, lost async page 
write
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227557 s, 46.1 MB/s

-- 
You received this bug notification because you are a member of Ubuntu
High Availability Team, which is subscribed to pacemaker in Ubuntu.
https://bugs.launchpad.net/bugs/1865523

Title:
  [bionic] fence_scsi not working properly with 1.1.18-2ubuntu1.1

Status in fence-agents package in Ubuntu:
  Fix Released
Status in pacemaker package in Ubuntu:
  Fix Released
Status in fence-agents source package in Bionic:
  Confirmed
Status in pacemaker source package in Bionic:
  Confirmed
Status in fence-agents source package in Disco:
  Confirmed
Status in fence-agents source package in Eoan:
  Fix Released
Status in fence-agents source package in Focal:
  Fix Released

Bug description:
  Trying to setup a cluster with an iscsi shared disk, using fence_scsi
  as the fencing mechanism, I realized that fence_scsi is not working in
  Ubuntu Bionic. I first thought it was related to Azure environment
  (LP: #1864419), where I was trying this environment, but then, trying
  locally, I figured out that somehow pacemaker 1.1.18 is not fencing
  the shared scsi disk properly.

  Note: I was able to "backport" vanilla 1.1.19 from upstream and
  fence_scsi worked. I have then tried 1.1.18 without all quilt patches
  and it didnt work as well. I think that bisecting 1.1.18 <-> 1.1.19
  might tell us which commit has fixed the behaviour needed by the
  fence_scsi agent.

  (k)rafaeldtinoco@clubionic01:~$ crm conf show
  node 1: clubionic01.private
  node 2: clubionic02.private
  node 3: clubionic03.private
  primitive fence_clubionic stonith:fence_scsi \
          params pcmk_host_list="10.250.3.10 10.250.3.11 10.250.3.12" 
devices="/dev/sda" \
          meta provides=unfencing
  property cib-bootstrap-options: \
          have-watchdog=false \
          dc-version=1.1.18-2b07d5c5a9 \
          cluster-infrastructure=corosync \
          cluster-name=clubionic \
          stonith-enabled=on \
          stonith-action=off \
          no-quorum-policy=stop \
          symmetric-cluster=true

  ----

  (k)rafaeldtinoco@clubionic02:~$ sudo crm_mon -1
  Stack: corosync
  Current DC: clubionic01.private (version 1.1.18-2b07d5c5a9) - partition with 
quorum
  Last updated: Mon Mar  2 15:55:30 2020
  Last change: Mon Mar  2 15:45:33 2020 by root via cibadmin on 
clubionic01.private

  3 nodes configured
  1 resource configured

  Online: [ clubionic01.private clubionic02.private clubionic03.private
  ]

  Active resources:

   fence_clubionic        (stonith:fence_scsi):   Started
  clubionic01.private

  ----

  (k)rafaeldtinoco@clubionic02:~$ sudo sg_persist --in --read-keys 
--device=/dev/sda
    LIO-ORG   cluster.bionic.   4.0
    Peripheral device type: disk
    PR generation=0x0, there are NO registered reservation keys

  (k)rafaeldtinoco@clubionic02:~$ sudo sg_persist -r /dev/sda
    LIO-ORG   cluster.bionic.   4.0
    Peripheral device type: disk
    PR generation=0x0, there is NO reservation held

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/fence-agents/+bug/1865523/+subscriptions

_______________________________________________
Mailing list: https://launchpad.net/~ubuntu-ha
Post to     : ubuntu-ha@lists.launchpad.net
Unsubscribe : https://launchpad.net/~ubuntu-ha
More help   : https://help.launchpad.net/ListHelp

Reply via email to