Hi !
I am running a custom-compiled Smartos derivate (based on illumos-joyent
122a8174b71285518bd85f331726b936b11de455 2013/12/02)
on two Supermicro Servers with X9DR7-TF+ with 6 Supermicro SAS disk
shelfs SC826BE26-R1K28LP for every system.
There is no SAS connection between the systems.
Configuration:
Every disk shelf is connected dual-path to one LSI 9207e HBA controller,
the shelfs are SAS-chained from top to bottom for the first HBA, from
bottom to top for the second HBA,
so every disk in every chassis is connected dual path. We use Seagate
2TB Constellation.ES3 disks and
2 Stec ZEUS Ram for ZIL. The systems are also exporting and importing
LUNs via FC.
To archive disk shelf redundancy in case of one disk shelf dying completely,
we arranged a ZFS disk pool with 9 RAIDZ2 vdevs consisting of 6 disks,
with every disk of one RAIDZ2 vdev located in a different shelf.
There are also spare disks in the shelfs.
Test:
To test this configuration, we switched off one disk shelf in the middle
of both SAS-chains,
the multi-path degraded for all disks, every vdev degraded, the pool
continued to work and used the spare disks in
the remaining 5 online disk shelfs.
This worked on the first of the two identical systems, on the second
system a kernel panic occured,
the system was not able to write a dump, trace is in a screenshot.
(please see in https://www.illumos.org/issues/4454).
On trying again the disk shelf shutdown after reboot on the second
system with the same disk shelf,
everything worked as expected.
2.)
The two systems are using vice versa FC exported LUNs based on ZFS ZVols.
Every system has a zpool with 2 mirrored FC devices for providing NFS
shares with synchronous storage backend,
both zpools are imported for active-active configuration.
If the second system dies on a kernel panic as described above, the
first system only coupled
by FC Luns also happened to panic.
Please see the attached crash dump file and screenshot in
https://www.illumos.org/issues/4455.
Thx a lot for your suggestions.
Regards,
Franz
--
---------------------------------------------------------------------
Dipl.-Ing. Franz Schober
[email protected]
FirmOS Business Solutions Gmbh
Obstweg 4
A-8073 Graz-Neupirka
Tel +43 316 242322-10
Fax +43 316 242322-99
http://www.firmos.at
FN 278321x, Lg für ZRS Graz UID-Nr: ATU62657119
Dieses eMail ist vertraulich und nur für die genannten Empfänger bestimmt.
Sollten Sie nicht der gewünschte Adressat sein, bitten wir Sie, uns umgehend zu
informieren sowie vorliegende Nachricht zu löschen ohne vorher einen Ausdruck
oder eine Kopie anzufertigen.
This message and any attached files are confidential and intended solely for
the adressee(s). Any publication, transmission or other use of the information
by a person or entity other than the intended addressee(s) is prohibited. If
you receive this in error please contact the sender and delete the material.
The sender does not accept liability for any errors or omissions as a result of
the transmission.
-------------------------------------------
illumos-discuss
Archives: https://www.listbox.com/member/archive/182180/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182180/21175430-2e6923be
Modify Your Subscription:
https://www.listbox.com/member/?member_id=21175430&id_secret=21175430-6a77cda4
Powered by Listbox: http://www.listbox.com
