Re: [ceph-users] FreeBSD Initiator with Ceph iscsi

[Jason Dillaman]

On Sat, Jun 30, 2018 at 6:04 PM Frank de Bot (lists) 
wrote:

> I've crossposted the problem to the freebsd-stable mailinglist. There is
> no ALUA support at the initiator side. There were 2 options for
> multipathing:
>
> 1. Export your LUNs via two (or more) different paths (for example
>via two different target portal IP addresses), on the initiator
>side set up both iSCSI sessions in the usual way (like without
>multipathing), add kern.iscsi.fail_on_disconnection=1 to
>/etc/sysctl.conf, and set up gmultipath on top of LUNs reachable
>via those sessions
>
> 2. Set up the target so it redirects (sends "Target moved temporarily"
>login responses) to the target portal it considers active.  Then
>set up the initiator (single session) to either one; the target
>will "bounce it" to the right place.  You don't need gmultipath
>in this case, because from the initiator point of view there's only
>one iSCSI session at any time.
>
> Would an of those 2 options be possible on the ceph iscsi gateway
> solution to configure?
>

We probably don't have the (development) bandwidth to implement a custom
solution for FreeBSD. You should be able to just use targetcli to configure
a one-node target using RBD as a backend, however.


>
> Regards,
>
> Frank
>
> Jason Dillaman wrote:
> > Conceptually, I would assume it should just work if configured correctly
> > w/ multipath (to properly configure the ALUA settings on the LUNs). I
> > don't run FreeBSD, but any particular issue you are seeing?
> >
> > On Tue, Jun 26, 2018 at 6:06 PM Frank de Bot (lists)  > > wrote:
> >
> > Hi,
> >
> > In my test setup I have a ceph iscsi gateway (configured as in
> > http://docs.ceph.com/docs/luminous/rbd/iscsi-overview/ )
> >
> > I would like to use thie with a FreeBSD (11.1) initiator, but I fail
> to
> > make a working setup in FreeBSD. Is it known if the FreeBSD initiator
> > (with gmultipath) can work with this gateway setup?
> >
> >
> > Regards,
> >
> > Frank
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com 
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >
> >
> >
> > --
> > Jason
>
>

-- 
Jason
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] FreeBSD Initiator with Ceph iscsi

[Frank (lists)]

Jason Dillaman wrote:
Conceptually, I would assume it should just work if configured 
correctly w/ multipath (to properly configure the ALUA settings on the 
LUNs). I don't run FreeBSD, but any particular issue you are seeing?


When logged in to both targets,  the following message floods the log

WARNING: 192.168.5.109 (iqn.2018-06.lan.x.iscsi-gw:ceph-igw): underflow 
mismatch: target indicates 0, we calculated 512

(da1:iscsi6:0:0:0): READ(10). CDB: 28 00 0c 7f ff ff 00 00 01 00
(da1:iscsi6:0:0:0): CAM status: SCSI Status Error
(da1:iscsi6:0:0:0): SCSI status: Check Condition
(da1:iscsi6:0:0:0): SCSI sense: NOT READY asc:4,b (Logical unit not 
accessible, target port in standby state)

(da1:iscsi6:0:0:0): Error 6, Unretryable error
(da1:iscsi6:0:0:0): Invalidating pack

For both sessions the message are the same (besides numbering of devices)

When trying to read from either of the devices (da1 and da2 in my case), 
FreeBSD gives the error 'Device not configured'. When using gmultipath, 
manually created, because FreeBSD is not able to write a label to either 
of the devices, the created multipath is not functional because it 
markes both devices as FAIL






On Tue, Jun 26, 2018 at 6:06 PM Frank de Bot (lists) 
mailto:li...@searchy.net>> wrote:


Hi,

In my test setup I have a ceph iscsi gateway (configured as in
http://docs.ceph.com/docs/luminous/rbd/iscsi-overview/ )

I would like to use thie with a FreeBSD (11.1) initiator, but I
fail to
make a working setup in FreeBSD. Is it known if the FreeBSD initiator
(with gmultipath) can work with this gateway setup?


Regards,

Frank
___
ceph-users mailing list
ceph-users@lists.ceph.com 
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



--
Jason


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] FreeBSD Initiator with Ceph iscsi

[Jason Dillaman]

Conceptually, I would assume it should just work if configured correctly w/
multipath (to properly configure the ALUA settings on the LUNs). I don't
run FreeBSD, but any particular issue you are seeing?

On Tue, Jun 26, 2018 at 6:06 PM Frank de Bot (lists) 
wrote:

> Hi,
>
> In my test setup I have a ceph iscsi gateway (configured as in
> http://docs.ceph.com/docs/luminous/rbd/iscsi-overview/ )
>
> I would like to use thie with a FreeBSD (11.1) initiator, but I fail to
> make a working setup in FreeBSD. Is it known if the FreeBSD initiator
> (with gmultipath) can work with this gateway setup?
>
>
> Regards,
>
> Frank
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>


-- 
Jason
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] FreeBSD Initiator with Ceph iscsi

[Frank de Bot (lists)]

Hi,

In my test setup I have a ceph iscsi gateway (configured as in
http://docs.ceph.com/docs/luminous/rbd/iscsi-overview/ )

I would like to use thie with a FreeBSD (11.1) initiator, but I fail to
make a working setup in FreeBSD. Is it known if the FreeBSD initiator
(with gmultipath) can work with this gateway setup?


Regards,

Frank
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com