Re: [ceph-users] Problems setting up iSCSI
Am 29.06.2018 um 17:45 schrieb Jason Dillaman: The 7d0023e73855a42ac25038403387ab41ca10753a version should be fine, it's what I use in my test environment. I really cannot explain why tcmu-runner is missing the rbd handler. I can only assume you have restarted the daemon after installing it. That did the trick. I didn't do any reboot or daemon restarting when I installed the other (newer) tcmu-runner versions. So the old version still ran. Now it seems to be working. Thank you very much for your help. Best regards Bernhard Any other log messages from tcmu-runner? Do you have a "/usr/lib64/tcmu-runner/handler_rbd.so" file? Perhaps enable debug-level logging in "/etc/tcmu/tcmu.conf" and see if that helps. On Fri, Jun 29, 2018 at 11:40 AM Bernhard Dick <mailto:bernh...@bdick.de>> wrote: Am 29.06.2018 um 17:26 schrieb Jason Dillaman: > OK, so your tcmu-runner doesn't have support for rbd images for some > reason. Where did you get your copy of tcmu-runner? hm originally I took it from the gluster40 repository from the Centos Storage SIG. > You should build it > from upstream or pull a copy from here [1]. > > [1] https://shaman.ceph.com/repos/tcmu-runner/ I tried the version: https://1.chacra.ceph.com/r/tcmu-runner/master/7d0023e73855a42ac25038403387ab41ca10753a/centos/7/flavors/default/x86_64/tcmu-runner-1.3.0-89.g7d0023e.el7.x86_64.rpm (because the version number from the storage SIG was a 1.3.0-rc4 which seemed a bit low). That resulted also in the error above. Now I tried the version from https://1.chacra.ceph.com/r/tcmu-runner/master/b7498c0857a77f61616b8ad86c775ae39f9c119d/centos/7/flavors/default/x86_64/ but the error persists. I am however able to map and unmap the image on the host using rbd map and unmap commands. Regards Bernhard > > On Fri, Jun 29, 2018 at 11:12 AM Bernhard Dick mailto:bernh...@bdick.de> > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de>>> wrote: > > Hi, > > Am 29.06.2018 um 17:04 schrieb Jason Dillaman: > > Is 'tcmu-runner' running on that node? > yes it is running > > > Any errors in dmesg or > here are no errors > > /var/log/tcmu-runner.log? > the following error is shown: > [ERROR] add_device:436: could not find handler for uio0 > > Regards > Bernhard > > > > On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick mailto:bernh...@bdick.de> > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de>> > > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de> <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de>>>> wrote: > > > > Hi, > > > > Am 28.06.2018 um 18:09 schrieb Jason Dillaman: > > > Do you have the ansible backtrace from the "ceph-iscsi-gw : > > igw_lun | > > > configureluns (create/map rbds and add to lio)]" step? > > I assume you mean the following (from running with verbosity > 3, after > > running the purge-iscsi-gateways playbook beforehand) > > > > Using module file /home/dick/git/ceph-ansible/library/igw_lun.py > > ESTABLISH SSH CONNECTION FOR USER: root > > SSH: EXEC ssh -o ControlMaster=auto -o > > ControlPersist=600s -o StrictHostKeyChecking=no -o > > KbdInteractiveAuthentication=no -o > > PreferredAuthentications=gssapi-with-mic,g > > ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o > > User=root -o ConnectTimeout=30 -o > > ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04 > '/bin/sh -c > > '"'"'/usr/bin/p > > ython && sleep 0'"'"'' > > (1, '', 'Traceback (most recent call last):\n > File > > "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in > > \n > > ansible_main()\n File "/tmp/ansible_F3 > > sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n > > lun.manage(desired_state)\n File > > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", >
Re: [ceph-users] Problems setting up iSCSI
Am 29.06.2018 um 17:26 schrieb Jason Dillaman: OK, so your tcmu-runner doesn't have support for rbd images for some reason. Where did you get your copy of tcmu-runner? hm originally I took it from the gluster40 repository from the Centos Storage SIG. You should build it from upstream or pull a copy from here [1]. [1] https://shaman.ceph.com/repos/tcmu-runner/ I tried the version: https://1.chacra.ceph.com/r/tcmu-runner/master/7d0023e73855a42ac25038403387ab41ca10753a/centos/7/flavors/default/x86_64/tcmu-runner-1.3.0-89.g7d0023e.el7.x86_64.rpm (because the version number from the storage SIG was a 1.3.0-rc4 which seemed a bit low). That resulted also in the error above. Now I tried the version from https://1.chacra.ceph.com/r/tcmu-runner/master/b7498c0857a77f61616b8ad86c775ae39f9c119d/centos/7/flavors/default/x86_64/ but the error persists. I am however able to map and unmap the image on the host using rbd map and unmap commands. Regards Bernhard On Fri, Jun 29, 2018 at 11:12 AM Bernhard Dick <mailto:bernh...@bdick.de>> wrote: Hi, Am 29.06.2018 um 17:04 schrieb Jason Dillaman: > Is 'tcmu-runner' running on that node? yes it is running > Any errors in dmesg or here are no errors > /var/log/tcmu-runner.log? the following error is shown: [ERROR] add_device:436: could not find handler for uio0 Regards Bernhard > > On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick mailto:bernh...@bdick.de> > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de>>> wrote: > > Hi, > > Am 28.06.2018 um 18:09 schrieb Jason Dillaman: > > Do you have the ansible backtrace from the "ceph-iscsi-gw : > igw_lun | > > configureluns (create/map rbds and add to lio)]" step? > I assume you mean the following (from running with verbosity 3, after > running the purge-iscsi-gateways playbook beforehand) > > Using module file /home/dick/git/ceph-ansible/library/igw_lun.py > ESTABLISH SSH CONNECTION FOR USER: root > SSH: EXEC ssh -o ControlMaster=auto -o > ControlPersist=600s -o StrictHostKeyChecking=no -o > KbdInteractiveAuthentication=no -o > PreferredAuthentications=gssapi-with-mic,g > ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o > User=root -o ConnectTimeout=30 -o > ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04 '/bin/sh -c > '"'"'/usr/bin/p > ython && sleep 0'"'"'' > (1, '', 'Traceback (most recent call last):\n File > "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in > \n > ansible_main()\n File "/tmp/ansible_F3 > sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n > lun.manage(desired_state)\n File > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 365, > in manage\n self.allocate()\n File "/u > sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 490, in > allocate\n lun = self.add_dev_to_lio()\n File > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 683, > in add_dev_to_lio\n > wwn=in_wwn, control=control_string)\n File > "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818, in > __init__\n self._configure(config, size, wwn, hw_max_sectors, > control)\n File "/usr/lib/pytho > n2.7/site-packages/rtslib_fb/tcm.py", line 836, in _configure\n > self._enable()\n File > "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172, in > _enable\n fwrite(path, "1\\n")\n File "/usr/lib/pyt > hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n > file_fd.write(str(string))\nIOError: [Errno 2] No such file or > directory\n') > The full traceback is: > Traceback (most recent call last): > File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in > > ansible_main() > File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 135, in > ansible_main > lun.manage(desired_state) > File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", > line 365, in manage > self.allocate() > File
Re: [ceph-users] Problems setting up iSCSI
Hi,
Am 29.06.2018 um 17:04 schrieb Jason Dillaman:
Is 'tcmu-runner' running on that node?
yes it is running
Any errors in dmesg or
here are no errors
/var/log/tcmu-runner.log?
the following error is shown:
[ERROR] add_device:436: could not find handler for uio0
Regards
Bernhard
On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick <mailto:bernh...@bdick.de>> wrote:
Hi,
Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
> Do you have the ansible backtrace from the "ceph-iscsi-gw :
igw_lun |
> configureluns (create/map rbds and add to lio)]" step?
I assume you mean the following (from running with verbosity 3, after
running the purge-iscsi-gateways playbook beforehand)
Using module file /home/dick/git/ceph-ansible/library/igw_lun.py
ESTABLISH SSH CONNECTION FOR USER: root
SSH: EXEC ssh -o ControlMaster=auto -o
ControlPersist=600s -o StrictHostKeyChecking=no -o
KbdInteractiveAuthentication=no -o
PreferredAuthentications=gssapi-with-mic,g
ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o
User=root -o ConnectTimeout=30 -o
ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04 '/bin/sh -c
'"'"'/usr/bin/p
ython && sleep 0'"'"''
(1, '', 'Traceback (most recent call last):\n File
"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in
\n
ansible_main()\n File "/tmp/ansible_F3
sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n
lun.manage(desired_state)\n File
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 365,
in manage\n self.allocate()\n File "/u
sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 490, in
allocate\n lun = self.add_dev_to_lio()\n File
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 683,
in add_dev_to_lio\n
wwn=in_wwn, control=control_string)\n File
"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818, in
__init__\n self._configure(config, size, wwn, hw_max_sectors,
control)\n File "/usr/lib/pytho
n2.7/site-packages/rtslib_fb/tcm.py", line 836, in _configure\n
self._enable()\n File
"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172, in
_enable\n fwrite(path, "1\\n")\n File "/usr/lib/pyt
hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n
file_fd.write(str(string))\nIOError: [Errno 2] No such file or
directory\n')
The full traceback is:
Traceback (most recent call last):
File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in
ansible_main()
File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 135, in
ansible_main
lun.manage(desired_state)
File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 365, in manage
self.allocate()
File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 490, in allocate
lun = self.add_dev_to_lio()
File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 683, in add_dev_to_lio
wwn=in_wwn, control=control_string)
File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818,
in __init__
self._configure(config, size, wwn, hw_max_sectors, control)
File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 836,
in _configure
self._enable()
File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172,
in _enable
fwrite(path, "1\n")
File "/usr/lib/python2.7/site-packages/rtslib_fb/utils.py", line
79,
in fwrite
file_fd.write(str(string))
IOError: [Errno 2] No such file or directory
failed: [ovirt-test04] (item={u'host': u'ovirt-test04', u'image':
u'iscsi2342', u'state': u'present', u'pool': u'rbd', u'size':
u'1G'}) => {
"changed": false,
"item": {
"host": "ovirt-test04",
"image": "iscsi2342",
"pool": "rbd",
"size": "1G",
"state": "present"
},
"module_stderr": "Traceback (most recent call last):\n File
\"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py\", line 166, in
\n ansible_main()\n File
\"/tmp/ansible_F3sf6j/ansible_module_igw_lun.
py\", line 135, in ansible_ma
Re: [ceph-users] Problems setting up iSCSI
Hi,
Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
Do you have the ansible backtrace from the "ceph-iscsi-gw : igw_lun |
configureluns (create/map rbds and add to lio)]" step?
I assume you mean the following (from running with verbosity 3, after
running the purge-iscsi-gateways playbook beforehand)
Using module file /home/dick/git/ceph-ansible/library/igw_lun.py
ESTABLISH SSH CONNECTION FOR USER: root
SSH: EXEC ssh -o ControlMaster=auto -o
ControlPersist=600s -o StrictHostKeyChecking=no -o
KbdInteractiveAuthentication=no -o
PreferredAuthentications=gssapi-with-mic,g
ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o
User=root -o ConnectTimeout=30 -o
ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04 '/bin/sh -c
'"'"'/usr/bin/p
ython && sleep 0'"'"''
(1, '', 'Traceback (most recent call last):\n File
"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in \n
ansible_main()\n File "/tmp/ansible_F3
sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n
lun.manage(desired_state)\n File
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 365,
in manage\nself.allocate()\n File "/u
sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 490, in
allocate\nlun = self.add_dev_to_lio()\n File
"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", line 683,
in add_dev_to_lio\n
wwn=in_wwn, control=control_string)\n File
"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818, in
__init__\nself._configure(config, size, wwn, hw_max_sectors,
control)\n File "/usr/lib/pytho
n2.7/site-packages/rtslib_fb/tcm.py", line 836, in _configure\n
self._enable()\n File
"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172, in
_enable\nfwrite(path, "1\\n")\n File "/usr/lib/pyt
hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n
file_fd.write(str(string))\nIOError: [Errno 2] No such file or directory\n')
The full traceback is:
Traceback (most recent call last):
File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in
ansible_main()
File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 135, in
ansible_main
lun.manage(desired_state)
File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 365, in manage
self.allocate()
File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 490, in allocate
lun = self.add_dev_to_lio()
File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
line 683, in add_dev_to_lio
wwn=in_wwn, control=control_string)
File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818,
in __init__
self._configure(config, size, wwn, hw_max_sectors, control)
File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 836,
in _configure
self._enable()
File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172,
in _enable
fwrite(path, "1\n")
File "/usr/lib/python2.7/site-packages/rtslib_fb/utils.py", line 79,
in fwrite
file_fd.write(str(string))
IOError: [Errno 2] No such file or directory
failed: [ovirt-test04] (item={u'host': u'ovirt-test04', u'image':
u'iscsi2342', u'state': u'present', u'pool': u'rbd', u'size': u'1G'}) => {
"changed": false,
"item": {
"host": "ovirt-test04",
"image": "iscsi2342",
"pool": "rbd",
"size": "1G",
"state": "present"
},
"module_stderr": "Traceback (most recent call last):\n File
\"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py\", line 166, in
\nansible_main()\n File
\"/tmp/ansible_F3sf6j/ansible_module_igw_lun.
py\", line 135, in ansible_main\nlun.manage(desired_state)\n File
\"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line 365,
in manage\nself.allocate()\n File \"/usr/lib/python2.7/site-pa
ckages/ceph_iscsi_config/lun.py\", line 490, in allocate\nlun =
self.add_dev_to_lio()\n File
\"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line 683,
in add_dev_to_lio\nwwn=in_wwn, contr
ol=control_string)\n File
\"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\", line 818, in
__init__\nself._configure(config, size, wwn, hw_max_sectors,
control)\n File \"/usr/lib/python2.7/site-packages
/rtslib_fb/tcm.py\", line 836, in _configure\n self._enable()\n File
\"/usr/lib/python2.7/site-packag
Re: [ceph-users] Problems setting up iSCSI
Hi Jason, Am 28.06.2018 um 14:33 schrieb Jason Dillaman: You should have "/var/log/ansible-module-igw_config.log" on the target machine that hopefully includes more information about why the RBD image is missing from the TCM backend. I have the logfile, however there everything seems fine. The last lines are: 2018-06-28 17:25:36,876 igw_lun.py DEBUG: Check the rbd image size matches the request 2018-06-28 17:25:36,904 igw_lun.py DEBUG: rbd image rbd.iscsi2342 size matches the configuration file request 2018-06-28 17:25:36,904 igw_lun.py DEBUG: Begin processing LIO mapping 2018-06-28 17:25:36,905 igw_lun.py INFO : (LUN.add_dev_to_lio) Adding image 'rbd.iscsi2342' to LIO 2018-06-28 17:25:36,905 igw_lun.py DEBUG: control="max_data_area_mb=8" Regards Bernhard In the past, I've seen issues w/ image features and image size mismatch causing the process to abort On Thu, Jun 28, 2018 at 5:57 AM Bernhard Dick <mailto:bernh...@bdick.de>> wrote: Hi, I'm trying to setup iSCSI using ceph-ansible (stable-3.1) branch with one iscsi gateway. The Host is a CentOS 7 host and I use the packages from the Centos Storage SIG for luminous. Additionally I have installed: ceph-iscsi-cli Version 2.7 Release 13.gb9e48a7.el7 ceph-iscsi-config Version 2.6 Release 15.ge016c6f.el7 from the iscsi project at shaman.ceph.com <http://shaman.ceph.com>. The python-rtslib version on the host is 2.1.fb67 Release 10.g7713d1e also from shaman. The running kernel version is 4.15.0-ceph-g1c778f43da52. The ansible process stops at TASK [ceph-iscsi-gw : igw_lun | configure luns (create/map rbds and add to lio)] complaining about file not found while caused by the self._enable function in tcm.py. That is due to the directory /sys/kernel/config/target/core/user_0/ is completely missing at this step. Do you have any ideas how to fix or debug this further? Regards Bernhard ___ ceph-users mailing list ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Jason -- Dipl.-Inf. Bernhard Dick Auf dem Anger 24 DE-46485 Wesel www.BernhardDick.de jabber: bernh...@jabber.bdick.de Tel : +49.2812068620 Mobil : +49.1747607927 FAX : +49.2812068621 USt-IdNr.: DE274728845 ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Problems setting up iSCSI
Hi, I'm trying to setup iSCSI using ceph-ansible (stable-3.1) branch with one iscsi gateway. The Host is a CentOS 7 host and I use the packages from the Centos Storage SIG for luminous. Additionally I have installed: ceph-iscsi-cli Version 2.7 Release 13.gb9e48a7.el7 ceph-iscsi-config Version 2.6 Release 15.ge016c6f.el7 from the iscsi project at shaman.ceph.com. The python-rtslib version on the host is 2.1.fb67 Release 10.g7713d1e also from shaman. The running kernel version is 4.15.0-ceph-g1c778f43da52. The ansible process stops at TASK [ceph-iscsi-gw : igw_lun | configure luns (create/map rbds and add to lio)] complaining about file not found while caused by the self._enable function in tcm.py. That is due to the directory /sys/kernel/config/target/core/user_0/ is completely missing at this step. Do you have any ideas how to fix or debug this further? Regards Bernhard ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] EPEL dependency on CENTOS
Hi, I'm experimenting with CEPH and have seen that ceph-deploy and ceph-ansible have the EPEL repositories as requirement, when installing CEPH on CENTOS hosts. Due to the nature of the EPEL repos this might cause trouble (i.e. when combining CEPH with oVirt on the same host). When using the CEPH repos from the storage-SIG of centos EPEL is not needed, so I'm asking whether it is still required to explicitly require installation of the EPEL repository when using the official ways of installing CEPH? My solution for it was changing the centos_package_dependencies list in the ceph-ansible tree by replacing epel-release with centos-release-ceph-luminous and setting ceph_origin to distro. Would it be an idea to add direct support for the centos SIG packages in ceph-ansible or to decide on when to install epel based on the used package repository? Regards Bernhard ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
