Re: [Openstack] create volume hangs at creating.
On Thu, Jun 28, 2012 at 4:52 AM, Milind milindkpa...@gmail.com wrote: Thanks for reply. When I ran following command tgtadm --lld iscsi --mode target --op show It hangs forever So I guess the command to create the export probably hangs too, and the greenthread in nova-volume never joins... which is maybe why you didn't get a traceback? Sadly I've not seen that before from tgt. But I guess it sounds like tgt isn't installed/setup properly. There's a number of things you could check, maybe try and restart the service and watch syslog for errors. Jay makes a good suggestion, about running the commands manually - some understanding of what the volume-manager does to provision volumes and expose them via iscsi would help you understand where things break down. You could also try to install iscsitarget. If your os has packages it's pretty painless, but there is a dkms - just uninstall/purge tgt first. Then try setting nova-volume to use iet as the iscsi_helper in your conf/flags. Good Luck, -clayg ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] create volume hangs at creating.
Hi, I am still facing this problem following is the log. 2012-06-27 16:13:10 DEBUG nova.manager [-] Running periodic task VolumeManager._publish_service_capabilities from (pid=17850) periodic_tasks /usr/lib/python2.7/dist-packages/nova/manager.py:152 2012-06-27 16:13:10 DEBUG nova.manager [-] Running periodic task VolumeManager._report_driver_status from (pid=17850) periodic_tasks /usr/lib/python2.7/dist-packages/nova/manager.py:152 2012-06-27 16:14:10 DEBUG nova.manager [-] Running periodic task VolumeManager._publish_service_capabilities from (pid=17850) periodic_tasks /usr/lib/python2.7/dist-packages/nova/manager.py:152 2012-06-27 16:14:10 DEBUG nova.manager [-] Running periodic task VolumeManager._report_driver_status from (pid=17850) periodic_tasks /usr/lib/python2.7/dist-packages/nova/manager.py:152 2012-06-27 16:14:36 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_context_request_id': u'req-07220301-c87c-40e3-a211-cc4725bcacd3', u'_context_read_deleted': u'no', u'args': {u'volume_id': 1, u'snapshot_id': None}, u'_context_auth_token': 'SANITIZED', u'_context_is_admin': True, u'_context_project_id': u'68124ec3a778447093eba446aa896105', u'_context_timestamp': u'2012-06-27T10:44:36.284391', u'_context_user_id': u'434a94c6f63e43289702353f410ab693', u'method': u'create_volume', u'_context_remote_address': u'10.253.59.152'} from (pid=17850) _safe_log /usr/lib/python2.7/dist-packages/nova/rpc/common.py:160 2012-06-27 16:14:36 DEBUG nova.rpc.amqp [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] unpacked context: {'user_id': u'434a94c6f63e43289702353f410ab693', 'roles': [u'admin'], 'timestamp': '2012-06-27T10:44:36.284391', 'auth_token': 'SANITIZED', 'remote_address': u'10.253.59.152', 'is_admin': True, 'request_id': u'req-07220301-c87c-40e3-a211-cc4725bcacd3', 'project_id': u'68124ec3a778447093eba446aa896105', 'read_deleted': u'no'} from (pid=17850) _safe_log /usr/lib/python2.7/dist-packages/nova/rpc/common.py:160 2012-06-27 16:14:36 INFO nova.volume.manager [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] volume volume-0001: creating 2012-06-27 16:14:36 DEBUG nova.volume.manager [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] volume volume-0001: creating lv of size 1G from (pid=17850) create_volume /usr/lib/python2.7/dist-packages/nova/volume/manager.py:120 2012-06-27 16:14:36 DEBUG nova.utils [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] Running cmd (subprocess): sudo nova-rootwrap lvcreate -L 1G -n volume-0001 nova-volumes from (pid=17850) execute /usr/lib/python2.7/dist-packages/nova/utils.py:219 Exception AssertionError: AssertionError() in module 'threading' from '/usr/lib/python2.7/threading.pyc' ignored 2012-06-27 16:14:36 DEBUG nova.volume.manager [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] volume volume-0001: creating export from (pid=17850) create_volume /usr/lib/python2.7/dist-packages/nova/volume/manager.py:131 2012-06-27 16:14:41 DEBUG nova.utils [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] Running cmd (subprocess): sudo nova-rootwrap tgtadm --op new --lld=iscsi --mode=target --tid=1 --targetname=iqn.2010-10.org.openstack:volume-0001 from (pid=17850) execute /usr/lib/python2.7/dist-packages/nova/utils.py:219 Exception AssertionError: AssertionError() in module 'threading' from '/usr/lib/python2.7/threading.pyc' ignored Regards, Milind ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] create volume hangs at creating.
On 06/27/2012 06:45 AM, Milind wrote: Hi, I am still facing this problem following is the log. I actually don't see any errors in the log file contents below (you can ignore the silly AssertionError thing about threading.pyc). Perhaps you could try executing the underlying volume creation commands as root and see if you get any output or if things just hang? From what I can tell, those commands would be: sudo lvcreate -L 1G -n volume-0001 nova-volumes sudo tgtadm --op new --lld=iscsi --mode=target --tid=1 --targetname=iqn.2010-10.org.openstack:volume-0001 Also remember that your nova-volumes volume group must have enough size in it to create this volume! Best, -jay 2012-06-27 16:13:10 DEBUG nova.manager [-] Running periodic task VolumeManager._publish_service_capabilities from (pid=17850) periodic_tasks /usr/lib/python2.7/dist-packages/nova/manager.py:152 2012-06-27 16:13:10 DEBUG nova.manager [-] Running periodic task VolumeManager._report_driver_status from (pid=17850) periodic_tasks /usr/lib/python2.7/dist-packages/nova/manager.py:152 2012-06-27 16:14:10 DEBUG nova.manager [-] Running periodic task VolumeManager._publish_service_capabilities from (pid=17850) periodic_tasks /usr/lib/python2.7/dist-packages/nova/manager.py:152 2012-06-27 16:14:10 DEBUG nova.manager [-] Running periodic task VolumeManager._report_driver_status from (pid=17850) periodic_tasks /usr/lib/python2.7/dist-packages/nova/manager.py:152 2012-06-27 16:14:36 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_context_request_id': u'req-07220301-c87c-40e3-a211-cc4725bcacd3', u'_context_read_deleted': u'no', u'args': {u'volume_id': 1, u'snapshot_id': None}, u'_context_auth_token': 'SANITIZED', u'_context_is_admin': True, u'_context_project_id': u'68124ec3a778447093eba446aa896105', u'_context_timestamp': u'2012-06-27T10:44:36.284391', u'_context_user_id': u'434a94c6f63e43289702353f410ab693', u'method': u'create_volume', u'_context_remote_address': u'10.253.59.152'} from (pid=17850) _safe_log /usr/lib/python2.7/dist-packages/nova/rpc/common.py:160 2012-06-27 16:14:36 DEBUG nova.rpc.amqp [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] unpacked context: {'user_id': u'434a94c6f63e43289702353f410ab693', 'roles': [u'admin'], 'timestamp': '2012-06-27T10:44:36.284391', 'auth_token': 'SANITIZED', 'remote_address': u'10.253.59.152', 'is_admin': True, 'request_id': u'req-07220301-c87c-40e3-a211-cc4725bcacd3', 'project_id': u'68124ec3a778447093eba446aa896105', 'read_deleted': u'no'} from (pid=17850) _safe_log /usr/lib/python2.7/dist-packages/nova/rpc/common.py:160 2012-06-27 16:14:36 INFO nova.volume.manager [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] volume volume-0001: creating 2012-06-27 16:14:36 DEBUG nova.volume.manager [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] volume volume-0001: creating lv of size 1G from (pid=17850) create_volume /usr/lib/python2.7/dist-packages/nova/volume/manager.py:120 2012-06-27 16:14:36 DEBUG nova.utils [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] Running cmd (subprocess): sudo nova-rootwrap lvcreate -L 1G -n volume-0001 nova-volumes from (pid=17850) execute /usr/lib/python2.7/dist-packages/nova/utils.py:219 Exception AssertionError: AssertionError() in module 'threading' from '/usr/lib/python2.7/threading.pyc' ignored 2012-06-27 16:14:36 DEBUG nova.volume.manager [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] volume volume-0001: creating export from (pid=17850) create_volume /usr/lib/python2.7/dist-packages/nova/volume/manager.py:131 2012-06-27 16:14:41 DEBUG nova.utils [req-07220301-c87c-40e3-a211-cc4725bcacd3 434a94c6f63e43289702353f410ab693 68124ec3a778447093eba446aa896105] Running cmd (subprocess): sudo nova-rootwrap tgtadm --op new --lld=iscsi --mode=target --tid=1 --targetname=iqn.2010-10.org.openstack:volume-0001 from (pid=17850) execute /usr/lib/python2.7/dist-packages/nova/utils.py:219 Exception AssertionError: AssertionError() in module 'threading' from '/usr/lib/python2.7/threading.pyc' ignored Regards, Milind ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp