Re: [Openstack-operators] [neutron] Liberty - DHCP ports keep going to BUILD state
eutron_agent self._as_root([net.version], tuple(args)) 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 338, in _as_root 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent use_root_namespace=use_root_namespace) 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 92, in _as_root 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent log_fail_as_error=self.log_fail_as_error) 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 101, in _execute 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent log_fail_as_error=log_fail_as_error) 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 159, in execute 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent raise RuntimeError(m) 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent RuntimeError: 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent Command: ['ip', '-4', 'addr', 'add', '172.22.10.99/24', 'scope', 'global', 'dev', u'brq10ee1383-ca', 'brd', '172.22.10.255'] 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent Exit code: 2 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent Stdin: 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent Stdout: 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent Stderr: RTNETLINK answers: File exists 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent 2017-11-05 10:44:10.802 1574 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent [root@maersk neutron]# date Sun Nov 5 10:44:16 PST 2017 - Christopher T. Hull Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Sun, Nov 5, 2017 at 10:40 AM, Christopher Hull <chrishul...@gmail.com> wrote: > HI all; > Trying to create DHCP on the Public network. This had been working, but > now all of a sudden the ports are set to BUILD instead of AVAILABLE. > > I did a cheat in MariaDB and discovered that something somewhere keeps > setting DHCP to BUILD. Any ideas? > > > *MariaDB [neutron]> update ports set status='AVAILABLE' where id > ='37cc930c-6ad3-4355-8ff5-6b75e131c998';* > > *Query OK, 1 row affected (0.05 sec)* > > *Rows matched: 1 Changed: 1 Warnings: 0* > > > *MariaDB [neutron]> select status, id from ports;* > > *+---+--+* > > *| status| id |* > > *+---+--+* > > *| BUILD | 0ebbaf42-6bd9-4853-b041-e00f3da4dd89 |* > > *| AVAILABLE | 37cc930c-6ad3-4355-8ff5-6b75e131c998 |* > > *+---+--+* > > *2 rows in set (0.00 sec)* > > > *MariaDB [neutron]> select status, id from ports;* > > *++--+* > > *| status | id |* > > *++--+* > > *| BUILD | 0ebbaf42-6bd9-4853-b041-e00f3da4dd89 |* > > *| BUILD | 37cc930c-6ad3-4355-8ff5-6b75e131c998 |* > > *++--+* > > *2 rows in set (0.00 sec)* > > > > > > > - Christopher T. Hull > Sunnyvale CA. 94085 > (415) 385 4865 <(415)%20385-4865> > chrishul...@gmail.com > http://chrishull.com > > > ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] [neutron] Liberty - DHCP ports keep going to BUILD state
HI all; Trying to create DHCP on the Public network. This had been working, but now all of a sudden the ports are set to BUILD instead of AVAILABLE. I did a cheat in MariaDB and discovered that something somewhere keeps setting DHCP to BUILD. Any ideas? *MariaDB [neutron]> update ports set status='AVAILABLE' where id ='37cc930c-6ad3-4355-8ff5-6b75e131c998';* *Query OK, 1 row affected (0.05 sec)* *Rows matched: 1 Changed: 1 Warnings: 0* *MariaDB [neutron]> select status, id from ports;* *+---+--+* *| status| id |* *+---+--+* *| BUILD | 0ebbaf42-6bd9-4853-b041-e00f3da4dd89 |* *| AVAILABLE | 37cc930c-6ad3-4355-8ff5-6b75e131c998 |* *+---+--+* *2 rows in set (0.00 sec)* *MariaDB [neutron]> select status, id from ports;* *++--+* *| status | id |* *++--+* *| BUILD | 0ebbaf42-6bd9-4853-b041-e00f3da4dd89 |* *| BUILD | 37cc930c-6ad3-4355-8ff5-6b75e131c998 |* *++--+* *2 rows in set (0.00 sec)* - Christopher T. Hull Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] [neutron] ERROR neutron.agent.linux.utils File exists
Hello again; I recently tried to fire up an instance and networking didn't work. I looked at the neutron logs and found this. 2017-10-24 15:57:10.565 1784 ERROR neutron.agent.linux.utils [req-bbe542d2-7d02-4373-b6af-4f8ee3dd6392 - - - - -] Command: ['ip', '-4', 'addr', 'add', '172.22.10.99/24', 'scope', 'global', 'dev', u'brq9ee73442-5a', 'brd', '172.22.10.255'] Exit code: 2 Stdin: Stdout: Stderr: RTNETLINK answers: File exists ifconfig shows this exists, and it's my host machine. This is out of range of the Openstack DHCP that I set up. brq9ee73442-5a: flags=4099mtu 1500 inet 172.22.10.99 netmask 255.255.255.0 broadcast 172.22.10.255 ether 00:00:00:00:00:00 txqueuelen 1000 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 11 bytes 2027 (1.9 KiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 Everything used to work. I wonder what has changed. Why would neutron try to create a port at "99" (if indeed that's what's happening). Finally, my subnet info for public. Could I have made a mistake here? Subnet Details Subnet Overview Subnet Name housenet ID 28683bfe-2410-4f9b-b805-ec3c7aee009a Network ID 9ee73442-5a86-48c0-84da-8f650937fd08 Subnetpool None IP version IPv4 CIDR 172.22.10.0/24 IP allocation pool Start 172.22.10.10 - End 172.22.10.90 Gateway IP 172.22.10.254 DHCP Enable Yes Additional routes None DNS name server 172.22.10.254 Thanks; -Chris = full stack trace. 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent sync = self.process_network_devices(device_info) 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 1009, in process_network_devices 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent resync_a = self.treat_devices_added_updated(devices_added_updated) 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 1045, in treat_devices_added_updated 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent device_details['port_id'], device_details['device_owner']) 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 542, in add_interface 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent tap_device_name, device_owner) 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 480, in add_tap_interface 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent return False 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 195, in __exit__ 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent six.reraise(self.type_, self.value, self.tb) 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 472, in add_tap_interface 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent tap_device_name, device_owner) 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 504, in _add_tap_interface 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent segmentation_id) 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 456, in ensure_physical_in_bridge 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent physical_interface) 2017-10-24 15:57:08.634 1784 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent File
[Openstack-operators] [glance] Modify image so it creates a Cinder volume as its root vol when launched
HI all; I've finally come up with a good strategy to migrate between images and volumes. (Had to hack my system a little as per previous mail.) When I upload a cinder volume to an image, it creates an image that then produces an instance where the root volume is on the compute node. This is often Ok, but I've somehow in the past produced images that automatically create root volumes on Cinder. How can I modify an image such that it creates root on Cinder when an instance is spun up? How can I switch back if I want? I'm sure this is a common new question. :-) Thanks; -Chris - Christopher T. Hull My contract at NASA has ended and I am seeking new opportunities. For updated resume and other info, please click this link. http://faq.chrishull.com Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] [cinder] Cant create Volume from Image, says checksums dont match
Hi Sean; It works just fine without the check. This is a hack, not my preferred solution. It would be nice if Cinder properly doublechecked the checksum. But this does work nicely. The symptom you will get from Horizon is an almost useless error message telling you to come back later. Us Java folks believe in proper error propagation. Guess PyDevs don't. heh. (I do Py too btw). I am not running any particular distro. I installed Liberty myself and developed a small tool to help with custom OPenstack installs. I would like to place it in the Operators git. Had tried that before with difficulty so I posted to Github.See https://github.com/chrishull/github-openstack Anyway, here's my fix with notes -Chris --- 2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 434, in integrity_iter 2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher (md5sum, checksum)) def integrity_iter(iter, checksum): """Check image data integrity. :raises: IOError """ md5sum = hashlib.md5() for chunk in iter: yield chunk if isinstance(chunk, six.string_types): chunk = six.b(chunk) md5sum.update(chunk) md5sum = md5sum.hexdigest() # if md5sum != checksum: <--- line 434 #raise IOError(errno.EPIPE, # 'Corrupt image download. Checksum was %s expected %s' % # (md5sum, checksum)) # Checksum is known to be good and working. glance to cinder seems to have an issue # Code commented out by chris hull on 19 Oct 2017 CTH - Christopher T. Hull My contract at NASA has ended and I am seeking new opportunities. For updated resume and other info, please click this link. http://faq.chrishull.com Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Fri, Oct 20, 2017 at 5:57 AM, Sean McGinnis <sean.mcgin...@gmx.com> wrote: > On Thu, Oct 19, 2017 at 06:55:38PM -0700, Christopher Hull wrote: > > The qcow2 checksums are correct. They run via nova. > > > > I seem to recall that the cinder checksum calculation when reading in an > > image is faulty. I'm simply going to remove the offending code. > > -Chris > > > > I have not heard this before. If you remove that check and verify > everything is > working without it, it would be useful to post those results here. > > I didn't see an open bug for this. If you could file a bug and include any > log > files and details, that would be appreciated: > > https://bugs.launchpad.net/cinder > > Sean > ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] [cinder] Cant create Volume from Image, says checksums dont match
The qcow2 checksums are correct. They run via nova. I seem to recall that the cinder checksum calculation when reading in an image is faulty. I'm simply going to remove the offending code. -Chris - Christopher T. Hull My contract at NASA has ended and I am seeking new opportunities. For updated resume and other info, please click this link. http://faq.chrishull.com Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Thu, Oct 19, 2017 at 2:07 PM, Christopher Hull <chrishul...@gmail.com> wrote: > HI guys; > This used to work. Trying to come up with an update / backup strategy > here. Successfully created an image from a volume (must do as admin it > seems, but that's not an issue.) The image runs just fine as an instance > (creates it's root drive on the controller/cumpute node). > But when I try to turn the image back into a volume I get this > nonsense. > > Note the warnings in the beginning. Not sure what these mean. > > Running Liberty. > > Thanks yet again; > -Chris > > -- > > > *2017-10-19 14:00:55.258 2787 INFO > cinder.volume.flows.manager.create_volume > [req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f > 7813be77b1de4196b1c6b77006afa21c - - -] Volume > cfb61fc5-4900-4e39-bda7-66f0f1b46a69: being created as image with > specification: {'status': u'creating', 'image_location': (None, None), > 'volume_size': 200, 'volume_name': > u'volume-cfb61fc5-4900-4e39-bda7-66f0f1b46a69', 'image_id': > u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'image_service': > , 'image_meta': > {'status': u'active', 'name': u'CentOS-KDE-Desktop2', 'deleted': False, > 'container_format': u'bare', 'created_at': datetime.datetime(2017, 10, 19, > 19, 34, 44, tzinfo=), 'disk_format': u'qcow2', 'updated_at': > datetime.datetime(2017, 10, 19, 20, 2, 45, tzinfo=), 'id': > u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'owner': > u'fdf3f98a9b0c4e9e94603d8a84ea41a8', 'min_ram': 0, 'checksum': > u'ac1f1ca3c04dd439291fd598d723adb5', 'min_disk': 0, 'is_public': True, > 'deleted_at': None, 'properties': {}, 'size': 12859670528}}* > > *2017-10-19 14:00:55.259 2787 WARNING cinder.context > [req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f > 7813be77b1de4196b1c6b77006afa21c - - -] Unable to get internal tenant > context: Missing required config parameters.* > > *2017-10-19 14:00:55.259 2787 WARNING > cinder.volume.flows.manager.create_volume > [req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f > 7813be77b1de4196b1c6b77006afa21c - - -] Unable to get Cinder internal > context, will not use image-volume cache.* > > *2017-10-19 14:02:18.216 2787 WARNING cinder.volume.manager > [req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f > 7813be77b1de4196b1c6b77006afa21c - - -] Task > 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' > (fdcc9b52-493d-4fb5-929f-d1554672deb1) transitioned into state 'FAILURE' > from state 'RUNNING'* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager Traceback (most > recent call last):* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File > "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", > line 82, in _execute_task* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager result = > task.execute(**arguments)* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File > "/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py", > line 834, in execute* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager > **volume_spec)* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File > "/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py", > line 737, in _create_from_image* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager > image_service, context, image_id) as tmp_image:* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File > "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager return > self.gen.next()* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File > "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 540, > in fetch* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager > fetch_verify_image(context, image_service, image_id, tmp)* > > *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File > "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 204, > in fetch_verify_image* &
[Openstack-operators] [cinder] Cant create Volume from Image, says checksums dont match
HI guys; This used to work. Trying to come up with an update / backup strategy here. Successfully created an image from a volume (must do as admin it seems, but that's not an issue.) The image runs just fine as an instance (creates it's root drive on the controller/cumpute node). But when I try to turn the image back into a volume I get this nonsense. Note the warnings in the beginning. Not sure what these mean. Running Liberty. Thanks yet again; -Chris -- *2017-10-19 14:00:55.258 2787 INFO cinder.volume.flows.manager.create_volume [req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f 7813be77b1de4196b1c6b77006afa21c - - -] Volume cfb61fc5-4900-4e39-bda7-66f0f1b46a69: being created as image with specification: {'status': u'creating', 'image_location': (None, None), 'volume_size': 200, 'volume_name': u'volume-cfb61fc5-4900-4e39-bda7-66f0f1b46a69', 'image_id': u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'image_service': , 'image_meta': {'status': u'active', 'name': u'CentOS-KDE-Desktop2', 'deleted': False, 'container_format': u'bare', 'created_at': datetime.datetime(2017, 10, 19, 19, 34, 44, tzinfo=), 'disk_format': u'qcow2', 'updated_at': datetime.datetime(2017, 10, 19, 20, 2, 45, tzinfo=), 'id': u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'owner': u'fdf3f98a9b0c4e9e94603d8a84ea41a8', 'min_ram': 0, 'checksum': u'ac1f1ca3c04dd439291fd598d723adb5', 'min_disk': 0, 'is_public': True, 'deleted_at': None, 'properties': {}, 'size': 12859670528}}* *2017-10-19 14:00:55.259 2787 WARNING cinder.context [req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f 7813be77b1de4196b1c6b77006afa21c - - -] Unable to get internal tenant context: Missing required config parameters.* *2017-10-19 14:00:55.259 2787 WARNING cinder.volume.flows.manager.create_volume [req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f 7813be77b1de4196b1c6b77006afa21c - - -] Unable to get Cinder internal context, will not use image-volume cache.* *2017-10-19 14:02:18.216 2787 WARNING cinder.volume.manager [req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f 7813be77b1de4196b1c6b77006afa21c - - -] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcc9b52-493d-4fb5-929f-d1554672deb1) transitioned into state 'FAILURE' from state 'RUNNING'* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager Traceback (most recent call last):* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager result = task.execute(**arguments)* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 834, in execute* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager **volume_spec)* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 737, in _create_from_image* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager image_service, context, image_id) as tmp_image:* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager return self.gen.next()* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 540, in fetch* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager fetch_verify_image(context, image_service, image_id, tmp)* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 204, in fetch_verify_image* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager None, None)* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 182, in fetch* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager image_service.download(context, image_id, image_file)* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/image/glance.py", line 323, in download* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager for chunk in image_chunks:* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 477, in __iter__* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager for chunk in self.iterable:* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 434, in integrity_iter* *2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager (md5sum,
[Openstack-operators] [cinder] volume in-use attached to None?
Running Liberty. I'd like to be able to create new volumes from old ones. Launching instances from volumes results in the volume being "root attached", and therefore, it seems, forever wed to the instance. It can not be copied. So I tried deleting the instance. Still no good. The volume is now in-use by None. So now the volume is completely useless. How do I force Cinder to detach from either a root mounted , or of all things, None?? -Chris - Christopher T. Hull http://faq.chrishull.com Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] How to best assign a public IP to a server?
Hi all; I have a fairly typical ATT service with 5 static IPs that I run servers on. I'd like to run some servers out of Openstack. What is the best way to assign a public IP to an instance? I've tried creating a second subnet on Public, and sometimes I get lucky and an instance picks up an IP from there. I've also tried using nova add-fixed-ip. There is no way to associate a subnet to an instance, only a whole network. And simply using flat, I can's have two networks associated with my ATT router. Running Liberty. Any ideas? Thanks; -Chris - Christopher T. Hull My contract at NASA has ended and I am seeking new opportunities. For updated resume and other info, please click this link. http://faq.chrishull.com Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] CentOS upgrade killed my Liberty system
Hello Yaguang; Thanks very much for the assist. Curiously, no errors in horizon. But an error upstream in httpd... Browser hangs for a while then shows "Internal Server Error" /var/log/httpd/error shows this... [Tue Oct 10 09:32:53.860393 2017] [core:error] [pid 27391] [client 172.22.10.130:53239] End of script output before headers: django.wsgi Hope this looks familiar to someone. Thanks all; -Chris - Christopher T. Hull My contract at NASA has ended and I am seeking new opportunities. For updated resume and other info, please click this link. http://faq.chrishull.com Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Tue, Oct 10, 2017 at 5:47 AM, Yaguang Tang <heut2...@gmail.com> wrote: > Can you paste out the horizon related error logs, may be caused by horizon > dependency issue. > > On Tue, Oct 10, 2017 at 2:12 AM, Christopher Hull <chrishul...@gmail.com> > wrote: > >> Hi all; >> >> About 18 months ago I did a piece by piece install of Liberty (following >> instructions on the Openstack page) and had been using it until somewhat >> recently when it broke after a CentOS 7 update ran. I think Python/http is >> what changed / broke (sessionless connections no longer supported?). >> Basics like nova list still work, but Horizon won't run. >> >> How can I "downgrade" my CentOS box? >> Or alternatively, how painful is it to update to the most current >> Openstack? >> >> Also, I noticed that the CeotOS cloud SIG repo moved. >> >> Please help. :-) >> >> BTW, for installs I wrote a tool to help with setting up the many >> Openstack config files. If interested, you can find it here. >> http://chrishull.com/career/openstack/index.html >> https://github.com/chrishull/github-openstack >> >> Several months ago I tried to check this into the Openstack Operators GIT >> repo, but had difficulty. >> >> Anyway. Please advise on how I can fix my Liberty system if you can. >> >> Thanks; >> -Chris >> >> >> >> >> >> >> >> >> >> >> >> >> - Christopher T. Hull >> My contract at NASA has ended and I am seeking new opportunities. >> For updated resume and other info, please click this link. >> http://faq.chrishull.com >> Sunnyvale CA. 94085 >> (415) 385 4865 <(415)%20385-4865> >> chrishul...@gmail.com >> http://chrishull.com >> >> >> >> ___ >> OpenStack-operators mailing list >> OpenStack-operators@lists.openstack.org >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators >> >> > > > -- > Tang Yaguang > > > > ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] CentOS upgrade killed my Liberty system
Hi all; About 18 months ago I did a piece by piece install of Liberty (following instructions on the Openstack page) and had been using it until somewhat recently when it broke after a CentOS 7 update ran. I think Python/http is what changed / broke (sessionless connections no longer supported?). Basics like nova list still work, but Horizon won't run. How can I "downgrade" my CentOS box? Or alternatively, how painful is it to update to the most current Openstack? Also, I noticed that the CeotOS cloud SIG repo moved. Please help. :-) BTW, for installs I wrote a tool to help with setting up the many Openstack config files. If interested, you can find it here. http://chrishull.com/career/openstack/index.html https://github.com/chrishull/github-openstack Several months ago I tried to check this into the Openstack Operators GIT repo, but had difficulty. Anyway. Please advise on how I can fix my Liberty system if you can. Thanks; -Chris - Christopher T. Hull My contract at NASA has ended and I am seeking new opportunities. For updated resume and other info, please click this link. http://faq.chrishull.com Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] Attempting to contribute code
Hello all; I have been attempting to set up access to the Gerrit / Git sandbox and submit code that I had offered to the group about a month or so ago. Off and on for the past month, I have attempted to agree to the Contributor License Agreement in order to get a space in Git. For the past month, whenever I hit Submit, I get an error 500. What gives? :-)Is there something else I can do? Maybe the back end doesn't like Firefox? Here's the URLhttps://review.openstack.org/#/settings/new-agreement Let me know what to do. I'd like to get this code in for review by the group.URL to my site with code. http://chrishull.com/career/openstack/index.html Let me know. Thanks; -Chris - Christopher T. Hull I am presently seeking a new career opportunity. If you are a recruiter, please see my career FAQ for updated resume and other important information. Click here ---> http://chrishull.com/career/faq.html Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] [neutron] Interesting networking issue - need help
If I set --router:external=False on the Public net, will that cause Neutron to create a purely virtual router based on an instance instead of playing games with the hardware NIC? Sure, that will "burn an instance", but it will have the advantage in that it might actually work! :-) -Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Thu, Mar 31, 2016 at 11:05 AM, Christopher Hull <chrishul...@gmail.com> wrote: > All by IP. Private instances can't get hostnames because they can't get > TCP/UDP back from DNS, so all testing is via IP. > > -Chris > > > - Christopher T. Hull > I am presently seeking a new career opportunity Please see career page > http://chrishull.com/career > 333 Orchard Ave, Sunnyvale CA. 94085 > (415) 385 4865 > chrishul...@gmail.com > http://chrishull.com > > > > On Thu, Mar 31, 2016 at 10:51 AM, Neil Jerram <neil.jer...@metaswitch.com> > wrote: > >> On 31/03/16 18:40, Christopher Hull wrote: >> > Hi all; >> > Was originally DNS issue, but that was a downstream symptom. >> > >> > Instances on Private net can't access internet TCP, but CAN ICMP. ping >> all. >> > Details: >> > 1. Instances on Public net work perfectly. >> > 2. Instances on Private net can fully access Public net instances, both >> > virtual and physical boxes. >> > ssh from Private to Public instance works. >> > http to OpenStack dashboard (physical box) from Private instance >> works. >> > 3. Private instances can ping everything, including the internet. >> >> By IP or by hostname? >> >> > 4. Private instances can NOT TCP to my ATT gateway. (public net) >> > HTTP to ATT gateway which has a web interface fails. >> > Same is true for internet. Ping, but no TCP (UDP?) >> >> Again, are these TCP attempts to an IP or to a hostname? >> >> Just want to be sure that this isn't still a name resolution issue. >> >> Neil >> >> >> > 5. Floating IPs work. I think the Neutron Router is fine. >> > >> > Any ideas?? >> > -Chris >> > >> > >> > >> > >> > >> > >> > >> > - Christopher T. Hull >> > I am presently seeking a new career opportunity Please see career page >> > http://chrishull.com/career >> > 333 Orchard Ave, Sunnyvale CA. 94085 >> > (415) 385 4865 >> > chrishul...@gmail.com <mailto:chrishul...@gmail.com> >> > http://chrishull.com >> > >> > >> >> > ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] [neutron] Instances on private net can't resolve, no DNS
Hello all; Well, more pulling of teeth it seems before I actually get to USE my self-installed OpenStack Liberty. :-) All networks seem to work just fine. Can ping everything from private network. You would think DNS would work, but it doesn'tThis I think has something to do with dnsmasq. I've read a few web pages. Set dnsmasq_dns_servers in dhcp_agent.ini to 8.8.8.8,8.8.4.4 (Google DNS). Also set the private subnet to those. Nada. >From within an instance on the Private network, telnet 8.8.8.8 53 "no route to host" but it PINGS! Hmmm. So help me unravel more of this genome known as OpenStack. Why if private instances can reach the internet, doens't DNS work Just patched Neutron to fix the previous bug. I think I have the latest. Thanks -Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] [neutron] Liberty - How to install latest version
Hi Kris; That actually makes a lot of sense. Seeing as I'm in a sort of "developer' role here, I should grab updates from their source. I have attempted to sign the Contributor agreement, but the site errors. I'll try again. Hopefully I'll be able to help out soon. I did clone git, but my place in the sandbox will not get created until the agreement is signed, I assume. Thanks for the help. Looking forward to giving back; -Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Tue, Mar 29, 2016 at 8:53 AM, Kris G. Lindgren <klindg...@godaddy.com> wrote: > To be fair. The missing update that he needed was from almost 60 days ago > (Tagged on Jan 23rd). > > ___ > Kris Lindgren > Senior Linux Systems Engineer > GoDaddy > > > > > > > > On 3/29/16, 6:14 AM, "Ihar Hrachyshka" <ihrac...@redhat.com> wrote: > > >Christopher Hull <chrishul...@gmail.com> wrote: > > > >> Nevermind! :-) Updated using all noarch RPMs. Liberty Router Pings > >> for the very first time! Yes, the fix was in that patch. CentOS, for > >> the sake of future stackers, please update your repo. And thanks all > >> for the help!!! > > > >Note that while CentOS provides some infra for RDO, RDO is a project that > >is separate from CentOS. If anything, you should ask RDO folks to manage > >missing updates. > > > >That said, I note that 22 days without an update does not sound > >embarrassing to me. RDO folks need some time to deliver an update while > >making sure it’s not breaking core scenarios for existing installations. > > > >Ihar > > > >___ > >OpenStack-operators mailing list > >OpenStack-operators@lists.openstack.org > >http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators > ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] [neutron] Liberty - How to install latest version
Nevermind! :-) Updated using all noarch RPMs. Liberty Router Pings for the very first time! Yes, the fix was in that patch. CentOS, for the sake of future stackers, please update your repo. And thanks all for the help!!! [sleestack@maersk src]$ ping 172.22.10.17 PING 172.22.10.17 (172.22.10.17) 56(84) bytes of data. 64 bytes from 172.22.10.17: icmp_seq=1 ttl=64 time=0.052 ms 64 bytes from 172.22.10.17: icmp_seq=2 ttl=64 time=0.031 ms 64 bytes from 172.22.10.17: icmp_seq=3 ttl=64 time=0.030 ms - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Sun, Mar 27, 2016 at 8:15 AM, Christopher Hull <chrishul...@gmail.com> wrote: > Hi all; > > In order to get the CentOS fix I need, I have to install the latest > Neutron. > There is a src rpm, and several noarch rpms.Considering OpenStack is > written in Python, it's pretty much all src right? Was wondering which > package(s) to install in this case. Think I'll install all the noarch > rpms. They depend upon one another. > > See http://cbs.centos.org/koji/buildinfo?buildID=10149 > > Thanks; > -Chris > > > - Christopher T. Hull > I am presently seeking a new career opportunity Please see career page > http://chrishull.com/career > 333 Orchard Ave, Sunnyvale CA. 94085 > (415) 385 4865 > chrishul...@gmail.com > http://chrishull.com > > > ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] [neutron] Liberty - How to install latest version
Hi all; In order to get the CentOS fix I need, I have to install the latest Neutron. There is a src rpm, and several noarch rpms.Considering OpenStack is written in Python, it's pretty much all src right? Was wondering which package(s) to install in this case. Think I'll install all the noarch rpms. They depend upon one another. See http://cbs.centos.org/koji/buildinfo?buildID=10149 Thanks; -Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] Where can I get current Liberty code updates?... was Re:[neutron] router Found my bug Can't add gateway
Heh; I misread. Of course I'll just grab Neutron from the suggested location... http://cbs.centos.org/koji/buildinfo?buildID=10149 -Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Sat, Mar 26, 2016 at 1:33 PM, Christopher Hull <chrishul...@gmail.com> wrote: > Hi Kris / all; > > Oh excellent! I would have posted earlier but I just wasn't sure if I > had a config issue or not. It was only Thursday that I found the smoking > log entry.I'm assuming this date will change once the patch has been > uploaded > > Repo-id : centos-openstack-liberty/x86_64 > Repo-name: CentOS-7 - OpenStack liberty > Repo-revision: 1454702604 > Repo-updated : Fri Feb 5 15:03:35 2016 > > > So, how can I help with all of this?I've been a developer for decades, > and I've even written a little OpenStack tool of my own. But when I tried > to sign the Contributor Agreement, I get a server error, several times. > > I did pull the git repo and sandbox. Next will check in a test to Gerrit > once it's all set up. Please let someone know the server is broke. > > > https://review.openstack.org/#/settings/new-agreement > "Server error Can not store contact information." > > Thanks; > -Chris > > > > - Christopher T. Hull > I am presently seeking a new career opportunity Please see career page > http://chrishull.com/career > 333 Orchard Ave, Sunnyvale CA. 94085 > (415) 385 4865 > chrishul...@gmail.com > http://chrishull.com > > > > On Sat, Mar 26, 2016 at 12:55 PM, Kris G. Lindgren <klindg...@godaddy.com> > wrote: > >> Looks like they are taking care of it: >> >> >> [11:12] *number80* klindgren: it's in liberty-testing => >> http://cbs.centos.org/koji/buildinfo?buildID=10149 >> >> [11:14] number80 I tagged it into -release since nobody reported issue >> for two weeks should be good >> ___ >> Kris Lindgren >> Senior Linux Systems Engineer >> GoDaddy >> >> From: Christopher Hull <chrishul...@gmail.com> >> Date: Saturday, March 26, 2016 at 11:06 AM >> To: "Kris G. Lindgren" <klindg...@godaddy.com> >> Cc: Kevin Benton <ke...@benton.pub>, OpenStack Operators < >> openstack-operators@lists.openstack.org> >> Subject: Re: [Openstack-operators] Where can I get current Liberty code >> updates?... was Re:[neutron] router Found my bug Can't add gateway >> >> Wow, thanks Kris; >> >> It's hard to believe that anyone running CentOS 7.2 has had any luck with >> Neutron routers. I found what seems to be the fix to my problem. And >> it's a simple 2 line Python change. I've been coding for decades, and the >> path of least risk as of now seems to be to just edit the code and hope >> there are no cascading issues. Had hoped to do it "right" :-).. but after >> 3 weeks (not full time, I have a real coding job too) I'm tired of routers >> not working. I want to migrate my servers already! :-) >> >> Will hit the IRC channels you suggest. >> >> Thanks all; >> -Chris >> >> >> >> >> - Christopher T. Hull >> I am presently seeking a new career opportunity Please see career page >> http://chrishull.com/career >> 333 Orchard Ave, Sunnyvale CA. 94085 >> (415) 385 4865 >> chrishul...@gmail.com >> http://chrishull.com >> >> >> >> On Sat, Mar 26, 2016 at 9:41 AM, Kris G. Lindgren <klindg...@godaddy.com> >> wrote: >> >>> I believe some Redhat people that hang out in #openstack-rpm-packaging. >>> But per: https://www.rdoproject.org/community/ Their main points of >>> contact are: >>> >>> #rdo: Discussion around RDO in general >>> #rdo-puppet: Discussion around deploying RDO with Packstack and it's >>> puppet modules >>> #openstack: Discussion around OpenStack with the broader OpenStack >>> community >>> #centos-devel: Discussion around the CentOS Cloud Special Interest Group >>> (SIG) >>> >>> I pointed out in the openstack-rpm-packaging channel that they are >>> pretty far behind on stable release. Last stable for neutron is 7.0.1 when >>> 7.0.3 is out. Nova is also behind on a stable that was released 22 days >>> ago. I would suggest that you talk to those guys on irc via their normal >>> communication path to let them know that
Re: [Openstack-operators] Where can I get current Liberty code updates?... was Re:[neutron] router Found my bug Can't add gateway
Hi Kris / all; Oh excellent! I would have posted earlier but I just wasn't sure if I had a config issue or not. It was only Thursday that I found the smoking log entry.I'm assuming this date will change once the patch has been uploaded Repo-id : centos-openstack-liberty/x86_64 Repo-name: CentOS-7 - OpenStack liberty Repo-revision: 1454702604 Repo-updated : Fri Feb 5 15:03:35 2016 So, how can I help with all of this?I've been a developer for decades, and I've even written a little OpenStack tool of my own. But when I tried to sign the Contributor Agreement, I get a server error, several times. I did pull the git repo and sandbox. Next will check in a test to Gerrit once it's all set up. Please let someone know the server is broke. https://review.openstack.org/#/settings/new-agreement "Server error Can not store contact information." Thanks; -Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Sat, Mar 26, 2016 at 12:55 PM, Kris G. Lindgren <klindg...@godaddy.com> wrote: > Looks like they are taking care of it: > > > [11:12] *number80* klindgren: it's in liberty-testing => > http://cbs.centos.org/koji/buildinfo?buildID=10149 > > [11:14] number80 I tagged it into -release since nobody reported issue > for two weeks should be good > ___ > Kris Lindgren > Senior Linux Systems Engineer > GoDaddy > > From: Christopher Hull <chrishul...@gmail.com> > Date: Saturday, March 26, 2016 at 11:06 AM > To: "Kris G. Lindgren" <klindg...@godaddy.com> > Cc: Kevin Benton <ke...@benton.pub>, OpenStack Operators < > openstack-operators@lists.openstack.org> > Subject: Re: [Openstack-operators] Where can I get current Liberty code > updates?... was Re:[neutron] router Found my bug Can't add gateway > > Wow, thanks Kris; > > It's hard to believe that anyone running CentOS 7.2 has had any luck with > Neutron routers. I found what seems to be the fix to my problem. And > it's a simple 2 line Python change. I've been coding for decades, and the > path of least risk as of now seems to be to just edit the code and hope > there are no cascading issues. Had hoped to do it "right" :-).. but after > 3 weeks (not full time, I have a real coding job too) I'm tired of routers > not working. I want to migrate my servers already! :-) > > Will hit the IRC channels you suggest. > > Thanks all; > -Chris > > > > > - Christopher T. Hull > I am presently seeking a new career opportunity Please see career page > http://chrishull.com/career > 333 Orchard Ave, Sunnyvale CA. 94085 > (415) 385 4865 > chrishul...@gmail.com > http://chrishull.com > > > > On Sat, Mar 26, 2016 at 9:41 AM, Kris G. Lindgren <klindg...@godaddy.com> > wrote: > >> I believe some Redhat people that hang out in #openstack-rpm-packaging. >> But per: https://www.rdoproject.org/community/ Their main points of >> contact are: >> >> #rdo: Discussion around RDO in general >> #rdo-puppet: Discussion around deploying RDO with Packstack and it's >> puppet modules >> #openstack: Discussion around OpenStack with the broader OpenStack >> community >> #centos-devel: Discussion around the CentOS Cloud Special Interest Group >> (SIG) >> >> I pointed out in the openstack-rpm-packaging channel that they are pretty >> far behind on stable release. Last stable for neutron is 7.0.1 when 7.0.3 >> is out. Nova is also behind on a stable that was released 22 days ago. I >> would suggest that you talk to those guys on irc via their normal >> communication path to let them know that they don’t appear to be publishing >> stable releases. >> >> ___ >> Kris Lindgren >> Senior Linux Systems Engineer >> GoDaddy >> >> From: Christopher Hull <chrishul...@gmail.com> >> Date: Saturday, March 26, 2016 at 9:57 AM >> To: Kevin Benton <ke...@benton.pub>, Christopher Hull < >> chrishul...@gmail.com> >> Cc: OpenStack Operators <openstack-operators@lists.openstack.org> >> Subject: [Openstack-operators] Where can I get current Liberty code >> updates?... was Re:[neutron] router Found my bug Can't add gateway >> >> I'm not getting current bug fixes and releases of Liberty via CentOS repo. >> >> So the short version is this Getting via yum install... >> >> Repo-id : centos-openstack-liberty/x86_
Re: [Openstack-operators] Where can I get current Liberty code updates?... was Re:[neutron] router Found my bug Can't add gateway
Wow, thanks Kris; It's hard to believe that anyone running CentOS 7.2 has had any luck with Neutron routers. I found what seems to be the fix to my problem. And it's a simple 2 line Python change. I've been coding for decades, and the path of least risk as of now seems to be to just edit the code and hope there are no cascading issues. Had hoped to do it "right" :-).. but after 3 weeks (not full time, I have a real coding job too) I'm tired of routers not working. I want to migrate my servers already! :-) Will hit the IRC channels you suggest. Thanks all; -Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Sat, Mar 26, 2016 at 9:41 AM, Kris G. Lindgren <klindg...@godaddy.com> wrote: > I believe some Redhat people that hang out in #openstack-rpm-packaging. > But per: https://www.rdoproject.org/community/ Their main points of > contact are: > > #rdo: Discussion around RDO in general > #rdo-puppet: Discussion around deploying RDO with Packstack and it's > puppet modules > #openstack: Discussion around OpenStack with the broader OpenStack > community > #centos-devel: Discussion around the CentOS Cloud Special Interest Group > (SIG) > > I pointed out in the openstack-rpm-packaging channel that they are pretty > far behind on stable release. Last stable for neutron is 7.0.1 when 7.0.3 > is out. Nova is also behind on a stable that was released 22 days ago. I > would suggest that you talk to those guys on irc via their normal > communication path to let them know that they don’t appear to be publishing > stable releases. > > ___ > Kris Lindgren > Senior Linux Systems Engineer > GoDaddy > > From: Christopher Hull <chrishul...@gmail.com> > Date: Saturday, March 26, 2016 at 9:57 AM > To: Kevin Benton <ke...@benton.pub>, Christopher Hull < > chrishul...@gmail.com> > Cc: OpenStack Operators <openstack-operators@lists.openstack.org> > Subject: [Openstack-operators] Where can I get current Liberty code > updates?... was Re:[neutron] router Found my bug Can't add gateway > > I'm not getting current bug fixes and releases of Liberty via CentOS repo. > > So the short version is this Getting via yum install... > > Repo-id : centos-openstack-liberty/x86_64 > Repo-name: CentOS-7 - OpenStack liberty > Repo-updated : Fri Feb 5 15:03:35 2016 > Repo-baseurl : > http://mirror.centos.org/centos/7/cloud/x86_64/openstack-liberty/ > > Clearly this repo isn't being updated. My Neutron and others are several > versions back, and I don't have a needed Neutron bug fix for CentOS. > Yes, of course yum update -y... NADA. :-) > > Where are you all getting your updates from?? I've been combing the net > for a repo. I'm running CentOS 7.2. > > Thanks; > -Chris > > > > - Christopher T. Hull > I am presently seeking a new career opportunity Please see career page > http://chrishull.com/career > 333 Orchard Ave, Sunnyvale CA. 94085 > (415) 385 4865 > chrishul...@gmail.com > http://chrishull.com > > > > On Sat, Mar 26, 2016 at 4:44 AM, Christopher Hull <chrishul...@gmail.com> > wrote: > >> Hi Keven; >> >> "Bug fixed a long time ago. How do you have old Nuetron version?" >> >> I was wondering that myself. See the install guide >> >> http://docs.openstack.org/liberty/install-guide-rdo/environment-packages.html >> >> Indeed my Neutron (and likely other parts of my install) seem quite >> old. How can this be? >> >> The fix is in neutron 7.0.2. >> [root@maersk qr]# neutron --version >> 3.1.0 ??? wow! >> >> For good measure I did a >> yum update -y >> >> >> --- >> From the Installation Guide >> yum remove epel-release >> >> >> On centos enable Openstack Repos >> >> >> yum install centos-release-openstack-liberty -y >> yum upgrade -y >> yum install python-openstackclient -y >> yum install openstack-selinux -y >> >> >> >> --- >> My repolist >> >> [root@maersk qr]# yum -v repolist >> Loading "fastestmirror" plugin >> Loading "langpacks" plugin >> Adding en_US to language list >> Config time: 0.005 >> Yum versio
[Openstack-operators] Where can I get current Liberty code updates?... was Re:[neutron] router Found my bug Can't add gateway
I'm not getting current bug fixes and releases of Liberty via CentOS repo. So the short version is this Getting via yum install... Repo-id : centos-openstack-liberty/x86_64 Repo-name: CentOS-7 - OpenStack liberty Repo-updated : Fri Feb 5 15:03:35 2016 Repo-baseurl : http://mirror.centos.org/centos/7/cloud/x86_64/openstack-liberty/ Clearly this repo isn't being updated. My Neutron and others are several versions back, and I don't have a needed Neutron bug fix for CentOS. Yes, of course yum update -y... NADA. :-) Where are you all getting your updates from?? I've been combing the net for a repo. I'm running CentOS 7.2. Thanks; -Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Sat, Mar 26, 2016 at 4:44 AM, Christopher Hull <chrishul...@gmail.com> wrote: > Hi Keven; > > "Bug fixed a long time ago. How do you have old Nuetron version?" > > I was wondering that myself. See the install guide > > http://docs.openstack.org/liberty/install-guide-rdo/environment-packages.html > > Indeed my Neutron (and likely other parts of my install) seem quite old. > How can this be? > > The fix is in neutron 7.0.2. > [root@maersk qr]# neutron --version > 3.1.0 ??? wow! > > For good measure I did a > yum update -y > > > --- > From the Installation Guide > yum remove epel-release > > > On centos enable Openstack Repos > > > yum install centos-release-openstack-liberty -y > yum upgrade -y > yum install python-openstackclient -y > yum install openstack-selinux -y > > > > --- > My repolist > > [root@maersk qr]# yum -v repolist > Loading "fastestmirror" plugin > Loading "langpacks" plugin > Adding en_US to language list > Config time: 0.005 > Yum version: 3.4.3 > Loading mirror speeds from cached hostfile > * base: centos.sonn.com > * extras: centos.sonn.com > * updates: centos.sonn.com > Setting up Package Sacks > pkgsack time: 0.002 > Repo-id : base/7/x86_64 > Repo-name: CentOS-7 - Base > Repo-revision: 1449700451 > Repo-updated : Wed Dec 9 17:35:45 2015 > Repo-pkgs: 9,007 > Repo-size: 6.5 G > Repo-mirrors : > http://mirrorlist.centos.org/?release=7=x86_64=os=stock > Repo-baseurl : http://centos.sonn.com/7/os/x86_64/ (9 more) > Repo-expire : 21,600 second(s) (last: Sat Mar 26 00:29:22 2016) > Repo-filename: /etc/yum.repos.d/CentOS-Base.repo > > Repo-id : centos-openstack-liberty/x86_64 > Repo-name: CentOS-7 - OpenStack liberty > Repo-revision: 1454702604 > Repo-updated : Fri Feb 5 15:03:35 2016 > Repo-pkgs: 976 > Repo-size: 485 M > Repo-baseurl : > http://mirror.centos.org/centos/7/cloud/x86_64/openstack-liberty/ > Repo-expire : 21,600 second(s) (last: Sat Mar 26 00:29:23 2016) > Repo-filename: /etc/yum.repos.d/CentOS-OpenStack-liberty.repo > > Repo-id : extras/7/x86_64 > Repo-name: CentOS-7 - Extras > Repo-revision: 1458849247 > Repo-updated : Thu Mar 24 15:54:21 2016 > Repo-pkgs: 228 > Repo-size: 599 M > Repo-mirrors : > http://mirrorlist.centos.org/?release=7=x86_64=extras=stock > Repo-baseurl : http://centos.sonn.com/7/extras/x86_64/ (9 more) > Repo-expire : 21,600 second(s) (last: Sat Mar 26 00:29:23 2016) > Repo-filename: /etc/yum.repos.d/CentOS-Base.repo > > Repo-id : updates/7/x86_64 > Repo-name: CentOS-7 - Updates > Repo-revision: 1458878881 > Repo-updated : Fri Mar 25 00:11:22 2016 > Repo-pkgs: 991 > Repo-size: 3.0 G > Repo-mirrors : > http://mirrorlist.centos.org/?release=7=x86_64=updates=stock > Repo-baseurl : http://centos.sonn.com/7/updates/x86_64/ (9 more) > Repo-expire : 21,600 second(s) (last: Sat Mar 26 00:29:23 2016) > Repo-filename: /etc/yum.repos.d/CentOS-Base.repo > > repolist: 11,202 > > > --- > yum update neutron... > > [root@maersk qr]# yum update openstack-neutron openstack-neutron-ml2 \ > > openstack-neutron-linuxbridge python-neutronclient ebtables ipset > Loaded plugins: fastestmirror, langpacks > base > | 3.6 kB 00:00:00 > centos-openstack-liberty > | 2.9 kB 00:00:00 > extras > | 3.4 kB 00:00:00 > updates > | 3.4 kB 00:00:00 > Loading mirror speeds from cached hostfile > * base: mirrors.syringa
[Openstack-operators] [neutron] router Found my bug Can't add gateway
Just in case others are having this issue. Indeed, there is an issue with Neutron Router / L3Agent. Basically, it can't update the qrouter file and can't add the Northbound gateway. I was in the middle of fixing the Python code when I found this (so I'm not crazy. :-) ) https://bugs.launchpad.net/neutron/+bug/1528977 - 2016-03-25 22:34:24.968 1734 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 159, in execute 2016-03-25 22:34:24.968 1734 ERROR neutron.agent.l3.agent raise RuntimeError(m) 2016-03-25 22:34:24.968 1734 ERROR neutron.agent.l3.agent RuntimeError: 2016-03-25 22:34:24.968 1734 ERROR neutron.agent.l3.agent Command: ['ip', 'netns', 'add', u'qrouter-6b171a53-cade-45f6-ad42-e612dc93e010'] 2016-03-25 22:34:24.968 1734 ERROR neutron.agent.l3.agent Exit code: 1 2016-03-25 22:34:24.968 1734 ERROR neutron.agent.l3.agent Stdin: 2016-03-25 22:34:24.968 1734 ERROR neutron.agent.l3.agent Stdout: 2016-03-25 22:34:24.968 1734 ERROR neutron.agent.l3.agent Stderr: Cannot create namespace file "/var/run/netns/qrouter-6b171a53-cade-45f6-ad42-e612dc93e010": File exists 2016-03-25 22:34:24.968 1734 ERROR neutron.agent.l3.agent 2016-03-25 22:34:24.968 1734 ERROR neutron.agent.l3.agent This error repeats indefinitely. Neutron keeps trying to update the router. - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] Manual router setup
James; Hey you know... I seem to remember zeroing out "eth0" IP 0.0.0.0 and setting the static IP on br-ex under Kilo and everything worked. That was using OVS. Perhaps I do the same, as you suggest, with LinuxBridge. Wow. Thanks. Will try. And if this doesn't work I'll respond with the diagnostic output you requested. Thanks to all of you; -Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Wed, Mar 23, 2016 at 5:57 PM, James Denton <james.den...@rackspace.com> wrote: > Hi Christopher, > > Routers work under Liberty and LinuxBridge just fine, in my experience, so > don’t be too quick to give up on them. I promise you’ll have a tougher go > at it, at this point, using another virtual machine as a router. > > Some tips: > > >1. Use the ‘ip’ command rather than ‘ifconfig’. Output of ‘ip addr’ >would be more helpful here. >2. Use ‘brctl show’ to see the virtual bridges and their members. That >output would be helpful here as well. > > > You have an IP configured on interface enp3s0, and I can’t tell what you > have set as the physical interface mappings in the ML2/LinuxBridge agent > config. On older email I see this: > > >> physical_interface_mappings | public:enp3s0 > > If that’s still the case, you’re going to have a hard time. The > LinuxBridge agent expects to put the enp3s0 interface into the respective > brq-* bridge that corresponds to the public (flat) network. Once the > interface is in the bridge, you may lose connectivity to/from any address > on that interface. At that point, your host will be unable to communicate > with the router's gateway interface also in the bridge, and probably any > external host. In this configuration, you may consider moving the IP from > enp3s0 to the brq-* bridge temporarily. That should work. Give it a try and > let me know. > > James > > From: Christopher Hull <chrishul...@gmail.com> > Date: Wednesday, March 23, 2016 at 7:21 PM > To: Dan Sneddon <dsned...@redhat.com> > Cc: openstack-operators <openstack-operators@lists.openstack.org> > Subject: Re: [Openstack-operators] Manual router setup > > Conclusion. Neutron routers under Liberty (Linux Bridge) don't work. > Please prove me wrong. Moving on to manual router creation. > 1: How can I assign a fixed IP to an instance? > 2: If I add routes will they get used? I probably have to create a Port > for every route (as Floating IPs do ). > > > -- Session: Trying to create a working router for the 15th time. > :-) > > > [root@maersk src]# ifconfig > enp3s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 > inet 172.22.10.99 netmask 255.255.255.0 broadcast 172.22.10.255 > inet6 2602:306:31fd:1020:ae9e:17ff:feec:5d95 prefixlen 64 > scopeid 0x0 > inet6 fe80::ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x20 > ether ac:9e:17:ec:5d:95 txqueuelen 1000 (Ethernet) > RX packets 238 bytes 16020 (15.6 KiB) > RX errors 0 dropped 0 overruns 0 frame 0 > TX packets 60 bytes 6650 (6.4 KiB) > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 > > lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536 > inet 127.0.0.1 netmask 255.0.0.0 > inet6 ::1 prefixlen 128 scopeid 0x10 > loop txqueuelen 0 (Local Loopback) > RX packets 4985 bytes 1060267 (1.0 MiB) > RX errors 0 dropped 0 overruns 0 frame 0 > TX packets 4985 bytes 1060267 (1.0 MiB) > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 > > virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500 > inet 192.168.122.1 netmask 255.255.255.0 broadcast > 192.168.122.255 > ether 52:54:00:33:94:b3 txqueuelen 0 (Ethernet) > RX packets 0 bytes 0 (0.0 B) > RX errors 0 dropped 0 overruns 0 frame 0 > TX packets 0 bytes 0 (0.0 B) > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 > > [root@maersk src]# source admin-openrc.sh > [root@maersk src]# clear > > [root@maersk src]# neutron net-create public --shared > --provider:physical_network public \ > >--provider:network_type flat > Created a new network: > +---+--+ > | Field | Value| > +---+--+ > | admin_state_up| True | > | id| 9ee73442-5a86-4
Re: [Openstack-operators] Manual router setup
outer +--+--+---+-+ | id | name | mac_address | fixed_ips | +--+--+---+-+ | 21c8decf-e4c8-4467-9266-ca5cfb9c7c20 | | fa:16:3e:d6:29:b4 | {"subnet_id": "28683bfe-2410-4f9b-b805-ec3c7aee009a", "ip_address": "172.22.10.10"} | | 74c0d2df-3944-43d7-8be9-2ef0d9242edc | | fa:16:3e:7b:d6:0f | {"subnet_id": "83f4f5e5-13b6-41f2-af07-b96d86847e2b", "ip_address": "192.168.10.1"} | +--+--+---+-+ [root@maersk src]# ping 172.22.10.10 PING 172.22.10.10 (172.22.10.10) 56(84) bytes of data. >From 172.22.10.99 icmp_seq=1 Destination Host Unreachable >From 172.22.10.99 icmp_seq=2 Destination Host Unreachable >From 172.22.10.99 icmp_seq=3 Destination Host Unreachable >From 172.22.10.99 icmp_seq=4 Destination Host Unreachable >From 172.22.10.99 icmp_seq=5 Destination Host Unreachable >From 172.22.10.99 icmp_seq=6 Destination Host Unreachable >From 172.22.10.99 icmp_seq=7 Destination Host Unreachable >From 172.22.10.99 icmp_seq=8 Destination Host Unreachable ^C --- 172.22.10.10 ping statistics --- 8 packets transmitted, 0 received, +8 errors, 100% packet loss, time 7000ms pipe 4 [root@maersk src]# ifconfig brq573956a6-13: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450 inet6 fe80::6469:36ff:fecc:a4d8 prefixlen 64 scopeid 0x20 ether 72:65:0b:f7:66:9c txqueuelen 0 (Ethernet) RX packets 6 bytes 348 (348.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 8 bytes 648 (648.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 enp3s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet 172.22.10.99 netmask 255.255.255.0 broadcast 172.22.10.255 inet6 2602:306:31fd:1020:ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x0 inet6 fe80::ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x20 ether ac:9e:17:ec:5d:95 txqueuelen 1000 (Ethernet) RX packets 6360 bytes 464736 (453.8 KiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 2867 bytes 3196849 (3.0 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6 ::1 prefixlen 128 scopeid 0x10 loop txqueuelen 0 (Local Loopback) RX packets 65582 bytes 17827940 (17.0 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 65582 bytes 17827940 (17.0 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 tap74c0d2df-39: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450 inet6 fe80::7065:bff:fef7:669c prefixlen 64 scopeid 0x20 ether 72:65:0b:f7:66:9c txqueuelen 1000 (Ethernet) RX packets 10 bytes 864 (864.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 8 bytes 648 (648.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 tapbb0ceef0-e6: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450 inet6 fe80::e816:29ff:fec8:9925 prefixlen 64 scopeid 0x20 ether ea:16:29:c8:99:25 txqueuelen 1000 (Ethernet) RX packets 8 bytes 648 (648.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 16 bytes 1248 (1.2 KiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500 inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255 ether 52:54:00:33:94:b3 txqueuelen 0 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 vxlan-92: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450 inet6 fe80::d888:38ff:fe4a:6e1 prefixlen 64 scopeid 0x20 ether da:88:38:4a:06:e1 txqueuelen 0 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 19 overruns 0 carrier 0 collisions 0 - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Wed, Mar 23, 2016 at 4:34 PM, Dan Sneddon <dsned...@redhat.com> wrote: > On 03/23/2016 04:06 PM, Christopher Hull wrote: > > Hmmm.
Re: [Openstack-operators] Manual router setup
neutron net-create public --shared --provider:physical_network public \ --provider:network_type flat Created a new network: +---+--+ | Field | Value| +---+--+ | admin_state_up| True | | id| be6e920a-51aa-4293-bb95-7ac38aab9df6 | | mtu | 0| | name | public | | port_security_enabled | True | | provider:network_type | flat | | provider:physical_network | public | | provider:segmentation_id | | | router:external | False| | shared| True | | status| ACTIVE | | subnets | | | tenant_id | fdf3f98a9b0c4e9e94603d8a84ea41a8 | +---+--+ 172.22.10.0/24 maps to physical net. I take a slice out that is out of the way of my ATT Router's DHCP range. 10 to 89. Instances on this subnet ping, run, see the internet. Only the Router port is dead (DOWN). ?? neutron subnet-create public 172.22.10.0/24 --name public \ --allocation-pool start=172.22.10.10,end=172.22.10.90 \ --dns-nameserver 172.22.10.254 --gateway 172.22.10.254 --enable_dhcp False Created a new subnet: +---+--+ | Field | Value| +---+--+ | allocation_pools | {"start": "172.22.10.10", "end": "172.22.10.90"} | | cidr | 172.22.10.0/24 | | dns_nameservers | 172.22.10.254| | enable_dhcp | True | | gateway_ip| 172.22.10.254| | host_routes | | | id| f227734a-eca3-4472-81f6-620e1bf1fac9 | | ip_version| 4| | ipv6_address_mode | | | ipv6_ra_mode | | | name | public | | network_id| be6e920a-51aa-4293-bb95-7ac38aab9df6 | | subnetpool_id | | | tenant_id | fdf3f98a9b0c4e9e94603d8a84ea41a8 | +---+--+ - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Wed, Mar 23, 2016 at 4:06 PM, Christopher Hull <chrishul...@gmail.com> wrote: > Hmmm. Well I'm not using OpenVSwitch. Just LinuxBridge. My CentOS 7 > install sees emp3s0 where eth0 would usually appear. But this may need to > be changed to br-ex? The IP address no longer apperas at enp3s0, so > perhaps that's the issue. > > When I make changes, I tear down all the networks and rebuild them > according to instructions. I do this after restarting the machine. I > wonder if the database needs to be updated as well. > > su -s /bin/sh -c "neutron-db-manage --config-file > /etc/neutron/neutron.conf \ > --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head" neutron > systemctl stop neutron-server.service \ > neutron-linuxbridge-agent.service neutron-dhcp-agent.service \ > neutron-metadata-agent.service > systemctl stop neutron-l3-agent.service > and restart. > > Thanks for the help. Yes. It's a bit confusing. Why are router and > instance ports different? It is for this reason that I figured I could > just create my own instance/router. But why should I have to?Do > routers not work unless you use OpenVSwitch? The Liberty install > instructions (unlike Kilo) don't seem to require installing OpenVSwitch. > > linux_bridge_agent.ini > inux_bridge | physical_interface_mappings | public:enp3s0 > > Perhaps br-ex? Or whereever I see my static IP when doing an ifconfig > :-) Was enp3s0 when CentOS was first installed, but I think thats changed > somehow. > > > +
Re: [Openstack-operators] Manual router setup
Hi Keven / all; Re: Getting a Neutron Router to work. (set external_network_bridge = blank). Apologies if this got sent twice. Nope, not quite there yet re getting the damn router to work (week 3 on this issue). The Liberty install instructions indeed say to set... external_network_bridge = I'm so desperate that I thought the blank space after the = might be the issue. No. Then I noticed these instructions in l3_agent.ini itself. - # When external_network_bridge is set, each L3 agent can be associated # with no more than one external network. This value should be set to the UUID # of that external network. To allow L3 agent support multiple external # networks, both the external_network_bridge and gateway_external_network_id # must be left empty. # gateway_external_network_id = 1: Should gateway_external_network_id = be unoommented? 2: Should I reupdate the database after these changes? su -s /bin/sh -c "neutron-db-manage --config-file /etc/neutron/neutron.conf \ --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head" neutron 3: Should external_network_bridge in fact be set to the UUID of the public network? 4. All instances Ports work just fine on public and private network. WHAT is the difference between a Neutron router northbound port and an instance port on the public net. Services restarted after config change (just removed space after = actually just in case sloppy Python coding was involved here). In fact, I rebooted the box just to be sure. Making my own instance based router is looking better and better all the time. If Neutron Routers really work, maybe UFO's exist too. :-) j/k Seriously. Thank you for your help. Hope to help the community soon too myself. Trying to get my Gerrit account up and running but the OpenStack.org site won't allow me to sign the Contrib agreement with out getting a server error. Config Details == Issue Neutron Router Northbound Port won't Ping, is Down [root@maersk src]# ./pluto.py show -p /etc neutron rootwrap.conf ml2_conf.ini l3_agent.ini linuxbridge_agent.ini dhcp_agent.ini +---++-+ | neutron: Section | Key| Value | +---++-+ | DEFAULT | verbose| True| | DEFAULT | nova_url | http://controller:8774/v2 | | DEFAULT | notify_nova_on_port_data_changes | True| | DEFAULT | notify_nova_on_port_status_changes | True| | DEFAULT | auth_strategy | keystone| | DEFAULT | rpc_backend| rabbit | | DEFAULT | allow_overlapping_ips | True| | DEFAULT | service_plugins| router | | DEFAULT | core_plugin| ml2 | | keystone_authtoken| password | mk4968small23buggidntpass | | keystone_authtoken| username | neutron | | keystone_authtoken| project_name | service | | keystone_authtoken| user_domain_id | default | | keystone_authtoken| project_domain_id | default | | keystone_authtoken| auth_plugin| password| | keystone_authtoken| auth_url | http://controller:35357 | | keystone_authtoken| auth_uri | http://controller:5000 | | database | connection | mysql://neutron:sleestack191@controller/neutron | | nova | password | mk4968small23buggidntpass | | nova | username | nova| | nova | project_name | service | | nova | region_name| RegionOne | | nova | user_domain_id
Re: [Openstack-operators] [nova] create image from paused VM refused with http 409
I had some interesting experiences between Cinder and Glance with Kilo as well. For instance, occasionally I'd get a bad checksum when running an image created from a Cinder volume. The checksum would occasionally be wrong. Liberty works well. All my images run no matter what. But I can't get a Liberty based Neutron Router to work. The Public Port is always Down. Resorting to dedicating a small instance to be my virtual router. Best of luck. If your problem keeps up upgrade to Liberty. Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Tue, Mar 22, 2016 at 7:36 AM, Saverio Protowrote: > I am not a developer but I tried my best ! > https://review.openstack.org/#/c/295865/ > > I applied the patch in my staging system and it fixes the problem :) > > Saverio > > > 2016-03-22 13:46 GMT+01:00 Saverio Proto : > > I found the problem. It happens only then the instance has booted from > volume. > > > > I think api.py should be patched at the function > > snapshot_volume_backed (line 2250) in a similar way as > > https://review.openstack.org/#/c/116789/ > > > > Looks like the bug is also there in master , file nova/compute/api.py > line 2296 > > > > I will try to submit a patch with Gerrit > > > > Saverio > > > > 2016-03-22 13:33 GMT+01:00 Saverio Proto : > >> Hello there, > >> > >> I used to do this in Juno, and now I upgraded to Kilo and it is not > >> working anymore. > >> > >> macsp:~ proto$ openstack server image create --name test > >> 81da19c6-efbe-4002-b4e8-5ce352ffdd14 > >> Cannot 'createImage' instance 81da19c6-efbe-4002-b4e8-5ce352ffdd14 > >> while it is in vm_state paused (HTTP 409) (Request-ID: > >> req-0e7f339d-a236-4584-a44c-49daed7558ee) > >> > >> Is this a change of behaviour ? > >> > >> I also found this: > >> > >> https://review.openstack.org/#/c/116789/ > >> > >> Should not this work ? my nova-api --version is 2015.1.2 > >> > >> Saverio > > ___ > OpenStack-operators mailing list > OpenStack-operators@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators > ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] Server error signing code contributor agreement
Hello all; I'm not sure who to contact about this, but I'm in the middle of setting up gerrit so I can push some code for review. I'm playing with the sandbox. A space doesn't seem to have been created for me in Gerrit, likely due to the fact that I get a server error when I try to agree to be a code contributor. Please forward to appropriate party. Agreement https://review.openstack.org/#/settings/new-agreement Gerrit user chrishull I did the rsa key exchange and am trying to test it. Orion:sandbox chris$ git review -s Could not connect to gerrit. Enter your gerrit username: chrishull Trying again with ssh:// chrish...@review.openstack.org:29418/openstack-dev/sandbox.git We don't know where your gerrit is. Please manually create a remote named "gerrit" and try again. Could not connect to gerrit at ssh:// chrish...@review.openstack.org:29418/openstack-dev/sandbox.git Traceback (most recent call last): File "/usr/local/bin/git-review", line 11, in sys.exit(main()) File "/Library/Python/2.7/site-packages/git_review/cmd.py", line 1534, in main sys.exit(e.EXIT_CODE) AttributeError: 'GitReviewException' object has no attribute 'EXIT_CODE' Thanks; -Chris - Christopher T. Hull I am presently seeking a new career opportunity Please see career page http://chrishull.com/career 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] Liberty Neutron - Can't ping router or get floating ips to work.
Hi all; again. :-) Sorry. Still having issues with this. It comes down to the public port on the router I think... Following the Liberty install instructions. Setting up a public / private net with router. Still trying to get my private to public net router working. Can't seem to get floating IPs to work. Am able to ping the router from the private space. Both public and private ports work. There seems to be something wrong with the router's public port as it is DOWN. Had thought it might be a security issue, but security is off for both public and private ports. And the private one works just fine. Perhaps I should create a VM on the public network and somehow force the router to use it's working port? How can I diagnose this. Thanks; -Chris Details. [sleestack@maersk src]$ neutron router-port-list router +--+--+---+-+ | id | name | mac_address | fixed_ips | +--+--+---+-+ | 145e2d39-75ff-452d-b840-bb355528f865 | | fa:16:3e:66:02:f2 | {"subnet_id": "9bc41a73-6863-476f-8b1a-5317dfc1fcdd", "ip_address": "192.168.10.1"} | | 688e344c-448a-4279-9e68-0653017c856f | | fa:16:3e:1b:b2:75 | {"subnet_id": "fdf2bf4b-e0ef-4843-85a2-e88f9aa674b5", "ip_address": "172.22.10.11"} | +--+--+---+-+ [sleestack@maersk src]$ neutron port-show 688e344c-448a-4279-9e68-0653017c856f +---+--+ | Field | Value | +---+--+ | admin_state_up| True | | allowed_address_pairs | | | binding:host_id | maersk | | binding:profile | {} | | binding:vif_details | {"port_filter": true} | | binding:vif_type | bridge | | binding:vnic_type | normal | | device_id | c6d5a6a9-e0b6-419d-adf6-3647410550bf | | device_owner | network:router_gateway | | dns_assignment| {"hostname": "host-172-22-10-11", "ip_address": "172.22.10.11", "fqdn": "host-172-22-10-11.openstacklocal."} | | dns_name | | | extra_dhcp_opts | | | fixed_ips | {"subnet_id": "fdf2bf4b-e0ef-4843-85a2-e88f9aa674b5", "ip_address": "172.22.10.11"} | | id| 688e344c-448a-4279-9e68-0653017c856f | | mac_address | fa:16:3e:1b:b2:75 | | name | | | network_id| 43f09f04-c7ca-4df9-bc74-516dd134313f | | port_security_enabled | False | | security_groups | | | status| DOWN | | tenant_id | | +---+--+ But the Private one works and it has no security either. Hmmm [sleestack@maersk src]$ neutron port-show 145e2d39-75ff-452d-b840-bb355528f865 +---+--+ | Field | Value | +---+--+ | admin_state_up| True | | allowed_address_pairs | | | binding:host_id | maersk | | binding:profile | {} | | binding:vif_details | {"port_filter": true} | | binding:vif_type | bridge | | binding:vnic_type | normal | | device_id | c6d5a6a9-e0b6-419d-adf6-3647410550bf | | device_owner | network:router_interface | | dns_assignment| {"hostname": "host-192-168-10-1", "ip_address": "192.168.10.1", "fqdn": "host-192-168-10-1.openstacklocal."} | | dns_name | | | extra_dhcp_opts | | | fixed_ips | {"subnet_id": "9bc41a73-6863-476f-8b1a-5317dfc1fcdd", "ip_address": "192.168.10.1"} | | id| 145e2d39-75ff-452d-b840-bb355528f865 | | mac_address | fa:16:3e:66:02:f2 | | name | | | network_id| f1309195-e346-4748-b223-d2875204cab8 | | port_security_enabled | False | | security_groups | | | status| ACTIVE | | tenant_id | 7813be77b1de4196b1c6b77006afa21c | +---+--+ [sleestack@maersk src]$ neutron port-update --security-group a76c3568-7f0c-4e57-903b-669f6911eb0d \ > 688e344c-448a-4279-9e68-0653017c856f Port security must be enabled and port must have an IP address
[Openstack-operators] Neutron Liberty - Basic networking question
Hello all; Thanks again for all your help. Setup is running, but I'm learning how to get networking up now. I have a fairly traditional setup with ATT router and DHCP over a certain range. I restricted that range to .100 to .200 because I thought my Openstack system sould occupy a range outside of DHCP space. But I noticed that my VMs show up on the ATT router list (as unknownXXX. Maybe I need to use cloud init to expose machine names.) When I create my public net and enable DHCP, is this a different DHCP server running within Openstack Neutron, or is it using my ATT router's DHCP? If the latter, should my public subnet use the same pool of addresses (.100 to .200)? Currently it is a different range (.10 to .90).My Openstack system is .99 so as to be out of everyone's way. I can't get the router between public and private net to work. It won't ping. I can't use floating IPs. They pretend to attach to private instances but no SSH (see previous mail). For now all instances will simply run on the public net. In order to put servers on the internet, should I simply add another subnet to public net (no DHCP, range being my public statics). Or should a just add a pool to the public subnet? Thanks Chris - Christopher T. Hull 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] Neutron Liberty - Can't ssh or ping thru Floating IP
A little more basic info on this problem. I can't ping the router gateway (as defined in the setup instructions). I can ping and ssh to all other instances on the public net. Are instances the only things that have security groups associated with them? I believe I setup Demo to default with ICMP and port 22, as described. Could my ATT router (which also provides DHCP, out of range of my public virtual net) be doing something? It sees at least some of my instances. -Chris - Christopher T. Hull 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Sun, Mar 13, 2016 at 11:11 AM, Christopher Hull <chrishul...@gmail.com> wrote: > Hi all; > I think I know what to do in the case of Nova, but with Liberty I > installed Neutron Option 2 networking and I can't seem to get floating IPs > to work properly. I can create and associate, but ca not SSH or PING thru > to the private net. > > This is a basic setup via the Openstack instructions. The public net / > subnet seem to work just fine. Can crate a Demo instance on Public and ssh > to it. But can not create a Demo instance on Private, associate floating > IP, and SSH. > > Is the floaging IP port itself blocking? Demo instance has all the > proper security groups. Don't think it's the fault of the instance. > > > > Session details > > Thanks in advance; > -Chris > > source demo-openrc.sh > neutron floatingip-create public > > [root@maersk src]# source demo-openrc.sh > [root@maersk src]# neutron floatingip-list > > +--+--+-+-+ > | id | fixed_ip_address | > floating_ip_address | port_id | > > +--+--+-+-+ > | 898a3257-a41a-48e5-8922-44939c049643 | | > 172.22.10.13| | > > +--+--+-+-+ > [root@maersk src]# neutron port-list > > +--+--+---+-+ > | id | name | mac_address | > fixed_ips > | > > +--+--+---+-+ > | 2e2666c7-4fef-4bc0-8ea5-dc02831a9717 | | fa:16:3e:b6:89:c0 | > {"subnet_id": "6eb927e5-095f-4c8c-bd3c-cb959414", "ip_address": > "192.168.10.1"} | > | b079c4ec-893e-4ec5-a033-f6e9dedde828 | | fa:16:3e:d3:87:7a | > {"subnet_id": "aea716c1-e1e2-430b-85c0-5ec975e3a287", "ip_address": > "172.22.10.11"} | > | eab0e97e-845b-4ed5-8f40-b1d16ccbfa44 | | fa:16:3e:06:64:b4 | > {"subnet_id": "6eb927e5-095f-4c8c-bd3c-cb959414", "ip_address": > "192.168.10.3"} | > | f383c60f-8d99-409c-8510-aeef3640f9bf | | fa:16:3e:f6:b3:c6 | > {"subnet_id": "6eb927e5-095f-4c8c-bd3c-cb959414", "ip_address": > "192.168.10.2"} | > > +--+--+---+-+ > [root@maersk src]# neutron floatingip-associate 172.22.10.13 > eab0e97e-845b-4ed5-8f40-b1d16ccbfa44 > Floating IP 172.22.10.13 could not be found > [root@maersk src]# neutron floatingip-associate > 898a3257-a41a-48e5-8922-44939c049643 eab0e97e-845b-4ed5-8f40-b1d16ccbfa44 > Associated floating IP 898a3257-a41a-48e5-8922-44939c049643 > [root@maersk src]# nova list > > +--++++-++ > | ID | Name | Status | > Task State | Power State | Networks | > > +--++++-++ > | f21c04d5-d217-493a-89ca-b71361c27d99 | Private Net Float Test | ACTIVE | > - | Running | private=192.168.10.3, 172.22.10.13 | > | c2d8c226-066d-403e-8771-2292d587a6df | test | ACTIVE | > - | Running | public=172.22.10.11| > > +--++++-++ > [root@maersk src]# ping 172.22.10.13 > PING 172.22.10.13 (172.22.10.13) 56(84) bytes of data. >
[Openstack-operators] Neutron Liberty - Can't ssh or ping thru Floating IP
Hi all; I think I know what to do in the case of Nova, but with Liberty I installed Neutron Option 2 networking and I can't seem to get floating IPs to work properly. I can create and associate, but ca not SSH or PING thru to the private net. This is a basic setup via the Openstack instructions. The public net / subnet seem to work just fine. Can crate a Demo instance on Public and ssh to it. But can not create a Demo instance on Private, associate floating IP, and SSH. Is the floaging IP port itself blocking? Demo instance has all the proper security groups. Don't think it's the fault of the instance. Session details Thanks in advance; -Chris source demo-openrc.sh neutron floatingip-create public [root@maersk src]# source demo-openrc.sh [root@maersk src]# neutron floatingip-list +--+--+-+-+ | id | fixed_ip_address | floating_ip_address | port_id | +--+--+-+-+ | 898a3257-a41a-48e5-8922-44939c049643 | | 172.22.10.13| | +--+--+-+-+ [root@maersk src]# neutron port-list +--+--+---+-+ | id | name | mac_address | fixed_ips | +--+--+---+-+ | 2e2666c7-4fef-4bc0-8ea5-dc02831a9717 | | fa:16:3e:b6:89:c0 | {"subnet_id": "6eb927e5-095f-4c8c-bd3c-cb959414", "ip_address": "192.168.10.1"} | | b079c4ec-893e-4ec5-a033-f6e9dedde828 | | fa:16:3e:d3:87:7a | {"subnet_id": "aea716c1-e1e2-430b-85c0-5ec975e3a287", "ip_address": "172.22.10.11"} | | eab0e97e-845b-4ed5-8f40-b1d16ccbfa44 | | fa:16:3e:06:64:b4 | {"subnet_id": "6eb927e5-095f-4c8c-bd3c-cb959414", "ip_address": "192.168.10.3"} | | f383c60f-8d99-409c-8510-aeef3640f9bf | | fa:16:3e:f6:b3:c6 | {"subnet_id": "6eb927e5-095f-4c8c-bd3c-cb959414", "ip_address": "192.168.10.2"} | +--+--+---+-+ [root@maersk src]# neutron floatingip-associate 172.22.10.13 eab0e97e-845b-4ed5-8f40-b1d16ccbfa44 Floating IP 172.22.10.13 could not be found [root@maersk src]# neutron floatingip-associate 898a3257-a41a-48e5-8922-44939c049643 eab0e97e-845b-4ed5-8f40-b1d16ccbfa44 Associated floating IP 898a3257-a41a-48e5-8922-44939c049643 [root@maersk src]# nova list +--++++-++ | ID | Name | Status | Task State | Power State | Networks | +--++++-++ | f21c04d5-d217-493a-89ca-b71361c27d99 | Private Net Float Test | ACTIVE | - | Running | private=192.168.10.3, 172.22.10.13 | | c2d8c226-066d-403e-8771-2292d587a6df | test | ACTIVE | - | Running | public=172.22.10.11| +--++++-++ [root@maersk src]# ping 172.22.10.13 PING 172.22.10.13 (172.22.10.13) 56(84) bytes of data. >From 172.22.10.99 icmp_seq=1 Destination Host Unreachable >From 172.22.10.99 icmp_seq=2 Destination Host Unreachable >From 172.22.10.99 icmp_seq=3 Destination Host Unreachable >From 172.22.10.99 icmp_seq=4 Destination Host Unreachable ^C --- 172.22.10.13 ping statistics --- 4 packets transmitted, 0 received, +4 errors, 100% packet loss, time 2999ms pipe 4 [root@maersk src]# ssh 172.22.10.13 ssh: connect to host 172.22.10.13 port 22: No route to host [root@maersk src]# ssh 172.22.10.11 The authenticity of host '172.22.10.11 (172.22.10.11)' can't be established. RSA key fingerprint is 1a:54:41:d8:72:6f:53:4c:e2:8f:95:8c:5c:1f:23:f7. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added '172.22.10.11' (RSA) to the list of known hosts. Please login as 'cirros' user, not as root ^CConnection to 172.22.10.11 closed. - Christopher T. Hull 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] Liberty Setup - Can't ping Demo Router
Hi all; Following the Neutron (Network Option 2 setup) instructions in Liberty. I can't ping my demo router. However, I do recall there are new security constraints that might prevent this in Liberty. Do I need to somehow allow ICMP? Here's what I did. === Create virtual networks http://docs.openstack.org/liberty/install-guide-rdo/launch-instance.html#create-virtual-networks === Create Public Provider Network http://docs.openstack.org/liberty/install-guide-rdo/launch-instance-networks-public.html [root@maersk src]# source admin-openrc.sh [root@maersk src]# neutron net-create public --shared --provider:physical_network public \ > --provider:network_type flat Created a new network: +---+--+ | Field | Value| +---+--+ | admin_state_up| True | | id| be6e920a-51aa-4293-bb95-7ac38aab9df6 | | mtu | 0| | name | public | | port_security_enabled | True | | provider:network_type | flat | | provider:physical_network | public | | provider:segmentation_id | | | router:external | False| | shared| True | | status| ACTIVE | | subnets | | | tenant_id | fdf3f98a9b0c4e9e94603d8a84ea41a8 | +---+--+ [root@maersk src]# --- Create a subnet on the network: Replace START_IP_ADDRESS and END_IP_ADDRESS with the first and last IP address of the range within the subnet that you want to allocate for instances. This range must not include any existing active IP addresses. Example neutron subnet-create public 203.0.113.0/24 --name public \ --allocation-pool start=203.0.113.101,end=203.0.113.200 \ --dns-nameserver 8.8.4.4 --gateway 203.0.113.1 [root@maersk src]# cat /etc/resolv.conf ; generated by /usr/sbin/dhclient-script search attlocal.net nameserver 172.22.10.254 cat ifcfg-enp3s0 GATEWAY=172.22.10.254 DNS1=172.22.10.254 neutron subnet-create public 172.22.10.0/24 --name public \ --allocation-pool start=172.22.10.10,end=172.22.10.90 \ --dns-nameserver 172.22.10.254 --gateway 172.22.10.254 Created a new subnet: +---+--+ | Field | Value| +---+--+ | allocation_pools | {"start": "172.22.10.10", "end": "172.22.10.90"} | | cidr | 172.22.10.0/24 | | dns_nameservers | 172.22.10.254| | enable_dhcp | True | | gateway_ip| 172.22.10.254| | host_routes | | | id| f227734a-eca3-4472-81f6-620e1bf1fac9 | | ip_version| 4| | ipv6_address_mode | | | ipv6_ra_mode | | | name | public | | network_id| be6e920a-51aa-4293-bb95-7ac38aab9df6 | | subnetpool_id | | | tenant_id | fdf3f98a9b0c4e9e94603d8a84ea41a8 | +---+--+ === Create the private project network http://docs.openstack.org/liberty/install-guide-rdo/launch-instance-networks-private.html source demo-openrc.sh neutron net-create private Created a new network: +---+--+ | Field | Value| +---+--+ | admin_state_up| True | | id| 28ca326a-8443-4c1c-b288-48920a1eefbe | | mtu | 0| | name | private | | port_security_enabled | True | | router:external | False| | shared| False
Re: [Openstack-operators] Neutron doesn't start - was Neutron connection issue
Oh. My bad. I installed Neutron Controller and Compute on the same node. When I did Compute, I commented out the DB connection (as it said)... OOPS! Put it back. Now it works. I feel silly. NOW I'm wondering where my Neutron Compute agent is. I should see one Compute in this list. neutron agent-list +--+++---++---+ | id | agent_type | host | alive | admin_state_up | binary| +--+++---++---+ | 41974f0e-4342-4027-a771-53443a8d1911 | Metadata agent | maersk | :-) | True | neutron-metadata-agent| | 9f002230-33ea-4523-a736-8d96a96a85f1 | Linux bridge agent | maersk | :-) | True | neutron-linuxbridge-agent | | ccb8cd1c-6c47-4df9-9e87-4b3b651c3427 | L3 agent | maersk | :-) | True | neutron-l3-agent | | ef5611be-edf3-4565-aaa7-a833bdc79d57 | DHCP agent | maersk | :-) | True | neutron-dhcp-agent| +--+++---++---+ I should see this. neutron agent-list+--+++---++---+| id | agent_type | host | alive | admin_state_up | binary |+--+++---++---+| 08905043-5010-4b87-bba5-aedb1956e27a | Linux bridge agent | compute1 | :-) | True | neutron-linuxbridge-agent || 27eee952-a748-467b-bf71-941e89846a92 | Linux bridge agent | controller | :-) | True | neutron-linuxbridge-agent || 830344ff-dc36-4956-84f4-067af667a0dc | L3 agent | controller | :-) | True | neutron-l3-agent || dd3644c9-1a3a-435a-9282-eb306b4b0391 | DHCP agent | controller | :-) | True | neutron-dhcp-agent|| f49a4b81-afd6-4b3d-b923-66c8f0517099 | Metadata agent | controller | :-) | True | neutron-metadata-agent |+--+++---++---+ HMM Or should I see only one if running all on the same box?? Thanks very much!! -Chris - Christopher T. Hull 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Tue, Mar 8, 2016 at 6:47 PM, Kevin Benton <ke...@benton.pub> wrote: > Once you get it configured with a normal db backend, you will have to run > the neutron-db-manage command again to repopulate the schema. > On Mar 8, 2016 18:43, "Kevin Benton" <ke...@benton.pub> wrote: > >> Ah, it looks like neutron isn't configured to use a database so it's >> defaulting to an in-memory sqlite server. Check your connection string in >> the neutron config. >> On Mar 8, 2016 18:39, "Christopher Hull" <chrishul...@gmail.com> wrote: >> >>> Ah Neutron didn't start... >>> I see this issue mentioned elsewhere, but haven't dug up a solution yet. >>> It was running before a reboot. Hmmm. >>> >>> neutron-server does not start: OperationalError: (OperationalError) no >>> such table: ml2_vlan_allocations >>> >>> >>> 2016-03-08 20:55:08.491 1664 ERROR neutron cursor.execute(statement, >>> parameters) >>> >>> 2016-03-08 20:55:08.491 1664 ERROR neutron OperationalError: >>> (sqlite3.OperationalError) no such table: ml2_vlan_allocations [SQL: >>> u'SELECT ml2_vlan_allocations.physical_network AS >>> ml2_vlan_allocations_physical_network, ml2_vlan_allocations.vlan_id AS >>> ml2_vlan_allocations_vlan_id, ml2_vlan_allocations.allocated AS >>> ml2_vlan_allocations_allocated \nFROM ml2_vlan_allocations'] >>> >>> 2016-03-08 20:55:08.491 1664 ERROR neutron >>> >>> >>> >>> >>> ___ >>> OpenStack-operators mailing list >>> OpenStack-operators@lists.openstack.org >>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators >>> >>> ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] Neutron doesn't start - was Neutron connection issue
Ah Neutron didn't start... I see this issue mentioned elsewhere, but haven't dug up a solution yet. It was running before a reboot. Hmmm. neutron-server does not start: OperationalError: (OperationalError) no such table: ml2_vlan_allocations 2016-03-08 20:55:08.491 1664 ERROR neutron cursor.execute(statement, parameters) 2016-03-08 20:55:08.491 1664 ERROR neutron OperationalError: (sqlite3.OperationalError) no such table: ml2_vlan_allocations [SQL: u'SELECT ml2_vlan_allocations.physical_network AS ml2_vlan_allocations_physical_network, ml2_vlan_allocations.vlan_id AS ml2_vlan_allocations_vlan_id, ml2_vlan_allocations.allocated AS ml2_vlan_allocations_allocated \nFROM ml2_vlan_allocations'] 2016-03-08 20:55:08.491 1664 ERROR neutron ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] Neutron connection issue - Unable to establish connection to http://controller
Hi all; I was wondering if someone could tell me how to trace this down. I've got a single box installation that I'm trying to get working. Everything seems to run, but when I reboot, Neutron drops off. neutron agent-list Unable to establish connection to http://controller:9696/v2.0/agents.json nova and glance seem ok. Neutron was a tough install. I chose Network Option 2 and did both the Controller and Compute installs on a single node. Before I rebooted I was able to get this. neutron agent-list +--+++---++---+ | id | agent_type | host | alive | admin_state_up | binary| +--+++---++---+ | 41974f0e-4342-4027-a771-53443a8d1911 | Metadata agent | maersk | :-) | True | neutron-metadata-agent| | 9f002230-33ea-4523-a736-8d96a96a85f1 | Linux bridge agent | maersk | :-) | True | neutron-linuxbridge-agent | | ccb8cd1c-6c47-4df9-9e87-4b3b651c3427 | L3 agent | maersk | :-) | True | neutron-l3-agent | | ef5611be-edf3-4565-aaa7-a833bdc79d57 | DHCP agent | maersk | :-) | True | neutron-dhcp-agent| +--+++---++---+ Wondering why Compute doesn't show up. Please help. Thanks; -Chris - Christopher T. Hull 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] Liberty install - Can't ping router
Hello all; This seems like a common problem. Seeing it in a few places. However am not finding that the question has been answered. I followed the Liberty install instructions for Networking option 2. I found one possible ambiguity in setting up the .ini files. === Create the Public Network Should physical_interface_mappings = public:eth1 or public:enp3s0" (enp3s0 is the physical eth0 on my box. My single install box only has one NIC. Should I be running with two? vi /etc/neutron/plugins/ml2/linuxbridge_agent.ini [linux_bridge] # ADDED FOR LIBERTY INSTALL # EXAMPLE SAYS physical_interface_mappings = public:eth1 # BUT ON MY SYSTEM IFCONFIG SAYS enp3s0 NOT SURE, # physical_interface_mappings = public:enp3s0 [root@maersk src]# source admin-openrc.sh [root@maersk src]# ip netns qrouter-669b05bb-e58b-4a5f-9139-bd5ad08d7139 (id: 4) qdhcp-5ee448e5-3d0b-48cd-85c5-a09bf7cac3ed (id: 3) qdhcp-023c94f6-d792-479e-b718-035098695a0d (id: 2) qdhcp-6e22-639b-4632-9c39-f3f2ec0518a7 (id: 1) qdhcp-2b853a39-c726-4abd-a8d5-e1f7e284d7c6 (id: 0) [root@maersk src]# neutron router-port-list router +--+--+---+-+ | id | name | mac_address | fixed_ips | +--+--+---+-+ | 333774cf-8faf-41c4-98fd-3cf794730258 | | fa:16:3e:84:cf:09 | {"subnet_id": "c80df59d-42e2-4c56-8681-ee49a1a77c2c", "ip_address": "192.168.10.1"} | | 80172f12-55ff-4eab-bc5f-ad527c296e2e | | fa:16:3e:79:16:cf | {"subnet_id": "3340fc39-bb62-43fc-8438-392b7ec23094", "ip_address": "172.22.10.11"} | +--+--+---+-+ [root@maersk src]# ping 172.22.10.11 PING 172.22.10.11 (172.22.10.11) 56(84) bytes of data. >From 172.22.10.99 icmp_seq=1 Destination Host Unreachable >From 172.22.10.99 icmp_seq=2 Destination Host Unreachable >From 172.22.10.99 icmp_seq=3 Destination Host Unreachable >From 172.22.10.99 icmp_seq=4 Destination Host Unreachable I've uninstalled and reinstalled networking a couple of times, changing the .ini each time. Looks like I have 2 too many qdhcp. Any ideas? Thanks Chris - Christopher T. Hull 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] Liberty Identity install: keystone.service not being created in DB
Hi all; I'm attempting an install of Liberty on a single box and I ran into an issue when syncing keystone.conf with the db. Contents of keystone.conf +---+-+---+ | keystone: Section | Key | Value | +---+-+---+ | DEFAULT | verbose | True | | DEFAULT | admin_token | 91121d2c109d7fc778e4 | | database | connection | mysql://keystone:sleestack191@controller/keystone | | memcache | servers | localhost:11211 | | revoke| driver | sql | | token | driver | memcache | | token | provider| uuid | +---+-+---+ su -s /bin/sh -c "keystone-manage db_sync" keystone No handlers could be found for logger "oslo_config.cfg" IS this an issue somehow? Not sure it's working. Because later when I try to openstack service create --name keystone --description "OpenStack Identity" identity An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-5603ec65-3ba2-4c9b-9501-73772d6b3812) Comes back quickly WTF? 2016-03-05 16:42:51.695 3294 ERROR keystone.common.wsgi [req-3059b920-d493-4142-b104-f59c955e5d37 - - - - -] (_mysql_exceptions.ProgrammingError) (1146, "Table 'keystone.service' doesn't exist") [SQL: u'INSERT INTO service (id, type, enabled, extra) VALUES (%s, %s, %s, %s)'] [parameters: ('17b77b89d54d4dad97a89afd5b779cb0', 'identity', 1, '{"description": "OpenStack Identity", "name": "keystone"}')] I log onto mariadb and indeed there is no keystone.service table in the keystone db. The only reference I could find was this. And BTW the poster is correct. I sure can't find a dup of the question. And if there was one a nice little link to it from this page sure would be the common sense thing to do. :-)I don't even know how to register for an account on this site? Anyway. has anyone else run into this? Chris --- And then, for no reason :-) it worked??? [root@maersk src]# source os-service-create.sh [root@maersk src]# openstack service create --name keystone --description "OpenStack Identity" identity +-+--+ | Field | Value| +-+--+ | description | OpenStack Identity | | enabled | True | | id | 2f38c47f88e54e59bb8e289644b7e8cb | | name| keystone | | type| identity | +-+--+ Um ok. Wonder if anyone else has seen this. - Christopher T. Hull 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] Configuration tool for Openstack
Hello Edgar; I'd be happy to. Not sure which part of the repo to put it in. This should become a mature tool, so perhaps genetic? Not quite sure. Let me know Chris - Christopher T. Hull 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com On Wed, Mar 2, 2016 at 3:33 PM, Edgar Maganawrote: > Hello Chris, > > Please, consider to move your code to OSOps Repos: > https://wiki.openstack.org/wiki/Osops > > Let me know if you need some assistance, > > Edgar > > From: "chrishul...@gmail.com" > Date: Wednesday, March 2, 2016 at 12:54 PM > To: "openstack-operators@lists.openstack.org" < > openstack-operators@lists.openstack.org> > Subject: [Openstack-operators] Configuration tool for Openstack > > Hi all; > > I'm still a bit new to the world of stacking, but like many of you I have > suffered thru the process of manual Openstack installation. > > I've been a developer for decades, so please excuse me for "productizing" > a simple tool. I hope this is useful. Feedback much appreciated. > > http://chrishull.com/career/openstack/index.html > > Please give feedback. The page is a quick read. > > Thanks > -Chris. > > > > Sent from my iPhone > ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
[Openstack-operators] Fwd: Kilo - Glance checksum error question
- Christopher T. Hull 333 Orchard Ave, Sunnyvale CA. 94085 (415) 385 4865 chrishul...@gmail.com http://chrishull.com -- Forwarded message -- From: Christopher Hull -X (chrihull - ZENAIDE TECHNOLOGIES INC at Cisco) < chrih...@cisco.com> Date: Mon, Feb 1, 2016 at 9:55 AM Subject: Kilo - Glance checksum error question To: "chrishul...@gmail.com" <chrishul...@gmail.com> Hello Stackers; I’ve been working with my manually installed (according to the Openstack Kilo instructions) Kilo installation. It’s all in one box, i7, plenty of RAM and disk. Everything seems to work except “large”glance images. I’ve posted about this before and now have had some time to experiment a little. It looks like Glance is storing a bogus check sum in the database. I think this because when I download the image, I consistently get a different checksum. If Glance were experiencing noise, I’d epxect to get different checksums back out, but they all seem to be the same. How or why would glance record an incorrect checksum? Thanks; -Chris = [sleestack@maersk maersk]$ glance image-download 3e8e0940-d4f8-48d1-8d0d-99d096e3d928 | md5sum - [Errno 32] Corrupt image download. Checksum was 27c1b9117728524705f2cd9602928d5a expected 7fbc000798c3daa7ec168f48604fe353 27c1b9117728524705f2cd9602928d5a - [sleestack@maersk maersk]$ glance image-download 3e8e0940-d4f8-48d1-8d0d-99d096e3d928 | md5sum - [Errno 32] Corrupt image download. Checksum was 27c1b9117728524705f2cd9602928d5a expected 7fbc000798c3daa7ec168f48604fe353 27c1b9117728524705f2cd9602928d5a - [sleestack@maersk maersk]$ glance image-download 3e8e0940-d4f8-48d1-8d0d-99d096e3d928 | md5sum - [Errno 32] Corrupt image download. Checksum was 27c1b9117728524705f2cd9602928d5a expected 7fbc000798c3daa7ec168f48604fe353 27c1b9117728524705f2cd9602928d5a - [sleestack@maersk maersk]$ glance image-show 3e8e0940-d4f8-48d1-8d0d- 99d096e3d928 +--+--+ | Property | Value| +--+--+ | checksum | 7fbc000798c3daa7ec168f48604fe353 | | container_format | bare | | created_at | 2016-01-03T00:26:08Z | | disk_format | raw | | id | 3e8e0940-d4f8-48d1-8d0d-99d096e3d928 | | min_disk | 0| | min_ram | 0| | name | v4c-centos-volume1-img1 | | owner| 3690e3975f6546d793b530dffa8f1a8d | | protected| False| | size | 10737418240 | | status | active | | tags | [] | | updated_at | 2016-01-03T00:28:20Z | | virtual_size | None | | visibility | private | +--+--+ ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
Re: [Openstack-operators] I have an installation question and possible bug
Wow. Thank you all for the response! Well, Installing Kilo because I started this last August and have worked on it gradually. Should probably do Liberty. Yes, I get timesouts between Nova and "model service" which I assume is Glance. Message timeouts and recoveries for large images. 100GB CentOS server. 2015-12-20 18:19:33.759 3755 TRACE nova.servicegroup.drivers.db MessagingTimeout: Timed out waiting for a reply to message ID 34fe85f35bf84908b516b8e79110f516. 2015-12-20 18:19:33.759 3755 TRACE nova.servicegroup.drivers.db 2015-12-20 18:19:33.895 3755 WARNING nova.openstack.common.loopingcall [req-37a3f586-84de-4a1b-9257-1f968ec99273 - - - - -] task > run outlasted interval by 8.43 sec 2015-12-20 18:19:33.896 3755 INFO nova.scheduler.client.report [req-9f0894b2-95f4-40f1-b9b0-83788d0e75d5 - - - - -] Compute_service record updated for ('maersk.chrishull.com', 'maersk.chrishull.com') 2015-12-20 18:19:33.896 3755 INFO nova.compute.resource_tracker [req-9f0894b2-95f4-40f1-b9b0-83788d0e75d5 - - - - -] Compute_service record updated for maersk.chrishull.com:maersk.chrishull.com 2015-12-20 18:19:54.642 3755 ERROR nova.servicegroup.drivers.db [req-37a3f586-84de-4a1b-9257-1f968ec99273 - - - - -] Recovered model server connection! Perhaps this doesn't happen with smaller images like Cirros. Here's my Glance.conf Is this some sort of REST timeout? RabbitMQ? glance-api.conf [DEFAULT] notification_driver = noop # Show more verbose log output (sets INFO log level output) verbose=True # Show debugging output in logs (sets DEBUG log level output) #debug=False # Maximum image size (in bytes) that may be uploaded through the # Glance API server. Defaults to 1 TB. # WARNING: this value should only be increased after careful consideration # and must be set to a value under 8 EB (9223372036854775808). #image_size_cap=1099511627776 # Address to bind the API server #bind_host=0.0.0.0 # Port the bind the API server to #bind_port=9292 # Log to this file. Make sure you do not set the same log file for both the API # and registry servers! # # If `log_file` is omitted and `use_syslog` is false, then log messages are # sent to stdout as a fallback. #log_file=/var/log/glance/api.log # Backlog requests when creating socket #backlog=4096 # TCP_KEEPIDLE value in seconds when creating socket. # Not supported on OS X. #tcp_keepidle=600 # Timeout (in seconds) for client connections' socket operations. If an incoming # connection is idle for this period it will be closed. A value of "0" # means wait forever. #client_socket_timeout=0 # API to use for accessing data. Default value points to sqlalchemy # package, it is also possible to use: glance.db.registry.api # data_api = glance.db.sqlalchemy.api # The number of child process workers that will be # created to service API requests. The default will be # equal to the number of CPUs available. (integer value) #workers=4 # Maximum line size of message headers to be accepted. # max_header_line may need to be increased when using large tokens # (typically those generated by the Keystone v3 API with big service # catalogs) # max_header_line = 16384 # Role used to identify an authenticated user as administrator #admin_role=admin # Allow unauthenticated users to access the API with read-only # privileges. This only applies when using ContextMiddleware. #allow_anonymous_access=False # Allow access to version 1 of glance api #enable_v1_api=True # Allow access to version 2 of glance api #enable_v2_api=True # Return the URL that references where the data is stored on # the backend storage system. For example, if using the # file system store a URL of 'file:///path/to/image' will # be returned to the user in the 'direct_url' meta-data field. # The default value is false. #show_image_direct_url=False # Send headers containing user and tenant information when making requests to # the v1 glance registry. This allows the registry to function as if a user is # authenticated without the need to authenticate a user itself using the # auth_token middleware. # The default value is false. #send_identity_headers=False # Supported values for the 'container_format' image attribute #container_formats=ami,ari,aki,bare,ovf,ova # Supported values for the 'disk_format' image attribute #disk_formats=ami,ari,aki,vhd,vmdk,raw,qcow2,vdi,iso # Property Protections config file # This file contains the rules for property protections and the roles/policies # associated with it. # If this config value is not specified, by default, property protections # won't be enforced. # If a value is specified and the file is not found, then the glance-api # service will not start. #property_protection_file = # Specify whether 'roles' or 'policies' are used in the # property_protection_file. # The default value for
[Openstack-operators] I have an installation question and possible bug
Hello all; I'm an experienced developer and I work at Cisco. Chances are I've covered the basics here,but just in case, check me. I've followed the Kilo install instructions to the letter so far as I can tell. I have not installed Swift, but I think everything else, and my installation almost works. I'm having a little trouble with Glance. It seems that when I attempt to create a large image (that may or not may be the issue), the checksum that Glance records in it's DB is incorrect. Cirros image runs just fine. CentOS cloud works. But when I offload and create an image from a big CentOS install (say 100gb), nova says the checksum is wrong when I try to boot it. Install was on a fresh CentOS7 on new system I built, i7 32GB 7TB. Plenty of speed and space. And this system is dedicated to Openstack. http://docs.openstack.org/kilo/install-guide/install/yum/content/index.html Here's a little test I ran. === Attempt to deploy image nova boot --flavor m1.medium --image v4c-centos-volume1-img1 --nic net-id=61a08e7c-8d4b-42c3-b963-eddcf98113a2 \ --security-group default --key-name demo-key v4c-centos-volume1-instance1 2016-01-02 16:37:27.764 4490 ERROR nova.compute.manager [req-87feb5bf-0e29-432b-8f6c-aeac1fba4753 196b1dc42db94eb7bf210c2281b68e67 3690e3975f6546d793b530dffa8f1a8d - - -] [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] Instance failed to spawn 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] Traceback (most recent call last): 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2461, in _build_resources 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] yield resources 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2333, in _build_and_run_instance 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] block_device_info=block_device_info) 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2378, in spawn 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] admin_pass=admin_password) 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2776, in _create_image 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] instance, size, fallback_from_host) 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 5894, in _try_fetch_image_cache 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] size=size) 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 231, in cache 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] *args, **kwargs) 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 480, in create_image 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] prepare_template(target=base, max_size=size, *args, **kwargs) 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 445, in inner 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] return f(*args, **kwargs) 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 221, in fetch_func_sync 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] fetch_func(target=target, *args, **kwargs) 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/utils.py", line 501, in fetch_image 2016-01-02 16:37:27.764 4490 TRACE nova.compute.manager [instance: 9e7d930d-4ee7-4556-905c-d4d54406c677] max_size=max_size) 2016-01-02 16:37:27.764 4490 TRACE