Yuanyou ZHANG, Looks like you are having the similar issue which I find during my testing with kilo in OPNFV and logged bug under rabbitmq-server https://bugs.launchpad.net/charms/+source/rabbitmq-server/+bug/1506642 .
Only workaround is to restart the rabbitmq, nova-conductor and nova-compute services. But after some time we observed the same issue again. After moving to Liberty Openstack we are not observing this behavior. Thanks and Regards, Narinder Gupta (PMP) narinder.gu...@canonical.com Canonical, Ltd. narindergupta [irc.freenode.net] +1.281.736.5150 narindergupta2007[skype] Ubuntu- Linux for human beings | www.ubuntu.com | www.canonical.com On Wed, Dec 2, 2015 at 9:04 PM, zhangyuanyou <zhangyuan...@huawei.com> wrote: > Hi Artur Tyloch, > I'm working on deploying openstack-kilo using Juju,now I can deploy > openstack successfully and create network in openstack-dashboard. > > But when I create a vm instance, I find the nova-compute shutdown. > I login the controller node and show the nova service-list,I find there is > not nova-consoleauth. > So I do this: apt-get install nova-consoleauth,but how can I reboot the > nova-compute? Any assistance is greatly appreciated. > > +----+----------------+----------------------------+----------+---------+-------+----------------------------+-----------------+ > | Id | Binary | Host | Zone | Status | > State | Updated_at | Disabled Reason | > > +----+----------------+----------------------------+----------+---------+-------+----------------------------+-----------------+ > | 1 | nova-cert | onos-local-machine-1-lxc-3 | internal | enabled | > up | 2015-12-02T09:56:38.000000 | - | > | 2 | nova-conductor | onos-local-machine-1-lxc-3 | internal | enabled | > up | 2015-12-02T09:56:39.000000 | - | > | 3 | nova-scheduler | onos-local-machine-1-lxc-3 | internal | enabled | > up | 2015-12-02T09:56:39.000000 | - | > | 4 | nova-compute | onos-local-machine-3 | nova | enabled | > down | 2015-12-02T09:47:43.000000 | - | > > +----+----------------+----------------------------+----------+---------+-------+----------------------------+-----------------+ > > nova-conductor.log: > 2015-12-02 08:59:00.341 11084 INFO nova.openstack.common.service > [req-6d38fc33-712f-4b12-83d0-d4399e870a5e - - - - -] Started child 11249 > 2015-12-02 08:59:00.348 11084 INFO nova.openstack.common.service > [req-6d38fc33-712f-4b12-83d0-d4399e870a5e - - - - -] Started child 11250 > 2015-12-02 08:59:00.358 11248 INFO nova.service [-] Starting conductor > node (version 2015.1.2) > 2015-12-02 08:59:00.358 11084 INFO nova.openstack.common.service > [req-6d38fc33-712f-4b12-83d0-d4399e870a5e - - - - -] Started child 11251 > 2015-12-02 08:59:00.367 11250 INFO nova.service [-] Starting conductor > node (version 2015.1.2) > 2015-12-02 08:59:00.367 11249 INFO nova.service [-] Starting conductor > node (version 2015.1.2) > 2015-12-02 08:59:00.372 11251 INFO nova.service [-] Starting conductor > node (version 2015.1.2) > 2015-12-02 08:59:00.413 11084 WARNING oslo_config.cfg > [req-6d38fc33-712f-4b12-83d0-d4399e870a5e - - - - -] Option "lock_path" > from group "DEFAULT" is deprecated. Use option "lock_path" from group > "oslo_concurrency". > 2015-12-02 08:59:00.734 11244 INFO oslo_messaging._drivers.impl_rabbit > [req-70fa0b3e-71d8-4171-9d63-83757938f02d - - - - -] Connecting to AMQP > server on localhost:5672 > 2015-12-02 08:59:00.753 11244 ERROR oslo_messaging._drivers.impl_rabbit > [req-70fa0b3e-71d8-4171-9d63-83757938f02d - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 1 seconds. > 2015-12-02 08:59:00.774 11247 INFO oslo_messaging._drivers.impl_rabbit > [req-2447759d-c90b-41d0-90a0-ec7a23551b86 - - - - -] Connecting to AMQP > server on localhost:5672 > 2015-12-02 08:59:00.778 11245 INFO oslo_messaging._drivers.impl_rabbit > [req-7db8bff8-46ae-4f14-ad0a-11506c858369 - - - - -] Connecting to AMQP > server on localhost:5672 > 2015-12-02 08:59:00.783 11247 ERROR oslo_messaging._drivers.impl_rabbit > [req-2447759d-c90b-41d0-90a0-ec7a23551b86 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 1 seconds. > 2015-12-02 08:59:00.783 11242 INFO oslo_messaging._drivers.impl_rabbit > [req-a0bab9d4-e8c4-4674-9fd9-d355a7137a1a - - - - -] Connecting to AMQP > server on localhost:5672 > 2015-12-02 08:59:00.787 11245 ERROR oslo_messaging._drivers.impl_rabbit > [req-7db8bff8-46ae-4f14-ad0a-11506c858369 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 1 seconds. > 2015-12-02 08:59:00.791 11242 ERROR oslo_messaging._drivers.impl_rabbit > [req-a0bab9d4-e8c4-4674-9fd9-d355a7137a1a - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 1 seconds. > 2015-12-02 08:59:00.801 11251 INFO oslo_messaging._drivers.impl_rabbit > [req-5af923e7-722a-4552-a788-f426c43dc916 - - - - -] Connecting to AMQP > server on localhost:5672 > 2015-12-02 08:59:00.806 11249 INFO oslo_messaging._drivers.impl_rabbit > [req-1b0fa84e-c4fa-4a83-8398-25280ec1386c - - - - -] Connecting to AMQP > server on localhost:5672 > 2015-12-02 08:59:00.813 11243 INFO oslo_messaging._drivers.impl_rabbit > [req-eb6fcf93-070a-4380-b3f3-2016ca4cc626 - - - - -] Connecting to AMQP > server on localhost:5672 > 2015-12-02 08:59:00.816 11251 ERROR oslo_messaging._drivers.impl_rabbit > [req-5af923e7-722a-4552-a788-f426c43dc916 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 1 seconds. > 2015-12-02 08:59:00.821 11250 INFO oslo_messaging._drivers.impl_rabbit > [req-8b512b83-6475-47b6-8090-3ee4c3889216 - - - - -] Connecting to AMQP > server on localhost:5672 > 2015-12-02 08:59:00.822 11243 ERROR oslo_messaging._drivers.impl_rabbit > [req-eb6fcf93-070a-4380-b3f3-2016ca4cc626 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 1 seconds. > 2015-12-02 08:59:00.825 11249 ERROR oslo_messaging._drivers.impl_rabbit > [req-1b0fa84e-c4fa-4a83-8398-25280ec1386c - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 1 seconds. > > root@onos-local-machine-1-lxc-3:/var/log/nova# vi nova-scheduler.log > 2015-12-02 08:59:01.627 11210 WARNING oslo_config.cfg > [req-0aac63aa-8691-4e3e-87e8-658a9a60a799 - - - - -] Option "lock_path" > from group "DEFAULT" is deprecated. Use option "lock_path" from group > "oslo_concurrency". > 2015-12-02 08:59:01.641 11210 INFO nova.service [-] Starting scheduler > node (version 2015.1.2) > 2015-12-02 08:59:01.701 11210 INFO oslo_messaging._drivers.impl_rabbit > [req-1149662e-50fc-4a5e-b8a6-5ee893ba8be6 - - - - -] Connecting to AMQP > server on localhost:5672 > 2015-12-02 08:59:01.709 11210 ERROR oslo_messaging._drivers.impl_rabbit > [req-1149662e-50fc-4a5e-b8a6-5ee893ba8be6 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 1 seconds. > 2015-12-02 08:59:02.633 11210 INFO nova.openstack.common.service > [req-0aac63aa-8691-4e3e-87e8-658a9a60a799 - - - - -] Caught SIGTERM, exiting > 2015-12-02 09:00:59.758 22858 INFO oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] Connecting to AMQP > server on localhost:5672 > 2015-12-02 09:00:59.772 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 1 seconds. > 2015-12-02 09:01:00.781 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:02.792 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:04.804 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:06.814 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:08.832 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:10.842 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:12.853 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:14.863 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:16.873 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:18.882 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:20.893 22858 ERROR oslo_messaging._drivers.impl_rabbit > [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on > 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in > 2 seconds. > 2015-12-02 09:01:24.622 25712 INFO oslo_messaging._drivers.impl_rabbit > [req-89ef66ed-b798-4ac7-85b1-68ed26bb4cec - - - - -] Connecting to AMQP > server on 192.168.122.97:5672 > 2015-12-02 09:01:24.684 25712 INFO oslo_messaging._drivers.impl_rabbit > [req-89ef66ed-b798-4ac7-85b1-68ed26bb4cec - - - - -] Connected to AMQP > server on 192.168.122.97:5672 > 2015-12-02 09:01:52.011 25712 ERROR oslo_messaging._drivers.impl_rabbit > [-] Failed to consume message from queue: > 2015-12-02 09:01:54.450 29216 INFO oslo_messaging._drivers.impl_rabbit > [req-4153dffe-a33b-4f12-8471-f41fe6501d60 - - - - -] Connecting to AMQP > server on 192.168.122.97:5672 > 2015-12-02 09:01:54.491 29216 INFO oslo_messaging._drivers.impl_rabbit > [req-4153dffe-a33b-4f12-8471-f41fe6501d60 - - - - -] Connected to AMQP > server on 192.168.122.97:5672 > 2015-12-02 09:34:39.317 29216 INFO oslo_messaging._drivers.impl_rabbit > [req-b01cf802-37d2-4c38-8c67-6aa3a24c2558 cb6303e9af9e477cb40a67c8424057aa > 9008a10877ee45ad8fec9df6ee7c2ac5 - - -] Connecting to AMQP server on > 192.168.122.97:5672 > 2015-12-02 09:34:39.328 29216 INFO oslo_messaging._drivers.impl_rabbit > [req-b01cf802-37d2-4c38-8c67-6aa3a24c2558 cb6303e9af9e477cb40a67c8424057aa > 9008a10877ee45ad8fec9df6ee7c2ac5 - - -] Connected to AMQP server on > 192.168.122.97:5672 > > > > > > Yuanyou ZHANG > > > > -- > Juju mailing list > Juju@lists.ubuntu.com > Modify settings or unsubscribe at: > https://lists.ubuntu.com/mailman/listinfo/juju > >
-- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju