Yuanyou ZHANG,

Looks like you are having the similar issue which I find during my testing
with kilo in OPNFV and logged  bug under rabbitmq-server
https://bugs.launchpad.net/charms/+source/rabbitmq-server/+bug/1506642 .

Only workaround is to restart the rabbitmq, nova-conductor and nova-compute
services.  But after some time we observed the same issue again.

After moving to Liberty Openstack we are not observing this behavior.


Thanks and Regards,
Narinder Gupta (PMP)                   narinder.gu...@canonical.com
Canonical, Ltd.                    narindergupta [irc.freenode.net]
+1.281.736.5150                            narindergupta2007[skype]

Ubuntu- Linux for human beings | www.ubuntu.com | www.canonical.com


On Wed, Dec 2, 2015 at 9:04 PM, zhangyuanyou <zhangyuan...@huawei.com>
wrote:

> Hi Artur Tyloch,
>   I'm working on deploying openstack-kilo using Juju,now I can deploy
> openstack successfully and create network in openstack-dashboard.
>
> But when I create a vm instance, I find the nova-compute shutdown.
> I login the controller node and show the nova service-list,I find there is
> not nova-consoleauth.
> So I do this: apt-get install nova-consoleauth,but how can I reboot the
> nova-compute? Any assistance is greatly appreciated.
>
> +----+----------------+----------------------------+----------+---------+-------+----------------------------+-----------------+
> | Id | Binary         | Host                       | Zone     | Status  |
> State | Updated_at                 | Disabled Reason |
>
> +----+----------------+----------------------------+----------+---------+-------+----------------------------+-----------------+
> | 1  | nova-cert      | onos-local-machine-1-lxc-3 | internal | enabled |
> up    | 2015-12-02T09:56:38.000000 | -               |
> | 2  | nova-conductor | onos-local-machine-1-lxc-3 | internal | enabled |
> up    | 2015-12-02T09:56:39.000000 | -               |
> | 3  | nova-scheduler | onos-local-machine-1-lxc-3 | internal | enabled |
> up    | 2015-12-02T09:56:39.000000 | -               |
> | 4  | nova-compute   | onos-local-machine-3       | nova     | enabled |
> down  | 2015-12-02T09:47:43.000000 | -               |
>
> +----+----------------+----------------------------+----------+---------+-------+----------------------------+-----------------+
>
> nova-conductor.log:
> 2015-12-02 08:59:00.341 11084 INFO nova.openstack.common.service
> [req-6d38fc33-712f-4b12-83d0-d4399e870a5e - - - - -] Started child 11249
> 2015-12-02 08:59:00.348 11084 INFO nova.openstack.common.service
> [req-6d38fc33-712f-4b12-83d0-d4399e870a5e - - - - -] Started child 11250
> 2015-12-02 08:59:00.358 11248 INFO nova.service [-] Starting conductor
> node (version 2015.1.2)
> 2015-12-02 08:59:00.358 11084 INFO nova.openstack.common.service
> [req-6d38fc33-712f-4b12-83d0-d4399e870a5e - - - - -] Started child 11251
> 2015-12-02 08:59:00.367 11250 INFO nova.service [-] Starting conductor
> node (version 2015.1.2)
> 2015-12-02 08:59:00.367 11249 INFO nova.service [-] Starting conductor
> node (version 2015.1.2)
> 2015-12-02 08:59:00.372 11251 INFO nova.service [-] Starting conductor
> node (version 2015.1.2)
> 2015-12-02 08:59:00.413 11084 WARNING oslo_config.cfg
> [req-6d38fc33-712f-4b12-83d0-d4399e870a5e - - - - -] Option "lock_path"
> from group "DEFAULT" is deprecated. Use option "lock_path" from group
> "oslo_concurrency".
> 2015-12-02 08:59:00.734 11244 INFO oslo_messaging._drivers.impl_rabbit
> [req-70fa0b3e-71d8-4171-9d63-83757938f02d - - - - -] Connecting to AMQP
> server on localhost:5672
> 2015-12-02 08:59:00.753 11244 ERROR oslo_messaging._drivers.impl_rabbit
> [req-70fa0b3e-71d8-4171-9d63-83757938f02d - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 1 seconds.
> 2015-12-02 08:59:00.774 11247 INFO oslo_messaging._drivers.impl_rabbit
> [req-2447759d-c90b-41d0-90a0-ec7a23551b86 - - - - -] Connecting to AMQP
> server on localhost:5672
> 2015-12-02 08:59:00.778 11245 INFO oslo_messaging._drivers.impl_rabbit
> [req-7db8bff8-46ae-4f14-ad0a-11506c858369 - - - - -] Connecting to AMQP
> server on localhost:5672
> 2015-12-02 08:59:00.783 11247 ERROR oslo_messaging._drivers.impl_rabbit
> [req-2447759d-c90b-41d0-90a0-ec7a23551b86 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 1 seconds.
> 2015-12-02 08:59:00.783 11242 INFO oslo_messaging._drivers.impl_rabbit
> [req-a0bab9d4-e8c4-4674-9fd9-d355a7137a1a - - - - -] Connecting to AMQP
> server on localhost:5672
> 2015-12-02 08:59:00.787 11245 ERROR oslo_messaging._drivers.impl_rabbit
> [req-7db8bff8-46ae-4f14-ad0a-11506c858369 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 1 seconds.
> 2015-12-02 08:59:00.791 11242 ERROR oslo_messaging._drivers.impl_rabbit
> [req-a0bab9d4-e8c4-4674-9fd9-d355a7137a1a - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 1 seconds.
> 2015-12-02 08:59:00.801 11251 INFO oslo_messaging._drivers.impl_rabbit
> [req-5af923e7-722a-4552-a788-f426c43dc916 - - - - -] Connecting to AMQP
> server on localhost:5672
> 2015-12-02 08:59:00.806 11249 INFO oslo_messaging._drivers.impl_rabbit
> [req-1b0fa84e-c4fa-4a83-8398-25280ec1386c - - - - -] Connecting to AMQP
> server on localhost:5672
> 2015-12-02 08:59:00.813 11243 INFO oslo_messaging._drivers.impl_rabbit
> [req-eb6fcf93-070a-4380-b3f3-2016ca4cc626 - - - - -] Connecting to AMQP
> server on localhost:5672
> 2015-12-02 08:59:00.816 11251 ERROR oslo_messaging._drivers.impl_rabbit
> [req-5af923e7-722a-4552-a788-f426c43dc916 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 1 seconds.
> 2015-12-02 08:59:00.821 11250 INFO oslo_messaging._drivers.impl_rabbit
> [req-8b512b83-6475-47b6-8090-3ee4c3889216 - - - - -] Connecting to AMQP
> server on localhost:5672
> 2015-12-02 08:59:00.822 11243 ERROR oslo_messaging._drivers.impl_rabbit
> [req-eb6fcf93-070a-4380-b3f3-2016ca4cc626 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 1 seconds.
> 2015-12-02 08:59:00.825 11249 ERROR oslo_messaging._drivers.impl_rabbit
> [req-1b0fa84e-c4fa-4a83-8398-25280ec1386c - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 1 seconds.
>
> root@onos-local-machine-1-lxc-3:/var/log/nova# vi nova-scheduler.log
> 2015-12-02 08:59:01.627 11210 WARNING oslo_config.cfg
> [req-0aac63aa-8691-4e3e-87e8-658a9a60a799 - - - - -] Option "lock_path"
> from group "DEFAULT" is deprecated. Use option "lock_path" from group
> "oslo_concurrency".
> 2015-12-02 08:59:01.641 11210 INFO nova.service [-] Starting scheduler
> node (version 2015.1.2)
> 2015-12-02 08:59:01.701 11210 INFO oslo_messaging._drivers.impl_rabbit
> [req-1149662e-50fc-4a5e-b8a6-5ee893ba8be6 - - - - -] Connecting to AMQP
> server on localhost:5672
> 2015-12-02 08:59:01.709 11210 ERROR oslo_messaging._drivers.impl_rabbit
> [req-1149662e-50fc-4a5e-b8a6-5ee893ba8be6 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 1 seconds.
> 2015-12-02 08:59:02.633 11210 INFO nova.openstack.common.service
> [req-0aac63aa-8691-4e3e-87e8-658a9a60a799 - - - - -] Caught SIGTERM, exiting
> 2015-12-02 09:00:59.758 22858 INFO oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] Connecting to AMQP
> server on localhost:5672
> 2015-12-02 09:00:59.772 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 1 seconds.
> 2015-12-02 09:01:00.781 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:02.792 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:04.804 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:06.814 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:08.832 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:10.842 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:12.853 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:14.863 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:16.873 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:18.882 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:20.893 22858 ERROR oslo_messaging._drivers.impl_rabbit
> [req-829ea81c-31fe-4353-9dd7-e1f626b6b4c0 - - - - -] AMQP server on
> 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
> 2 seconds.
> 2015-12-02 09:01:24.622 25712 INFO oslo_messaging._drivers.impl_rabbit
> [req-89ef66ed-b798-4ac7-85b1-68ed26bb4cec - - - - -] Connecting to AMQP
> server on 192.168.122.97:5672
> 2015-12-02 09:01:24.684 25712 INFO oslo_messaging._drivers.impl_rabbit
> [req-89ef66ed-b798-4ac7-85b1-68ed26bb4cec - - - - -] Connected to AMQP
> server on 192.168.122.97:5672
> 2015-12-02 09:01:52.011 25712 ERROR oslo_messaging._drivers.impl_rabbit
> [-] Failed to consume message from queue:
> 2015-12-02 09:01:54.450 29216 INFO oslo_messaging._drivers.impl_rabbit
> [req-4153dffe-a33b-4f12-8471-f41fe6501d60 - - - - -] Connecting to AMQP
> server on 192.168.122.97:5672
> 2015-12-02 09:01:54.491 29216 INFO oslo_messaging._drivers.impl_rabbit
> [req-4153dffe-a33b-4f12-8471-f41fe6501d60 - - - - -] Connected to AMQP
> server on 192.168.122.97:5672
> 2015-12-02 09:34:39.317 29216 INFO oslo_messaging._drivers.impl_rabbit
> [req-b01cf802-37d2-4c38-8c67-6aa3a24c2558 cb6303e9af9e477cb40a67c8424057aa
> 9008a10877ee45ad8fec9df6ee7c2ac5 - - -] Connecting to AMQP server on
> 192.168.122.97:5672
> 2015-12-02 09:34:39.328 29216 INFO oslo_messaging._drivers.impl_rabbit
> [req-b01cf802-37d2-4c38-8c67-6aa3a24c2558 cb6303e9af9e477cb40a67c8424057aa
> 9008a10877ee45ad8fec9df6ee7c2ac5 - - -] Connected to AMQP server on
> 192.168.122.97:5672
>
>
>
>
>
> Yuanyou ZHANG
>
>
>
> --
> Juju mailing list
> Juju@lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/juju
>
>
-- 
Juju mailing list
Juju@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/juju

Reply via email to