Public bug reported: I am a beginner, trying to build a house.
Openstack Mitaka Centos 7 host controller 192.168.100.10 192.168.100.20 compute 192.168.200.10 192.168.200.20 ================================== neutron network name IP ext-net ext-subnet 192.168.200.0/24 (external network) net200 net200-subnet 200.0.0.0/24 (internal network) net100 net100-subnet 100.0.0.0/24 (internal network) I created two nodes, the name is 'controller' and 'compute' . Is the same name and server . Each node is a double network and Intranet . When I attached floating IP cannot access nodes . Then remove nodes . When I recreate the tip cannot be created . Here is the error log [root@controller nova]# cat nova-api.log 2017-02-08 22:10:11.451 19199 INFO nova.osapi_compute.wsgi.server [req-eaca421f-2f82-4cde-8f4c-43eeb48130d1 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "GET /v2.1/5c0b88983228434986d355142b27ae59/flavors/5/os-extra_specs HTTP/1.1" status: 200 len: 286 time: 0.0261800 2017-02-08 22:10:11.554 19199 INFO nova.osapi_compute.wsgi.server [req-f61100ba-a245-454a-baf3-8a1c74a8f021 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "GET /v2.1/5c0b88983228434986d355142b27ae59/extensions HTTP/1.1" status: 200 len: 21766 time: 0.0557902 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions [req-27f90911-7f89-45c1-80ba-34ed58f51c08 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] Unexpected exception in API method 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions Traceback (most recent call last): 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 629, in create 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions **create_kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions rv = f(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1562, in create 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions check_server_group_quota=check_server_group_quota) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1175, in _create_instance 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions instance_group, check_server_group_quota, filter_properties) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1033, in _provision_instances 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions quotas.rollback() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self.force_reraise() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions six.reraise(self.type_, self.value, self.tb) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 975, in _provision_instances 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions req_spec.create() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 223, in wrapper 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return fn(self, *args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/objects/request_spec.py", line 432, in create 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions db_spec = self._create_in_db(self._context, updates) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 708, in wrapper 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions with self._transaction_scope(context): 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return self.gen.next() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 759, in _transaction_scope 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions allow_async=self._allow_async) as resource: 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return self.gen.next() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 491, in _session 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions bind=self.connection, mode=self.mode) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 272, in _create_session 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self._start() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 338, in _start 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions engine_args, maker_args) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 362, in _setup_for_connection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions sql_connection=sql_connection, **engine_kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 152, in create_engine 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions test_conn = _test_connection(engine, max_retries, retry_interval) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 326, in _test_connection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return engine.connect() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2018, in connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return self._connection_cls(self, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 72, in __init__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions if connection is not None else engine.raw_connection() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2104, in raw_connection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self.pool.unique_connection, _connection) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2078, in _wrap_pool_connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions e, dialect, self) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1401, in _handle_dbapi_exception_noconnection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions util.raise_from_cause(newraise, exc_info) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions reraise(type(exception), exception, tb=exc_tb) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2074, in _wrap_pool_connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return fn() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 318, in unique_connection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return _ConnectionFairy._checkout(self) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 713, in _checkout 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions fairy = _ConnectionRecord.checkout(pool) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 480, in checkout 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions rec = pool._do_get() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 1060, in _do_get 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self._dec_overflow() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions compat.reraise(exc_type, exc_value, exc_tb) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 1057, in _do_get 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return self._create_connection() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 323, in _create_connection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return _ConnectionRecord(self) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 449, in __init__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self.connection = self.__connect() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 607, in __connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions connection = self.__pool._invoke_creator(self) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 97, in connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return dialect.connect(*cargs, **cparams) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 385, in connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return self.dbapi.connect(*cargs, **cparams) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/__init__.py", line 88, in Connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return Connection(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 657, in __init__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self.connect() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 851, in connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self._request_authentication() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1034, in _request_authentication 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions auth_packet = self._read_packet() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 906, in _read_packet 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions packet.check_error() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 367, in check_error 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions err.raise_mysql_exception(self._data) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 120, in raise_mysql_exception 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions _check_mysql_exception(errinfo) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 112, in _check_mysql_exception 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions raise errorclass(errno, errorvalue) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions OperationalError: (pymysql.err.OperationalError) (1040, u'Too many connections') 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions 2017-02-08 22:10:34.065 19199 INFO nova.api.openstack.wsgi [req-27f90911-7f89-45c1-80ba-34ed58f51c08 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. <class 'sqlalchemy.exc.OperationalError'> 2017-02-08 22:10:34.066 19199 INFO nova.osapi_compute.wsgi.server [req-27f90911-7f89-45c1-80ba-34ed58f51c08 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "POST /v2.1/5c0b88983228434986d355142b27ae59/servers HTTP/1.1" status: 500 len: 507 time: 0.5376399 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions [req-50c53ea6-72cf-438a-b468-49da1d9c2657 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] Unexpected exception in API method 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions Traceback (most recent call last): 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 629, in create 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions **create_kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions rv = f(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1562, in create 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions check_server_group_quota=check_server_group_quota) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1175, in _create_instance 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions instance_group, check_server_group_quota, filter_properties) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1033, in _provision_instances 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions quotas.rollback() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self.force_reraise() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions six.reraise(self.type_, self.value, self.tb) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 975, in _provision_instances 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions req_spec.create() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 223, in wrapper 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return fn(self, *args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/objects/request_spec.py", line 432, in create 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions db_spec = self._create_in_db(self._context, updates) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 708, in wrapper 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions with self._transaction_scope(context): 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return self.gen.next() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 759, in _transaction_scope 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions allow_async=self._allow_async) as resource: 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return self.gen.next() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 491, in _session 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions bind=self.connection, mode=self.mode) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 272, in _create_session 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self._start() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 338, in _start 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions engine_args, maker_args) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 362, in _setup_for_connection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions sql_connection=sql_connection, **engine_kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 152, in create_engine 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions test_conn = _test_connection(engine, max_retries, retry_interval) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 326, in _test_connection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return engine.connect() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2018, in connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return self._connection_cls(self, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 72, in __init__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions if connection is not None else engine.raw_connection() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2104, in raw_connection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self.pool.unique_connection, _connection) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2078, in _wrap_pool_connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions e, dialect, self) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1401, in _handle_dbapi_exception_noconnection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions util.raise_from_cause(newraise, exc_info) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions reraise(type(exception), exception, tb=exc_tb) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2074, in _wrap_pool_connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return fn() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 318, in unique_connection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return _ConnectionFairy._checkout(self) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 713, in _checkout 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions fairy = _ConnectionRecord.checkout(pool) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 480, in checkout 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions rec = pool._do_get() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 1060, in _do_get 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self._dec_overflow() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions compat.reraise(exc_type, exc_value, exc_tb) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 1057, in _do_get 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return self._create_connection() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 323, in _create_connection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return _ConnectionRecord(self) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 449, in __init__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self.connection = self.__connect() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 607, in __connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions connection = self.__pool._invoke_creator(self) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 97, in connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return dialect.connect(*cargs, **cparams) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 385, in connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return self.dbapi.connect(*cargs, **cparams) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/__init__.py", line 88, in Connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return Connection(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 657, in __init__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self.connect() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 851, in connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self._request_authentication() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1034, in _request_authentication 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions auth_packet = self._read_packet() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 906, in _read_packet 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions packet.check_error() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 367, in check_error 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions err.raise_mysql_exception(self._data) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 120, in raise_mysql_exception 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions _check_mysql_exception(errinfo) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 112, in _check_mysql_exception 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions raise errorclass(errno, errorvalue) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions OperationalError: (pymysql.err.OperationalError) (1040, u'Too many connections') 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions 2017-02-08 22:10:37.702 19170 INFO nova.api.openstack.wsgi [req-50c53ea6-72cf-438a-b468-49da1d9c2657 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. <class 'sqlalchemy.exc.OperationalError'> 2017-02-08 22:10:37.703 19170 INFO nova.osapi_compute.wsgi.server [req-50c53ea6-72cf-438a-b468-49da1d9c2657 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "POST /v2.1/5c0b88983228434986d355142b27ae59/servers HTTP/1.1" status: 500 len: 507 time: 0.5736270 2017-02-08 22:11:03.353 19170 INFO nova.osapi_compute.wsgi.server [req-19939a6e-e863-483e-b481-f347b5539777 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "GET /v2.1/5c0b88983228434986d355142b27ae59 HTTP/1.1" status: 404 len: 264 time: 0.2591701 2017-02-08 22:11:03.365 19170 INFO nova.osapi_compute.wsgi.server [req-8ca06bb1-8b26-470a-abef-5691732c3efd 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "GET /v2.1/ HTTP/1.1" status: 200 len: 652 time: 0.0086830 2017-02-08 22:11:03.588 19170 INFO nova.osapi_compute.wsgi.server [req-d92d186a-0193-46fb-b514-ba1239412e7c 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "GET /v2.1/5c0b88983228434986d355142b27ae59/os-services HTTP/1.1" status: 200 len: 1109 time: 0.0278270 ** Affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1662789 Title: qlalchemy.exc.OperationalError Status in OpenStack Compute (nova): New Bug description: I am a beginner, trying to build a house. Openstack Mitaka Centos 7 host controller 192.168.100.10 192.168.100.20 compute 192.168.200.10 192.168.200.20 ================================== neutron network name IP ext-net ext-subnet 192.168.200.0/24 (external network) net200 net200-subnet 200.0.0.0/24 (internal network) net100 net100-subnet 100.0.0.0/24 (internal network) I created two nodes, the name is 'controller' and 'compute' . Is the same name and server . Each node is a double network and Intranet . When I attached floating IP cannot access nodes . Then remove nodes . When I recreate the tip cannot be created . Here is the error log [root@controller nova]# cat nova-api.log 2017-02-08 22:10:11.451 19199 INFO nova.osapi_compute.wsgi.server [req-eaca421f-2f82-4cde-8f4c-43eeb48130d1 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "GET /v2.1/5c0b88983228434986d355142b27ae59/flavors/5/os-extra_specs HTTP/1.1" status: 200 len: 286 time: 0.0261800 2017-02-08 22:10:11.554 19199 INFO nova.osapi_compute.wsgi.server [req-f61100ba-a245-454a-baf3-8a1c74a8f021 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "GET /v2.1/5c0b88983228434986d355142b27ae59/extensions HTTP/1.1" status: 200 len: 21766 time: 0.0557902 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions [req-27f90911-7f89-45c1-80ba-34ed58f51c08 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] Unexpected exception in API method 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions Traceback (most recent call last): 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 629, in create 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions **create_kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions rv = f(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1562, in create 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions check_server_group_quota=check_server_group_quota) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1175, in _create_instance 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions instance_group, check_server_group_quota, filter_properties) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1033, in _provision_instances 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions quotas.rollback() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self.force_reraise() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions six.reraise(self.type_, self.value, self.tb) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 975, in _provision_instances 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions req_spec.create() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 223, in wrapper 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return fn(self, *args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/objects/request_spec.py", line 432, in create 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions db_spec = self._create_in_db(self._context, updates) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 708, in wrapper 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions with self._transaction_scope(context): 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return self.gen.next() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 759, in _transaction_scope 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions allow_async=self._allow_async) as resource: 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return self.gen.next() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 491, in _session 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions bind=self.connection, mode=self.mode) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 272, in _create_session 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self._start() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 338, in _start 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions engine_args, maker_args) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 362, in _setup_for_connection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions sql_connection=sql_connection, **engine_kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 152, in create_engine 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions test_conn = _test_connection(engine, max_retries, retry_interval) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 326, in _test_connection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return engine.connect() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2018, in connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return self._connection_cls(self, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 72, in __init__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions if connection is not None else engine.raw_connection() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2104, in raw_connection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self.pool.unique_connection, _connection) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2078, in _wrap_pool_connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions e, dialect, self) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1401, in _handle_dbapi_exception_noconnection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions util.raise_from_cause(newraise, exc_info) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions reraise(type(exception), exception, tb=exc_tb) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2074, in _wrap_pool_connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return fn() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 318, in unique_connection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return _ConnectionFairy._checkout(self) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 713, in _checkout 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions fairy = _ConnectionRecord.checkout(pool) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 480, in checkout 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions rec = pool._do_get() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 1060, in _do_get 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self._dec_overflow() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions compat.reraise(exc_type, exc_value, exc_tb) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 1057, in _do_get 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return self._create_connection() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 323, in _create_connection 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return _ConnectionRecord(self) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 449, in __init__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self.connection = self.__connect() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 607, in __connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions connection = self.__pool._invoke_creator(self) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 97, in connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return dialect.connect(*cargs, **cparams) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 385, in connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return self.dbapi.connect(*cargs, **cparams) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/__init__.py", line 88, in Connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions return Connection(*args, **kwargs) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 657, in __init__ 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self.connect() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 851, in connect 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions self._request_authentication() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1034, in _request_authentication 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions auth_packet = self._read_packet() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 906, in _read_packet 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions packet.check_error() 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 367, in check_error 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions err.raise_mysql_exception(self._data) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 120, in raise_mysql_exception 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions _check_mysql_exception(errinfo) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 112, in _check_mysql_exception 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions raise errorclass(errno, errorvalue) 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions OperationalError: (pymysql.err.OperationalError) (1040, u'Too many connections') 2017-02-08 22:10:34.057 19199 ERROR nova.api.openstack.extensions 2017-02-08 22:10:34.065 19199 INFO nova.api.openstack.wsgi [req-27f90911-7f89-45c1-80ba-34ed58f51c08 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. <class 'sqlalchemy.exc.OperationalError'> 2017-02-08 22:10:34.066 19199 INFO nova.osapi_compute.wsgi.server [req-27f90911-7f89-45c1-80ba-34ed58f51c08 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "POST /v2.1/5c0b88983228434986d355142b27ae59/servers HTTP/1.1" status: 500 len: 507 time: 0.5376399 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions [req-50c53ea6-72cf-438a-b468-49da1d9c2657 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] Unexpected exception in API method 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions Traceback (most recent call last): 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 629, in create 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions **create_kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions rv = f(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1562, in create 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions check_server_group_quota=check_server_group_quota) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1175, in _create_instance 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions instance_group, check_server_group_quota, filter_properties) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1033, in _provision_instances 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions quotas.rollback() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self.force_reraise() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions six.reraise(self.type_, self.value, self.tb) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 975, in _provision_instances 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions req_spec.create() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 223, in wrapper 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return fn(self, *args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/objects/request_spec.py", line 432, in create 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions db_spec = self._create_in_db(self._context, updates) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 708, in wrapper 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions with self._transaction_scope(context): 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return self.gen.next() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 759, in _transaction_scope 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions allow_async=self._allow_async) as resource: 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return self.gen.next() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 491, in _session 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions bind=self.connection, mode=self.mode) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 272, in _create_session 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self._start() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 338, in _start 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions engine_args, maker_args) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 362, in _setup_for_connection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions sql_connection=sql_connection, **engine_kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 152, in create_engine 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions test_conn = _test_connection(engine, max_retries, retry_interval) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 326, in _test_connection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return engine.connect() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2018, in connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return self._connection_cls(self, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 72, in __init__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions if connection is not None else engine.raw_connection() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2104, in raw_connection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self.pool.unique_connection, _connection) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2078, in _wrap_pool_connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions e, dialect, self) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1401, in _handle_dbapi_exception_noconnection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions util.raise_from_cause(newraise, exc_info) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions reraise(type(exception), exception, tb=exc_tb) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2074, in _wrap_pool_connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return fn() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 318, in unique_connection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return _ConnectionFairy._checkout(self) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 713, in _checkout 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions fairy = _ConnectionRecord.checkout(pool) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 480, in checkout 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions rec = pool._do_get() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 1060, in _do_get 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self._dec_overflow() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions compat.reraise(exc_type, exc_value, exc_tb) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 1057, in _do_get 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return self._create_connection() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 323, in _create_connection 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return _ConnectionRecord(self) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 449, in __init__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self.connection = self.__connect() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 607, in __connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions connection = self.__pool._invoke_creator(self) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 97, in connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return dialect.connect(*cargs, **cparams) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 385, in connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return self.dbapi.connect(*cargs, **cparams) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/__init__.py", line 88, in Connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions return Connection(*args, **kwargs) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 657, in __init__ 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self.connect() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 851, in connect 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions self._request_authentication() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1034, in _request_authentication 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions auth_packet = self._read_packet() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 906, in _read_packet 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions packet.check_error() 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 367, in check_error 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions err.raise_mysql_exception(self._data) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 120, in raise_mysql_exception 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions _check_mysql_exception(errinfo) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 112, in _check_mysql_exception 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions raise errorclass(errno, errorvalue) 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions OperationalError: (pymysql.err.OperationalError) (1040, u'Too many connections') 2017-02-08 22:10:37.693 19170 ERROR nova.api.openstack.extensions 2017-02-08 22:10:37.702 19170 INFO nova.api.openstack.wsgi [req-50c53ea6-72cf-438a-b468-49da1d9c2657 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. <class 'sqlalchemy.exc.OperationalError'> 2017-02-08 22:10:37.703 19170 INFO nova.osapi_compute.wsgi.server [req-50c53ea6-72cf-438a-b468-49da1d9c2657 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "POST /v2.1/5c0b88983228434986d355142b27ae59/servers HTTP/1.1" status: 500 len: 507 time: 0.5736270 2017-02-08 22:11:03.353 19170 INFO nova.osapi_compute.wsgi.server [req-19939a6e-e863-483e-b481-f347b5539777 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "GET /v2.1/5c0b88983228434986d355142b27ae59 HTTP/1.1" status: 404 len: 264 time: 0.2591701 2017-02-08 22:11:03.365 19170 INFO nova.osapi_compute.wsgi.server [req-8ca06bb1-8b26-470a-abef-5691732c3efd 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "GET /v2.1/ HTTP/1.1" status: 200 len: 652 time: 0.0086830 2017-02-08 22:11:03.588 19170 INFO nova.osapi_compute.wsgi.server [req-d92d186a-0193-46fb-b514-ba1239412e7c 563cfa6210f84578a4ad846331723cab 5c0b88983228434986d355142b27ae59 - - -] 192.168.100.10 "GET /v2.1/5c0b88983228434986d355142b27ae59/os-services HTTP/1.1" status: 200 len: 1109 time: 0.0278270 To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1662789/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
