Public bug reported: Description ===========
Hello, I've got an issue regarding undercloud when I execute the command " Openstack server list". Environment =========== I'm working in Red Hat openstack Plateform 11 environment Steps to reproduce ================== I did "openstack server list" but it's returned me this : "Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-444677f3-9944-4522-a67c-865cea7d33b4)" Then i Did the same command with "--debug" and here the result : START with options: [u'server', u'list', u'--debug'] options: Namespace(access_key='', access_secret='***', access_token='***', access_token_endpoint='', access_token_type='', aodh_endpoint='', auth_type='password', auth_url='https://172.16.138.161:13000/v2.0', cacert=None, cert='', client_id='', client_secret='***', cloud='', code='', consumer_key='', consumer_secret='***', debug=True, default_domain='default', default_domain_id='', default_domain_name='', deferred_help=False, discovery_endpoint='', domain_id='', domain_name='', endpoint='', glare_url='', identity_provider='', identity_provider_url='', insecure=None, inspector_api_version='1', inspector_url=None, interface='', key='', log_file=None, murano_packages_service='murano', murano_url='', old_profile=None, openid_scope='', os_alarming_api_version='2', os_application_catalog_api_version='1', os_baremetal_api_version='1.29', os_beta_command=False, os_compute_api_version='', os_container_infra_api_version='1', os_data_processing_api_version='1.1', os_data_processing_url='', os_database_api_version='1', os_dns_api_version='2', os_identity_api_version='', os_image_api_version='', os_key_manager_api_version='1', os_metrics_api_version='1', os_network_api_version='', os_object_api_version='', os_orchestration_api_version='1', os_project_id=None, os_project_name=None, os_queues_api_version='2', os_tripleoclient_api_version='1', os_volume_api_version='', os_workflow_api_version='2', passcode='', password='***', profile=None, project_domain_id='', project_domain_name='', project_id='', project_name='admin', protocol='', redirect_uri='', region_name='', roles='', timing=False, token='***', trust_id='', url='', user='', user_domain_id='', user_domain_name='', user_id='', username='admin', verbose_level=3, verify=None) Auth plugin password selected auth_config_hook(): {'auth_type': 'password', 'beta_command': False, 'tripleoclient_api_version': '1', u'compute_api_version': u'2', 'key': None, u'database_api_version': '1', 'metrics_api_version': '1', 'data_processing_api_version': '1.1', 'inspector_api_version': '1', 'auth_url': 'https://172.16.138.161:13000/v2.0', u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', 'networks': [], u'image_api_version': u'2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'username': 'admin', u'container_infra_api_version': '1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': '1.29', 'queues_api_version': '2', 'auth': {'project_name': 'admin'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'password': '***', u'application_catalog_api_version': '1', 'murano_packages_service': 'murano', 'cacert': None, u'key_manager_api_version': '1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': u'2.0', 'workflow_api_version': '2', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'status': u'active', 'alarming_api_version': '2', 'debug': True, u'interface': None, u'disable_vendor_agent': {}} defaults: {u'auth_type': 'password', u'status': u'active', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', u'key_manager_api_version': u'v1', 'verify': True, u'identity_api_version': u'2.0', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': None, u'disable_vendor_agent': {}} cloud cfg: {'auth_type': 'password', 'beta_command': False, 'tripleoclient_api_version': '1', u'compute_api_version': u'2', 'key': None, u'database_api_version': '1', 'metrics_api_version': '1', 'data_processing_api_version': '1.1', 'inspector_api_version': '1', 'auth_url': 'https://172.16.138.161:13000/v2.0', u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', 'networks': [], u'image_api_version': u'2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'username': 'admin', u'container_infra_api_version': '1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': '1.29', 'queues_api_version': '2', 'auth': {'project_name': 'admin'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'password': '***', u'application_catalog_api_version': '1', 'murano_packages_service': 'murano', 'cacert': None, u'key_manager_api_version': '1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': u'2.0', 'workflow_api_version': '2', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'status': u'active', 'alarming_api_version': '2', 'debug': True, u'interface': None, u'disable_vendor_agent': {}} compute API version 2, cmd group openstack.compute.v2 network API version 2, cmd group openstack.network.v2 image API version 2, cmd group openstack.image.v2 volume API version 2, cmd group openstack.volume.v2 identity API version 2.0, cmd group openstack.identity.v2 object_store API version 1, cmd group openstack.object_store.v1 metric API version 1, cmd group openstack.metric.v1 messaging API version 2, cmd group openstack.messaging.v2 neutronclient API version 2, cmd group openstack.neutronclient.v2 orchestration API version 1, cmd group openstack.orchestration.v1 alarming API version 2, cmd group openstack.alarming.v2 dns API version 2, cmd group openstack.dns.v2 key_manager API version 1, cmd group openstack.key_manager.v1 container_infra API version 1, cmd group openstack.container_infra.v1 baremetal API version 1.29, cmd group openstack.baremetal.v1 workflow_engine API version 2, cmd group openstack.workflow_engine.v2 baremetal_introspection API version 1, cmd group openstack.baremetal_introspection.v1 database API version 1, cmd group openstack.database.v1 application_catalog API version 1, cmd group openstack.application_catalog.v1 tripleoclient API version 1, cmd group openstack.tripleoclient.v1 data_processing API version 1.1, cmd group openstack.data_processing.v1 Auth plugin password selected auth_config_hook(): {'auth_type': 'password', 'beta_command': False, 'tripleoclient_api_version': '1', u'compute_api_version': u'2', 'key': None, u'database_api_version': '1', 'metrics_api_version': '1', 'data_processing_api_version': '1.1', 'inspector_api_version': '1', 'auth_url': 'https://172.16.138.161:13000/v2.0', u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', 'networks': [], u'image_api_version': u'2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'username': 'admin', u'container_infra_api_version': '1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': '1.29', 'queues_api_version': '2', 'auth': {'project_name': 'admin'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'password': '***', u'application_catalog_api_version': '1', 'murano_packages_service': 'murano', 'cacert': None, u'key_manager_api_version': '1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': u'2.0', 'workflow_api_version': '2', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'status': u'active', 'alarming_api_version': '2', 'debug': True, u'interface': None, u'disable_vendor_agent': {}} Auth plugin password selected auth_config_hook(): {'auth_type': 'password', 'beta_command': False, 'tripleoclient_api_version': '1', u'compute_api_version': u'2', 'key': None, u'database_api_version': '1', 'metrics_api_version': '1', 'data_processing_api_version': '1.1', 'inspector_api_version': '1', 'auth_url': 'https://172.16.138.161:13000/v2.0', u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', 'networks': [], u'image_api_version': u'2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'username': 'admin', u'container_infra_api_version': '1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': '1.29', 'queues_api_version': '2', 'auth': {'project_name': 'admin'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'password': '***', u'application_catalog_api_version': '1', 'murano_packages_service': 'murano', 'cacert': None, u'key_manager_api_version': '1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': u'2.0', 'workflow_api_version': '2', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'status': u'active', 'alarming_api_version': '2', 'debug': True, u'interface': None, u'disable_vendor_agent': {}} command: server list -> openstackclient.compute.v2.server.ListServer Auth plugin password selected auth_config_hook(): {'auth_type': 'password', 'beta_command': False, 'tripleoclient_api_version': '1', u'compute_api_version': u'2', 'key': None, u'database_api_version': '1', 'metrics_api_version': '1', 'data_processing_api_version': '1.1', 'inspector_api_version': '1', 'auth_url': 'https://172.16.138.161:13000/v2.0', u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', 'networks': [], u'image_api_version': u'2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'username': 'admin', u'container_infra_api_version': '1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': '1.29', 'queues_api_version': '2', 'auth': {'project_name': 'admin'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'password': '***', u'application_catalog_api_version': '1', 'murano_packages_service': 'murano', 'cacert': None, u'key_manager_api_version': '1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': u'2.0', 'workflow_api_version': '2', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'status': u'active', 'alarming_api_version': '2', 'debug': True, u'interface': None, u'disable_vendor_agent': {}} Using auth plugin: password Using parameters {'username': 'admin', 'password': '***', 'project_name': 'admin', 'auth_url': 'https://172.16.138.161:13000/v2.0'} Get auth_ref REQ: curl -g -i -X GET https://172.16.138.161:13000/v2.0 -H "Accept: application/json" -H "User-Agent: osc-lib/1.3.0 keystoneauth1/2.18.0 python-requests/2.11.1 CPython/2.7.5" Starting new HTTPS connection (1): 172.16.138.161 "GET /v2.0 HTTP/1.1" 200 233 RESP: [200] Date: Wed, 09 May 2018 14:29:31 GMT Server: Apache Vary: X-Auth-Token,Accept-Encoding x-openstack-request-id: req-08d0b083-c5b2-4582-b077-28a0a08375d9 Content-Encoding: gzip Content-Length: 233 Content-Type: application/json RESP BODY: {"version": {"status": "deprecated", "updated": "2016-08-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}], "id": "v2.0", "links": [{"href": "https://172.16.138.161:13000/v2.0/", "rel": "self"}, {"href": "https://docs.openstack.org/", "type": "text/html", "rel": "describedby"}]}} GET call to None for https://172.16.138.161:13000/v2.0 used request id req-08d0b083-c5b2-4582-b077-28a0a08375d9 Making authentication request to https://172.16.138.161:13000/v2.0/tokens "POST /v2.0/tokens HTTP/1.1" 200 1460 run(Namespace(all_projects=False, changes_since=None, columns=[], deleted=False, flavor=None, formatter='table', host=None, image=None, instance_name=None, ip=None, ip6=None, limit=None, long=False, marker=None, max_width=0, name=None, noindent=False, print_empty=False, project=None, project_domain=None, quote_mode='nonnumeric', reservation_id=None, status=None, user=None, user_domain=None)) Instantiating compute client for API Version Major: 2, Minor: 0 Instantiating identity client: <class 'openstackclient.identity.client.IdentityClientv2'> Instantiating image client: <class 'glanceclient.v2.client.Client'> Making authentication request to https://172.16.138.161:13000/v2.0/tokens "POST /v2.0/tokens HTTP/1.1" 200 1465 Instantiating image api: <class 'openstackclient.api.image_v2.APIv2'> search options: {'status': None, 'deleted': False, 'ip': None, 'image': None, 'host': None, 'ip6': None, 'all_tenants': False, 'flavor': None, 'reservation_id': None, 'user_id': None, 'name': None, 'tenant_id': None, 'instance_name': None, 'changes_since': None} REQ: curl -g -i -X GET https://172.16.138.161:13774/v2.1/servers/detail -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}0f63ee03c939dea9d64f5e42e1cab4eeab1edaa3" Starting new HTTPS connection (1): 172.16.138.161 "GET /v2.1/servers/detail HTTP/1.1" 500 220 RESP: [500] Openstack-Api-Version: compute 2.1 X-Openstack-Nova-Api-Version: 2.1 Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version Content-Type: application/json; charset=UTF-8 Content-Length: 220 X-Compute-Request-Id: req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 Date: Wed, 09 May 2018 14:29:33 GMT RESP BODY: {"computeFault": {"message": "Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible.\n<class 'oslo_db.exception.DBError'>", "code": 500}} GET call to compute for https://172.16.138.161:13774/v2.1/servers/detail used request id req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/cliff/app.py", line 400, in run_subcommand result = cmd.run(parsed_args) File "/usr/lib/python2.7/site-packages/osc_lib/command/command.py", line 41, in run return super(Command, self).run(parsed_args) File "/usr/lib/python2.7/site-packages/cliff/display.py", line 112, in run column_names, data = self.take_action(parsed_args) File "/usr/lib/python2.7/site-packages/openstackclient/compute/v2/server.py", line 947, in take_action limit=parsed_args.limit) File "/usr/lib/python2.7/site-packages/novaclient/v2/servers.py", line 861, in list "servers") File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 254, in _list resp, body = self.api.client.get(url) File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 217, in get return self.request(url, 'GET', **kwargs) File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 80, in request raise exceptions.from_response(resp, body, url, method) ClientException: Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77) clean_up ListServer: Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/osc_lib/shell.py", line 135, in run ret_val = super(OpenStackShell, self).run(argv) File "/usr/lib/python2.7/site-packages/cliff/app.py", line 279, in run result = self.run_subcommand(remainder) File "/usr/lib/python2.7/site-packages/osc_lib/shell.py", line 180, in run_subcommand ret_value = super(OpenStackShell, self).run_subcommand(argv) File "/usr/lib/python2.7/site-packages/cliff/app.py", line 400, in run_subcommand result = cmd.run(parsed_args) File "/usr/lib/python2.7/site-packages/osc_lib/command/command.py", line 41, in run return super(Command, self).run(parsed_args) File "/usr/lib/python2.7/site-packages/cliff/display.py", line 112, in run column_names, data = self.take_action(parsed_args) File "/usr/lib/python2.7/site-packages/openstackclient/compute/v2/server.py", line 947, in take_action limit=parsed_args.limit) File "/usr/lib/python2.7/site-packages/novaclient/v2/servers.py", line 861, in list "servers") File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 254, in _list resp, body = self.api.client.get(url) File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 217, in get return self.request(url, 'GET', **kwargs) File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 80, in request raise exceptions.from_response(resp, body, url, method) ClientException: Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77) END return value: 1" I don't know where the issue could be at. If someone has an idea, I'll be pleased to take it. Logs & Configs ============== And here the Nova.log : ": 1000, u'deleted_2': 0, u'deleted_1': 0, u'vm_state_1': 'soft-delete', u'project_id_1': u'5f2ab0226eb34ccebaa92b2bd650d6a3'}] 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last): 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters context) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 450, in do_execute 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters cursor.execute(statement, parameters) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 166, in execute 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters result = self._query(query) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 322, in _query 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters conn.query(q) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 841, in query 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters self._affected_rows = self._read_query_result(unbuffered=unbuffered) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1029, in _read_query_result 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters result.read() 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1312, in read 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters first_packet = self.connection._read_packet() 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 991, in _read_packet 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters packet.check_error() 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 393, in check_error 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters err.raise_mysql_exception(self._data) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 107, in raise_mysql_exception 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters raise errorclass(errno, errval) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1, u"Can't create/write to file '/tmp/#sql_4038_1.MAI' (Errcode: 2)") 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions [req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 392a9afe7aca4957b4aac919db1bf29c 5f2ab0226eb34ccebaa92b2bd650d6a3 - default default] Exception inattendue dans la méthode API 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions Traceback (most recent call last): 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 338, in wrapped 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 181, in wrapper 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 181, in wrapper 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 214, in detail 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions servers = self._get_servers(req, is_detail=True) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 357, in _get_servers 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions sort_keys=sort_keys, sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 2477, in get_all 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 2620, in _get_instances_by_filters 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions expected_attrs=fields, sort_keys=sort_keys, sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions result = fn(cls, context, *args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/objects/instance.py", line 1220, in get_by_filters 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions use_slave=use_slave, sort_keys=sort_keys, sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 236, in wrapper 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/objects/instance.py", line 1204, in _get_by_filters_impl 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions sort_keys=sort_keys, sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/db/api.py", line 763, in instance_get_all_by_filters_sort 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 180, in wrapper 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 281, in wrapped 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return f(context, *args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 2262, in instance_get_all_by_filters_sort 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return _instances_fill_metadata(context, query_prefix.all(), manual_joins) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2588, in all 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return list(self) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2736, in __iter__ 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return self._execute_and_instances(context) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions result = conn.execute(querycontext.statement, self._params) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 914, in execute 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return meth(self, multiparams, params) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return connection._execute_clauseelement(self, multiparams, params) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions compiled_sql, distilled_params 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions context) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions util.raise_from_cause(newraise, exc_info) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions reraise(type(exception), exception, tb=exc_tb) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions context) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 450, in do_execute 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions cursor.execute(statement, parameters) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 166, in execute 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions result = self._query(query) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 322, in _query 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions conn.query(q) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 841, in query 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions self._affected_rows = self._read_query_result(unbuffered=unbuffered) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1029, in _read_query_result 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions result.read() 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1312, in read 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions first_packet = self.connection._read_packet() 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 991, in _read_packet 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions packet.check_error() 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 393, in check_error 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions err.raise_mysql_exception(self._data) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 107, in raise_mysql_exception 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions raise errorclass(errno, errval) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions DBError: (pymysql.err.InternalError) (1, u"Can't create/write to file '/tmp/#sql_4038_1.MAI' (Errcode: 2)") [SQL: u'SELECT anon_1.instances_created_at AS anon_1_instances_created_at, anon_1.instances_updated_at AS anon_1_instances_updated_at, anon_1.instances_deleted_at AS anon_1_instances_deleted_at, anon_1.instances_deleted AS anon_1_instances_deleted, anon_1.instances_id AS anon_1_instances_id, anon_1.instances_user_id AS anon_1_instances_user_id, anon_1.instances_project_id AS anon_1_instances_project_id, anon_1.instances_image_ref AS anon_1_instances_image_ref, anon_1.instances_kernel_id AS anon_1_instances_kernel_id, anon_1.instances_ramdisk_id AS anon_1_instances_ramdisk_id, anon_1.instances_hostname AS anon_1_instances_hostname, anon_1.instances_launch_index AS anon_1_instances_launch_index, anon_1.instances_key_name AS anon_1_instances_key_name, anon_1.instances_key_data AS anon_1_instances_key_data, anon_1.instances_power_state AS anon_1_instances_power_state, anon_1.instances_vm_state AS anon_1_instances_vm_state, anon_1.instances_task_state AS anon_1_instances_task_state, anon_1.instances_memory_mb AS anon_1_instances_memory_mb, anon_1.instances_vcpus AS anon_1_instances_vcpus, anon_1.instances_root_gb AS anon_1_instances_root_gb, anon_1.instances_ephemeral_gb AS anon_1_instances_ephemeral_gb, anon_1.instances_ephemeral_key_uuid AS anon_1_instances_ephemeral_key_uuid, anon_1.instances_host AS anon_1_instances_host, anon_1.instances_node AS anon_1_instances_node, anon_1.instances_instance_type_id AS anon_1_instances_instance_type_id, anon_1.instances_user_data AS anon_1_instances_user_data, anon_1.instances_reservation_id AS anon_1_instances_reservation_id, anon_1.instances_launched_at AS anon_1_instances_launched_at, anon_1.instances_terminated_at AS anon_1_instances_terminated_at, anon_1.instances_availability_zone AS anon_1_instances_availability_zone, anon_1.instances_display_name AS anon_1_instances_display_name, anon_1.instances_display_description AS anon_1_instances_display_description, anon_1.instances_launched_on AS anon_1_instances_launched_on, anon_1.instances_locked AS anon_1_instances_locked, anon_1.instances_locked_by AS anon_1_instances_locked_by, anon_1.instances_os_type AS anon_1_instances_os_type, anon_1.instances_architecture AS anon_1_instances_architecture, anon_1.instances_vm_mode AS anon_1_instances_vm_mode, anon_1.instances_uuid AS anon_1_instances_uuid, anon_1.instances_root_device_name AS anon_1_instances_root_device_name, anon_1.instances_default_ephemeral_device AS anon_1_instances_default_ephemeral_device, anon_1.instances_default_swap_device AS anon_1_instances_default_swap_device, anon_1.instances_config_drive AS anon_1_instances_config_drive, anon_1.instances_access_ip_v4 AS anon_1_instances_access_ip_v4, anon_1.instances_access_ip_v6 AS anon_1_instances_access_ip_v6, anon_1.instances_auto_disk_config AS anon_1_instances_auto_disk_config, anon_1.instances_progress AS anon_1_instances_progress, anon_1.instances_shutdown_terminate AS anon_1_instances_shutdown_terminate, anon_1.instances_disable_terminate AS anon_1_instances_disable_terminate, anon_1.instances_cell_name AS anon_1_instances_cell_name, anon_1.instances_cleaned AS anon_1_instances_cleaned, instance_extra_1.flavor AS instance_extra_1_flavor, instance_extra_1.created_at AS instance_extra_1_created_at, instance_extra_1.updated_at AS instance_extra_1_updated_at, instance_extra_1.deleted_at AS instance_extra_1_deleted_at, instance_extra_1.deleted AS instance_extra_1_deleted, instance_extra_1.id AS instance_extra_1_id, instance_extra_1.instance_uuid AS instance_extra_1_instance_uuid, instance_info_caches_1.created_at AS instance_info_caches_1_created_at, instance_info_caches_1.updated_at AS instance_info_caches_1_updated_at, instance_info_caches_1.deleted_at AS instance_info_caches_1_deleted_at, instance_info_caches_1.deleted AS instance_info_caches_1_deleted, instance_info_caches_1.id AS instance_info_caches_1_id, instance_info_caches_1.network_info AS instance_info_caches_1_network_info, instance_info_caches_1.instance_uuid AS instance_info_caches_1_instance_uuid, security_groups_1.created_at AS security_groups_1_created_at, security_groups_1.updated_at AS security_groups_1_updated_at, security_groups_1.deleted_at AS security_groups_1_deleted_at, security_groups_1.deleted AS security_groups_1_deleted, security_groups_1.id AS security_groups_1_id, security_groups_1.name AS security_groups_1_name, security_groups_1.description AS security_groups_1_description, security_groups_1.user_id AS security_groups_1_user_id, security_groups_1.project_id AS security_groups_1_project_id, services_1.created_at AS services_1_created_at, services_1.updated_at AS services_1_updated_at, services_1.deleted_at AS services_1_deleted_at, services_1.deleted AS services_1_deleted, services_1.id AS services_1_id, services_1.host AS services_1_host, services_1.`binary` AS services_1_binary, services_1.topic AS services_1_topic, services_1.report_count AS services_1_report_count, services_1.disabled AS services_1_disabled, services_1.disabled_reason AS services_1_disabled_reason, services_1.last_seen_up AS services_1_last_seen_up, services_1.forced_down AS services_1_forced_down, services_1.version AS services_1_version \nFROM (SELECT instances.created_at AS instances_created_at, instances.updated_at AS instances_updated_at, instances.deleted_at AS instances_deleted_at, instances.deleted AS instances_deleted, instances.id AS instances_id, instances.user_id AS instances_user_id, instances.project_id AS instances_project_id, instances.image_ref AS instances_image_ref, instances.kernel_id AS instances_kernel_id, instances.ramdisk_id AS instances_ramdisk_id, instances.hostname AS instances_hostname, instances.launch_index AS instances_launch_index, instances.key_name AS instances_key_name, instances.key_data AS instances_key_data, instances.power_state AS instances_power_state, instances.vm_state AS instances_vm_state, instances.task_state AS instances_task_state, instances.memory_mb AS instances_memory_mb, instances.vcpus AS instances_vcpus, instances.root_gb AS instances_root_gb, instances.ephemeral_gb AS instances_ephemeral_gb, instances.ephemeral_key_uuid AS instances_ephemeral_key_uuid, instances.host AS instances_host, instances.node AS instances_node, instances.instance_type_id AS instances_instance_type_id, instances.user_data AS instances_user_data, instances.reservation_id AS instances_reservation_id, instances.launched_at AS instances_launched_at, instances.terminated_at AS instances_terminated_at, instances.availability_zone AS instances_availability_zone, instances.display_name AS instances_display_name, instances.display_description AS instances_display_description, instances.launched_on AS instances_launched_on, instances.locked AS instances_locked, instances.locked_by AS instances_locked_by, instances.os_type AS instances_os_type, instances.architecture AS instances_architecture, instances.vm_mode AS instances_vm_mode, instances.uuid AS instances_uuid, instances.root_device_name AS instances_root_device_name, instances.default_ephemeral_device AS instances_default_ephemeral_device, instances.default_swap_device AS instances_default_swap_device, instances.config_drive AS instances_config_drive, instances.access_ip_v4 AS instances_access_ip_v4, instances.access_ip_v6 AS instances_access_ip_v6, instances.auto_disk_config AS instances_auto_disk_config, instances.progress AS instances_progress, instances.shutdown_terminate AS instances_shutdown_terminate, instances.disable_terminate AS instances_disable_terminate, instances.cell_name AS instances_cell_name, instances.cleaned AS instances_cleaned \nFROM instances \nWHERE instances.deleted = %(deleted_1)s AND (instances.vm_state != %(vm_state_1)s OR instances.vm_state IS NULL) AND instances.project_id = %(project_id_1)s ORDER BY instances.created_at DESC, instances.id DESC \n LIMIT %(param_1)s) AS anon_1 LEFT OUTER JOIN instance_extra AS instance_extra_1 ON instance_extra_1.instance_uuid = anon_1.instances_uuid LEFT OUTER JOIN instance_info_caches AS instance_info_caches_1 ON instance_info_caches_1.instance_uuid = anon_1.instances_uuid LEFT OUTER JOIN (security_group_instance_association AS security_group_instance_association_1 INNER JOIN security_groups AS security_groups_1 ON security_groups_1.id = security_group_instance_association_1.security_group_id AND security_group_instance_association_1.deleted = %(deleted_2)s AND security_groups_1.deleted = %(deleted_3)s) ON security_group_instance_association_1.instance_uuid = anon_1.instances_uuid AND anon_1.instances_deleted = %(deleted_4)s LEFT OUTER JOIN services AS services_1 ON services_1.host = anon_1.instances_host AND services_1.`binary` = %(binary_1)s AND anon_1.instances_deleted = %(deleted_5)s ORDER BY anon_1.instances_created_at DESC, anon_1.instances_id DESC'] [parameters: {u'binary_1': 'nova-compute', u'deleted_3': 0, u'deleted_5': 0, u'deleted_4': 0, u'param_1': 1000, u'deleted_2': 0, u'deleted_1': 0, u'vm_state_1': 'soft-delete', u'project_id_1': u'5f2ab0226eb34ccebaa92b2bd650d6a3'}] 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions 2018-05-09 16:29:33.281 11031 INFO nova.api.openstack.wsgi [req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 392a9afe7aca4957b4aac919db1bf29c 5f2ab0226eb34ccebaa92b2bd650d6a3 - default default] Exception HTTP générée : Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> 2018-05-09 16:29:33.282 11031 DEBUG nova.api.openstack.wsgi [req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 392a9afe7aca4957b4aac919db1bf29c 5f2ab0226eb34ccebaa92b2bd650d6a3 - default default] Returning 500 to user: Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> __call__ /usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py:1039 2018-05-09 16:29:33.284 11031 INFO nova.osapi_compute.wsgi.server [req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 392a9afe7aca4957b4aac919db1bf29c 5f2ab0226eb34ccebaa92b2bd650d6a3 - default default] 192.168.24.1 "GET /v2.1/servers/detail HTTP/1.1" status: 500 len: 563 time: 0.4968269 " Advance thanks, ** Affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1770177 Title: <class 'oslo_db.exception.DBError'> Status in OpenStack Compute (nova): New Bug description: Description =========== Hello, I've got an issue regarding undercloud when I execute the command " Openstack server list". Environment =========== I'm working in Red Hat openstack Plateform 11 environment Steps to reproduce ================== I did "openstack server list" but it's returned me this : "Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-444677f3-9944-4522-a67c-865cea7d33b4)" Then i Did the same command with "--debug" and here the result : START with options: [u'server', u'list', u'--debug'] options: Namespace(access_key='', access_secret='***', access_token='***', access_token_endpoint='', access_token_type='', aodh_endpoint='', auth_type='password', auth_url='https://172.16.138.161:13000/v2.0', cacert=None, cert='', client_id='', client_secret='***', cloud='', code='', consumer_key='', consumer_secret='***', debug=True, default_domain='default', default_domain_id='', default_domain_name='', deferred_help=False, discovery_endpoint='', domain_id='', domain_name='', endpoint='', glare_url='', identity_provider='', identity_provider_url='', insecure=None, inspector_api_version='1', inspector_url=None, interface='', key='', log_file=None, murano_packages_service='murano', murano_url='', old_profile=None, openid_scope='', os_alarming_api_version='2', os_application_catalog_api_version='1', os_baremetal_api_version='1.29', os_beta_command=False, os_compute_api_version='', os_container_infra_api_version='1', os_data_processing_api_version='1.1', os_data_processing_url='', os_database_api_version='1', os_dns_api_version='2', os_identity_api_version='', os_image_api_version='', os_key_manager_api_version='1', os_metrics_api_version='1', os_network_api_version='', os_object_api_version='', os_orchestration_api_version='1', os_project_id=None, os_project_name=None, os_queues_api_version='2', os_tripleoclient_api_version='1', os_volume_api_version='', os_workflow_api_version='2', passcode='', password='***', profile=None, project_domain_id='', project_domain_name='', project_id='', project_name='admin', protocol='', redirect_uri='', region_name='', roles='', timing=False, token='***', trust_id='', url='', user='', user_domain_id='', user_domain_name='', user_id='', username='admin', verbose_level=3, verify=None) Auth plugin password selected auth_config_hook(): {'auth_type': 'password', 'beta_command': False, 'tripleoclient_api_version': '1', u'compute_api_version': u'2', 'key': None, u'database_api_version': '1', 'metrics_api_version': '1', 'data_processing_api_version': '1.1', 'inspector_api_version': '1', 'auth_url': 'https://172.16.138.161:13000/v2.0', u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', 'networks': [], u'image_api_version': u'2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'username': 'admin', u'container_infra_api_version': '1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': '1.29', 'queues_api_version': '2', 'auth': {'project_name': 'admin'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'password': '***', u'application_catalog_api_version': '1', 'murano_packages_service': 'murano', 'cacert': None, u'key_manager_api_version': '1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': u'2.0', 'workflow_api_version': '2', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'status': u'active', 'alarming_api_version': '2', 'debug': True, u'interface': None, u'disable_vendor_agent': {}} defaults: {u'auth_type': 'password', u'status': u'active', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', u'key_manager_api_version': u'v1', 'verify': True, u'identity_api_version': u'2.0', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': None, u'disable_vendor_agent': {}} cloud cfg: {'auth_type': 'password', 'beta_command': False, 'tripleoclient_api_version': '1', u'compute_api_version': u'2', 'key': None, u'database_api_version': '1', 'metrics_api_version': '1', 'data_processing_api_version': '1.1', 'inspector_api_version': '1', 'auth_url': 'https://172.16.138.161:13000/v2.0', u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', 'networks': [], u'image_api_version': u'2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'username': 'admin', u'container_infra_api_version': '1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': '1.29', 'queues_api_version': '2', 'auth': {'project_name': 'admin'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'password': '***', u'application_catalog_api_version': '1', 'murano_packages_service': 'murano', 'cacert': None, u'key_manager_api_version': '1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': u'2.0', 'workflow_api_version': '2', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'status': u'active', 'alarming_api_version': '2', 'debug': True, u'interface': None, u'disable_vendor_agent': {}} compute API version 2, cmd group openstack.compute.v2 network API version 2, cmd group openstack.network.v2 image API version 2, cmd group openstack.image.v2 volume API version 2, cmd group openstack.volume.v2 identity API version 2.0, cmd group openstack.identity.v2 object_store API version 1, cmd group openstack.object_store.v1 metric API version 1, cmd group openstack.metric.v1 messaging API version 2, cmd group openstack.messaging.v2 neutronclient API version 2, cmd group openstack.neutronclient.v2 orchestration API version 1, cmd group openstack.orchestration.v1 alarming API version 2, cmd group openstack.alarming.v2 dns API version 2, cmd group openstack.dns.v2 key_manager API version 1, cmd group openstack.key_manager.v1 container_infra API version 1, cmd group openstack.container_infra.v1 baremetal API version 1.29, cmd group openstack.baremetal.v1 workflow_engine API version 2, cmd group openstack.workflow_engine.v2 baremetal_introspection API version 1, cmd group openstack.baremetal_introspection.v1 database API version 1, cmd group openstack.database.v1 application_catalog API version 1, cmd group openstack.application_catalog.v1 tripleoclient API version 1, cmd group openstack.tripleoclient.v1 data_processing API version 1.1, cmd group openstack.data_processing.v1 Auth plugin password selected auth_config_hook(): {'auth_type': 'password', 'beta_command': False, 'tripleoclient_api_version': '1', u'compute_api_version': u'2', 'key': None, u'database_api_version': '1', 'metrics_api_version': '1', 'data_processing_api_version': '1.1', 'inspector_api_version': '1', 'auth_url': 'https://172.16.138.161:13000/v2.0', u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', 'networks': [], u'image_api_version': u'2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'username': 'admin', u'container_infra_api_version': '1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': '1.29', 'queues_api_version': '2', 'auth': {'project_name': 'admin'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'password': '***', u'application_catalog_api_version': '1', 'murano_packages_service': 'murano', 'cacert': None, u'key_manager_api_version': '1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': u'2.0', 'workflow_api_version': '2', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'status': u'active', 'alarming_api_version': '2', 'debug': True, u'interface': None, u'disable_vendor_agent': {}} Auth plugin password selected auth_config_hook(): {'auth_type': 'password', 'beta_command': False, 'tripleoclient_api_version': '1', u'compute_api_version': u'2', 'key': None, u'database_api_version': '1', 'metrics_api_version': '1', 'data_processing_api_version': '1.1', 'inspector_api_version': '1', 'auth_url': 'https://172.16.138.161:13000/v2.0', u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', 'networks': [], u'image_api_version': u'2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'username': 'admin', u'container_infra_api_version': '1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': '1.29', 'queues_api_version': '2', 'auth': {'project_name': 'admin'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'password': '***', u'application_catalog_api_version': '1', 'murano_packages_service': 'murano', 'cacert': None, u'key_manager_api_version': '1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': u'2.0', 'workflow_api_version': '2', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'status': u'active', 'alarming_api_version': '2', 'debug': True, u'interface': None, u'disable_vendor_agent': {}} command: server list -> openstackclient.compute.v2.server.ListServer Auth plugin password selected auth_config_hook(): {'auth_type': 'password', 'beta_command': False, 'tripleoclient_api_version': '1', u'compute_api_version': u'2', 'key': None, u'database_api_version': '1', 'metrics_api_version': '1', 'data_processing_api_version': '1.1', 'inspector_api_version': '1', 'auth_url': 'https://172.16.138.161:13000/v2.0', u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', 'networks': [], u'image_api_version': u'2', 'verify': True, u'dns_api_version': '2', u'object_store_api_version': u'1', 'username': 'admin', u'container_infra_api_version': '1', 'verbose_level': 3, 'region_name': '', 'api_timeout': None, u'baremetal_api_version': '1.29', 'queues_api_version': '2', 'auth': {'project_name': 'admin'}, 'default_domain': 'default', u'container_api_version': u'1', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': '1', 'timing': False, 'password': '***', u'application_catalog_api_version': '1', 'murano_packages_service': 'murano', 'cacert': None, u'key_manager_api_version': '1', u'metering_api_version': u'2', 'deferred_help': False, u'identity_api_version': u'2.0', 'workflow_api_version': '2', u'volume_api_version': u'2', 'cert': None, u'secgroup_source': u'neutron', u'status': u'active', 'alarming_api_version': '2', 'debug': True, u'interface': None, u'disable_vendor_agent': {}} Using auth plugin: password Using parameters {'username': 'admin', 'password': '***', 'project_name': 'admin', 'auth_url': 'https://172.16.138.161:13000/v2.0'} Get auth_ref REQ: curl -g -i -X GET https://172.16.138.161:13000/v2.0 -H "Accept: application/json" -H "User-Agent: osc-lib/1.3.0 keystoneauth1/2.18.0 python-requests/2.11.1 CPython/2.7.5" Starting new HTTPS connection (1): 172.16.138.161 "GET /v2.0 HTTP/1.1" 200 233 RESP: [200] Date: Wed, 09 May 2018 14:29:31 GMT Server: Apache Vary: X-Auth-Token,Accept-Encoding x-openstack-request-id: req-08d0b083-c5b2-4582-b077-28a0a08375d9 Content-Encoding: gzip Content-Length: 233 Content-Type: application/json RESP BODY: {"version": {"status": "deprecated", "updated": "2016-08-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}], "id": "v2.0", "links": [{"href": "https://172.16.138.161:13000/v2.0/", "rel": "self"}, {"href": "https://docs.openstack.org/", "type": "text/html", "rel": "describedby"}]}} GET call to None for https://172.16.138.161:13000/v2.0 used request id req-08d0b083-c5b2-4582-b077-28a0a08375d9 Making authentication request to https://172.16.138.161:13000/v2.0/tokens "POST /v2.0/tokens HTTP/1.1" 200 1460 run(Namespace(all_projects=False, changes_since=None, columns=[], deleted=False, flavor=None, formatter='table', host=None, image=None, instance_name=None, ip=None, ip6=None, limit=None, long=False, marker=None, max_width=0, name=None, noindent=False, print_empty=False, project=None, project_domain=None, quote_mode='nonnumeric', reservation_id=None, status=None, user=None, user_domain=None)) Instantiating compute client for API Version Major: 2, Minor: 0 Instantiating identity client: <class 'openstackclient.identity.client.IdentityClientv2'> Instantiating image client: <class 'glanceclient.v2.client.Client'> Making authentication request to https://172.16.138.161:13000/v2.0/tokens "POST /v2.0/tokens HTTP/1.1" 200 1465 Instantiating image api: <class 'openstackclient.api.image_v2.APIv2'> search options: {'status': None, 'deleted': False, 'ip': None, 'image': None, 'host': None, 'ip6': None, 'all_tenants': False, 'flavor': None, 'reservation_id': None, 'user_id': None, 'name': None, 'tenant_id': None, 'instance_name': None, 'changes_since': None} REQ: curl -g -i -X GET https://172.16.138.161:13774/v2.1/servers/detail -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}0f63ee03c939dea9d64f5e42e1cab4eeab1edaa3" Starting new HTTPS connection (1): 172.16.138.161 "GET /v2.1/servers/detail HTTP/1.1" 500 220 RESP: [500] Openstack-Api-Version: compute 2.1 X-Openstack-Nova-Api-Version: 2.1 Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version Content-Type: application/json; charset=UTF-8 Content-Length: 220 X-Compute-Request-Id: req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 Date: Wed, 09 May 2018 14:29:33 GMT RESP BODY: {"computeFault": {"message": "Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible.\n<class 'oslo_db.exception.DBError'>", "code": 500}} GET call to compute for https://172.16.138.161:13774/v2.1/servers/detail used request id req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/cliff/app.py", line 400, in run_subcommand result = cmd.run(parsed_args) File "/usr/lib/python2.7/site-packages/osc_lib/command/command.py", line 41, in run return super(Command, self).run(parsed_args) File "/usr/lib/python2.7/site-packages/cliff/display.py", line 112, in run column_names, data = self.take_action(parsed_args) File "/usr/lib/python2.7/site-packages/openstackclient/compute/v2/server.py", line 947, in take_action limit=parsed_args.limit) File "/usr/lib/python2.7/site-packages/novaclient/v2/servers.py", line 861, in list "servers") File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 254, in _list resp, body = self.api.client.get(url) File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 217, in get return self.request(url, 'GET', **kwargs) File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 80, in request raise exceptions.from_response(resp, body, url, method) ClientException: Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77) clean_up ListServer: Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/osc_lib/shell.py", line 135, in run ret_val = super(OpenStackShell, self).run(argv) File "/usr/lib/python2.7/site-packages/cliff/app.py", line 279, in run result = self.run_subcommand(remainder) File "/usr/lib/python2.7/site-packages/osc_lib/shell.py", line 180, in run_subcommand ret_value = super(OpenStackShell, self).run_subcommand(argv) File "/usr/lib/python2.7/site-packages/cliff/app.py", line 400, in run_subcommand result = cmd.run(parsed_args) File "/usr/lib/python2.7/site-packages/osc_lib/command/command.py", line 41, in run return super(Command, self).run(parsed_args) File "/usr/lib/python2.7/site-packages/cliff/display.py", line 112, in run column_names, data = self.take_action(parsed_args) File "/usr/lib/python2.7/site-packages/openstackclient/compute/v2/server.py", line 947, in take_action limit=parsed_args.limit) File "/usr/lib/python2.7/site-packages/novaclient/v2/servers.py", line 861, in list "servers") File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 254, in _list resp, body = self.api.client.get(url) File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 217, in get return self.request(url, 'GET', **kwargs) File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 80, in request raise exceptions.from_response(resp, body, url, method) ClientException: Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> (HTTP 500) (Request-ID: req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77) END return value: 1" I don't know where the issue could be at. If someone has an idea, I'll be pleased to take it. Logs & Configs ============== And here the Nova.log : ": 1000, u'deleted_2': 0, u'deleted_1': 0, u'vm_state_1': 'soft-delete', u'project_id_1': u'5f2ab0226eb34ccebaa92b2bd650d6a3'}] 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last): 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters context) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 450, in do_execute 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters cursor.execute(statement, parameters) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 166, in execute 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters result = self._query(query) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 322, in _query 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters conn.query(q) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 841, in query 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters self._affected_rows = self._read_query_result(unbuffered=unbuffered) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1029, in _read_query_result 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters result.read() 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1312, in read 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters first_packet = self.connection._read_packet() 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 991, in _read_packet 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters packet.check_error() 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 393, in check_error 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters err.raise_mysql_exception(self._data) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 107, in raise_mysql_exception 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters raise errorclass(errno, errval) 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1, u"Can't create/write to file '/tmp/#sql_4038_1.MAI' (Errcode: 2)") 2018-05-09 16:29:33.275 11031 ERROR oslo_db.sqlalchemy.exc_filters 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions [req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 392a9afe7aca4957b4aac919db1bf29c 5f2ab0226eb34ccebaa92b2bd650d6a3 - default default] Exception inattendue dans la méthode API 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions Traceback (most recent call last): 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 338, in wrapped 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 181, in wrapper 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 181, in wrapper 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return func(*args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 214, in detail 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions servers = self._get_servers(req, is_detail=True) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 357, in _get_servers 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions sort_keys=sort_keys, sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 2477, in get_all 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 2620, in _get_instances_by_filters 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions expected_attrs=fields, sort_keys=sort_keys, sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions result = fn(cls, context, *args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/objects/instance.py", line 1220, in get_by_filters 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions use_slave=use_slave, sort_keys=sort_keys, sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 236, in wrapper 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/objects/instance.py", line 1204, in _get_by_filters_impl 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions sort_keys=sort_keys, sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/db/api.py", line 763, in instance_get_all_by_filters_sort 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions sort_dirs=sort_dirs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 180, in wrapper 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return f(*args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 281, in wrapped 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return f(context, *args, **kwargs) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 2262, in instance_get_all_by_filters_sort 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return _instances_fill_metadata(context, query_prefix.all(), manual_joins) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2588, in all 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return list(self) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2736, in __iter__ 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return self._execute_and_instances(context) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions result = conn.execute(querycontext.statement, self._params) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 914, in execute 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return meth(self, multiparams, params) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions return connection._execute_clauseelement(self, multiparams, params) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions compiled_sql, distilled_params 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions context) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions util.raise_from_cause(newraise, exc_info) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions reraise(type(exception), exception, tb=exc_tb) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions context) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 450, in do_execute 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions cursor.execute(statement, parameters) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 166, in execute 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions result = self._query(query) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 322, in _query 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions conn.query(q) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 841, in query 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions self._affected_rows = self._read_query_result(unbuffered=unbuffered) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1029, in _read_query_result 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions result.read() 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1312, in read 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions first_packet = self.connection._read_packet() 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 991, in _read_packet 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions packet.check_error() 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 393, in check_error 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions err.raise_mysql_exception(self._data) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/pymysql/err.py", line 107, in raise_mysql_exception 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions raise errorclass(errno, errval) 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions DBError: (pymysql.err.InternalError) (1, u"Can't create/write to file '/tmp/#sql_4038_1.MAI' (Errcode: 2)") [SQL: u'SELECT anon_1.instances_created_at AS anon_1_instances_created_at, anon_1.instances_updated_at AS anon_1_instances_updated_at, anon_1.instances_deleted_at AS anon_1_instances_deleted_at, anon_1.instances_deleted AS anon_1_instances_deleted, anon_1.instances_id AS anon_1_instances_id, anon_1.instances_user_id AS anon_1_instances_user_id, anon_1.instances_project_id AS anon_1_instances_project_id, anon_1.instances_image_ref AS anon_1_instances_image_ref, anon_1.instances_kernel_id AS anon_1_instances_kernel_id, anon_1.instances_ramdisk_id AS anon_1_instances_ramdisk_id, anon_1.instances_hostname AS anon_1_instances_hostname, anon_1.instances_launch_index AS anon_1_instances_launch_index, anon_1.instances_key_name AS anon_1_instances_key_name, anon_1.instances_key_data AS anon_1_instances_key_data, anon_1.instances_power_state AS anon_1_instances_power_state, anon_1.instances_vm_state AS anon_1_instances_vm_state, anon_1.instances_task_state AS anon_1_instances_task_state, anon_1.instances_memory_mb AS anon_1_instances_memory_mb, anon_1.instances_vcpus AS anon_1_instances_vcpus, anon_1.instances_root_gb AS anon_1_instances_root_gb, anon_1.instances_ephemeral_gb AS anon_1_instances_ephemeral_gb, anon_1.instances_ephemeral_key_uuid AS anon_1_instances_ephemeral_key_uuid, anon_1.instances_host AS anon_1_instances_host, anon_1.instances_node AS anon_1_instances_node, anon_1.instances_instance_type_id AS anon_1_instances_instance_type_id, anon_1.instances_user_data AS anon_1_instances_user_data, anon_1.instances_reservation_id AS anon_1_instances_reservation_id, anon_1.instances_launched_at AS anon_1_instances_launched_at, anon_1.instances_terminated_at AS anon_1_instances_terminated_at, anon_1.instances_availability_zone AS anon_1_instances_availability_zone, anon_1.instances_display_name AS anon_1_instances_display_name, anon_1.instances_display_description AS anon_1_instances_display_description, anon_1.instances_launched_on AS anon_1_instances_launched_on, anon_1.instances_locked AS anon_1_instances_locked, anon_1.instances_locked_by AS anon_1_instances_locked_by, anon_1.instances_os_type AS anon_1_instances_os_type, anon_1.instances_architecture AS anon_1_instances_architecture, anon_1.instances_vm_mode AS anon_1_instances_vm_mode, anon_1.instances_uuid AS anon_1_instances_uuid, anon_1.instances_root_device_name AS anon_1_instances_root_device_name, anon_1.instances_default_ephemeral_device AS anon_1_instances_default_ephemeral_device, anon_1.instances_default_swap_device AS anon_1_instances_default_swap_device, anon_1.instances_config_drive AS anon_1_instances_config_drive, anon_1.instances_access_ip_v4 AS anon_1_instances_access_ip_v4, anon_1.instances_access_ip_v6 AS anon_1_instances_access_ip_v6, anon_1.instances_auto_disk_config AS anon_1_instances_auto_disk_config, anon_1.instances_progress AS anon_1_instances_progress, anon_1.instances_shutdown_terminate AS anon_1_instances_shutdown_terminate, anon_1.instances_disable_terminate AS anon_1_instances_disable_terminate, anon_1.instances_cell_name AS anon_1_instances_cell_name, anon_1.instances_cleaned AS anon_1_instances_cleaned, instance_extra_1.flavor AS instance_extra_1_flavor, instance_extra_1.created_at AS instance_extra_1_created_at, instance_extra_1.updated_at AS instance_extra_1_updated_at, instance_extra_1.deleted_at AS instance_extra_1_deleted_at, instance_extra_1.deleted AS instance_extra_1_deleted, instance_extra_1.id AS instance_extra_1_id, instance_extra_1.instance_uuid AS instance_extra_1_instance_uuid, instance_info_caches_1.created_at AS instance_info_caches_1_created_at, instance_info_caches_1.updated_at AS instance_info_caches_1_updated_at, instance_info_caches_1.deleted_at AS instance_info_caches_1_deleted_at, instance_info_caches_1.deleted AS instance_info_caches_1_deleted, instance_info_caches_1.id AS instance_info_caches_1_id, instance_info_caches_1.network_info AS instance_info_caches_1_network_info, instance_info_caches_1.instance_uuid AS instance_info_caches_1_instance_uuid, security_groups_1.created_at AS security_groups_1_created_at, security_groups_1.updated_at AS security_groups_1_updated_at, security_groups_1.deleted_at AS security_groups_1_deleted_at, security_groups_1.deleted AS security_groups_1_deleted, security_groups_1.id AS security_groups_1_id, security_groups_1.name AS security_groups_1_name, security_groups_1.description AS security_groups_1_description, security_groups_1.user_id AS security_groups_1_user_id, security_groups_1.project_id AS security_groups_1_project_id, services_1.created_at AS services_1_created_at, services_1.updated_at AS services_1_updated_at, services_1.deleted_at AS services_1_deleted_at, services_1.deleted AS services_1_deleted, services_1.id AS services_1_id, services_1.host AS services_1_host, services_1.`binary` AS services_1_binary, services_1.topic AS services_1_topic, services_1.report_count AS services_1_report_count, services_1.disabled AS services_1_disabled, services_1.disabled_reason AS services_1_disabled_reason, services_1.last_seen_up AS services_1_last_seen_up, services_1.forced_down AS services_1_forced_down, services_1.version AS services_1_version \nFROM (SELECT instances.created_at AS instances_created_at, instances.updated_at AS instances_updated_at, instances.deleted_at AS instances_deleted_at, instances.deleted AS instances_deleted, instances.id AS instances_id, instances.user_id AS instances_user_id, instances.project_id AS instances_project_id, instances.image_ref AS instances_image_ref, instances.kernel_id AS instances_kernel_id, instances.ramdisk_id AS instances_ramdisk_id, instances.hostname AS instances_hostname, instances.launch_index AS instances_launch_index, instances.key_name AS instances_key_name, instances.key_data AS instances_key_data, instances.power_state AS instances_power_state, instances.vm_state AS instances_vm_state, instances.task_state AS instances_task_state, instances.memory_mb AS instances_memory_mb, instances.vcpus AS instances_vcpus, instances.root_gb AS instances_root_gb, instances.ephemeral_gb AS instances_ephemeral_gb, instances.ephemeral_key_uuid AS instances_ephemeral_key_uuid, instances.host AS instances_host, instances.node AS instances_node, instances.instance_type_id AS instances_instance_type_id, instances.user_data AS instances_user_data, instances.reservation_id AS instances_reservation_id, instances.launched_at AS instances_launched_at, instances.terminated_at AS instances_terminated_at, instances.availability_zone AS instances_availability_zone, instances.display_name AS instances_display_name, instances.display_description AS instances_display_description, instances.launched_on AS instances_launched_on, instances.locked AS instances_locked, instances.locked_by AS instances_locked_by, instances.os_type AS instances_os_type, instances.architecture AS instances_architecture, instances.vm_mode AS instances_vm_mode, instances.uuid AS instances_uuid, instances.root_device_name AS instances_root_device_name, instances.default_ephemeral_device AS instances_default_ephemeral_device, instances.default_swap_device AS instances_default_swap_device, instances.config_drive AS instances_config_drive, instances.access_ip_v4 AS instances_access_ip_v4, instances.access_ip_v6 AS instances_access_ip_v6, instances.auto_disk_config AS instances_auto_disk_config, instances.progress AS instances_progress, instances.shutdown_terminate AS instances_shutdown_terminate, instances.disable_terminate AS instances_disable_terminate, instances.cell_name AS instances_cell_name, instances.cleaned AS instances_cleaned \nFROM instances \nWHERE instances.deleted = %(deleted_1)s AND (instances.vm_state != %(vm_state_1)s OR instances.vm_state IS NULL) AND instances.project_id = %(project_id_1)s ORDER BY instances.created_at DESC, instances.id DESC \n LIMIT %(param_1)s) AS anon_1 LEFT OUTER JOIN instance_extra AS instance_extra_1 ON instance_extra_1.instance_uuid = anon_1.instances_uuid LEFT OUTER JOIN instance_info_caches AS instance_info_caches_1 ON instance_info_caches_1.instance_uuid = anon_1.instances_uuid LEFT OUTER JOIN (security_group_instance_association AS security_group_instance_association_1 INNER JOIN security_groups AS security_groups_1 ON security_groups_1.id = security_group_instance_association_1.security_group_id AND security_group_instance_association_1.deleted = %(deleted_2)s AND security_groups_1.deleted = %(deleted_3)s) ON security_group_instance_association_1.instance_uuid = anon_1.instances_uuid AND anon_1.instances_deleted = %(deleted_4)s LEFT OUTER JOIN services AS services_1 ON services_1.host = anon_1.instances_host AND services_1.`binary` = %(binary_1)s AND anon_1.instances_deleted = %(deleted_5)s ORDER BY anon_1.instances_created_at DESC, anon_1.instances_id DESC'] [parameters: {u'binary_1': 'nova-compute', u'deleted_3': 0, u'deleted_5': 0, u'deleted_4': 0, u'param_1': 1000, u'deleted_2': 0, u'deleted_1': 0, u'vm_state_1': 'soft-delete', u'project_id_1': u'5f2ab0226eb34ccebaa92b2bd650d6a3'}] 2018-05-09 16:29:33.278 11031 ERROR nova.api.openstack.extensions 2018-05-09 16:29:33.281 11031 INFO nova.api.openstack.wsgi [req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 392a9afe7aca4957b4aac919db1bf29c 5f2ab0226eb34ccebaa92b2bd650d6a3 - default default] Exception HTTP générée : Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> 2018-05-09 16:29:33.282 11031 DEBUG nova.api.openstack.wsgi [req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 392a9afe7aca4957b4aac919db1bf29c 5f2ab0226eb34ccebaa92b2bd650d6a3 - default default] Returning 500 to user: Erreur de l'API inattendue. Merci de la reporter sur http://bugs.launchpad.net/nova/ et d'y joindre le rapport de L'API Nova si possible. <class 'oslo_db.exception.DBError'> __call__ /usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py:1039 2018-05-09 16:29:33.284 11031 INFO nova.osapi_compute.wsgi.server [req-f866f3c9-3cc0-44dd-8d0f-70c465d6df77 392a9afe7aca4957b4aac919db1bf29c 5f2ab0226eb34ccebaa92b2bd650d6a3 - default default] 192.168.24.1 "GET /v2.1/servers/detail HTTP/1.1" status: 500 len: 563 time: 0.4968269 " Advance thanks, To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1770177/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp