Public bug reported: When boot a VM assign name and password, I have met a run-time error. In L3 agent configuration file I have enabled enable_metadata_proxy.
Trace info from l3-agent.log: 2014-08-18 16:56:11.971 3281 ERROR neutron.agent.linux.utils [req-3c9892ce-0d64-4cdd-ac27-dd8736076c18 None] Command: ['sudo', 'ip', 'netns', 'exec', 'qrouter-2123c965-410d-4dc0-ab3c-240c0969b525', 'neutron-ns-metadata-proxy', '--pid_file=/var/lib/neutron/external/pids/2123c965-410d-4dc0-ab3c-240c0969b525.pid', '--metadata_proxy_socket=/var/lib/neutron/metadata_proxy', '--router_id=2123c965-410d-4dc0-ab3c-240c0969b525', '--state_path=/var/lib/neutron', '--metadata_port=9697', '--verbose', '--log-file=neutron-ns-metadata-proxy-2123c965-410d-4dc0-ab3c-240c0969b525.log', '--log-dir=/var/log/neutron'] Exit code: 1 Stdout: '' Stderr: '2014-08-18 16:56:11.908 3861 INFO neutron.common.config [-] Logging enabled!\n2014-08-18 16:56:11.916 3861 ERROR neutron.agent.linux.daemon [-] Error while handling pidfile: /var/lib/neutron/external/pids/2123c965-410d-4dc0-ab3c-240c0969b525.pid\n2014-08-18 16:56:11.916 3861 TRACE neutron.agent.linux.daemon Traceback (most recent call last):\n2014-08-18 16:56:11.916 3861 TRACE neutron.agent.linux.daemon File "/usr/lib/python2.6/site-packages/neutron/agent/linux/daemon.py", line 37, in __init__\n2014-08-18 16:56:11.916 3861 TRACE neutron.agent.linux.daemon fcntl.flock(self.fd, fcntl.LOCK_EX | fcntl.LOCK_NB)\n2014-08-18 16:56:11.916 3861 TRACE neutron.agent.linux.daemon IOError: [Errno 11] Resource temporarily unavailable\n2014-08-18 16:56:11.916 3861 TRACE neutron.agent.linux.daemon \n' 2014-08-18 16:56:11.972 3281 ERROR neutron.agent.l3_agent [req-3c9892ce-0d64-4cdd-ac27-dd8736076c18 None] Failed synchronizing routers 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent Traceback (most recent call last): 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 879, in _sync_routers_task 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 812, in _process_routers 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent self._router_added(r['id'], r) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 368, in _router_added 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent self._spawn_metadata_proxy(ri.router_id, ri.ns_name) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 409, in _spawn_metadata_proxy 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent pm.enable(callback) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/linux/external_process.py", line 54, in enable 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent ip_wrapper.netns.execute(cmd) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 466, in execute 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent check_exit_code=check_exit_code) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 78, in execute 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent raise RuntimeError(m) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent RuntimeError: when spawn neutron-ns-metadata-proxy, using file-lock lock the pidfile which on behalf of router id is failed. But the router already exists when neutron-ns-metadata-proxy starts. ** Affects: neutron Importance: Undecided Status: New ** Summary changed: - Get VM metadata infomation by l3 agent, resource temporarily unavailable + Get VM metadata information by l3 agent, resource temporarily unavailable -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1361088 Title: Get VM metadata information by l3 agent, resource temporarily unavailable Status in OpenStack Neutron (virtual network service): New Bug description: When boot a VM assign name and password, I have met a run-time error. In L3 agent configuration file I have enabled enable_metadata_proxy. Trace info from l3-agent.log: 2014-08-18 16:56:11.971 3281 ERROR neutron.agent.linux.utils [req-3c9892ce-0d64-4cdd-ac27-dd8736076c18 None] Command: ['sudo', 'ip', 'netns', 'exec', 'qrouter-2123c965-410d-4dc0-ab3c-240c0969b525', 'neutron-ns-metadata-proxy', '--pid_file=/var/lib/neutron/external/pids/2123c965-410d-4dc0-ab3c-240c0969b525.pid', '--metadata_proxy_socket=/var/lib/neutron/metadata_proxy', '--router_id=2123c965-410d-4dc0-ab3c-240c0969b525', '--state_path=/var/lib/neutron', '--metadata_port=9697', '--verbose', '--log-file=neutron-ns-metadata-proxy-2123c965-410d-4dc0-ab3c-240c0969b525.log', '--log-dir=/var/log/neutron'] Exit code: 1 Stdout: '' Stderr: '2014-08-18 16:56:11.908 3861 INFO neutron.common.config [-] Logging enabled!\n2014-08-18 16:56:11.916 3861 ERROR neutron.agent.linux.daemon [-] Error while handling pidfile: /var/lib/neutron/external/pids/2123c965-410d-4dc0-ab3c-240c0969b525.pid\n2014-08-18 16:56:11.916 3861 TRACE neutron.agent.linux.daemon Traceback (most recent call last):\n2014-08-18 16:56:11.916 3861 TRACE neutron.agent.linux.daemon File "/usr/lib/python2.6/site-packages/neutron/agent/linux/daemon.py", line 37, in __init__\n2014-08-18 16:56:11.916 3861 TRACE neutron.agent.linux.daemon fcntl.flock(self.fd, fcntl.LOCK_EX | fcntl.LOCK_NB)\n2014-08-18 16:56:11.916 3861 TRACE neutron.agent.linux.daemon IOError: [Errno 11] Resource temporarily unavailable\n2014-08-18 16:56:11.916 3861 TRACE neutron.agent.linux.daemon \n' 2014-08-18 16:56:11.972 3281 ERROR neutron.agent.l3_agent [req-3c9892ce-0d64-4cdd-ac27-dd8736076c18 None] Failed synchronizing routers 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent Traceback (most recent call last): 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 879, in _sync_routers_task 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 812, in _process_routers 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent self._router_added(r['id'], r) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 368, in _router_added 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent self._spawn_metadata_proxy(ri.router_id, ri.ns_name) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 409, in _spawn_metadata_proxy 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent pm.enable(callback) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/linux/external_process.py", line 54, in enable 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent ip_wrapper.netns.execute(cmd) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 466, in execute 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent check_exit_code=check_exit_code) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 78, in execute 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent raise RuntimeError(m) 2014-08-18 16:56:11.972 3281 TRACE neutron.agent.l3_agent RuntimeError: when spawn neutron-ns-metadata-proxy, using file-lock lock the pidfile which on behalf of router id is failed. But the router already exists when neutron-ns-metadata-proxy starts. To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1361088/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp