I updated the description with a better diagnosis of the problem, as the first was way off, and only would cause confusion.
** Description changed: - The fix for bug 1325128 [1] included changes to the metadata service - seen at: - trunk [2]: 4a60c6a655006b2882331844664fac5cf67c5f34 - icehouse [3]: 9f59ca751f1a392ef24d8ab73a7bf5ce9655017e + A change was made to the neutron portion of the nova metadata service to + disable caching. This ends up causing a all hits to the nova metadata + service to generate messages to retrieve data from neutron. Doing so + makes a "crawl" of the metadata service take at least 8x longer than it + did. cloud-init crawls the metadata service during boot. The end + result is that instances boot significantly slower than they did + previously. - The new code is around 100x slower. That slow down causes - excessive load on the metadata server if an instance crawls the metadata - service (which generates dozens of http requests). + The commits are marked as having fixed bug 1276440 [1]. + The commits are: + icehouse: d568fee34be36ca17a9124fe6539f62d702d6359 [2] + trunk: 3faea81c6029033c85cefd6e98d7a3e719e858f5 [3] - Both cloud-init and cirros's boot code crawl that meta-data service. The - end result is linux instances boot time is dramatically affected. A - typical Ubuntu boot time will be < 10 seconds to executing user code, but - after this regression, I'm seeing boots in the range of 30 to 45 seconds. - - While the fix is exactly intended to slow things down to improve - security, the performance regression seems significant enough to - address. - - -- - [1] http://pad.lv/1325128 - [2] https://git.openstack.org/cgit/openstack/nova/commit/?id=4a60c6a655006b2882331844664fac5cf67c5f34 - [3] https://git.openstack.org/cgit/openstack/nova/commit/?id=4a60c6a655006b2882331844664fac5cf67c5f34 + [1] http://pad.lv/1276440 + [2] https://github.com/openstack/neutron/commit/d568fee34be36ca17a9124fe6539f62d702d6359 + [3] https://github.com/openstack/neutron/commit/423ca756af10e10398636d6d34a7594a4fd4bc87 -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1361357 Title: metadata service performance regression ~8x To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1361357/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
