Hey folks, Thanks for the video, those are great - if not a little hard for the casual observer to follow.
That said, benchmark results of scale testing can be a dangerous game to play, so lets not play games about it. I'd like to see a full characterization of the hardware gear and topology under test so others can duplicate the results if they so desire. Lets get this stuff in the repo in the doc directory asap - starting now (or Monday, since its the weekend and our team needs some well earned R&R). I'll login to the OSIC cluster this weekend and get the documentation started with what I think would be helpful information for folks evaluating scale testing benchmarks. Since I wasn't actively involved with the gear setup, I will be requiring help (in a starred set of reviews) to correctly identify the hardware under test, how the networks are setup, how the filesystems are setup, how the raid is setup, how docker is configured, the exact make and model of the CPU, chipset, brand and model of nvme SSDs, and memory bandwidth (I assume its quad channel memory, but more details are needed). I'd like to objectively benchmark performance of /var/lib/docker, the root filesystem, and the memory bandwidth of the using respected third party benchmarking tools. The results in this thread are just preliminary to share with the community, but please wait for the final documentation in our repository to be completed in about 3 weeks to pass judgement on the scale performance. One thing that is clear from the video Michal produced is indeed Kolla can scale to 4 controller nodes and 101 compute nodes (IIRC I believe on IRC he indicated this was the system configuration used during our dead chicken testing) with no problems other then human error (which Sean Mooney is rapidly working to eliminate via his team's bare metal deployment work with BiFrost thanks in no small part to the contributions of the BiFrost and Ironic community). The deployment is very fast (20 minutes) on very fast hardware (the OSIC kit is super fantastically fast). We also intend to measure day 2 scenarios (such as upgrade and reconfigure) with a variety of configuration options (including ceph as a storage system). One thing that wasn't mentioned in these threads is some basic testing of the OpenStack cluster was done to validate it was functional in the control and data planes of the system. These results are real with video evidence but as I'e stated the characterization is incomplete. I'd like to thank OSIC for facilitating this community effort to help gather some real-wrold benchmarks of how well atleast Kolla performs in deployment and operational functionality. If folks have other interests in specific data please weigh in. Once our loan of the hardware is up, it may be some time before we have another shot at using it. We are far from finished with using the OSIC cluster - we have a tough slog ahead finishing our scale testing benchmarking results - thanks to the Kolla community for sticking with it and doing their best to produce objective results for consumption by a variety of individuals. I'm sure there is something I missed in the need to characterize the systems under test, so if I missed something above, please point it out so we can fix it up front. Thanks and fantastic work! -steve On 8/5/16, 11:53 AM, "Michał Jastrzębski" <inc...@gmail.com> wrote: >And we finished our first deployment >We had some hurdles due to misconfiguration, you can see it in along >with a fix. After these fixes and cleanups performed (we don't want to >affect resulting time now do we?), we deployed functional openstack >successfully within 20min:) More videos and tests to come! > >https://www.youtube.com/watch?v=RNZMtym5x1c > > > >On 5 August 2016 at 11:48, Paul Bourke <paul.bou...@oracle.com> wrote: >> Hi Kolla, >> >> Thought it will be helpful to send a status mail once we hit >>checkpoints in >> the osic cluster work, so people can keep up to speed without having to >> trawl IRC. >> >> Reference: https://etherpad.openstack.org/p/kolla-N-midcycle-osic >> >> Work began on the cluster Wed Aug 3rd, item 1) from the etherpad is now >> complete. The 131 bare metal nodes have been provisioned with Ubuntu >>14.04, >> networking is configured, and all Kolla prechecks are passing. >> >> The default set of images (--profile default) have been built and >>pushed to >> a registry running on the deployment node, the build taking a very >>speedy >> 5m37.040s. >> >> Cheers, >> -Paul >> >> >>_________________________________________________________________________ >>_ >> OpenStack Development Mailing List (not for usage questions) >> Unsubscribe: >>openstack-dev-requ...@lists.openstack.org?subject:unsubscribe >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > >__________________________________________________________________________ >OpenStack Development Mailing List (not for usage questions) >Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe >http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev