I think I am going to have to revert #1493 ( https://github.com/apache/cloudstack/pull/1493) because it seems to be responsible for the `addHost` issue I am having in all my CI environments while doing DeployDC. On completely new deployments, I got the `addHost` error on all 6 of my CI environments with #1493 included. I have noticed this as an intermittent issue for the last while, but could not isolate it.
I have reverted #1493 (and it's descendants) locally and I have not had the error in my first 3 tests after reverting it. I only started seeing the problem after #1493. With the freeze basically here, I need my CI environments in action cause I have a few PRs that I really want to run before I merge and freeze... *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Mon, May 16, 2016 at 1:53 PM, Will Stevens <wstev...@cloudops.com> wrote: > I mean revert them locally to test (for now)... > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 > w cloudops.com *|* tw @CloudOps_ > > On Mon, May 16, 2016 at 1:53 PM, Will Stevens <wstev...@cloudops.com> > wrote: > >> I am getting it more than not right now. I am concerned we have a bigger >> issue here. It only started happening for me after #1493 went in, but I >> don't want to blame it on that without knowing for sure. >> >> Maybe I will revert those ones and see if it changes anything... :( >> >> *Will STEVENS* >> Lead Developer >> >> *CloudOps* *| *Cloud Solutions Experts >> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 >> w cloudops.com *|* tw @CloudOps_ >> >> On Mon, May 16, 2016 at 1:45 PM, Daan Hoogland <daan.hoogl...@gmail.com> >> wrote: >> >>> yes, I'm having the same thing. I need to restart the kvm1 vm to have it >>> be >>> able to connect to the ms. It seems intermittent. >>> >>> On Mon, May 16, 2016 at 7:38 PM, Will Stevens <wstev...@cloudops.com> >>> wrote: >>> >>> > I am currently running into an issue in DeployDC that I started >>> getting on >>> > Thursday or Friday. I am not sure if it is a bubble issue or an issue >>> with >>> > ACS. >>> > >>> > I am trying to get it sorted out now... >>> > >>> > ==== Deploy DC Started ==== >>> > >>> > Exception Occurred :['Traceback (most recent call last):\n', ' File >>> > "/data/git/cs1/cloudstack/tools/marvin/marvin/deployDataCenter.py", >>> line >>> > 142, in addHosts\n ret = self.__apiClient.addHost(hostcmd)\n', ' >>> File >>> > >>> > >>> "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py", >>> > line 1530, in addHost\n response = >>> > self.connection.marvinRequest(command, response_type=response, >>> > method=method)\n', ' File >>> > "/usr/lib/python2.7/site-packages/marvin/cloudstackConnection.py", line >>> > 379, in marvinRequest\n raise e\n', 'CloudstackAPIException: Execute >>> > cmd: addhost failed, due to: errorCode: 530, errorText:Unable to add >>> the >>> > host\n'] >>> > >>> > Exception Occurred :['Traceback (most recent call last):\n', ' File >>> > "/data/git/cs1/cloudstack/tools/marvin/marvin/deployDataCenter.py", >>> line >>> > 142, in addHosts\n ret = self.__apiClient.addHost(hostcmd)\n', ' >>> File >>> > >>> > >>> "/usr/lib/python2.7/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py", >>> > line 1530, in addHost\n response = >>> > self.connection.marvinRequest(command, response_type=response, >>> > method=method)\n', ' File >>> > "/usr/lib/python2.7/site-packages/marvin/cloudstackConnection.py", line >>> > 379, in marvinRequest\n raise e\n', 'CloudstackAPIException: Execute >>> > cmd: addhost failed, due to: errorCode: 530, errorText:Guid is not >>> updated >>> > for cluster with specified cluster id; need to wait for hosts in this >>> > cluster to come up\n'] >>> > >>> > ===deploy dc failed, so cleaning the created entries=== >>> > >>> > *Will STEVENS* >>> > Lead Developer >>> > >>> > *CloudOps* *| *Cloud Solutions Experts >>> > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 >>> > w cloudops.com *|* tw @CloudOps_ >>> > >>> > On Mon, May 16, 2016 at 12:51 PM, Daan Hoogland < >>> daan.hoogl...@gmail.com> >>> > wrote: >>> > >>> > > I understoud the request to try it out. I have #1547 running once >>> again >>> > now >>> > > and will try Remi's new version with the next one i'll run. >>> > > >>> > > On Mon, May 16, 2016 at 6:34 PM, Will Stevens < >>> williamstev...@gmail.com> >>> > > wrote: >>> > > >>> > > > Sorry. My phone decides to write whatever the hell it wants to. I >>> need >>> > to >>> > > > proof read everything on my phone. You can probably understand my >>> > > previous >>> > > > email though. >>> > > > On May 16, 2016 12:32 PM, "Will Stevens" <williamstev...@gmail.com >>> > >>> > > wrote: >>> > > > >>> > > > > Remi and I have been discussing this. I suggested we implement an >>> > > > override >>> > > > > system so she could reuse lost of the code, but be able to >>> override >>> > > files >>> > > > > specific to cosmic and cloudstack without impacting each other. >>> Remi >>> > > > > implemented this concept and asked me to verify it is working as >>> > > > expected, >>> > > > > but I didn't want to push my luck with the freeze so close and I >>> had >>> > > > > working bubbles. >>> > > > > >>> > > > > I think the recent changes are going to help mitigate issues >>> going >>> > > > > forward, but I have not had a chance to validate yet. >>> > > > > On May 16, 2016 12:27 PM, "Daan Hoogland" < >>> daan.hoogl...@gmail.com> >>> > > > wrote: >>> > > > > >>> > > > >> trying that one but I think we need to add that repo to the cs >>> > system >>> > > in >>> > > > >> or >>> > > > >> before the build script. Also this is not the last (HEAD) of the >>> > > master >>> > > > >> branch of the bubble. I saw some cosmic specific changes. We >>> have >>> > some >>> > > > >> challenges on the road ahead. >>> > > > >> >>> > > > >> On Mon, May 16, 2016 at 3:06 PM, Will Stevens < >>> > wstev...@cloudops.com> >>> > > > >> wrote: >>> > > > >> >>> > > > >> > Daan, I am using bubble commit >>> > > > 9134cf8be930d0b982829da216471feaf214621f >>> > > > >> and >>> > > > >> > things seem to be working. Let me know if that is not >>> working for >>> > > > >> you... >>> > > > >> > >>> > > > >> > *Will STEVENS* >>> > > > >> > Lead Developer >>> > > > >> > >>> > > > >> > *CloudOps* *| *Cloud Solutions Experts >>> > > > >> > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 >>> > > > >> > w cloudops.com *|* tw @CloudOps_ >>> > > > >> > >>> > > > >> > On Mon, May 16, 2016 at 8:02 AM, Daan Hoogland < >>> > > > daan.hoogl...@gmail.com >>> > > > >> > >>> > > > >> > wrote: >>> > > > >> > >>> > > > >> > > Thanks Rohit, >>> > > > >> > > >>> > > > >> > > I did try the manual install on the build host but that >>> didn't >>> > > help. >>> > > > >> I'll >>> > > > >> > > have a look at the extra yum repo to add later. >>> > > > >> > > >>> > > > >> > > On Mon, May 16, 2016 at 12:26 PM, Rohit Yadav < >>> > > > >> rohit.ya...@shapeblue.com >>> > > > >> > > >>> > > > >> > > wrote: >>> > > > >> > > >>> > > > >> > > > I checked this again today, with the recent changes wrt >>> rpm >>> > > > >> > > deps/packaging >>> > > > >> > > > the mysql-connector-python is not availble in default >>> CentOS >>> > > > >> > repositories >>> > > > >> > > > therefore we'll need to modify documentation to install it >>> > from >>> > > > >> MySQL >>> > > > >> > yum >>> > > > >> > > > repos: >>> > > > >> > > > http://dev.mysql.com/downloads/repo/yum >>> > > > >> > > > >>> > > > >> > > > Regards, >>> > > > >> > > > Rohit Yadav >>> > > > >> > > > >>> > > > >> > > > >>> > > > >> > > > Regards, >>> > > > >> > > > >>> > > > >> > > > Rohit Yadav >>> > > > >> > > > >>> > > > >> > > > rohit.ya...@shapeblue.com >>> > > > >> > > > www.shapeblue.com >>> > > > >> > > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK >>> > > > >> > > > @shapeblue >>> > > > >> > > > On May 16 2016, at 8:37 am, Rohit Yadav < >>> > > > rohit.ya...@shapeblue.com> >>> > > > >> > > wrote: >>> > > > >> > > > >>> > > > >> > > > Daan, >>> > > > >> > > > >>> > > > >> > > > mysql-connector-python was recently added as a pure-python >>> > > > >> dependency, >>> > > > >> > > can >>> > > > >> > > > you try to install that on your host system and retry rpm >>> > > > building. >>> > > > >> > > > >>> > > > >> > > > Regards. >>> > > > >> > > > ________________________________________ >>> > > > >> > > > From: Daan Hoogland <daan.hoogl...@gmail.com> >>> > > > >> > > > Sent: 15 May 2016 14:34:49 >>> > > > >> > > > To: dev >>> > > > >> > > > Subject: old error back? >>> > > > >> > > > >>> > > > >> > > > anybody else seeing this in the bubble or during rpm >>> build? >>> > > > >> > > > >>> > > > >> > > > ``` >>> > > > >> > > > error: Failed build dependencies: >>> > > > >> > > > mysql-connector-python is needed by >>> > > > >> > > > cloudstack-4.9.0-SNAPSHOT.el7.centos.x86_64 >>> > > > >> > > > RPM Build Failed >>> > > > >> > > > ``` >>> > > > >> > > > >>> > > > >> > > > -- >>> > > > >> > > > Daan >>> > > > >> > > > >>> > > > >> > > > Regards, >>> > > > >> > > > >>> > > > >> > > > Rohit Yadav >>> > > > >> > > > >>> > > > >> > > > rohit.ya...@shapeblue.com >>> > > > >> > > > www.shapeblue.com >>> > > > >> > > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK >>> > > > >> > > > @shapeblue >>> > > > >> > > > >>> > > > >> > > >>> > > > >> > > >>> > > > >> > > >>> > > > >> > > -- >>> > > > >> > > Daan >>> > > > >> > > >>> > > > >> > >>> > > > >> >>> > > > >> >>> > > > >> >>> > > > >> -- >>> > > > >> Daan >>> > > > >> >>> > > > > >>> > > > >>> > > >>> > > >>> > > >>> > > -- >>> > > Daan >>> > > >>> > >>> >>> >>> >>> -- >>> Daan >>> >> >> >
