RE: [DISCUSS] - Releases, Project Management & Funding Thereof
We could probably split this topic down also I think I may have mentioned previously 😊 my view on how we have somewhat shot ourselves in the foot with the release process this time around. I think that for the most part, people have been well intentioned, and have been trying to 'make this release as good as possible' which is counter-productive, as it's been introducing new blockers. I'm not sure we have a problem in our 'loosely-agreed' process, it's just that repeatedly people have ignored it. WRT a full-time release manager, I suspect that they would find that "you can lead a horse to water, but you can't make it drink". They would not be able to compel anyone to 'hurry up and fix that bug you created', although I guess maybe they could pull a feature if the author(s) didn't sort it out. Because ultimately a release manager, paid or otherwise should only be doing what the 'community' decides the release manager's role is. So we need to be clear about how we want releases to work before worrying about who manages that. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Alex Hitchins [mailto:a...@alexhitchins.com] Sent: 30 June 2017 15:05 To: dev@cloudstack.apache.org Subject: RE: [DISCUSS] - Releases, Project Management & Funding Thereof I am in complete agreement with you. Also on your other reply regards to a FT release manager. If 'we' don't go down this line, more and more people will follow the Cosmic/Schuberg Philis path or even use Cosmic instead. I'm encouraged by your response. Sounds like a few others hold the same concerns. Alexander Hitchins E: a...@alexhitchins.com W: alexhitchins.com M: 07788 423 969 T: 01892 523 587 -Original Message- From: Will Stevens [mailto:williamstev...@gmail.com] Sent: 30 June 2017 14:54 To: dev@cloudstack.apache.org Subject: RE: [DISCUSS] - Releases, Project Management & Funding Thereof Yes, Schuberg Philis, a very active community member forked Cosmic off of CloudStack and has been developing their fork for their needs. I do think we need to have a more consistent front on this matter. I think it would make a big difference on the quality, release cadence and perception of the project. On Jun 30, 2017 9:48 AM, "Alex Hitchins" wrote: Thanks Will, I understand it's something that comes with a big bag of troublesome worries. If this topic comes up again in any discussions, I'd be interested to hear their thoughts on what I see as the alternative; without a dedicated RM/PM/Captain, people will fork off CS so they can achieve the same thing, and CS ultimately looses out long term. I can't remember the name of the fork, but I think I'm right that a previous large CS contributor/user forked off as they wanted greater management in the areas we are discussing here. Alexander Hitchins E: a...@alexhitchins.com W: alexhitchins.com M: 07788 423 969 T: 01892 523 587 -Original Message- From: Will Stevens [mailto:williamstev...@gmail.com] Sent: 30 June 2017 14:31 To: dev@cloudstack.apache.org Subject: Re: [DISCUSS] - Releases, Project Management & Funding Thereof Apache has been historically against the idea of a cloudstack foundation and there is a bit of a pandoras box there which we will want to be careful about opening. Apache added direct contribution, but it was unusable for us historically because it required a minimum contribution of 50k, which none of us can afford. However, there have been some changes to the board recently which are in our favour if we want to put pressure to lower that to say 5-10k. Even if we do solve for smaller direct contributions, we will have to jump through hoops to be able to use those funds for a dedicated release manager. I do think this is a possibility if we manage our needs and communications very well. I had some preliminary discussions with some apache foundation folks to express these specific concerns. I played off the fact that i know they dont want to entertain a cloudstack foundation and tried to see if i could get them to move on the direct contribution mechanism to make it usable for us, specifically with the goal of hiring a full time release manager. I definitely had their ear and they acknowledged the problems we are facing (and currently discussing). They expressed concerns about being able to hire someone with the direct contributions, but brainstormed a bit to potentially hire an agency who actually does the hire and they pay the persons salary through the agency with the direct contribution funds. All to say, there are potential options here, but there be dragons, so we have to handle this topic with care. On Jun 30,
RE: JIRA - PLEASE READ
Whether we use 'GitHub Issues' or 'Jira Issues' doesn't change the basic point, which is bug fixes and indeed features need to be tracked. If someone wants to know what versions a feature is in, or what version a bug was fixed, or if anyone has experienced/reported/fix a bug that they are experiencing, then they need somewhere to go to find that. When doing a release we need to be able to easily see what bugs are outstanding for that release and which are blocker/critical etc. Burying information in PRs just leads to chaos. And if someone has to write a tool to extract what has gone into a release, then it's obviously too complicated. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Will Stevens [mailto:williamstev...@gmail.com] Sent: 30 June 2017 16:07 To: dev@cloudstack.apache.org Subject: Re: JIRA - PLEASE READ Yes, we would be adopting github issues for that then. If you want to handle those in jira we could, but i personally dont see any value in a jira ticket for an actual PR. On Jun 30, 2017 10:26 AM, "Ron Wheeler" wrote: > Going back to my previous point. > Whatever makes the preparation of Release Notes easier should drive > the policy. > > It sounds like Will is favouring a complete abandonment of the JIRA. > Does this change the end-user's process for reporting bugs or > requesting new features? > > Ron > > On 30/06/2017 9:09 AM, Will Stevens wrote: > >> Back to jira. I personally have never searched jira for an issue. I >> search github prs for issues often though to see what code is >> actually pending for different issues. I dont think i am alone in >> that. >> >> My stance is that unless we have a solid reason for using jira which >> we can not solve with github at this point, we should reconsider our >> use of jira. >> >> Now that we have gitbox setup, i think we have the ability to use >> Issues as well as PRs. I think it is much wiser to keep the >> discussion around the code much closer to the code and not in a 3rd >> system. By using jira we encourage people who are contributing to >> the discussion to never look at the code because it is not available >> in the same screen. I think it is much more useful to discuss changes >> with the context of the code at your finger tips. Comment on >> specific lines of code, review the conformance to the style guide, >> etc... >> >> Also, I think the argument that jira somehow helps with release notes >> is being made by people who have never created the release notes. >> When using jira, you are assuming that everyone has jira in their >> workflow and the status of a ticket is always right. This is almost >> never the case and there is a huge amount of man effort to try to >> manage that delta. My colleague, Pierre-Luc Dion, has historically >> created the majority of release notes up until 4.9, when I scripted >> based on the PRs actually merged (as I was the >> 4.9 RM). My script tried to associate jira tickets if it could find >> them, but not every piece of code merged had a ticket (which will >> always be the case). There will always be a PR for a change, there >> wont always be a jira ticket. That alone should mean that we should >> be doing release notes based on the PRs and not the jira tickets. >> Also, Pierre-Luc does not have the time to spend a week building the >> release notes anymore for every release, he is a busy man... >> >> Anyway, these are my two cents. As always I am open to other opinions >> and points of view. I would encourage us to try to understand and >> pinpoint what we think adding jira to the flow actually achieves. Now >> that we have the gitbox integration I feel like we should move the >> vast majority of the development and issue related workflows closer >> to the code. >> >> Sorry for the wall of text... >> >> On Jun 30, 2017 6:52 AM, "Alex Hitchins" wrote: >> >> Hello, >> >> I've created a DISCUSS thread to... discuss this subject separately >> from the original Jira issue. >> >> Sorry Paul for hijacking your Jira rant. >> >> >> Alexander Hitchins >> >> E: a...@alexhitchins.com >> W: alexhitchins.com >> M: 07788 423 969 >> T: 01892 523 587 >> >> -Original Message- >> From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] >> Sent: 29 June 2017 20:41 >> To: dev@cloudstack.apache.org >> Subject: Re: JIRA - PL
RE: JIRA - PLEASE READ
Such a view of CloudStack is what holds CloudStack back. It stops users/operators from having any chance of understanding what CloudStack does and how it does it. Code for code's sake is no use to anyone. Jira is about communication between developers and to everyone else. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] Sent: 29 June 2017 10:14 To: dev Subject: Re: JIRA - PLEASE READ On Thu, Jun 29, 2017 at 11:06 AM, Paul Angus wrote: > + Release notes will be impossible to create without a proper Jira history. > And no one will know what has gone into CloudStack. No they are not mr Grumpy. they should be base on the code anyway, hence on git, not jira. I do not appose to the use of Jira but it is not required for good coding practices and as we are not and will not function as a corporation, jira is an extra for those that grave for it. not a requirement. -- Daan
JIRA - PLEASE READ
Hi, Mr Grumpy here! I was looking the commits and I'm seeing commits going in with no Jira Issue assigned. My understanding is that there must be a Jira ticket for EVERY fix/enhancement/feature, so that we have a way to search and track these things. + Release notes will be impossible to create without a proper Jira history. And no one will know what has gone into CloudStack. I know rules and procedures are a PITA, but we can't let this turn into the wild west! Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rajani Karuturi [mailto:raj...@apache.org] Sent: 28 June 2017 10:10 To: dev@cloudstack.apache.org Subject: Re: [VOTE] Apache Cloudstack 4.10.0.0 RC3 Yes, those shouldn't have been merged. We should have released faster and then merged. Lets think of it as ours and us than theirs and those. ~ Rajani http://cloudplatform.accelerite.com/ On June 28, 2017 at 12:19 PM, Paul Angus (paul.an...@shapeblue.com) wrote: Those new PRs should not have been merged. Those on the mailing list should respect the process and accept that they will have to wait until code is unfrozen. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com ( http://www.shapeblue.com ) 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rajani Karuturi [mailto:raj...@apache.org] Sent: 28 June 2017 07:45 To: dev@cloudstack.apache.org Subject: Re: [VOTE] Apache Cloudstack 4.10.0.0 RC3 Paul, Which shows we are not actively following RCs. That PR was a blocker for RC3 and was well discussed. That PR is a perfect example that we are not working as community to release code. That is a fix for a blocker which stayed open for more than 45 days. If you see till RC2 it was only blockers that were merged. But, since it has taken a lot more time to fix blockers, more PRs were merged on request on the mailing list(and we don't have people even to object it). you can think of it as a combination of two releases due to the time it has taken. ~ Rajani http://cloudplatform.accelerite.com/ On June 28, 2017 at 12:06 PM, Paul Angus (paul.an...@shapeblue.com) wrote: Rajani, I suspect that fatigue with the 4.10 release testing that we are seeing is due to the time it has taken to release it. And that is has been caused by new code going in, which have introduced new bugs. This was demonstrated in the last -1 from Kris. This change was merged 10 days ago. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com ( http://www.shapeblue.com ) ( http://www.shapeblue.com ) 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rajani Karuturi [mailto:raj...@apache.org] Sent: 28 June 2017 06:14 To: dev@cloudstack.apache.org Subject: Re: [VOTE] Apache Cloudstack 4.10.0.0 RC3 We can do a release every month as long as we have enough people actively participating in the release process. We have people who wants to have their code/features checked in. We, very clearly do not have enough people working on releases/blockers. How many of us are testing/voting on releases or PRs? We have blockers in jira, with no one to fix. We have PRs open for release blockers for more than a month with no one to test. I would ask everyone to start testing releases/PRs and voting on them actively. We need people who can do the work. We already know what needs to be done as outlined in the release principles wiki after long discussions on this list. Whether we create a branch off RC or continue on master wont change the current situation. We, as community should commit to testing and releasing code. principles and theory wont help. Thanks, ~ Rajani http://cloudplatform.accelerite.com/ On June 27, 2017 at 9:43 PM, Rafael Weingärtner (rafaelweingart...@gmail.com) wrote: +1 to what Paul said. IMHO, as soon as we start a release candidate to close a version, all merges should stop (period); the only exceptions should be PRs that address specific problems in the RC. I always thought that we had a protocol for that [1]; maybe for this version, we have not followed it? [1] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Release+principles+for+Apache+CloudStack+4.6+and+up#ReleaseprinciplesforApacheCloudStack4.6andup-Preparingnewrelease:masterfrozen On Tue, Jun 27, 2017 at 1:32 AM, Paul Angus wrote: Hi All, From my view point 'we' have been the architects of our own downfall. Once a code freeze is in place NO new features, NO enhancements should be going in. Once we're at an RC stage, NO new bug fixes other that for the blockers should be going in. that way the release gets out, and the next one can get going. If 4.10 had gone out in a timely fashion, then we'd probably be on 4.11 if not 4.12 by now, with all the new features AND all the new fixes i
RE: [VOTE] Apache Cloudstack 4.10.0.0 RC3
Those new PRs should not have been merged. Those on the mailing list should respect the process and accept that they will have to wait until code is unfrozen. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rajani Karuturi [mailto:raj...@apache.org] Sent: 28 June 2017 07:45 To: dev@cloudstack.apache.org Subject: Re: [VOTE] Apache Cloudstack 4.10.0.0 RC3 Paul, Which shows we are not actively following RCs. That PR was a blocker for RC3 and was well discussed. That PR is a perfect example that we are not working as community to release code. That is a fix for a blocker which stayed open for more than 45 days. If you see till RC2 it was only blockers that were merged. But, since it has taken a lot more time to fix blockers, more PRs were merged on request on the mailing list(and we don't have people even to object it). you can think of it as a combination of two releases due to the time it has taken. ~ Rajani http://cloudplatform.accelerite.com/ On June 28, 2017 at 12:06 PM, Paul Angus (paul.an...@shapeblue.com) wrote: Rajani, I suspect that fatigue with the 4.10 release testing that we are seeing is due to the time it has taken to release it. And that is has been caused by new code going in, which have introduced new bugs. This was demonstrated in the last -1 from Kris. This change was merged 10 days ago. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com ( http://www.shapeblue.com ) 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rajani Karuturi [mailto:raj...@apache.org] Sent: 28 June 2017 06:14 To: dev@cloudstack.apache.org Subject: Re: [VOTE] Apache Cloudstack 4.10.0.0 RC3 We can do a release every month as long as we have enough people actively participating in the release process. We have people who wants to have their code/features checked in. We, very clearly do not have enough people working on releases/blockers. How many of us are testing/voting on releases or PRs? We have blockers in jira, with no one to fix. We have PRs open for release blockers for more than a month with no one to test. I would ask everyone to start testing releases/PRs and voting on them actively. We need people who can do the work. We already know what needs to be done as outlined in the release principles wiki after long discussions on this list. Whether we create a branch off RC or continue on master wont change the current situation. We, as community should commit to testing and releasing code. principles and theory wont help. Thanks, ~ Rajani http://cloudplatform.accelerite.com/ On June 27, 2017 at 9:43 PM, Rafael Weingärtner (rafaelweingart...@gmail.com) wrote: +1 to what Paul said. IMHO, as soon as we start a release candidate to close a version, all merges should stop (period); the only exceptions should be PRs that address specific problems in the RC. I always thought that we had a protocol for that [1]; maybe for this version, we have not followed it? [1] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Release+principles+for+Apache+CloudStack+4.6+and+up#ReleaseprinciplesforApacheCloudStack4.6andup-Preparingnewrelease:masterfrozen On Tue, Jun 27, 2017 at 1:32 AM, Paul Angus wrote: Hi All, From my view point 'we' have been the architects of our own downfall. Once a code freeze is in place NO new features, NO enhancements should be going in. Once we're at an RC stage, NO new bug fixes other that for the blockers should be going in. that way the release gets out, and the next one can get going. If 4.10 had gone out in a timely fashion, then we'd probably be on 4.11 if not 4.12 by now, with all the new features AND all the new fixes in. People sliding new changes/bug fixes/enhancements in are not making the product better, they're stopping progress. As we can clearly see here. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com ( http://www.shapeblue.com ) ( http://www.shapeblue.com ) 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Tutkowski, Mike [mailto:mike.tutkow...@netapp.com] Sent: 27 June 2017 01:25 To: dev@cloudstack.apache.org Cc: Wido den Hollander Subject: Re: [VOTE] Apache Cloudstack 4.10.0.0 RC3 I tend to agree with you here, Daan. I know the downside we’ve discussed in the past is that overall community participation in the RC process has dropped off when such a new branch is created (since the community as a whole tends to focus more on the new branch rather than on testing the RC and releasing it). I believe we should do the following: As we approach the first RC, we need to limit the number of PRs going into the branch (in order to stabilize it). If we had a super duper array of automated regression tests that ran against the code, then we might
RE: [VOTE] Apache Cloudstack 4.10.0.0 RC3
Rajani, I suspect that fatigue with the 4.10 release testing that we are seeing is due to the time it has taken to release it. And that is has been caused by new code going in, which have introduced new bugs. This was demonstrated in the last -1 from Kris. This change was merged 10 days ago. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rajani Karuturi [mailto:raj...@apache.org] Sent: 28 June 2017 06:14 To: dev@cloudstack.apache.org Subject: Re: [VOTE] Apache Cloudstack 4.10.0.0 RC3 We can do a release every month as long as we have enough people actively participating in the release process. We have people who wants to have their code/features checked in. We, very clearly do not have enough people working on releases/blockers. How many of us are testing/voting on releases or PRs? We have blockers in jira, with no one to fix. We have PRs open for release blockers for more than a month with no one to test. I would ask everyone to start testing releases/PRs and voting on them actively. We need people who can do the work. We already know what needs to be done as outlined in the release principles wiki after long discussions on this list. Whether we create a branch off RC or continue on master wont change the current situation. We, as community should commit to testing and releasing code. principles and theory wont help. Thanks, ~ Rajani http://cloudplatform.accelerite.com/ On June 27, 2017 at 9:43 PM, Rafael Weingärtner (rafaelweingart...@gmail.com) wrote: +1 to what Paul said. IMHO, as soon as we start a release candidate to close a version, all merges should stop (period); the only exceptions should be PRs that address specific problems in the RC. I always thought that we had a protocol for that [1]; maybe for this version, we have not followed it? [1] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Release+principles+for+Apache+CloudStack+4.6+and+up#ReleaseprinciplesforApacheCloudStack4.6andup-Preparingnewrelease:masterfrozen On Tue, Jun 27, 2017 at 1:32 AM, Paul Angus wrote: Hi All, From my view point 'we' have been the architects of our own downfall. Once a code freeze is in place NO new features, NO enhancements should be going in. Once we're at an RC stage, NO new bug fixes other that for the blockers should be going in. that way the release gets out, and the next one can get going. If 4.10 had gone out in a timely fashion, then we'd probably be on 4.11 if not 4.12 by now, with all the new features AND all the new fixes in. People sliding new changes/bug fixes/enhancements in are not making the product better, they're stopping progress. As we can clearly see here. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com ( http://www.shapeblue.com ) 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Tutkowski, Mike [mailto:mike.tutkow...@netapp.com] Sent: 27 June 2017 01:25 To: dev@cloudstack.apache.org Cc: Wido den Hollander Subject: Re: [VOTE] Apache Cloudstack 4.10.0.0 RC3 I tend to agree with you here, Daan. I know the downside we’ve discussed in the past is that overall community participation in the RC process has dropped off when such a new branch is created (since the community as a whole tends to focus more on the new branch rather than on testing the RC and releasing it). I believe we should do the following: As we approach the first RC, we need to limit the number of PRs going into the branch (in order to stabilize it). If we had a super duper array of automated regression tests that ran against the code, then we might be able to avoid this, but our automated test suite is not extensive enough for us to do so. As we approach the first RC, only blockers and trivial (ex. text changes) PRs should be permitted in. Once we cut the first RC, create a new branch for ongoing dev work. In between RCs, we can only allow in code related to blocker PRs (or trivial text changes, as discussed before). What do people think? On 6/13/17, 4:56 AM, "Daan Hoogland" wrote: this is why i say we should branch on first RC, fix in release branch only and merge forward On Tue, Jun 13, 2017 at 12:41 PM, Will Stevens < williamstev...@gmail.com> wrote: I know it is hard to justify not merging PRs that seem ready but are not blockers in an RC, but it is a vicious circle which ultimately results in a longer RC process. It is something i struggled with as a release manager as well. On Jun 13, 2017 1:56 AM, "Rajani Karuturi" wrote: Thanks Mike, Will hold off next RC until we hear an update from you. Regarding merging non-blockers, unfortunately, its a side-effect of taking more than three months in the RC phase :( Thanks, ~ Rajani http://cloudplatform.accelerite.com/ On June 13, 2017 at 10:10 AM, Tut
RE: [VOTE] Apache Cloudstack 4.10.0.0 RC3
Hi All, From my view point 'we' have been the architects of our own downfall. Once a code freeze is in place NO new features, NO enhancements should be going in. Once we're at an RC stage, NO new bug fixes other that for the blockers should be going in. that way the release gets out, and the next one can get going. If 4.10 had gone out in a timely fashion, then we'd probably be on 4.11 if not 4.12 by now, with all the new features AND all the new fixes in. People sliding new changes/bug fixes/enhancements in are not making the product better, they're stopping progress. As we can clearly see here. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Tutkowski, Mike [mailto:mike.tutkow...@netapp.com] Sent: 27 June 2017 01:25 To: dev@cloudstack.apache.org Cc: Wido den Hollander Subject: Re: [VOTE] Apache Cloudstack 4.10.0.0 RC3 I tend to agree with you here, Daan. I know the downside we’ve discussed in the past is that overall community participation in the RC process has dropped off when such a new branch is created (since the community as a whole tends to focus more on the new branch rather than on testing the RC and releasing it). I believe we should do the following: As we approach the first RC, we need to limit the number of PRs going into the branch (in order to stabilize it). If we had a super duper array of automated regression tests that ran against the code, then we might be able to avoid this, but our automated test suite is not extensive enough for us to do so. As we approach the first RC, only blockers and trivial (ex. text changes) PRs should be permitted in. Once we cut the first RC, create a new branch for ongoing dev work. In between RCs, we can only allow in code related to blocker PRs (or trivial text changes, as discussed before). What do people think? On 6/13/17, 4:56 AM, "Daan Hoogland" wrote: this is why i say we should branch on first RC, fix in release branch only and merge forward On Tue, Jun 13, 2017 at 12:41 PM, Will Stevens wrote: > I know it is hard to justify not merging PRs that seem ready but are not > blockers in an RC, but it is a vicious circle which ultimately results in a > longer RC process. > > It is something i struggled with as a release manager as well. > > On Jun 13, 2017 1:56 AM, "Rajani Karuturi" wrote: > > Thanks Mike, > > Will hold off next RC until we hear an update from you. > > Regarding merging non-blockers, unfortunately, its a side-effect > of taking more than three months in the RC phase :( > > Thanks, > > ~ Rajani > > http://cloudplatform.accelerite.com/ > > On June 13, 2017 at 10:10 AM, Tutkowski, Mike > (mike.tutkow...@netapp.com) wrote: > > Hi everyone, > > I had a little time this evening and re-ran some VMware-related > tests around managed storage. I noticed a problem that I’d like > to investigate before we spin up the next RC. Let’s hold off on > the next RC until I can find out more (I should know more within > 24 hours). > > Thanks! > Mike > > On 6/12/17, 2:40 AM, "Wido den Hollander" > wrote: > >> Op 10 juni 2017 om 21:18 schreef "Tutkowski, Mike" > : >> >> >> Hi, >> >> I opened a PR against the most recent RC: > https://github.com/apache/cloudstack/pull/2141 >> >> I ran all managed-storage regression tests against it and they > pass (as noted in detail in the PR). >> >> If someone wants to take this code and create a new RC from > it, I’m +1 on the new RC as long as this is the only commit added > to it since the current RC. > > Thanks Mike! > > If this PR is good we should probably merge it asap and go for > RC5. > > 4.10 should really be released by now. > > Wido > >> >> Thanks! >> Mike >> >> On 6/9/17, 7:43 PM, "Tutkowski, Mike" > wrote: >> >> Hi everyone, >> >> I found a critical issue that was introduced into this RC > since the most recent RC, so I am -1 on this RC. >> >> The fix for this ticket breaks the support for storing volume > snapshots on primary storage (which is a feature managed storage > can support): >> >> https://issues.apache.org/jira/browse/CLOUDSTACK-9685 >> >> Here is the SHA: 336df84f1787de962a67d0a34551f9027303040e >> &
RE: Private Gateway on REDUNDANT VPC
I don't believe so. Rules look OK and consistent with std VPC as well. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Jayapal Uradi [mailto:jayapal.ur...@accelerite.com] Sent: 20 June 2017 09:30 To: dev@cloudstack.apache.org Subject: Re: Private Gateway on REDUNDANT VPC Did you check iptables, Is it blocking on the VR ? > On Jun 20, 2017, at 1:30 PM, Paul Angus wrote: > > Hi All, > > I've been looking at the failing Marvin tests for Private Gateways.It > passes on std VPC and fails on rVPC. > The test tries to ping a VM on a remote VPC via the private gateways on both > VRs. > Digging into it, I found that an ARP request goes out for the remote VM from > the local VR to the remote VR, the local VR receives it, then nothing. On > the std VRs a reply goes back out. > > I've checked all interfaces to see if the reply is going out of the wrong > interface, but it just isn't going out anywhere. I can't figure out why no > reply seems to be generated... Obviously the answer is in the difference in > config and packages on VPC vs rVPC - but I can't find it. > > HELP! Any ideas anyone? > > > Kind regards, > > Paul Angus > > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > DISCLAIMER == This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.
Private Gateway on REDUNDANT VPC
Hi All, I've been looking at the failing Marvin tests for Private Gateways.It passes on std VPC and fails on rVPC. The test tries to ping a VM on a remote VPC via the private gateways on both VRs. Digging into it, I found that an ARP request goes out for the remote VM from the local VR to the remote VR, the local VR receives it, then nothing. On the std VRs a reply goes back out. I've checked all interfaces to see if the reply is going out of the wrong interface, but it just isn't going out anywhere. I can't figure out why no reply seems to be generated... Obviously the answer is in the difference in config and packages on VPC vs rVPC - but I can't find it. HELP! Any ideas anyone? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: [apache/cloudstack] Vyos router plugin (#2105)
Hi Matthew, I don't know how others feel about this, but I don't think that the core CloudStack code is the place for Proof-of-Concepts. I have nothing against your VyOS concept, in fact I have suggested it as an alternative in the past and I kicked off a Blue Orangutan build and looked at what you had done so far. My personal feeling is that the we (you) need to have a branch which is kept in sync with master that is used for this work. My 2p worth, is that the part that really needs PoC is refactoring the code such that the VyOS can be deployed in place of a VR, then that CloudStack can send commands to alternate 'drivers' when configuring what it sees as a user created VR. I really don't wish to on your bonfire, I think that this is a great project I would love to help out with it... Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Matthew Smart [mailto:msm...@smartsoftwareinc.com] Sent: 03 June 2017 12:50 To: dev@cloudstack.apache.org Subject: Re: [apache/cloudstack] Vyos router plugin (#2105) This didn't go through the first time for some reason... Hey guys, I know this is going to take some time to merge. In the meantime, I am preparing my design for the next iteration of the plugin which will tentatively add DNS, DHCP, VPN, and maybe VRRP (redundant routing) support. I am not very familiar with GIT or the PR process. Assuming my design phase completes before my PR is merged how should I go about starting work on the next iteration of the plugin? Can I create a new branch from the branch that is waiting for the PR to be merged and make my changes there? Thanks, Matthew Smart President Smart Software Solutions Inc. 108 S Pierre St. Pierre, SD 57501 Phone: (605) 280-0383 Skype: msmart13 Email: msm...@smartsoftwareinc.com Forwarded Message Subject:Re: [apache/cloudstack] Vyos router plugin (#2105) Date: Fri, 2 Jun 2017 15:47:37 -0500 From: Matthew Smart To: reply+0133cbd45f36984313fd3e0860108796fac2fb386eb2d6d492cf0001153d1d reply+b792a169ce0da2c...@reply.github.com Hey guys, I know this is going to take some time to merge. In the meantime, I am preparing my design for the next iteration of the plugin which will tentatively add DNS, DHCP, VPN, and maybe VRRP (redundant routing) support. I am not very familiar with GIT or the PR process. Assuming my design phase completes before my PR is merged how should I go about starting work on the next iteration of the plugin? Can I create a new branch from the branch that is waiting for the PR to be merged and make my changes there? Thanks, Matthew Smart President Smart Software Solutions Inc. 108 S Pierre St. Pierre, SD 57501 Phone: (605) 280-0383 Skype: msmart13 Email:msm...@smartsoftwareinc.com On 05/24/2017 05:08 AM, Blue Orangutan Build Things wrote: > > Packaging result: ✔centos6 ✔centos7 ✔debian. JID-741 > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <https://github.com/apache/cloudstack/pull/2105#issuecomment-303679093 > >, > or mute the thread > <https://github.com/notifications/unsubscribe-auth/ATPL1JdWfN4FiJb3qjC > 15mP-6zmdwUneks5r9AG3gaJpZM4NbYdv>.Web > Bug from > https://github.com/notifications/beacon/ATPL1CU8Qdww8m5wKxzpzxmhtOcv9O > KMks5r9AG3gaJpZM4NbYdv.gif >
RE: Miami CCC '17 Roundtable/Hackathon Summary
Rather than trying to re-write my presentation at CCC17 here, have a look at the slides here: https://www.slideshare.net/ShapeBlue/ccna17-cloudstack-and-nfv Before we can separate out the VR into VNFs, we need to be able to connect VNFs together logically in a useful manner. A firewall VM will need to pass traffic to a discreet VPN VM and a discreet loadbalancer. CloudStack doesn't allow for that kind of plumbing currently. And to be honest, CloudStack intelligently provisioning and them and configuring them on its own will be no mean feat either. I'm a big fan of VyOS - in that I used Vyatta Core quite a bit before it was shutdown by Brocade. So I'm going to have a look at that PR. A 'drop in' replacement for the home-brew VR seems to be the easiest path. A guy in my presentation from the incubating Apache Project ARIA TOSCA http://ariatosca.org/about/ - suggested that we should be looking to TOSCA to provide our 'definitions' and blueprints. Which is actually quite a sensible approach. I think this thread could run for a while yet We should probably try to have a dedicated 'channel' or bi-weekly 'conf calls' to make real progress Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] Sent: 23 May 2017 16:18 To: dev@cloudstack.apache.org Subject: Re: Miami CCC '17 Roundtable/Hackathon Summary I missed the roundtable and hackathon, my bad guys :( I liked the ideas that you (all) put forward. The VR is interesting and a nice feature to have, but it causes some pain to maintain in our development cycles. The idea to split the current VR into NFV is great; this can make things more pluggable and take ACS to NFV (officially). We could develop a framework in ACS (an API method?) that creates a system VM called NFV where people (vendors, enthusiast, users and others) can then extend and add their functions/systems there. The problem is the work required to design and develop such thing. I use Daan`s words here, this is a community effort and not a single company or individual. What do you guys think? We could start creating a roadmap of when we want this feature (milestones for delivering piece by piece of the complete feature), then the draft of a proposal, and later define the implementation job, so people of the community can embrace it. On Tue, May 23, 2017 at 10:18 AM, Daan Hoogland wrote: > Great thanks Simon, > > Just want to play bingo a bit; dividing the VR into VNFs (virtual > network > functions) was mentioned. This pertains to the mention of making the > VR more modular ;) > > Hopefully everybody is inspired by this because no one company or > person is going to make this happen. > > Dahn > > On 23/05/17 14:16, "Simon Weller" wrote: > > Hi everyone, > > > During the CCC last week in Miami, we held a roundtable/hackathon > to discuss some of the major areas the community would like to focus > more attention. > > > The discussions were passionate and were mainly focused around > networking and our current use of our home-spun Virtual Router. > > > For most of the us, the VR has become a challenging beast, mainly > due to how difficult it is to end-to-end test for new releases. > > Quite often PRs are pushed that fix an issue on one feature set, > but break another unintentionally. This has a great deal to do with > how inter-mingled all the features are currently. > > > We floated some ideas related to short term VR fixes in order to > make it more modular, as well as API driven, rather than the currently > SSH JSON injections. > > A number of possible alternatives were also brought up to see what > VR feature coverage could be handled by other virtual appliances > currently out on the market. > > > These included (but not limited to): > > > VyOS (current PR out there for integration via a plugin – thanks > Matthew!) > > Microtek (Commerical) > > Openswitch/Flexswitch > > Cloud Router > > > The second major topic of the day was related to how we want to > integrate networking moving forward. > > > A fair number of individuals felt that we shouldn't be focusing so > much on integrating network functions, but relying on other network > orchestrators to hand this. > > It was also noted that what draws a lot of people to ACS is the > fact we have a VR and do provide these functions out of the box. > > > We discussed how we could standardize the network sub system to > use some sort of queuing bus to make it easier
RE: [Github/Gitbox] Setting up your committer account
That’s in progress... It would be cool if we could parse comments for LGTM and OK to Merge so that we can have them as status labels. Otherwise a manual process of updating a status would still be great. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: 15 April 2017 11:30 To: dev@cloudstack.apache.org Subject: [Github/Gitbox] Setting up your committer account Hi, Since yesterday we are using the Gitbox [0] services from ASF to have Github our 'primary' source of code. This means that we can now label PRs, merge them, close them, all on Github. If you are a committer you have to be added to the 'cloudstack committers' team on Github and this is done automatically [1] once every X hours. You however need to make sure that your Apache Profile/ID [2] has the right information and that you have 2FA [3] enabled on your Github account. The steps you need to take: - Make sure you are a CloudStack committer - Make sure you have a Github account - Enable 2FA [3] on your Github account - Update your Apache profile [2] and add your Github username Now, after a few hours the sync between ASF and Github should be completed and you are added to the right team on Github. If that doesn't work you might need to visit the Gitbox setup page [4] to link your Apache account to Github. Since we moved to Gitbox the URL of our Git repositories also changed, for example: - https://gitbox.apache.org/repos/asf/cloudstack.git If you want RO you can also sync from Github: - https://github.com/apache/cloudstack.git Once you are in the right group on Github you should be able to label PRs, close them, merge them and move. I have already created [5] a bunch of labels. If we all try to label the PRs it will be much easier for people to filter PRs and review them. Questions? Ask! Wido [0]: https://gitbox.apache.org/ [1]: https://issues.apache.org/jira/browse/INFRA-13885 [2]: https://id.apache.org/ [3]: https://help.github.com/articles/about-two-factor-authentication/ [4]: https://gitbox.apache.org/setup/ [5]: https://github.com/apache/cloudstack/labels
RE: [VOTE] Retirement of midonet plugin
+1 to retire. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Marty Godsey [mailto:ma...@gonsource.com] Sent: 29 March 2017 02:59 To: dev@cloudstack.apache.org; us...@cloudstack.apache.org Subject: RE: [VOTE] Retirement of midonet plugin +1 to retire. Regards, Marty Godsey Principal Engineer nSource Solutions, LLC -Original Message- From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] Sent: Tuesday, March 28, 2017 4:46 PM To: dev@cloudstack.apache.org; us...@cloudstack.apache.org Subject: [VOTE] Retirement of midonet plugin Dear ACS fellows, We have discussed the retirement of Midonet plugin [*]. After quite some talk, we converged in a retirement process and it seems that we all agree that the Midonet plugin should be retired. So, to formalize things, we should vote Midonet retirement. All users and devs are welcome to vote here: [+1] I *do want to retire *the Midonet plugin [0] Whatever happens I am happy [-1] I *do not want to retire* the Midonet plugin [*] http://markmail.org/message/x6p3gnvqbbxcj6gs -- Rafael Weingärtner
RE: Welcoming Wido as the new ACS VP
Thanks Will for all the great work. And congratulations Wido - good luck. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Raja Pullela [mailto:raja.pull...@accelerite.com] Sent: 17 March 2017 02:59 To: dev@cloudstack.apache.org; us...@cloudstack.apache.org Subject: Re: Welcoming Wido as the new ACS VP Thank you Will for all the great work! cheers! Raja Pullela Engineering Team, Accelerite, 2055 Laurelwood Road, Santa Clara, CA, 95054 On 3/16/17, 10:30 PM, "Will Stevens" wrote: Hello Everyone, It has been a pleasure working with you as the ACS VP over the past year. I would like to say Thank You to everyone who has supported me in this role and have supported the project as a whole. It is my pleasure to announce that Wido den Hollander has been voted in to replace me as the Apache Cloudstack VP in our annual VP rotation. Wido has a long history with the project and we are happy welcome him into this new role. Be sure to join us at CCC in Miami [1] so we can initiate him correctly over many beers. :) Cheers, *Will Stevens* [1] http://us.cloudstackcollab.org/ DISCLAIMER == This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.
RE: [ANNOUNCE] Wei Zhou and Rene Moser are now PMC members
Congratulations Rene and Wei. You're great supporters of the CloudStack cause, it's well deserved. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@shapeblue.com] Sent: 17 March 2017 07:06 To: dev@cloudstack.apache.org Subject: [ANNOUNCE] Wei Zhou and Rene Moser are now PMC members dear devs, The PMC has invited Rene Moser and Wei Zhou over the last couple of weeks to join their ranks. Both have accepted. Please join me in congratulating both, thanking them for their contributions so far and encouraging them to show their best for Apache CloudStack ;) \o/ ... regards, daan.hoogl...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: [Proposal] - StorageHA
Hi Jeromy, I love the idea, I'm not really a developer, so those guys will look at things a different way, but... These would be by my initial comments: 1. We can't/don't run scripts on vSphere hosts (not sure about Hyper-V) 2. I know of one failure scenario (which happened) where MTU issues in intermediate switches meant that small amounts of data could pass, but anything that was passed as jumbo frames then failed. So it would be important to exercise that. 3. You need to be very sure of failures before shutting hosts down. Also a host is likely to be connected to multiple storage pools, so you wouldn't want to shut down a host due to one pool becoming unavailable. 4. Environments can have hundreds of storage pools, so watch out for spamming the logs with updates. 5. The primary storage pools have a 'state' which should get updated and used by the deployment planners 6. Secondary storage pools don't have a 'state' - but it would be great if that were added in the DB and reflected in the UI. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue From: Jeromy Grimmett [mailto:jer...@cloudbrix.com] Sent: 10 March 2017 15:28 To: dev@cloudstack.apache.org Subject: [Proposal] - StorageHA Hello, I am new to the mailing list, and we are glad to be a part of the CloudStack community. We are looking to develop plugins and modules that will help grow and expand the adoption and use of CloudStack. So as part of my introductory email, I'd like to introduce a little project we have been working on; a StorageHA Monitor. The Monitor would allow CloudStack and the hosts to test, communicate and resolve VM availability issues when storage (primary and/or secondary) availability becomes apparent. This is a small write up about how it would work: Consists of two scripts/programs: The host script runs on the host servers and checks to see if the primary and secondary storage is available by doing a read/write test then reports to the master script that runs on the Cloudstack server. The host script will test a read and a write to the storage every 5 seconds (configurable), and if it fails 3 times (configurable) then it will be recorded by the master script. The master script will monitor the results of the host script. If the test is good, nothing happens and the results are logged and so that we can track the history of the test results. If the test reports back as failed, then it will perform the following actions: * Secondary Storage - It will simply generate and send an alert that the failure has occurred. * Primary Storage - The script will perform the following tasks: * Generate and send an alert that the failure has occurred. * Force the VMs on that host to shutdown. * Determine which host to move the VMs to. * Start the VMs on the healthy host. We have already started working on some code, and the solution seems to be testing well. Any thoughts/ideas/input are(is) welcome. Should there are a solution out there already, then please forgive our ignorance, and point us in the right direction. We look forward to further collaboration with you all. Regards, j Jeromy Grimmett [cb-sig-logo2] 155 Fleet Street Portsmouth, NH 03801 Direct: 603.766.3625 Office: 603.766.4908 Fax: 603.766.4729 jer...@cloudbrix.com<mailto:jer...@cloudbrix.com> www.cloudbrix.com<http://www.cloudbrix.com/>
RE: midonet-client and Guava dependency conflict
Jeff, To confirm what Rohit said, I spoke with Midokura a couple of years ago, they did some basics, then were looking for a customer to finish/polish the implementation with. AFAIK that never happened, as customers wanted to see it working FIRST before signing up. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Jeff Hair [mailto:j...@greenqloud.com] Sent: 10 March 2017 13:45 To: dev@cloudstack.apache.org Subject: Re: midonet-client and Guava dependency conflict The Midonet jar has Guava 18 packaged into it with the Shade plugin. Guava-19.0 is also on the classpath. But for whatever reason, com.google.common.base.Equivalence is being loaded from the Midonet jar instead of guava-19.0.jar, even with an alphabetically sorted classpath. This causes the error mentioned in the original message. My next step is to figure out if this is just what happens when CS 4.9 is running on Tomcat 8 (my current guess), or if it's some weird interaction with changes we've made on our fork (don't see how it can be the case, but must try all possibilities). Guava 19.0 is coming in as a transitive dependency of Reflections 0.9.10. This version was set in commit bb29b1d06. *Jeff Hair* Technical Lead and Software Developer Tel: (+354) 415 0200 j...@greenqloud.com www.greenqloud.com On Fri, Mar 10, 2017 at 1:34 PM, Rafael Weingärtner < rafaelweingart...@gmail.com> wrote: > Are these Guava classes in the Midonet jar? Or do you have two jars > for the same library with two different version in the lib folder? > > On Fri, Mar 10, 2017 at 8:32 AM, Jeff Hair wrote: > > > I have managed to confirm with advanced debugging techniques (i.e. > sticking > > log statements everywhere) that the classloader which sorts the jars > > is working as expected, but the error with guava is still popping > > up. My > next > > step is to see if there is some overriding of the sorted classpath > loader. > > > > *Jeff Hair* > > Technical Lead and Software Developer > > > > Tel: (+354) 415 0200 > > j...@greenqloud.com > > www.greenqloud.com > > > > On Fri, Mar 10, 2017 at 9:25 AM, Rohit Yadav > > > > wrote: > > > > > +1 Retire unsupported plugins, with at least comment them from the > > default > > > build/packaging in plugins/pom.xml? > > > > > > > > > Several plugins in 'plugins/network-elements/' may be removed from > > > the default build/packaging. However, 'midonet' was never fully > > > implemented > > or > > > completed and most definitely removed. > > > > > > > > > Regards. > > > > > > > > > From: Simon Weller > > > Sent: 09 March 2017 21:37:08 > > > To: dev@cloudstack.apache.org > > > Subject: Re: midonet-client and Guava dependency conflict > > > > > > So this brings up a good discussion point. As Jeff points out, the > > Midonet > > > plugin hasn't been actively supported for almost 5 years. At what > > > point > > do > > > we consider retiring unsupported plugins? > > > > > > > > > - Si > > > > > > > > > > > > From: Jeff Hair > > > Sent: Thursday, March 9, 2017 9:43 AM > > > To: dev@cloudstack.apache.org > > > Subject: Re: midonet-client and Guava dependency conflict > > > > > > After doing some more digging, I have confirmed the following: > > > > > >- The midonet plugin is using the Maven Shade plugin to put a > > > bunch > of > > >dependencies into itself. > > >- The plugin hosted in this repository was last updated in 2013. > > >- Most importantly: removing all the guava stuff out of the midonet > > >plugin fixes this issue. > > > > > > I have not had any success in applying > > > https://github.com/openwide-java/tomcat-classloader-ordered to get > > Tomcat > > > [https://avatars1.githubusercontent.com/u/1385131?v=3&s=400] > > :// github.com/openwide-java/tomcat-classloader-ordered> > > > > > > GitHub - openwide-java/tomcat-classloader-ordered: A ...< > > > https://github.com/openwide-java/tomcat-classloader-ordered> > > > github.com > > > README.md tomcat-classloader-ordered. A classloader for Apache > > > Tomcat 8 which loads the jars of WEB-INF lib in alphabetical > > > order. Prior to > > vers
RE: Modern template hosting
but I think it would be fair. > > > > > > > > > > [1] https://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html > > > > > > > > > > PS: You really like very short variables names! > > > > > > > > > > On Fri, Mar 3, 2017 at 1:24 AM, Daan Hoogland < > > > > daan.hoogl...@shapeblue.com > > > > > > > > > > > wrote: > > > > > > > > > > > Nice little thing Will, > > > > > > > > > > > > One question: if I read the code correctly it ‘go’es and > > > > > > tries > all > > > > > mirrors > > > > > > at once and whichever responses first is redirected to the > client. > > > This > > > > > > might well be the same every time. This might be the one > > > > > > closest > to > > > the > > > > > > mirror302 and not to the client. Is that correct or did I > > > > > > miss a > > > > weighing > > > > > > algorithm hidden in there? > > > > > > > > > > > > Good coding, > > > > > > > > > > > > On 03/03/17 00:23, "Will Stevens" wrote: > > > > > > > > > > > > Hey All, > > > > > > Please review this repo and tell me what you think: > > > > > > https://github.com/swill/mirror302 > > > > > > > > > > > > Let me know if you have questions or you would like me > > > > > > to > make > > > > > changes > > > > > > before I bring this topic up with ASF Infra and open a > > > > > > ticket > > to > > > > get > > > > > > this > > > > > > implemented. > > > > > > > > > > > > Cheers, > > > > > > > > > > > > *Will Stevens* > > > > > > > > > > > > > > > > > > > > > > > > On Wed, Mar 1, 2017 at 11:37 AM, Will Stevens < > > > > wstev...@cloudops.com > > > > > > > > > > > > wrote: > > > > > > > > > > > > > I am building a short term solution right now. I > > > > > > hopefully > > > will > > > > > > have the > > > > > > > building blocks in place by the weekend so we can > > > > > > start > > working > > > > > with > > > > > > Infra > > > > > > > to get it in place. > > > > > > > > > > > > > > We will have a web server which we can point something like > > > > > > > downloads.cloudstack.org (or whatever url) at. Then > > > > > > we > will > > > > have > > > > > > an ASF > > > > > > > repo which tracks a mirror list and exposes a static > > > > > > site > to > > be > > > > > able > > > > > > to > > > > > > > query the mirror list. > > > > > > > > > > > > > > The web server will receive a request and will do a > > > > > > 302 > > > redirect > > > > to > > > > > > the > > > > > > > appropriate resource on one of the mirrors. > > > > > > > > > > > > > > This gets us started. Legacy environments will have > > > > > > to do > a > > DB > > > > > > change to > > > > > > > change from 'download.cloud.com' to ' > > downloads.cloudstack.org' > > > > (or > > > > > > > whatever), but otherwise it should be pretty simple. > > > > > > > > > > > > > > We can improve how we deliver templates going forward, > > > > > > but > > this > > > > > > obviously > > > > > > > requires some discussion still. I will try to buy us > > > > > > some > > time > > > > > with > > > > > > an > > > > > > > implementation which solves our problems today... > > > > > > > > > > > > > &g
RE: Modern template hosting
-1 We are trying to get MORE people to use CloudStack. And raising the barrier to entry does nothing to help that. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Abhinandan Prateek [mailto:abhinandan.prat...@shapeblue.com] Sent: 01 March 2017 09:39 To: dev@cloudstack.apache.org Subject: Re: Modern template hosting +1 After seeing this discussion running in circles several times, I think we should at least get started with the simplest option. On 27/02/17, 11:54 PM, "Chiradeep Vittal" wrote: >The alternative foolproof way is to simply not provide the automatic >download. > >Just document the mirror list URL where the templates can be found. I >don't know why people reject this option. > >https://shankerbalan.net/blog/seed-cloudstack-templates-offline/ > >On Mon, Feb 27, 2017 at 10:15 AM, Will Stevens > >wrote: > >> OK. Thanks for the heads up. >> >> On Feb 27, 2017 1:08 PM, "Chiradeep Vittal" wrote: >> >> > Sounds workable. The downloader code in the SSVM won't follow >> > redirects I think. >> > https://github.com/apache/cloudstack/blob/5511065fc20787619d9cd0444 >> > a65a3 155fc9c921/core/src/com/cloud/storage/template/ >> > HttpTemplateDownloader.java#L93 >> > https://goo.gl/dSi0r5 >> > Might need to add >> > client.setRedirectStrategy(new LaxRedirectStrategy()); >> > >> > On Mon, Feb 27, 2017 at 9:57 AM, Will Stevens >> > >> > wrote: >> > >> > > We haven't opened a ticket yet because we don't have a strategy yet. >> > > >> > > What do you guys think of this: >> > > - We setup a new github repo in the 'apache' org which consists >> > > of a >> > single >> > > file with a list of active/supported mirrors. >> > > - I write a small web server, distributed as a binary, which can >> > > be >> > hosted >> > > by ASF Infra. This web server will query the current list of >> > > mirrors >> and >> > > will select one and then do a 302 redirect to that mirror. >> > > >> > > The act of 'choosing' a mirror could be done in a number of ways. >> > > - If we want to define an order, then it could just try from the >> > > top of >> > the >> > > list and work its way down. It would curl the target to make >> > > sure it >> > gets >> > > a 200 and if it does, it would do a 302 redirect. >> > > - Or, if we want to distribute the load across the mirrors, we >> > > could >> pick >> > > from the list randomly. Again, doing a curl to verify the mirror >> > > is up >> > and >> > > then doing a redirect. >> > > - If we want to get fancy, we could do a reverse IP lookup and >> > > try to >> > match >> > > the requester with their closest geographical mirror. >> > > >> > > Thoughts? >> > > >> > > *Will STEVENS* >> > > Lead Developer >> > > >> > > <https://goo.gl/NYZ8KK> >> > > >> > > On Mon, Feb 27, 2017 at 12:46 PM, Chiradeep Vittal < >> chirade...@gmail.com >> > > >> > > wrote: >> > > >> > > > What steps are needed to set up a mirror? What does Infra need to do? >> > Has >> > > > anybody filed a ticket with Infra? >> > > > >> > > > On Sun, Feb 26, 2017 at 10:17 PM, Raja Pullela < >> > > > raja.pull...@accelerite.com> >> > > > wrote: >> > > > >> > > > > Hi will, >> > > > > >> > > > > I believe, we didn’t get to close ‘getting a mirror on Apache’ >> > because >> > > we >> > > > > needed someone on the Apache Infra side to close this. BTW, >> > > > > cloudstack-apt.get.eu (I think Nux manages this?) has >> > > > > all/most of >> > the >> > > > > content. Once we can close on the Apache mirror for hosting >> > > > > the >> > > > content, I >> > > > > can help assist getting the content there. >> > > > > >> > > > > For now, we have replicated the download.cloud.com content to >> > > > > ‘ s3.download.accelerite.com’. >&g
RE: Modern template hosting
Hi Nathan,
Ideally, if you put the template location in (or use a template defined in)
test_data.py then the actual location can be overridden by anyone testing.
For Trillian, we've copied all of the templates that people have define to a
local repo and then replace the URLs in test_data.py to reduce bandwidth use
and download times.
Ie:
"bootableIso":
{
"displaytext": "Test Bootable ISO",
"name": "testISO",
"bootable": True,
"ispublic": False,
"url": "{{ marvin_images_location }}/TinyCore-current.iso",
"ostype": 'Other Linux (64-bit)',
"mode": 'HTTP_DOWNLOAD'
},
I thought that we had come up with a solution for download.cloud.com, by having
a mirrorlist hosted in Community Apache 'space' with anyone able to out
themselves forward as a mirror.
But I must admit I lost track of whether anyone made the requisite changes in
code
Kind regards,
Paul Angus
paul.an...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London WC2N 4HSUK
@shapeblue
-Original Message-
From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of
Will Stevens
Sent: 24 February 2017 16:30
To: dev@cloudstack.apache.org
Subject: Re: Modern template hosting
this is a hard questions. in general, we should be setting up a mirror on some
cloudstack/apache domain and then mirror to other provided templates.
we MUST come up with a solution to deprecate 'download.cloud.com', that is
going to be going away any day now.
i don't know the right way to solve this to be honest, but if you have ideas, i
am willing to help.
*Will STEVENS*
Lead Developer
<https://goo.gl/NYZ8KK>
On Fri, Feb 24, 2017 at 11:25 AM, Nathan Johnson wrote:
> So not to re-open a can of worms, but I’m in a situation where I need
> to come up with a Marvin component test that depends on a template
> based on a kernel that’s relatively new, i.e., newer than Centos 5.3 / Ubuntu
> 10.04 .
> I see openvm.eu has a suitable template (Ubuntu 16.0.4 for KVM), but
> from looking at the thread "Migrating CloudStack content from
> download.cloud.com” it looks like there is resistance to using this at
> least for hosting system vm templates over concerns of neutrality.
> Would this be suitable for a component test? If not, what is a “blessed”
> template location?
>
> Thanks in advance!
>
> Nathan Johnson
> R&D Engineer
>
>
>
> 618 Grassmere Park Drive, Suite 12
> Nashville, TN 37211
> General Office: 615-312-6000
>
> website | blog | support
>
>
>
>
>
>
>
Re: [PROPOSAL] add native container orchestration service
Will is 100% correct. As I mentioned the Title is misleading. However, Murali did clarify in his explanation; this is really about vm cluster orchestration. From: Will Stevens Sent: 6 Feb 2017 22:54 To: dev@cloudstack.apache.org Subject: Re: [PROPOSAL] add native container orchestration service My understanding is that what Paul is talking about is what is already built and IS what the thread is talking about. *Will STEVENS* Lead Developer <https://goo.gl/NYZ8KK> On Mon, Feb 6, 2017 at 2:29 PM, Rajesh Ramchandani < rajesh.ramchand...@accelerite.com> wrote: > Hi Paul - I think this is different from what the thread was about. The > conversation was specifically about adding support for container > orchestrators. You are talking about provisioning a group of VMs. Although, > this is something I think several Cloudstack users have requested before > and we should propose a solution to this. > > Raj > > ____ > From: Paul Angus > Sent: Monday, February 6, 2017 11:16:41 AM > To: dev@cloudstack.apache.org > Subject: RE: [PROPOSAL] add native container orchestration service > > #WhatHeSaid > > The title is misleading. The proposal is purely to add the notion of > Clusters of VMs to CloudStack. These may be for databases, containers or > anything else that needs 'clusters' of compute. Self-healing and > autoscaling are logical next steps to be added. > > Those guys at ShapeBlue have open-sourced their whole k8s container > service piece. If/when the 'cluster' part of that work is added into > CloudStack, the k8s specific pieces can be used by anyone who wants to, > alternatively they could be used for reference in order to create another > types of cluster. (or ignored completely). > > > > > paul.an...@shapeblue.com > www.shapeblue.com<http://www.shapeblue.com> > 53 Chandos Place, Covent Garden, London WC2N 4HSUK > @shapeblue > > > > > -Original Message- > From: Will Stevens [mailto:williamstev...@gmail.com] > Sent: 31 January 2017 13:26 > To: dev@cloudstack.apache.org > Subject: Re: [PROPOSAL] add native container orchestration service > > s/cloud-init/cloud-config/ > > On Jan 31, 2017 7:24 AM, "Will Stevens" wrote: > > > I think that is covered in this proposal. There is nothing k8s > > specific in this integration (from what I understand), all the k8s > > details are passed in via the cloud-init configuration after the cluster > has been provisioned. > > > > On Jan 31, 2017 3:06 AM, "Lianghwa Jou" > > wrote: > > > > > > There are many container orchestrators. Those container orchestrators > > are happy to run on any VMs or bare metal machines. K8s is just one of > > them and there will be more in the future. It may not be a good idea > > to make CloudStack to be k8s aware. IMO, the relationship between k8s > > and cloudstack should be similar to application and os. It probably > > not a good idea to make your OS to be aware of any specific > > applications so IMHO I don’t think k8s should be native to CloudStack. > > It makes more sense to provide some generic services that many > > applications can take advantages of. Some generic resource grouping > > service makes sense so a group of VMs, baremetal machines or network > > can be treated as a single entity. Some life cycle management will be > > necessary for these entities too. We can deploy k8s, swarm, dcos or > > even non-container specific services on top of CloudStack. The k8s is > > changing fast. One single tenant installation may need more than one > > VM group and may actually requires more (k8s federation). It will be a > > struggle to be in sync if we try to bring k8s specific knowledge into > cloudstack. > > > > Regards, > > > > > > -- > > Lianghwa Jou > > VP Engineering, Accelerite > > email: lianghwa@accelerite.com > > > > > > > > > > > > On 1/29/17, 11:54 PM, "Murali Reddy" wrote: > > > > > > I agree with some good views Will has shared and I also agree to > > the concerns raised by Wido and Eric. IMO we need balance of staying > > relevant/add new features vs stability of CloudStack and take > > corrective action if needed. We have two good examples for both. When > > SDN was hot technology CloudStack ended up with bunch of SDN controller > integrations. > > Few years later, now CloudStack is carrying baggage with no > > maintainers for those plugins, with probably not many of CloudStack > users needing overlays. > > On the other hand,
RE: [PROPOSAL] add native container orchestration service
#WhatHeSaid The title is misleading. The proposal is purely to add the notion of Clusters of VMs to CloudStack. These may be for databases, containers or anything else that needs 'clusters' of compute. Self-healing and autoscaling are logical next steps to be added. Those guys at ShapeBlue have open-sourced their whole k8s container service piece. If/when the 'cluster' part of that work is added into CloudStack, the k8s specific pieces can be used by anyone who wants to, alternatively they could be used for reference in order to create another types of cluster. (or ignored completely). paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Will Stevens [mailto:williamstev...@gmail.com] Sent: 31 January 2017 13:26 To: dev@cloudstack.apache.org Subject: Re: [PROPOSAL] add native container orchestration service s/cloud-init/cloud-config/ On Jan 31, 2017 7:24 AM, "Will Stevens" wrote: > I think that is covered in this proposal. There is nothing k8s > specific in this integration (from what I understand), all the k8s > details are passed in via the cloud-init configuration after the cluster has > been provisioned. > > On Jan 31, 2017 3:06 AM, "Lianghwa Jou" > wrote: > > > There are many container orchestrators. Those container orchestrators > are happy to run on any VMs or bare metal machines. K8s is just one of > them and there will be more in the future. It may not be a good idea > to make CloudStack to be k8s aware. IMO, the relationship between k8s > and cloudstack should be similar to application and os. It probably > not a good idea to make your OS to be aware of any specific > applications so IMHO I don’t think k8s should be native to CloudStack. > It makes more sense to provide some generic services that many > applications can take advantages of. Some generic resource grouping > service makes sense so a group of VMs, baremetal machines or network > can be treated as a single entity. Some life cycle management will be > necessary for these entities too. We can deploy k8s, swarm, dcos or > even non-container specific services on top of CloudStack. The k8s is > changing fast. One single tenant installation may need more than one > VM group and may actually requires more (k8s federation). It will be a > struggle to be in sync if we try to bring k8s specific knowledge into > cloudstack. > > Regards, > > > -- > Lianghwa Jou > VP Engineering, Accelerite > email: lianghwa@accelerite.com > > > > > > On 1/29/17, 11:54 PM, "Murali Reddy" wrote: > > > I agree with some good views Will has shared and I also agree to > the concerns raised by Wido and Eric. IMO we need balance of staying > relevant/add new features vs stability of CloudStack and take > corrective action if needed. We have two good examples for both. When > SDN was hot technology CloudStack ended up with bunch of SDN controller > integrations. > Few years later, now CloudStack is carrying baggage with no > maintainers for those plugins, with probably not many of CloudStack users > needing overlays. > On the other hand, other than attempt to liaison with ETSI for NFV no > effort was done. OpenStack has become de-facto for NFV. Now for > OpenStack, arguably NFV has become larger use case than cloud it self. > I concur with Will’s point that with minimal viable solution that does > not change the core of CloudStack, and can keep CloudStack relevant is > worth to be taken in. > > Will, > > To your question of how different is from ShapeBlue’s container > service, its design, implementation and API semantics etc remain same. > ShapeBlue’s container service was true drop in plug-in to CloudStack, > with this proposal I am trying to re-work to make it a core CloudStack > pluggable service which is part of CloudStack. > > Key concepts that this proposal is trying to add > > - add notion of ‘container cluster’ as a first class entity in > CloudStack. Which is bacially collection of other CloudStack resources > (like VM’s, networks, public ip, network rules etc) > - life cycle operation to manage ‘container cluster’ like > create, delete, start, stop, scale-up, scale-down, heal etc > - orchestrate container orchestrator control plane on top of > provisioned resources > > At-least for k8s (which is what this proposal is targeting), > integration with k8s is bare minimum. There are cloud-config scripts > that automatically setup k8s cluster master and node VM’s. All > CloudStack is doing in passing the cloud-config to the core OS VM’s as user > data. > > Regards > Murali Reddy > > > > > > > > On 29/01/17, 8:54 AM, "Will Stevens" behalf of wstev...@cloudops.com> wrote: > > >I agree that we need to be careful what we take on and own inside > >CloudStack. I feel like some of the plugins or integrations > which we have > >been "maintaini
RE: Dedicated IP range for SSVM/CPVM
I have come across a few people with effectively this use case over the years.
My thoughts have always been that it would good to be able to reserve IPs or
ranges for SSVM & CPVM in the same way that we can reserve IPs or ranges for an
account or domain...
Kind regards,
Paul Angus
paul.an...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London WC2N 4HSUK
@shapeblue
-Original Message-
From: Erik Weber [mailto:terbol...@gmail.com]
Sent: 17 January 2017 08:27
To: dev@cloudstack.apache.org
Subject: Re: Dedicated IP range for SSVM/CPVM
Hi Nitin,
There are legit reasons for separating VR public pool from SSVM and CPVM.
For instance if you run a private cloud and don't want to have your cpvm/ssvm
publically available, but still want to have the VRs accessible
Erik
tir. 17. jan. 2017 kl. 05.37 skrev Nitin Kumar Maharana <
nitinkumar.mahar...@accelerite.com>:
> Hi Rene,
>
>
>
> The default pool, which means are you mentioning the public IP range?
>
>
>
> If it is a public IP range, user VMs won’t be consuming any IP from there.
>
> Only system VMs(CPVM/SSVM/VR) will be consuming. VRs will be providing
> public access to the user VMs.
>
>
>
>
>
> Thanks,
>
> Nitin
>
> > On 16-Jan-2017, at 8:56 PM, Rene Moser wrote:
>
> >
>
> > Hi
>
> >
>
> > We would like to make a change proposal for SSVM/CPVM.
>
> >
>
> > Currently, the SSVM/CPVM get an IP from the "default" pool of
>
> > vlaniprange which is the from the account "system"
>
> >
>
> >
>
> > "vlaniprange": [
>
> >{
>
> > "account": "system",
>
> > "domain": "ROOT",
>
> > "endip": "10.101.0.250",
>
> > "forvirtualnetwork": true,
>
> > "gateway": "10.101.0.1",
>
> > "netmask": "255.255.255.0",
>
> > "startip": "10.101.0.11",
>
> > ...
>
> >
>
> >},
>
> >
>
> >
>
> > "systemvm": [
>
> >{
>
> > "activeviewersessions": 0,
>
> > "gateway": "10.101.0.1",
>
> > "hypervisor": "VMware",
>
> > "id": "d9a8abe5-b1e0-47d6-8f39-01b48ff1e0fa",
>
> > "name": "v-5877-VM",
>
> > "privatenetmask": "255.255.255.0",
>
> > "publicip": "10.101.0.113",
>
> > "publicnetmask": "255.255.255.0",
>
> > "state": "Running",
>
> > ...
>
> >},
>
> >
>
> >
>
> > For security considerations we would like to define a dedicated IP
> > range
>
> > for SSVM/CPVM, which, preferably, should not have any relation to
> > the
>
> > default pool range.
>
> >
>
> > The default pool range should be used for userVMs only. To indicate
> > the
>
> > use I propolse 2 new flags, which only considered for "account=system"
>
> > and indicate if the range can be used for userVMs or/and systemVMs.
>
> >
>
> > For backwards compatibility this would be the default
>
> >
>
> > "foruservms": true,
>
> > "forsystemvms": true,
>
> >
>
> >
>
> > to have a separate range for UserVMs/SystemVMs, it would look like
>
> >
>
> >
>
> > "vlaniprange": [
>
> >{
>
> > "account": "system",
>
> > "domain": "ROOT",
>
> > "foruservms": true,
>
> > "forsystemvms": false,
>
> > "endip": "192.160.123.250",
>
> > "forvirtualnetwork": true,
>
> > "gateway": "192.160.123.1",
>
> > "netmask": "255.255.255.0",
>
> > "startip": "192.160.123.11",
>
> > ...
>
> >
>
> >},
>
> >
>
> > "vlaniprange": [
>
> >{
>
> > "account": "system",
>
> > "domain": "ROOT",
>
> > "foruservms": false,
>
> > "forsystemvms": true,
>
> > "endip": "10.101.0.250",
>
> > "forvirtualnetwork": true,
>
> > "gateway": "10.101.0.1",
>
> > "netmask": "255.255.255.0",
>
> > "startip": "10.101.0.11",
>
> > ...
>
> >
>
> >},
>
> >
>
> >
>
> > Does anyone has see any conflicts with this proposal?
>
> >
>
> > Regards
>
> > René
>
> >
>
>
>
>
>
>
>
>
>
> DISCLAIMER
>
> ==
>
> This e-mail may contain privileged and confidential information which
> is the property of Accelerite, a Persistent Systems business. It is
> intended only for the use of the individual or entity to which it is
> addressed. If you are not the intended recipient, you are not
> authorized to read, retain, copy, print, distribute or use this
> message. If you have received this communication in error, please
> notify the sender and delete all copies of this message. Accelerite, a
> Persistent Systems business does not accept any liability for virus infected
> mails.
>
>
RE: Welcoming Simon Weller & Paul Angus to the PMC
Thank you guys and let me add my congratulations to Simon too ! Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Ian Rae [mailto:i...@cloudops.com] Sent: 15 January 2017 15:57 To: dev@cloudstack.apache.org; Glenn Wagner Cc: us...@cloudstack.apache.org Subject: Re: Welcoming Simon Weller & Paul Angus to the PMC Bravo! On Sun, Jan 15, 2017 at 9:49 AM, Glenn Wagner wrote: > Congratulations guys, well done to you both. > > Glenn > > > glenn.wag...@shapeblue.com > www.shapeblue.com > First Floor, Victoria Centre, 7 Victoria Street, Somerset West, Cape > Town 7129South Africa @shapeblue > > > > > -Original Message- > From: Will Stevens > mailto:will%20stevens%20%3csw...@apache.org%3e>> > Reply-to: > To: dev@cloudstack.apache.org > mailto:%22...@cloudstack.apache.org%22%20%3 > c...@cloudstack.apache.org%3e>>, us...@cloudstack.apache.org > mailto:%22us...@cloudstack.apache.org%22% > 20%3cus...@cloudstack.apache.org%3e>> > Subject: Welcoming Simon Weller & Paul Angus to the PMC > Date: Fri, 13 Jan 2017 11:30:20 -0500 > > > Join me in welcoming Simon Weller and Paul Angus to the Apache > CloudStack PMC. Both have been dedicated members of the community and > it is with great pleasure that we welcome them to the PMC. > > Next time you see either of them, buy them a drink. :) > > Welcome guys... > -- Ian Rae CEO | PDG c: 514.944.4008 CloudOps | Cloud Infrastructure and Networking Solutions www.cloudops.com | 420 rue Guy | Montreal | Canada | H3J 1S6
RE: [RESULT][VOTE] Apache Cloudstack 4.9.2.0 (RC2)
Good job Rohit! Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rohit Yadav [mailto:bhais...@apache.org] Sent: 06 January 2017 05:03 To: dev@cloudstack.apache.org Subject: [RESULT][VOTE] Apache Cloudstack 4.9.2.0 (RC2) Hi all, After 72 hours, the vote for CloudStack 4.9.2.0 *passes* with 4 PMC + 0 non-PMC votes. +1 (PMC / binding) 4 person (Wido, Bruno, Rajani, Rohit) +1 (non binding) none 0 none -1 none Thanks to everyone participating. I will now prepare the release announcement to go out after 24 hours to give the mirrors time to catch up. Regards.
RE: [DISCUSS][FUTURE] Move to JDK1.8 and support JRE1.8
I have no idea of the effort involved, so I'm going to pretend that it would be easy. It would be great if our plugin model for network functions could become more of a driver model, such that these things could be developed and maintained independantly of the ACS release cycles. It would be a fantastic step toward a proper, flexible NFV offering. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] Sent: 27 December 2016 07:24 To: dev@cloudstack.apache.org Subject: [DISCUSS][FUTURE] Move to JDK1.8 and support JRE1.8 All, Java7 has eol-ed, it's about time to move to Java8 for both codebase and runtime [1]. An experimental PR [2] shows that moving to Java8 is fairly straight forward. The only component that is failing is F5 network plugin, which lacks authors/maintainers as this issue has been previously raised on dev@ [3]. In order to move to JDK8, we'll need to take hard decisions to comment/exclude plugins such as F5 from the default build profiles that may not get fixes and improvements from their authors/maintainers. Thoughts, comments? [1] https://issues.apache.org/jira/browse/CLOUDSTACK-9710 <https://issues.apache.org/jira/browse/CLOUDSTACK-9710> [2] https://github.com/apache/cloudstack/pull/1864 [3] http://markmail.org/message/ggx5ycoezyr2ywel Regards. rohit.ya...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: rVPC
Thanks for this information Wei, It there a detailed design document which imcludes this kind of information for the redundant routers and VPCs? My understanding is that they use VRRP, which *can* use a 'virtual MAC' but the primary MAC addresses of the public interface should be unique - with the last byte of the MAC address matching representing the Virtual Router Identifier. I'd like to understand why this was implemented differently. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Wei ZHOU [mailto:ustcweiz...@gmail.com] Sent: 28 November 2016 06:05 To: dev@cloudstack.apache.org Subject: Re: rVPC Hi Paul, CloudStack is designed like it. Not only RVR on VPC, but also RVR for isolated network, the MAC on public interface are the same on MASTER/BACKUP. -Wei 2016-11-27 21:30 GMT+01:00 Paul Angus : > Hey Wilder, > > I hope that you are well. > > We've found that the rVPC seems to use the same MAC address on the > public interface of both the Master and Backup rVPC nodes - was this by > design? > > Kind regards, > > Paul Angus > > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > >
rVPC
Hey Wilder, I hope that you are well. We've found that the rVPC seems to use the same MAC address on the public interface of both the Master and Backup rVPC nodes - was this by design? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
PR Backlog
All, Now that we're getting some testing momentum going, I was thinking that we need a way to categorise and prioritise the PR queue. There are a limited number of labels available for use to apply to the PRs within Github as it is, but we could go through and highlight bug fixes and prioritise them and mark ones with outstanding questions against them... We also need the PRs rebased as some are pretty old. Thoughts/flames? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: [GitHub] cloudstack issue #1711: Xenserver7 Support
@rohit Can you set a BlueO job off from this please? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: syed [mailto:g...@git.apache.org] Sent: 25 October 2016 17:27 To: dev@cloudstack.apache.org Subject: [GitHub] cloudstack issue #1711: Xenserver7 Support Github user syed commented on the issue: https://github.com/apache/cloudstack/pull/1711 @PaulAngus would it be possible to run another round of tests on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
RE: 4.8, 4.9, and master Testing Status
To give a specific example, Running XenServer7 smoke tests result in a large number of failures due to problems with the tests. If we're going to make any real forward progress, we need to be able to get meaningful test results. Plae review/test these PRs pretty please (with sugar on top). Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] Sent: 19 October 2016 12:39 To: dev@cloudstack.apache.org Subject: Re: 4.8, 4.9, and master Testing Status All, At least one more test/review LGTM is required on following PRs, please help with your review/tests as they will help us work towards cutting the RCs: https://github.com/apache/cloudstack/pull/1692 https://github.com/apache/cloudstack/pull/1703 https://github.com/apache/cloudstack/pull/1708 As John has shared in the previous email, we still have outstanding failures and we'll be working towards fixing all three of them. If we can get them merged before end of the week, we can trigger tests on them again to know test status on each of the 4.8, 4.9 and master branches that can help us determine the quality on each of the branches and we can work towards RCs. Regards. From: John Burwell Sent: 14 October 2016 12:11:04 To: dev@cloudstack.apache.org Subject: Re: 4.8, 4.9, and master Testing Status All, We have made great strides stabilizing the 4.8 [1] and 4.9 [2] smoke tests. While we are not super green, the following remaining failures/issues are isolated to the VPC VR and secondary storage. * CLOUDSTACK-9541: redundant VPC VR: issues when master and backup switch happens on failover [3] * CLOUDSTACK-9540: createPrivateGateway create private network does not create proper VLAN network on XenServer * CLOUDSTACK-9528: SSVM Downloads (built-in) template multiple times Therefore, I would like to merge these two PRs so that we can begin the process of rebasing and retesting the PRs slotted for 4.8 and 4.9 that are not affected by these issues (i.e. PRs unrelated to secondary storage or the VR). Our hope is that we can correct these issues quickly, and by the time we have worked through the backlog of pending PRs, these issues will be addressed and we can move those impacted forward. Unfortunately, the master PR [5] has 6 failures and 4 errors on XenServer [6] that we are currently analyzing. We hope to have these resolved shortly in order to begin progressing PRs targeting master. I would like to get 1692 [1] and 1703 [2] merged in the next 24 hours. We need to complete the following actions in order to accomplish this goal: * Obtain at least one code review LGTM on PR #1692 [1] * Obtain at least one code review LGTM on PR #1703 [2] * Obtain at least one test review LGTM on PR #1703 [2] Once these PRs, I will be updating PRs slotted for 4.8 and 4.9 to ping authors for a rebase. Following each rebase, we will trigger blueorangutan to retest each one. Thank again for your patience and assistance, -John [1]: https://github.com/apache/cloudstack/pull/1692 [2]: https://github.com/apache/cloudstack/pull/1703 [3]: https://issues.apache.org/jira/browse/CLOUDSTACK-9541 [4]: https://issues.apache.org/jira/browse/CLOUDSTACK-9540 [5]: https://github.com/apache/cloudstack/pull/1708 [6]: https://github.com/apache/cloudstack/pull/1708#issuecomment-253698099 > On Oct 7, 2016, at 10:12 AM, Will Stevens wrote: > > Great work everyone. Don't worry about the sporadic updates, that is > just the nature of the beast when working through stuff like this. > Well done so far... > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > @CloudOps_ > > On Fri, Oct 7, 2016 at 9:53 AM, John Burwell > > wrote: > >> All, >> >> Thank you Ilya and Haijao for your words of encouragement. In >> addition to the efforts of Paul, Rohit, Murali, Abhi, and Bobby, >> Sergey Levitskiy has been providing great help testing VMware. >> >> I apologize for my sporadic status updates. We have made significant >> progress in getting smoke tests to pass on KVM, XenServer, and VMware. >> Currently, we have the following number of failures and errors: >> >>* KVM: 0 >>* VMware: 4 >>* XenServer: 8 >> >> The outstanding failures and errors seem to be the caused by the >> following >> issues: >> >>1. On VMware and XenServer, guest VMs in VPCs start but don’t >> acquire IP addresses causing tests relying on SSH connectivity tests >> to fail. The issue occurs does not occur
RE: XenServer 7
Hi Syed, I've added XenServer7 into our potential testing matrix, and kicked of the smoke test suite. The first thing that I've noticed, is that one of my two hosts hasn't configured 'fully' - The label 'Local-Storage' hasn't changed to a UUID I'll have some proper feedback in the morning, when the test suites have finished... Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Syed Ahmed [mailto:sah...@cloudops.com] Sent: 17 October 2016 21:04 To: dev@cloudstack.apache.org Subject: Re: XenServer 7 @Raj I'd be more interested in knowing if there are any corner cases that We've missed. The fix seems to be relatively simple but I wonder if there is something that I've missed as I cannot tests most of the scenarios On Mon, Oct 17, 2016 at 4:00 PM, Syed Ahmed wrote: > PR Created at https://github.com/apache/cloudstack/pull/1711 > > > > On Mon, Oct 17, 2016 at 3:20 PM, Syed Ahmed wrote: > >> Agree with Paul. If you can point to your public repo we can >> collaborate easily. >> >> As per testing. I have manually verified the following use cases >> below. I am very happy with the results so far. I will open a PR with >> this and we can run regression tests. I also have qcow2 images of >> XenServer7 and script to reset/reinitialize it so I will post them as >> well on the PR so you guys can take them and install/test XS7 >> >> * Create a new cluster with XenServer7 >> * Add Primary storage: Should create an SR on XS7 >> * Add another XS7 host to the Pool >> * Add host2 to Cloudstack >> * Create VM1 from template >> * Create VM2 from template >> * Ping/SSH VM1 to VM2 and vice-versa >> * Stop/Delete/Expunge VM2 >> * Create Data disk >> * Attach it to VM1 >> * Create VM snaphsot of VM1 >> * Restore VM snapshot of VM1 >> * Delete VM snapshot of VM1 >> * Create Volume snapshot of Datadisk >> * Create volume snapshot of Root disk >> * Create new template from snapshot of root disk >> * Create volume from snapshot of datadisk >> * Detach datadisk volume >> * Delete datadisk volume >> * Aquire a public IP >> * Create a static nat to VM1 >> * Live migrate VM1 while traffic on VM >> * Delete VM1 >> >> Thanks, >> -Syed >> >> >> On Mon, Oct 17, 2016 at 1:45 PM, Paul Angus >> >> wrote: >> >>> Hey Rajesh, >>> >>> Could you submit a pull request to Syed's branch containing where >>> you've got to (or let us know where your work is publicly >>> accessible) so that we can combine work..? >>> >>> >>> >>> Kind regards, >>> >>> Paul Angus >>> >>> paul.an...@shapeblue.com >>> www.shapeblue.com >>> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue >>> >>> >>> >>> >>> -Original Message- >>> From: Rajesh Ramchandani [mailto:rajesh.ramchand...@accelerite.com] >>> Sent: 17 October 2016 18:37 >>> To: dev@cloudstack.apache.org >>> Subject: Re: XenServer 7 >>> >>> Syed - we are working with Citrix on XS7 as well, please drop a note if >>> you need help. >>> >>> Raj >>> >>> >>> >>> On Mon, Oct 17, 2016 at 8:30 AM -0700, "Syed Ahmed" >> <mailto:sah...@cloudops.com>> wrote: >>> >>> Hi Guys, >>> >>> I have some free time on my hands and was trying to add XenServer 7 >>> support. There seems to be only one line change that was required to add >>> it. I am able to create VMs and do basic stuff like NAT/port forwarding. >>> >>> If anyone is interested in trying this out, I have a branch [1] which I >>> am working on currently. I will open a PR after I am fairly confident that >>> everything works. >>> >>> [1] https://github.com/syed/cloudstack/tree/xenserver7 >>> >>> >>> Thanks, >>> -Syed >>> >>> >>> >>> DISCLAIMER >>> == >>> This e-mail may contain privileged and confidential information which is >>> the property of Accelerite, a Persistent Systems business. It is intended >>> only for the use of the individual or entity to which it is addressed. If >>> you are not the intended recipient, you are not authorized to read, retain, >>> copy, print, distribute or use this message. If you have received this >>> communication in error, please notify the sender and delete all copies of >>> this message. Accelerite, a Persistent Systems business does not accept any >>> liability for virus infected mails. >>> >> >> >
RE: XenServer 7
Hey Rajesh, Could you submit a pull request to Syed's branch containing where you've got to (or let us know where your work is publicly accessible) so that we can combine work..? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rajesh Ramchandani [mailto:rajesh.ramchand...@accelerite.com] Sent: 17 October 2016 18:37 To: dev@cloudstack.apache.org Subject: Re: XenServer 7 Syed - we are working with Citrix on XS7 as well, please drop a note if you need help. Raj On Mon, Oct 17, 2016 at 8:30 AM -0700, "Syed Ahmed" mailto:sah...@cloudops.com>> wrote: Hi Guys, I have some free time on my hands and was trying to add XenServer 7 support. There seems to be only one line change that was required to add it. I am able to create VMs and do basic stuff like NAT/port forwarding. If anyone is interested in trying this out, I have a branch [1] which I am working on currently. I will open a PR after I am fairly confident that everything works. [1] https://github.com/syed/cloudstack/tree/xenserver7 Thanks, -Syed DISCLAIMER == This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.
RE: XenServer 7
Awesome Syed, What can we do to help? @rohit can we point blueorangutan at any repo to build packages for testing? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Syed Ahmed [mailto:sah...@cloudops.com] Sent: 17 October 2016 16:29 To: dev@cloudstack.apache.org Subject: XenServer 7 Hi Guys, I have some free time on my hands and was trying to add XenServer 7 support. There seems to be only one line change that was required to add it. I am able to create VMs and do basic stuff like NAT/port forwarding. If anyone is interested in trying this out, I have a branch [1] which I am working on currently. I will open a PR after I am fairly confident that everything works. [1] https://github.com/syed/cloudstack/tree/xenserver7 Thanks, -Syed
RE: ACS 4.9 + VMware: Unable to remove one of the NICs of a multi-nic VM
I tried extending the timeout to 30 seconds, but that didn't help. However, installing vmware tools (not easy in our built-in templates) made the problem go away. With the tools installed the removal was pretty much instant. Doesn't explain the difference 4.7 and 4.9 that you are seeing though. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Prashanth Manthena [mailto:prashanth.manth...@nuagenetworks.net] Sent: 14 October 2016 13:24 To: dev@cloudstack.apache.org Subject: Re: ACS 4.9 + VMware: Unable to remove one of the NICs of a multi-nic VM Hi Paul, Thank you for trying it out. I am only hitting this issue for guest VMs (i.e. not with VPC VRs) created in ACS 4.9 (i.e. not in ACS 4.7) with VMware setups. Moreover, I get the same error when I am trying to remove the NIC (i.e. network adapter) directly from VMware's Vcenter. There is a possible workaround for this issue from VMware on Internet, which doesn't work in this scenario both from CloudStack and VMware: https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2081503 Most likely, this issue has something to do with how we deploy (multi-nic) guest VMs in ACS 4.9 with VMware setups. On Fri, Oct 14, 2016 at 1:00 PM, Paul Angus wrote: > Hi Prashanth, > > I've just tried that. I get the same error - The guest operating > system did not respond to a hot-remove request for device ethernet1 in > a timely manner. > > Kind regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > > -Original Message- > From: Prashanth Manthena [mailto:prashanth.manth...@nuagenetworks.net] > Sent: 14 October 2016 09:21 > To: dev@cloudstack.apache.org > Subject: Re: ACS 4.9 + VMware: Unable to remove one of the NICs of a > multi-nic VM > > HI All, > > Does this issue ring a bell, and is anyone else hitting this issue ? > > Let me know, if it is a known issue. > > Thanking you in advance !! > > On Thu, Oct 13, 2016 at 6:25 PM, Prashanth Manthena < prashanth.manthena@ > nuagenetworks.net> wrote: > > > Hi, > > > > I am hitting the following issue on an ACS 4.9 + VMware setup (steps > > to > > reproduce): > > > > 1) Deploy a multi-nic VM (or) add a nic to a single-nic VM > > > > 2) Remove the non-default nic from the multi-nic VM, which fails with > > the following error/exception in the management server log: > > > > 2016-10-05 06:13:28,251 DEBUG [c.c.a.ApiServlet] > > (catalina-exec-14:ctx-f8dc6bd0 ctx-ee610e01) (logid:58e9cf98) > > ===END=== 10.31.52.95 -- GET > > command=queryAsyncJobResult&jobId=9ad66ce9-6e1b-4c25-bd2e-763f4586dd86 > > &response=json&_=1475673245452 > > 2016-10-05 06:13:29,787 ERROR [c.c.h.v.r.VmwareResource] > (DirectAgent-302:ctx-78a58d67 10.31.56.178, job-171/job-172, cmd: > UnPlugNicCommand) (logid:9ad66ce9) Unexpected exception: > > java.lang.RuntimeException: The guest operating system did not respond > to a hot-remove request for device ethernet1 in a timely manner. > > at com.cloud.hypervisor.vmware.util.VmwareClient.waitForTask( > VmwareClient.java:354) > > at com.cloud.hypervisor.vmware.mo.VirtualMachineMO. > configureVm(VirtualMachineMO.java:949) > > at com.cloud.hypervisor.vmware.resource.VmwareResource. > execute(VmwareResource.java:1103) > > at com.cloud.hypervisor.vmware.resource.VmwareResource. > executeRequest(VmwareResource.java:469) > > at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext( > DirectAgentAttache.java:315) > > at org.apache.cloudstack.managed.context. > ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > > at org.apache.cloudstack.managed.context.impl. > DefaultManagedContext$1.call(DefaultManagedContext.java:56) > > at org.apache.cloudstack.managed.context.impl. > DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > > at org.apache.cloudstack.managed.context.impl. > DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > > at org.apache.cloudstack.managed.context. > ManagedContextRunnable.run(ManagedContextRunnable.java:46) > > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:471) > > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) > >
RE: ACS 4.9 + VMware: Unable to remove one of the NICs of a multi-nic VM
Hi Prashanth, I've just tried that. I get the same error - The guest operating system did not respond to a hot-remove request for device ethernet1 in a timely manner. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Prashanth Manthena [mailto:prashanth.manth...@nuagenetworks.net] Sent: 14 October 2016 09:21 To: dev@cloudstack.apache.org Subject: Re: ACS 4.9 + VMware: Unable to remove one of the NICs of a multi-nic VM HI All, Does this issue ring a bell, and is anyone else hitting this issue ? Let me know, if it is a known issue. Thanking you in advance !! On Thu, Oct 13, 2016 at 6:25 PM, Prashanth Manthena < prashanth.manth...@nuagenetworks.net> wrote: > Hi, > > I am hitting the following issue on an ACS 4.9 + VMware setup (steps > to > reproduce): > > 1) Deploy a multi-nic VM (or) add a nic to a single-nic VM > > 2) Remove the non-default nic from the multi-nic VM, which fails with > the following error/exception in the management server log: > > 2016-10-05 06:13:28,251 DEBUG [c.c.a.ApiServlet] > (catalina-exec-14:ctx-f8dc6bd0 ctx-ee610e01) (logid:58e9cf98) > ===END=== 10.31.52.95 -- GET > command=queryAsyncJobResult&jobId=9ad66ce9-6e1b-4c25-bd2e-763f4586dd86 > &response=json&_=1475673245452 > 2016-10-05 06:13:29,787 ERROR [c.c.h.v.r.VmwareResource] > (DirectAgent-302:ctx-78a58d67 10.31.56.178, job-171/job-172, cmd: > UnPlugNicCommand) (logid:9ad66ce9) Unexpected exception: > java.lang.RuntimeException: The guest operating system did not respond to a > hot-remove request for device ethernet1 in a timely manner. > at > com.cloud.hypervisor.vmware.util.VmwareClient.waitForTask(VmwareClient.java:354) > at > com.cloud.hypervisor.vmware.mo.VirtualMachineMO.configureVm(VirtualMachineMO.java:949) > at > com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:1103) > at > com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:469) > at > com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:315) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > 2016-10-05 06:13:29,788 DEBUG [c.c.a.m.DirectAgentAttache] > (DirectAgent-302:ctx-78a58d67) (logid:9ad66ce9) Seq 4-1440588930805137508: > Response Received: > 2016-10-05 06:13:29,788 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] > (DirectAgent-302:ctx-78a58d67) (logid:9ad66ce9) Seq > 4-1440588930805137508: MgmtId 275619427423488: Resp: Routing to peer > 2016-10-05 06:13:29,789 DEBUG [c.c.a.m.AgentAttache] > (DirectAgent-302:ctx-78a58d67) (logid:9ad66ce9) Seq > 4-1440588930805137508: No more commands found > 2016-10-05 06:13:31,120 DEBUG [o.s.b.f.s.DefaultListableBeanFactory] > (API-Job-Executor-8:ctx-a6e36538 job-171 ctx-446c510f) (logid:9ad66ce9) > Returning cached instance of singleton bean 'messageBus' > 2016-10-05 06:13:31,127 ERROR [c.c.a.ApiAsyncJobDispatcher] > (API-Job-Executor-8:ctx-a6e36538 job-171) (logid:9ad66ce9) Unexpected > exception while executing > org.apache.cloudstack.api.command.admin.vm.RemoveNicFromVMCmdByAdmin > com.cloud.utils.exception.CloudRuntimeException: Unable to remove > Ntwk[205|Guest|16] from VM[User|i-2-3-VM] > at > com.cloud.vm.UserVmManagerImpl.removeNicFromVirtualMachine(UserVmManagerImpl.java:1291) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >
RE: [ANNOUNCE] New committer: Syed Ahmed
Congrats Syed.! Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] Sent: 06 October 2016 16:59 To: dev@cloudstack.apache.org Subject: Re: [ANNOUNCE] New committer: Syed Ahmed Congratulations Syed! Welcome to the club ;) On Thu, Oct 6, 2016 at 12:56 PM, Nicolás Vázquez wrote: > Congratulations Syed! > > 2016-10-06 11:21 GMT-03:00 Syed Ahmed : > > > Thank you all :) > > > > On Thu, Oct 6, 2016 at 6:17 AM, Wei ZHOU wrote: > > > > > Congratulations, Syed!! > > > > > > 2016-10-05 22:07 GMT+02:00 Will Stevens : > > > > > > > The Project Management Committee (PMC) for Apache CloudStack has > > > > asked Syed Ahmed to become a committer and we are pleased to > > > > announce that he has accepted. > > > > > > > > Being a committer allows many contributors to contribute more > > > > autonomously. For developers, it makes it easier to submit > > > > changes > and > > > > eliminates the need to have contributions reviewed via the patch > > > > submission process. Whether contributions are > > > > development-related or otherwise, it is a recognition of a > > > > contributor's participation in > the > > > > project and commitment to the project and the Apache Way. > > > > > > > > Please join me in congratulating Syed! > > > > > > > > Will Stevens > > > > on behalf of the CloudStack PMC > > > > > > > > > > -- Rafael Weingärtner
RE: macchinina OVA template
Awesome! thanks Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Nux! [mailto:n...@li.nux.ro] Sent: 03 October 2016 20:06 To: Paul Angus Cc: dev Subject: Re: macchinina OVA template Sure, done -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - > From: "Paul Angus" > To: "dev" , "Nux!" > Sent: Monday, 3 October, 2016 19:58:52 > Subject: macchinina OVA template > Hi Nux, > > Could you move the new vmware macchinina template into the main > download directory (http://dl.openvm.eu/cloudstack/macchinina/x86_64/) > so that tests will run please. > > > > > Kind regards, > > Paul Angus > > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
macchinina OVA template
Hi Nux, Could you move the new vmware macchinina template into the main download directory (http://dl.openvm.eu/cloudstack/macchinina/x86_64/) so that tests will run please. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: vmware macchinina template
Hi Nux, No, It doesn’t seem to be in there either. ☹ Kind regards, Paul Angus From: Nux! [mailto:n...@li.nux.ro] Sent: 23 September 2016 21:16 To: Paul Angus ; dev@cloudstack.apache.org Subject: Re: vmware macchinina template Hi, I am away for a few days, won't have a chance to look at this till next week. There should be an 'old' dir on the same location, can you give that a try, see if it has the driver? -- Sent from my mobile device. Please excuse my brevity. On 23 September 2016 13:05:26 CEST, Paul Angus mailto:paul.an...@shapeblue.com>> wrote: Hi Nux, How are you doing? I’m fixing the marvin tests to point to http://dl.openvm.eu/cloudstack/macchinina/x86_64/macchinina-vmware.ova But Serg points out that the vmware template doesn’t have an E1000 (intel pro/1000) driver in it so can’t enable interfaces. Could you fix or let me know how I can build a template to pass back to you pls. Kind regards, Paul Angus paul.an...@shapeblue.com<mailto:paul.an...@shapeblue.com> www.shapeblue.com<http://www.shapeblue.com> @shapeblue paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
vmware macchinina template
Hi Nux, How are you doing? I'm fixing the marvin tests to point to http://dl.openvm.eu/cloudstack/macchinina/x86_64/macchinina-vmware.ova But Serg points out that the vmware template doesn't have an E1000 (intel pro/1000) driver in it so can't enable interfaces. Could you fix or let me know how I can build a template to pass back to you pls. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: [DISCUSS] Replacing the VR
Hi All, From the looks of this thread and the different preferences that parties have, the way forward looks to be a model that allows multiple different VRs to be used is the answer. This is something that I have had in mind for some time now. By abstracting the roles and configuration of the VR, drivers can be written which transform requests such as 'add these firewall rules' into something that a VyOs, Fortigate, pfSense, Cisco ASAv, a Juniper vSRX or a homebrew VR can understand and implement. Ideally I'd like to see the features separated and service chaining introduced such that someone might use a stock VR with a VPN appliance or a Cisco ASAv in front of a VR doing load balancing. This moves us forward into a much more NFV-like world. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Syed Ahmed [mailto:sah...@cloudops.com] Sent: 19 September 2016 17:07 To: dev@cloudstack.apache.org Subject: Re: [DISCUSS] Replacing the VR Hey Guys, Will and I had a discussion in the morning on around VyOS and I have an idea that could work, here me out. The way Cloudstack currently communicates with VR is via the Hypervisor (let's assume KVM and XenServer for now). The management server sends a command as a JSON to the hypervisor which proxies them to the VR and they get executed there. Now, what we could do is add a proxy on the hypervisor which translates the management server JSON to VyOS commands (and vice-versa). There is a VyOS API lib in python which we clould use. Now this would require 0 changes on the Cloudstack core networking side. There may be a few minor changes required to push this proxy on the hypervisor but other than that there is nothing major. Now in the mean time, the VyOS guys can work on their v2.0 and when they have a stable enough API we can make it a first class citizen in Cloudstack. This approach would not work for VMWare as in VMWare the management server directly talks to the VR. However, this problem could be fixed by adding a middle VM which does the proxying to-and-from the VR. This would also improve the overall security of the system in VMWare as well. I am not too concerned about VMWare at the moment as most of us use either KVM or XenServer. What do you guys think of this approach? -Syed On Mon, Sep 19, 2016 at 11:42 AM, Stephan Seitz < s.se...@secretresearchfacility.com> wrote: > Hi! > > Just to add my 2 cents to that thread: > > I'ld really like to see something like vyatta or pfsense integrated as > "standard" VR. > > We'd also talked internally about replacing the VR with some more > mature "appliance"-like router distro. > > pfsense e.g. comes AFAIK with no defined API but instead has a very > nice GUI. > How would this fit into the concept of configuring the VR via ACS? > Would parts of the GUI - like IP configuration and basic firewall rules > - hidden or greyed? > Where would one save the configuration, VPN certificates and so on? > > > - Stephan > > > Am Sonntag, den 18.09.2016, 15:19 + schrieb Marty Godsey: > > On this note I also mentioned pfsense earlier. > > > > www.pfsense.org > > > > > > Regards, > > Marty Godsey > > > > -Original Message- > > From: ilya [mailto:ilya.mailing.li...@gmail.com] > > Sent: Sunday, September 18, 2016 1:09 AM > > To: dev@cloudstack.apache.org > > Subject: Re: [DISCUSS] Replacing the VR > > > > Our options become much better if we consider BSD based routers. > > > > Would that be on the table? > > > > https://en.wikipedia.org/wiki/List_of_router_and_firewall_distributio > > ns > > > > > > On 9/16/16 12:04 PM, Will Stevens wrote: > > > > > > Ya, your points are all valid Simon. The lack of standard > > > libraries > > > to handle a lot of the details is a problem. I don't think it is > > > an > > > unsolvable problem, but if we spend the time to do that, will we > > > have > > > something that will work for us for the next 5 years? This may be > > > the > > > shortest path to getting us where we need to be for the time being. > > > > > > What is the best case scenario for the VR going forward which will > > > last us the next 5 years? Maybe we just clean up what we have to > > > do a > > > major restructuring of the pieces and how they are > > > implemented. We > > > need to keep in mind how maintainable this implementation is > > > because > > > that is going to be key going forward IMO. > > > > > > > > > > > >
RE: Virtual Router - Zabbix integration
Hi Artjoms, The guys at SwissTXT do some great stuff around external monitoring of their VRs. If Rene doesn't pick up on this thread, I'll ping him directly for you. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue From: Artjoms Petrovs [mailto:artjoms.petr...@telia.lv] Sent: 07 September 2016 08:35 To: dev@cloudstack.apache.org Subject: Virtual Router - Zabbix integration Hello, All! A while back I've found a need to monitor Virtual Router performance ( CPU, Network peaks, etc ), which is not provided by VR Service Monitoring Tool. Does anyone have experience with adding Zabbix ( or Nagios ) agent to Virtual Router default template? How update-safe is this approach? Maybe someone has used Chef or Ansible to provide custom configuration of Virtual Routers after install/reinstall? Best Regards, [cid:image001.jpg@01D208F2.7536D000]<http://www.telia.lv/> Artjoms Petrovs System Analyst / Programmer Telia Latvija, Ltd. | Lielvardes street 8a, Riga, Latvia, LV-1006 Ph.: +371 67082144 Mob. +371 27498048 artjoms.petr...@telia.lv<mailto:artjoms.petr...@telia.lv> | telia.lv This email (and any attachements or hyperlinks within it) may contain information that is confidential, legally privileged or otherwise protected from disclosure. If you are not the intended recipient of this email, you are not entitled to use, disclose, distribute, copy, print, disseminate or rely on this email in any way. If you have received this email in error, please notify the sender immediately by or email and destroy it, and all copies of it.
RE: [VOTE] Apache Cloudstack 4.9.0 RC2
Hi, To add to John's data, we're seeing on average 13 failed smoke tests out of the total 52. We are still triaging the tests themselves. However I see no regressions from 4.8 in the results. Therefore I vote +1 I will be creating PRs for the tests that I have fixed shortly. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: John Burwell [mailto:john.burw...@shapeblue.com] Sent: 28 July 2016 21:13 To: dev@cloudstack.apache.org Subject: Re: [VOTE] Apache Cloudstack 4.9.0 RC2 All, I vote +1 (binding). We have tested 4.9.0 RC2 in the following environments: • CentOS 6.8 management server + CentOS 6.8 KVM Hosts using NFS primary and secondary storage (would allow us to verify/fix the documented libvirt/qemu versions) • CentOS 6.8 management server + vCenter 5.5u3d + ESXi 5.5u3b using NFS primary and secondary storage • CentOS 6.8 management server + vCenter 6.0u2 + ESXi Express Patch 6 using NFS primary and secondary storage • CentOS 6.8 management server + XenServer 6.2 SP1 using NFS primary and secondary storage • CentOS 6.8 management server + XenServer 6.5 SP1 using NFS primary and secondary storage For each environment, we have run the following tests: • All smoke tests • test_accounts.py • test_acl_*.py • test_sharednetwork*.py • test_add_remove_network.py • test_advancedsg_networks.py • test_affinity_groups*.py • test_cpu_domain_limits.py • test_cpu_limits.py • test_cpu_max_limits.py • test_host_maintenance.py • test_memory_limits.py • test_network_offering.py • test_overcommit.py • test_persistent_networks.py • test_ps_domain_limits.py • test_ps_limits.py • test_ps_max_limits.py • test_ps_resize_volume.py • test_ps_resource_limits_volume.py • test_resource_limits.py • test_routers.py • test_security_groups.py • test_shared_networks.py • test_snapshots.py • test_ss_domain_limits.py • test_ss_limits.py • test_ss_max_limits.py • test_templates.py • test_update_vm.py • test_volumes.py • test_vpc.py During our tests, we found the following issues, but do not see any of them as blockers: • As Paul and Boris noted, the test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL in test_vpc_redundant.py fails. We are uncertain as to whether this failure is caused by a defect, a problem with the test case, or our test environment. • We have seen NPEs in the log every 10 minutes attempting to garbage collect a non-existent XenServer volume previously attached to a VR. While ugly, it is not leaving unused volumes to consume disk space. Thanks, -John > john.burw...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London VA WC2N 4HSUK @shapeblue On Jul 28, 2016, at 12:55 PM, Paul Angus wrote: > > I'm getting a pass on KVM for > /marvin/test/integration/smoke/test_vpc_redundant.py > And a FAIL on VMware for the same test, with the same error. > > 2016-07-28 04:00:52,133 - CRITICAL - FAILED: > test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL: ['Traceback (most > recent call last):\n', ' File "/usr/lib64/python2.7/unittest/case.py", line > 369, in run\ntestMethod()\n', ' File > "/marvin/test/integration/smoke/test_vpc_redundant.py", line 537, in > test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL\n > self.check_routers_state(1)\n', ' File > "/marvin/test/integration/smoke/test_vpc_redundant.py", line 304, in > check_routers_state\nself.query_routers(count, showall)\n', ' File > "/marvin/test/integration/smoke/test_vpc_redundant.py", line 297, in > query_routers\n"Check that %s routers were indeed created" % count)\n', ' > File "/usr/lib64/python2.7/unittest/case.py", line 553, in assertEqual\n > assertion_func(first, second, msg=msg)\n', ' File > "/usr/lib64/python2.7/unittest/case.py", line 546, in _baseAssertEqual\n > raise self.failureException(msg)\n', 'AssertionError: Check that 1 routers > were indeed created\n'] > > Kind regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > > -Original Message- > From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of > Will Stevens > Sent: 28 July 2016 17:24 > To: dev@cloudstack.apache.org > Subject: Re: [VOTE] Apache Cloudstack 4.9.0 RC
RE: [VOTE] Apache Cloudstack 4.9.0 RC2
I'm getting a pass on KVM for
/marvin/test/integration/smoke/test_vpc_redundant.py
And a FAIL on VMware for the same test, with the same error.
2016-07-28 04:00:52,133 - CRITICAL - FAILED:
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL: ['Traceback (most recent
call last):\n', ' File "/usr/lib64/python2.7/unittest/case.py", line 369, in
run\ntestMethod()\n', ' File
"/marvin/test/integration/smoke/test_vpc_redundant.py", line 537, in
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL\n
self.check_routers_state(1)\n', ' File
"/marvin/test/integration/smoke/test_vpc_redundant.py", line 304, in
check_routers_state\nself.query_routers(count, showall)\n', ' File
"/marvin/test/integration/smoke/test_vpc_redundant.py", line 297, in
query_routers\n"Check that %s routers were indeed created" % count)\n', '
File "/usr/lib64/python2.7/unittest/case.py", line 553, in assertEqual\n
assertion_func(first, second, msg=msg)\n', ' File
"/usr/lib64/python2.7/unittest/case.py", line 546, in _baseAssertEqual\n
raise self.failureException(msg)\n', 'AssertionError: Check that 1 routers were
indeed created\n']
Kind regards,
Paul Angus
paul.an...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London WC2N 4HSUK
@shapeblue
-Original Message-
From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of
Will Stevens
Sent: 28 July 2016 17:24
To: dev@cloudstack.apache.org
Subject: Re: [VOTE] Apache Cloudstack 4.9.0 RC2
The teardown issue looks to be environmental. Apparently the network did not
get cleaned up before the network service offering using it was attempted to be
deleted.
I am not sure about the test_vpc_redundent test failure. I run that test all
the time on KVM and have not been getting that problem. Do you get the same
thing if you run it again in your environment?
*Will STEVENS*
Lead Developer
*CloudOps* *| *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_
On Thu, Jul 28, 2016 at 12:00 PM, Boris Stoyanov <
boris.stoya...@shapeblue.com> wrote:
> Hi we’ve run: test_vpc_redundant and got :
>
> 2016-07-28 16:36:29,959 - CRITICAL - FAILED: test_05_rvpc_multi_tiers:
> ['Traceback (most recent call last):\n', ' File
> "/usr/lib64/python2.7/unittest/case.py", line 369, in run\n
> testMethod()\n', ' File
> "/marvin/test/integration/smoke/test_vpc_redundant.py", line 620, in
> test_05_rvpc_multi_tiers\nself.check_routers_state()\n', ' File
> "/marvin/test/integration/smoke/test_vpc_redundant.py", line 353, in
> check_routers_state\nself.fail("Expected \'%s\' routers at state
> \'%s\', but found \'%s\'!" % (expected_count, status_to_check,
> cnts[vals.index(status_to_check)]))\n', ' File
> "/usr/lib64/python2.7/unittest/case.py", line 450, in fail\nraise
> self.failureException(msg)\n', "AssertionError: Expected '1' routers
> at state 'MASTER', but found '0'!\n"]
>
>
> Deleting network offering while in use?
>
> 2016-07-28 16:38:41,560 - CRITICAL - EXCEPTION: test_05_rvpc_multi_tiers:
> ['Traceback (most recent call last):\n', ' File
> "/usr/lib64/python2.7/unittest/case.py", line 398, in run\n
> self.tearDown()\n', ' File
> "/marvin/test/integration/smoke/test_vpc_redundant.py", line 281, in
> tearDown\nraise Exception("Warning: Exception during cleanup : %s" %
> e)\n', "Exception: Warning: Exception during cleanup : Execute cmd:
> deletenetworkoffering failed, due to: errorCode: 431, errorText:Can't
> delete network offering 35 as its used by 1 networks. To make the
> network offering unavaiable, disable it\n"]
>
> Our setup is centos68 with xen6.2 hosts.
>
>
>
>
> boris.stoya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
>
>
>
> On Jul 27, 2016, at 6:20 PM, Haijiao <18602198...@163.com 18602198...@163.com>> wrote:
>
>
>
> Hi, Gents
>
>
> Anyone tested RC2 with redudant VR configuration ? I think there are some
> issues not fixed yet, e.g. password server.
> https://issues.apache.org/jira/browse/CLOUDSTACK-9385
>
>
> We will test these days and come back.
>
>
>
>
>
RE: [VOTE] Split Marvin to its own repository
Would it make sense to have tests include cloudstack versions along with 'other' requirements in their meta-data, so that they don't *have* to be tied to a branch. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rohit Yadav [mailto:bhais...@apache.org] Sent: 18 July 2016 10:44 To: dev@cloudstack.apache.org Subject: [VOTE] Split Marvin to its own repository All, Based on a recent discussion thread [1], I want to start a voting thread to gather consensus around splitting Marvin from the CloudStack repository. On successful voting, we would extract and maintain Marvin as a separate library in a separate repository (example repository [2]) and various build/test systems such as Travis [3] can install it directly for usage with pip+git etc. Background: During the build process, a commands.xml generated to build apidocs is also used to generate CloudStack Cmd and Request classes are auto-generated, which is the only dependency why we needed Marvin and CloudStack together. The auto-generated cloudstackAPI module can be also generated against a live running CloudStack mgmt server which has api discovery (listApis) enabled. The integration tests will still be tied to a branch and will remain withing the repository. A PR [3] was sent to show that we can still execute tests using this approach, and this would finally allow us to build, release and use Marvin as an independent library. Vote will be open for 72 hours. For sanity in tallying the vote, can PMC members please be sure to indicate "(binding)" with their vote? [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove (and reason why) [1] http://markmail.org/thread/kiezqhjpz44hvrau [2] https://github.com/rhtyd/marvin [3] https://github.com/apache/cloudstack/pull/1599 Regards, Rohit Yadav
RE: [VOTE] Apache Cloudstack 4.9.0 RC1
Hey Will, I was referring to the need to add: db.cloud.driver=jdbc:mysql db.usage.driver=jdbc:mysql db.simulator.driver=jdbc:mysql to db.properties when upgrading. Asking admins to add this manually won’t give the impression of a ‘well-packaged’ product. And I suspect will end up like the manually encrypting vmware passwords step, which was required for one upgrade, and now clients constantly ask us if they need to repeat the step, because its carried forward to every upgrade note. Kind regards, Paul Angus From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 11 July 2016 14:10 To: dev@cloudstack.apache.org; Paul Angus Subject: Re: [VOTE] Apache Cloudstack 4.9.0 RC1 Hi Paul, Can you review the discussion here to see if it clears anything up: https://github.com/apache/cloudstack/pull/1489#issuecomment-215479369 Can you help me understand what you are expecting the functionality to be and what you are experiencing? Thanks, Will STEVENS Lead Developer CloudOps | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w cloudops.com<http://cloudops.com/> | tw @CloudOps_ On Sun, Jul 10, 2016 at 8:06 AM, Paul Angus mailto:paul.an...@shapeblue.com>> wrote: Guys, Is it not possible to add the additional entries into db.properties when CloudStack is upgrading rather than manually? If it is possible, then manually intervention is a -1 in my book. Sure it's not a big fix required - but it's still required for CloudStack to work in a slick manner. We're trying to improve the user experience. Kind regards, Paul Angus paul.an...@shapeblue.com<mailto:paul.an...@shapeblue.com> www.shapeblue.com<http://www.shapeblue.com> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Milamber [mailto:milam...@apache.org<mailto:milam...@apache.org>] Sent: 10 July 2016 12:06 To: dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org> Subject: Re: [VOTE] Apache Cloudstack 4.9.0 RC1 Hello, My vote +1 (binding) Tests are passed on a virtual topology of servers (CS over CS) (1mgr+2nodes+1nfs) : 1/ Fresh install of 4.9.0RC1 (adv net) on Ubuntu 14.04.4 + KVM + NFS : OK Some standard tests with success (create vm, migration, HA, create networks, create user, create ssh key, destroy vm, register template, create snapshot, restore snapshot, create template, ip association, ip release, static nat, firewall rule) Some tests with cloudstack ansible module with sucess too (create network, register templates, create vm, ip, firewall rule) 2/ Test upgrade from 4.7.1 to 4.9.0RC1 : OK with the same remarks than Wido (need to add JDBC driver type in db.properties) 3/ Tests of all localizations of Web UI of 4.9RC1 : Localization works well except Spanish: the Web UI won't display due of 2 localization strings with a escaped quote (from Transifex) 'label.number.of.system.vms': 'Número de VM\\'s del Systema', 'label.vm.state': 'Estado de VM\\'s', Fixed in the PR1583 https://github.com/apache/cloudstack/pull/1583 Perhaps add in the Release notes this 2 issues (jdbc type & spanish l10n) Thanks to the RM. Milamber On 06/07/2016 20:52, Will Stevens wrote: > Hi All, > > I've created a 4.9.0 release, with the following artifacts up for a vote: > > Git Branch and Commit SH: > https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h= > refs/heads/4.9.0-RC20160706T1546 > Commit: 643f75aa9150156b1fb05f339a338614fc7ad3fb > > I will be updating the Release Notes with the changes in this release > tomorrow. If the RC changes, I can adapt the release notes after. > > Source release (checksums and signatures are available at the same > location): > https://dist.apache.org/repos/dist/dev/cloudstack/4.9.0/ > > PGP release keys (signed using CB818F64): > https://dist.apache.org/repos/dist/release/cloudstack/KEYS > > Vote will be open for 72 hours. > > For sanity in tallying the vote, can PMC members please be sure to > indicate "(binding)" with their vote? > > [ ] +1 approve > [ ] +0 no opinion > [ ] -1 disapprove (and reason why) > > Thanks, > > Will >
Marvin - test_data.py
Hi all,
The default test data has the following entries - does anyone have copies of
these images which I can download and host locally to our Trillian deployment?
"templateregister1": {
"displaytext": "win8withpv",
"name": "win8withpv",
"passwordenabled": False,
"url": "http://pleaseupdateURL/dummy.vhd";,
"format": "VHD",
"ostype": "Windows 8 (64-bit)",
"ispublic": "true",
"hypervisor": "XenServer"
},
"Windows 8 (64-bit)": {
"displaytext": "Windows 8 (64-bit)",
"name": "win8withpv",
"passwordenabled": False,
"url": "http://pleaseupdateURL/dummy.vhd";,
"format": "VHD",
"ostype": "Windows 8 (64-bit)",
"ispublic": "true",
"hypervisor": "XenServer"
},
"Windows Server 2012 (64-bit)": {
"displaytext": "Windows Server 2012 (64-bit)",
"name": "Windows Server 2012 (64-bit)",
"passwordenabled": False,
"url": "http://pleaseupdateURL/dummy.vhd";,
"format": "VHD",
"ostype": "Windows Server 2012 (64-bit)",
"ispublic": "true",
"hypervisor": "XenServer"
},
"Windows 7 (64-bit)": {
"displaytext": "Windows 7 (64-bit)",
"name": "Windows 7 (64-bit)",
"passwordenabled": False,
"url": "http://pleaseupdateURL/dummy.vhd";,
"format": "VHD",
"ostype": "Windows 7 (64-bit)",
"ispublic": "true",
"hypervisor": "XenServer"
},
Kind regards,
Paul Angus
paul.an...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London WC2N 4HSUK
@shapeblue
RE: [VOTE] Apache Cloudstack 4.9.0 RC1
Guys, Is it not possible to add the additional entries into db.properties when CloudStack is upgrading rather than manually? If it is possible, then manually intervention is a -1 in my book. Sure it's not a big fix required - but it's still required for CloudStack to work in a slick manner. We're trying to improve the user experience. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Milamber [mailto:milam...@apache.org] Sent: 10 July 2016 12:06 To: dev@cloudstack.apache.org Subject: Re: [VOTE] Apache Cloudstack 4.9.0 RC1 Hello, My vote +1 (binding) Tests are passed on a virtual topology of servers (CS over CS) (1mgr+2nodes+1nfs) : 1/ Fresh install of 4.9.0RC1 (adv net) on Ubuntu 14.04.4 + KVM + NFS : OK Some standard tests with success (create vm, migration, HA, create networks, create user, create ssh key, destroy vm, register template, create snapshot, restore snapshot, create template, ip association, ip release, static nat, firewall rule) Some tests with cloudstack ansible module with sucess too (create network, register templates, create vm, ip, firewall rule) 2/ Test upgrade from 4.7.1 to 4.9.0RC1 : OK with the same remarks than Wido (need to add JDBC driver type in db.properties) 3/ Tests of all localizations of Web UI of 4.9RC1 : Localization works well except Spanish: the Web UI won't display due of 2 localization strings with a escaped quote (from Transifex) 'label.number.of.system.vms': 'Número de VM\\'s del Systema', 'label.vm.state': 'Estado de VM\\'s', Fixed in the PR1583 https://github.com/apache/cloudstack/pull/1583 Perhaps add in the Release notes this 2 issues (jdbc type & spanish l10n) Thanks to the RM. Milamber On 06/07/2016 20:52, Will Stevens wrote: > Hi All, > > I've created a 4.9.0 release, with the following artifacts up for a vote: > > Git Branch and Commit SH: > https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h= > refs/heads/4.9.0-RC20160706T1546 > Commit: 643f75aa9150156b1fb05f339a338614fc7ad3fb > > I will be updating the Release Notes with the changes in this release > tomorrow. If the RC changes, I can adapt the release notes after. > > Source release (checksums and signatures are available at the same > location): > https://dist.apache.org/repos/dist/dev/cloudstack/4.9.0/ > > PGP release keys (signed using CB818F64): > https://dist.apache.org/repos/dist/release/cloudstack/KEYS > > Vote will be open for 72 hours. > > For sanity in tallying the vote, can PMC members please be sure to > indicate "(binding)" with their vote? > > [ ] +1 approve > [ ] +0 no opinion > [ ] -1 disapprove (and reason why) > > Thanks, > > Will >
RE: Roadmap on Wiki
Awesome. thanks Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Anshul Gangwar [mailto:anshul.gang...@accelerite.com] Sent: 07 July 2016 11:44 To: dev@cloudstack.apache.org Subject: Re: Roadmap on Wiki There are 3 active PRs for the items Snapshot Improvements https://github.com/apache/cloudstack/pull/672 iSCSI and HA support in Hyper-V https://github.com/apache/cloudstack/pull/351 Support for non-US keyboards in Console Proxy https://github.com/apache/cloudstack/pull/669 Regards, Anshul On 07/07/16, 3:57 PM, "Paul Angus" wrote: Hi All, We have a number of 'Citrix' items on the roadmap, I'd like to find out if they're still in progress at Accelerite - or should we remove them from the list... Snapshot Improvements CLOUDSTACK-8663<https://issues.apache.org/jira/browse/CLOUDSTACK-8663?src=confmacro> Anshul Gangwar <https://cwiki.apache.org/confluence/display/~anshulg>(Citrix) Openswan with strongswan jayapal<https://cwiki.apache.org/confluence/display/~jayapal> (Citrix) iSCSI and HA support in Hyper-V CLOUDSTACK-8444<https://issues.apache.org/jira/browse/CLOUDSTACK-8444?src=confmacro> Anshul Gangwar <https://cwiki.apache.org/confluence/display/~anshulg>(Citrix) 4.6.0 Design document is available at iSCSI and HA support in Hyper-V<https://cwiki.apache.org/confluence/display/CLOUDSTACK/iSCSI+and+HA+support+in+Hyper-V> Support for non-US keyboards in Console Proxy CLOUDSTACK-8665<https://issues.apache.org/jira/browse/CLOUDSTACK-8665?src=confmacro> Anshul Gangwar <https://cwiki.apache.org/confluence/display/~anshulg>(Citrix) 4.6.0 Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue DISCLAIMER == This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.
Roadmap on Wiki
Hi All, We have a number of 'Citrix' items on the roadmap, I'd like to find out if they're still in progress at Accelerite - or should we remove them from the list... Snapshot Improvements CLOUDSTACK-8663<https://issues.apache.org/jira/browse/CLOUDSTACK-8663?src=confmacro> Anshul Gangwar <https://cwiki.apache.org/confluence/display/~anshulg>(Citrix) Openswan with strongswan jayapal<https://cwiki.apache.org/confluence/display/~jayapal> (Citrix) iSCSI and HA support in Hyper-V CLOUDSTACK-8444<https://issues.apache.org/jira/browse/CLOUDSTACK-8444?src=confmacro> Anshul Gangwar <https://cwiki.apache.org/confluence/display/~anshulg>(Citrix) 4.6.0 Design document is available at iSCSI and HA support in Hyper-V<https://cwiki.apache.org/confluence/display/CLOUDSTACK/iSCSI+and+HA+support+in+Hyper-V> Support for non-US keyboards in Console Proxy CLOUDSTACK-8665<https://issues.apache.org/jira/browse/CLOUDSTACK-8665?src=confmacro> Anshul Gangwar <https://cwiki.apache.org/confluence/display/~anshulg>(Citrix) 4.6.0 Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
Trillian.
Hi all As some of you may know, I have been working for some time on a project called Trillian. This started out as an internal project at $dayjob with the intentions of being able to quickly build environments to: a) Test new feature software builds (manually and via Marvin) b) Test community releases (manually and via Marvin) c) Replicate failure scenarios d) Evaluate new features To meet these and a number of other requirements I started Trillian. At Trillian's core are Ansible, CloudStack and vSphere virtualisation. Ansible takes a command line input and requests VM instances from CloudStack and then configures all of the hypervisor hosts and mgmt. servers, finally creating a zone which incorporates all of the components which were requested. The environments are built in projects and the accounts which are allowed access are specified on the commandline. The commandline arguments look like this: --extra-vars "env_name=myACSenv env_version=cs45 hvtype=x hv=2 xs_ver=xs65sp1 env_accounts=all pri=1 mgmt_os=6" There is a global file which holds the mapping of ACS version to relevant URLs or OS types to specific templates, however EVERY mapping can be overridden from commandline. --extra-vars "env_name=cs49-vmw55-pga env_version=cs49 mgmt_os=6 hvtype=v vmware_ver=55u3 hv=2 pri=2 env_accounts=all build_marvin=yes baseurl_cloudstack=http://10.2.0.4/shapeblue/cloudstack/testing/ mgmtsrv_template=Testc6Template" CloudStack deploys the virtualised hypervisor hosts and mgmt. servers as and when required - CloudStack mgmt. server, MySQL hosts Marvin host, vCenter server) onto the ESXi hosts. The output from each request is a bespoke, fully working virtualised CloudStack environment. The reason trillion came about in its current form is that at $dayjob we have to deal with lots of different types of environment, hypervisors and configurations. I know others have put a lot of work into similar tools, which I've used over the years and found useful but I needed some tooling that could also support vSphere hosts and Hyper-V and also be easy to connect to external integration points such as SolidFire storage, NetScalers, Cloudian S3 installations etc. as well as supporting multi-tenancy. For some time, it's been my intention to make this open source and generally available for this community. While I could have done this sooner but I held back a little as I wanted to make sure that it was well documented and could be easily deployed for a wide range of use-cases I'm happy to say I think we're just about there. Trillion is now available: https://github.com/shapeblue/Trillian Please feel free to use, comment, find bugs or come up with any ideas on how we can make this better. Rohit has integrated this with Jenkins and will be sharing how he has done this soon too. If people think this is useful for the community, I've got clearance from $dayjob to donate the work into ACS (if we want it). Marvin: "I think you ought to know I'm feeling very depressed." Trillian: "Well, we have something that may take your mind off it." Marvin: "It won't work, I have an exceptionally large mind." Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: Roadmap for 4.x and 5.0
That sounds great. I'll get it added. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: ma...@exoscale.ch [mailto:ma...@exoscale.ch] Sent: 01 July 2016 11:31 To: dev@cloudstack.apache.org Subject: Re: Roadmap for 4.x and 5.0 Hi, I can't edit the page but I'll be glad to put some effort for the V5: - Live migration for KVM - Improve logging using UUIDs (as I already did part of that for us at exoscale) I'm in the process to add another feature we need: graceful shutdown of a management server when running a cluster of MS. The goal is to send a "prepareForShutdown" command to one or more MS and have them rebalance their agents to the ones still running so that no command will be lost. Then there shouldn't be any downtime with any agent during an update. Kind regards, Marc-Aurèle PS: Is there any architectural discussion going on on the Slack channel? I saw that the IRC is not so active... > On 01 Jul 2016, at 11:55, Paul Angus wrote: > > There's not been much response to this, but I'll start clearing away the > unclaimed items, people can always add them back. > > > Kind regards, > > Paul Angus > > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > >
RE: Roadmap for 4.x and 5.0
There's not been much response to this, but I'll start clearing away the unclaimed items, people can always add them back. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: 4.9/master Testing Coordination
Np. Happy 'tenting' :) Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 29 June 2016 15:16 To: dev@cloudstack.apache.org Subject: Re: 4.9/master Testing Coordination Great, thanks for the support Paul. :) *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Wed, Jun 29, 2016 at 10:12 AM, Paul Angus wrote: > Thanks for the update Will. > I'll look for the VR issue, I think that I've it in 4.5 intermittently > on vmware. - in fact I've seen it come up with 6 interfaces before... > > > Kind regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > > -Original Message- > From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On > Behalf Of Will Stevens > Sent: 29 June 2016 15:09 > To: dev@cloudstack.apache.org > Subject: Re: 4.9/master Testing Coordination > > We are keeping an eye on the NIO SSH stuff because we have had reports of > the connection being lost for more than 10 minutes (before manual > intervention), but it seems intermittent. > > There is also a potential issue with the VR coming up with only two nics > instead of three, but there are conflicting reports on that one, so keep an > eye out for that too. > > Most of the details of the things people have come up against are in this > thread. > > I will be camping till monday, so I will have very limited connectivity. > I will hopefully cut the RC when I get back, so please let me know if you > find anything this week. > > Thanks, > > Will > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > @CloudOps_ > > On Wed, Jun 29, 2016 at 9:15 AM, Paul Angus > wrote: > > > Hi Will, > > > > What's the current situation with the 4.9 release? > > I'm helping John with setting up the environments which he's listed > > for testing. Do we have a list of any blocker bugs that need clearing > > or a timetable? > > > > Kind regards, > > > > Paul Angus > > > > paul.an...@shapeblue.com > > www.shapeblue.com > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > > > > > > > -Original Message- > > From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On > > Behalf Of Will Stevens > > Sent: 28 June 2016 18:16 > > To: dev@cloudstack.apache.org > > Subject: Re: 4.9/master Testing Coordination > > > > Rohit, > > Simon and his team is in the final push getting their next internal > > production release ready to ship, so their testing of 4.9 has paused > while > > they get that ready. I suspect he and his team will have limited time to > > dedicate to this in this week. > > > > Just figured I would pass that along if he is not able to get back to you > > quickly so you understand why there may be a delay. :) > > > > Cheers, > > > > *Will STEVENS* > > Lead Developer > > > > *CloudOps* *| *Cloud Solutions Experts > > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > > @CloudOps_ > > > > On Tue, Jun 28, 2016 at 1:08 PM, Rohit Yadav > > wrote: > > > > > Hi Simon, > > > > > > > > > Thanks for sharing. I'm continuing the discussion from a PR ( > > > https://github.com/apache/cloudstack/pull/1549#issuecomment-229070969) > > > here wrt NIO ssl agent connection. Are you using latest master, and > > > are you able to consistently reproduce the issue? Make sure that both > > > management server and kvm-agent (or ssvm agents etc.) are using the > > > packages built from latest master as well (i.e. updating both agent > > > and mgmt server pkg jars is necessary). > > > > > > > > > > ""I did also run into the NIO SSL agent not connecting problem again. > > > When I telnetted to 8250, the agent immediately came up without me > > > having to restart it. So keep an eye out for that as well."" > > > > > > > > > When you ran into the issue, what was the environment like. Did you > > > have to wait long enough before you decided to telnet
RE: 4.9/master Testing Coordination
Thanks for the update Will. I'll look for the VR issue, I think that I've it in 4.5 intermittently on vmware. - in fact I've seen it come up with 6 interfaces before... Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 29 June 2016 15:09 To: dev@cloudstack.apache.org Subject: Re: 4.9/master Testing Coordination We are keeping an eye on the NIO SSH stuff because we have had reports of the connection being lost for more than 10 minutes (before manual intervention), but it seems intermittent. There is also a potential issue with the VR coming up with only two nics instead of three, but there are conflicting reports on that one, so keep an eye out for that too. Most of the details of the things people have come up against are in this thread. I will be camping till monday, so I will have very limited connectivity. I will hopefully cut the RC when I get back, so please let me know if you find anything this week. Thanks, Will *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Wed, Jun 29, 2016 at 9:15 AM, Paul Angus wrote: > Hi Will, > > What's the current situation with the 4.9 release? > I'm helping John with setting up the environments which he's listed > for testing. Do we have a list of any blocker bugs that need clearing > or a timetable? > > Kind regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > > -Original Message- > From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On > Behalf Of Will Stevens > Sent: 28 June 2016 18:16 > To: dev@cloudstack.apache.org > Subject: Re: 4.9/master Testing Coordination > > Rohit, > Simon and his team is in the final push getting their next internal > production release ready to ship, so their testing of 4.9 has paused while > they get that ready. I suspect he and his team will have limited time to > dedicate to this in this week. > > Just figured I would pass that along if he is not able to get back to you > quickly so you understand why there may be a delay. :) > > Cheers, > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > @CloudOps_ > > On Tue, Jun 28, 2016 at 1:08 PM, Rohit Yadav > wrote: > > > Hi Simon, > > > > > > Thanks for sharing. I'm continuing the discussion from a PR ( > > https://github.com/apache/cloudstack/pull/1549#issuecomment-229070969) > > here wrt NIO ssl agent connection. Are you using latest master, and > > are you able to consistently reproduce the issue? Make sure that both > > management server and kvm-agent (or ssvm agents etc.) are using the > > packages built from latest master as well (i.e. updating both agent > > and mgmt server pkg jars is necessary). > > > > > > > ""I did also run into the NIO SSL agent not connecting problem again. > > When I telnetted to 8250, the agent immediately came up without me > > having to restart it. So keep an eye out for that as well."" > > > > > > When you ran into the issue, what was the environment like. Did you > > have to wait long enough before you decided to telnet on agent's port > > 8250? The current master's NioConnection code makes sure to check for > > new channels/connections every one second, this change ensures that > > reconnections are fast and non-blocking. > > > > > > Regards. > > > > > > From: Simon Weller > > Sent: 18 June 2016 02:17:08 > > To: dev@cloudstack.apache.org > > Subject: Re: 4.9/master Testing Coordination > > > > Here's a quick run down on the configuration(s) we're testing: > > > > > > Centos 7.2 > > > > Advanced Zone with VXLAN on KVM > > > > VPC functionality including Private GW, VPN, Static Routes, ACL Lists > > et al > > > > Redundant VPC VRs > > > > Ceph Primary Storage > > > > NFS and S3 secondary storage > > > > As Will mentioned, we've found an odd issue with VPCs that we're still > > debugging. > > > > Here's a summary of what we've found thus far: > > When a tier is added, the network interface for the tier network is > > never
RE: 4.9/master Testing Coordination
Hi Will, What's the current situation with the 4.9 release? I'm helping John with setting up the environments which he's listed for testing. Do we have a list of any blocker bugs that need clearing or a timetable? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 28 June 2016 18:16 To: dev@cloudstack.apache.org Subject: Re: 4.9/master Testing Coordination Rohit, Simon and his team is in the final push getting their next internal production release ready to ship, so their testing of 4.9 has paused while they get that ready. I suspect he and his team will have limited time to dedicate to this in this week. Just figured I would pass that along if he is not able to get back to you quickly so you understand why there may be a delay. :) Cheers, *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Tue, Jun 28, 2016 at 1:08 PM, Rohit Yadav wrote: > Hi Simon, > > > Thanks for sharing. I'm continuing the discussion from a PR ( > https://github.com/apache/cloudstack/pull/1549#issuecomment-229070969) > here wrt NIO ssl agent connection. Are you using latest master, and > are you able to consistently reproduce the issue? Make sure that both > management server and kvm-agent (or ssvm agents etc.) are using the > packages built from latest master as well (i.e. updating both agent > and mgmt server pkg jars is necessary). > > > > ""I did also run into the NIO SSL agent not connecting problem again. > When I telnetted to 8250, the agent immediately came up without me > having to restart it. So keep an eye out for that as well."" > > > When you ran into the issue, what was the environment like. Did you > have to wait long enough before you decided to telnet on agent's port > 8250? The current master's NioConnection code makes sure to check for > new channels/connections every one second, this change ensures that > reconnections are fast and non-blocking. > > > Regards. > > > From: Simon Weller > Sent: 18 June 2016 02:17:08 > To: dev@cloudstack.apache.org > Subject: Re: 4.9/master Testing Coordination > > Here's a quick run down on the configuration(s) we're testing: > > > Centos 7.2 > > Advanced Zone with VXLAN on KVM > > VPC functionality including Private GW, VPN, Static Routes, ACL Lists > et al > > Redundant VPC VRs > > Ceph Primary Storage > > NFS and S3 secondary storage > > As Will mentioned, we've found an odd issue with VPCs that we're still > debugging. > > Here's a summary of what we've found thus far: > When a tier is added, the network interface for the tier network is > never plugged by libvirt. You only get 2 interfaces (eth0 and eth1). > eth2 is never plugged when you attempt to provision the first VM > within the VPC and the VM creation fails. If you have existing VMs and > you restart the router, you lose the eth2 interface in the libvirt > configuration (confirmed with a virsh dumpxml). > If you leave the VRs alone after the upgrade, VMs can be provisioned > correctly (until you reboot the VRs). > > I did also run into the NIO SSL agent not connecting problem again. > When I telnetted to 8250, the agent immediately came up without me > having to restart it. So keep an eye out for that as well. > > > - Si > > > From: williamstev...@gmail.com on behalf of > Will Stevens > Sent: Friday, June 17, 2016 3:02 PM > To: dev@cloudstack.apache.org > Subject: Re: 4.9/master Testing Coordination > > Syed is looking into a potential issue with Swift as secondary storage > on master. > > ENA is looking into a potential problem when upgrading a VR which was > working in 4.8.0, but after an upgrade to 4.9.0 and restarting the > network there are only 2 nics instead of 3. If they spin a new VR > from scratch it seems to work. I need to follow up with them to see > if they have an updated status of their testing. > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > @CloudOps_ > > > rohit.ya...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > On Fri, Jun 17, 2016 at 4:00 PM, Will Stevens > wrote: > > > The following tests are running cleanly on KVM with Adv
KVM Libvirt Versions
Hi All, Our documentation states that the following are required: * libvirt: 1.2.0 or higher * Qemu/KVM: 2.0 or higher CentOS6 does not include these versions CentOS7 does only goes as high as QEMU 1.5 Only Ubuntu > 14.04 supports these versions. Are there features in our implementation which require these versions of Libvirt and QEMU or is this a documentation bug? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: Roadmap for 4.x and 5.0
I brought up the subject of updating this page a month or so ago. To try and get some movement, here is a list of all of the titles with nobody's name against them: If no one claims them then I’ll remove them at the end of next week…. Packaging: YAML based configs Logging/Metrics: Use MDC Improve logging using UUIDs and internal metrics Better error handling Processing Logs Storage : Remove NFS dependency Snapshots on SAN Network Improved GSLB Network ACLS Globo DNS API VR: dnsmasq to better dns Better LB Improve VR, VR agent, API for VR Hybrid setups across domains L2 on L3 (sbp) VPC: inter vpc, private gateways GSLB Multi-zone UI, API: 2Factor Authentication Refactor API + core Misc: Disaster Recovery, Import infra Terraform support Architecture Refactor management Core Apparmour/Selinux support (KVM) Persistance layer: away from DAO Architecture changes/upgrade Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Ron Wheeler [mailto:rwhee...@artifact-software.com] Sent: 17 June 2016 15:25 To: dev@cloudstack.apache.org Subject: Roadmap for 4.x and 5.0 https://cwiki.apache.org/confluence/display/CLOUDSTACK/Roadmap Needs updating. Some of the work must have been completed since it is slotted for 4.6. Perhaps this is the page to start laying out the "new" release protocol and to start to collect the tasks for 4.10 and 4.11 It would also be a good place to collect ideas for 5.0 so that we can see what the proposed release numbering and delivery schedule actually means in terms of delivery of functionality. The mailing list discussion has been pretty robust and a lot of writing has been done that deserves a more permanent home and some more concrete descriptions of proposed work. Ron -- Ron Wheeler President Artifact Software Inc email: rwhee...@artifact-software.com<mailto:rwhee...@artifact-software.com> skype: ronaldmwheeler phone: 866-970-2435, ext 102
RE: Delete obsolete stuff from the wiki
Ron, It's a record of the graduation process. I'm not sure that it's fair game for housekeeping, Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Ron Wheeler [mailto:rwhee...@artifact-software.com] Sent: 17 June 2016 15:12 To: dev@cloudstack.apache.org Subject: Delete obsolete stuff from the wiki https://cwiki.apache.org/confluence/display/CLOUDSTACK/Graduation looks like it could go. Anyone object if I delete it? Ron -- Ron Wheeler President Artifact Software Inc email: rwhee...@artifact-software.com skype: ronaldmwheeler phone: 866-970-2435, ext 102
RE: 4.9+ release
+1 Daan. My recollection was that major version number changes were only to be triggered by breaks in backward compatibility (API). Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] Sent: 14 June 2016 14:47 To: dev Cc: Rajani Karuturi Subject: Re: 4.9+ release You know that would require more then one byte for our minor version, Will. I would be very pleased to go to 5.0 before that time. On Tue, Jun 14, 2016 at 3:43 PM, Will Stevens wrote: > Daan is just trying to get us to version 4.256. :P > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > @CloudOps_ > > On Tue, Jun 14, 2016 at 9:41 AM, Daan Hoogland > > wrote: > > > -1 to what Wido said. None of those points warant a major release > > number upgrade. these should all be in 4.10, -.11, -12 etc. > > > > major incompatibilities like API refactor, dropping backend support > > for this or that hyporvisor or DB refactor are the things that > > warrant 5.0, IMNSHO > > > > On Tue, Jun 14, 2016 at 1:13 PM, Will Stevens > > > > wrote: > > > > > +1. :) > > > On Jun 14, 2016 5:07 AM, "Wido den Hollander" wrote: > > > > > > > > > > > > Op 14 juni 2016 om 10:55 schreef Rajani Karuturi < > raj...@apache.org > > >: > > > > > > > > > > > > > > > 4.10 or 5.0? > > > > > > > > > > > > > I would say 4.10 > > > > > > > > > We are in the 4.* release cycle from a long time. > > > > > Just wanted to check if anyone is planning on major changes > > > > > which > > > > warrants > > > > > 5.0 > > > > > > > > > > > > > 5.0 should imho be: > > > > > > > > - Java 8 > > > > - Ubuntu 16.04 / systemd support > > > > - Drop support for older libvirt versions (KVM) > > > > - Some killer feature(s) > > > > > > > > Wido > > > > > > > > > ~Rajani > > > > > > > > > > > > > > > -- > > Daan > > > -- Daan
RE: Introducing Mukul
Hi Mukul, Welcome. VirtualBox can't virtualise VT-x so can't pass it through to the guest (nested) hypervisor. You can run XenServer in PV mode (but it's slow), KVM requires VT-x to be available so you won't be able to start the KVM modules on you CentOS/Ubuntu host. You need to use VMware Workstation or Fusion Or use a full hypervisor. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Mukul Rajarshi [mailto:mukul_rajar...@accelerite.com] Sent: 08 June 2016 14:27 To: dev@cloudstack.apache.org; us...@cloudstack.apache.org Subject: Introducing Mukul Hello CloudStack team, My name is Mukul Rajarshi and I have joined Accelerite CloudPlatform testing team. Earlier I have worked on in storage systems, cloud computing, virtualization and data management systems. This is the first time I am working on CloudStack in the process have followed posts/blogs from some of the members in this community and found them really helpful. Excited to be part of this community and hopefully would be to contribute in future. Currently I am trying putting up a scratchpad CloudStack environment on VirtualBox. Facing issue when I use KVM hypervisor, XenServer is fine. Let me know there are known issues or gotchas with KVM as a VM. ~Mukul www.accelerite.com<http://www.accelerite.com> DISCLAIMER == This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.
RE: cloud.com references
-1 Using apt-get is still an external dependency. If the hardcoded value is an Apache/CloudStack domain we can always repoint as required. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] Sent: 07 June 2016 16:15 To: dev Subject: Re: cloud.com references I grepped the source for all occurances of download.cloud.com and did $ wget -P `dirname $file | cut -d '/' -f 4-` $file making the best mirror of download.com that I could. I think having the domain and pointing it to our repo is easiest but a possible next step is also changing all to our new domain. I did all did on cloudstack.apt-get.eu so for now I will add a commit to my PR to change the urls to apt-get. gotcha's: 1: I don't feel sure this makes for everything 2: apt-get is only a slightly bigger ensurance for continuity so we would want this to be a replacement string (e.g. templated) 3: problably as well so far, more to follow On Tue, Jun 7, 2016 at 4:09 PM, Paul Angus wrote: > I *think* that we got to a general consensus that the ideal way > forward would be to host a mirror list at download.cloudstack.org on Apache > infra. > > For existing systemVMs and templates I guess we could use > archive.cloudstack.org pointed at apt-get..? > > > Kind regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > -Original Message- > From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] > Sent: 07 June 2016 15:00 > To: dev > Subject: Re: cloud.com references > > I would say of course if I didn't feel I don't see your concern, Will. Can > you explain? > > Biligual auto correct use. Read at your own risico Op 7 jun. 2016 3:33 PM > schreef "Will Stevens" : > > > I am not sure, but I would make sure we have a strategy to solve for > > all of the different URLs we are deprecating... > > > > *Will STEVENS* > > Lead Developer > > > > *CloudOps* *| *Cloud Solutions Experts > > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > > @CloudOps_ > > > > On Tue, Jun 7, 2016 at 4:12 AM, Daan Hoogland > > > > wrote: > > > > > during a search on refs to cloud.com i found > > > http://download.cloud.com.s3.amazonaws.com/ a couple of times in the > > > devcloud and devcloud4 projects dirs. > > > Ar people still using those or could we remove them? Or maybe > > > extract and put in a sepparate project? > > > > > > -- > > > Daan > > > > > > -- Daan
RE: cloud.com references
I *think* that we got to a general consensus that the ideal way forward would be to host a mirror list at download.cloudstack.org on Apache infra. For existing systemVMs and templates I guess we could use archive.cloudstack.org pointed at apt-get..? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] Sent: 07 June 2016 15:00 To: dev Subject: Re: cloud.com references I would say of course if I didn't feel I don't see your concern, Will. Can you explain? Biligual auto correct use. Read at your own risico Op 7 jun. 2016 3:33 PM schreef "Will Stevens" : > I am not sure, but I would make sure we have a strategy to solve for > all of the different URLs we are deprecating... > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > @CloudOps_ > > On Tue, Jun 7, 2016 at 4:12 AM, Daan Hoogland > > wrote: > > > during a search on refs to cloud.com i found > > http://download.cloud.com.s3.amazonaws.com/ a couple of times in the > > devcloud and devcloud4 projects dirs. > > Ar people still using those or could we remove them? Or maybe > > extract and put in a sepparate project? > > > > -- > > Daan > > >
RE: Migrating CloudStack content from download.cloud.com
1] >>>>>> >>>>>> >>>>> >>>> >>> http://code.activestate.com/recipes/284631-a-python-script-to-test-d >>> ownload-mirrors/ >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> On Fri, May 20, 2016 at 9:52 AM, Chiradeep Vittal < >>>> chirade...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Agree with Daan : we shouldn't be pushing these ancient insecure >>>>>>> templates! >>>>>>> >>>>>>> >>>>>>> On Fri, May 20, 2016 at 9:51 AM, Chiradeep Vittal < >>>>> chirade...@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> :) According to Raja, there is some time before >>> download.cloud.com >>>> is >>>>>>>> doomed. Let's pretend that date is Jan 1 2017. Now pretend that >>> it >>>> is >>>>>> Dec >>>>>>>> 25, 2016 and we're still debating mirror list vs steps and what >>> not. >>>>>> Now, >>>>>>>> just change the 2017 to 2016 and re-consider. We need this done >>>>>> yesterday! >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Fri, May 20, 2016 at 1:53 AM, Daan Hoogland < >>>>> daan.hoogl...@gmail.com >>>>>>> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> send by tablet, no warranties in existence On 20 May 2016 >>>>>>>>> 09:29, "Paul Angus" >>>> wrote: >>>>>>>>>> >>>>>>>>>> I'm a -1 on adding another step to the installation process. >>>>>>>>>> >>>>>>>>>> I agree with Will, it will only be another barrier to >>>>>>>>>> platform >>>>>>>>> adoption. >>>>>>>>>> >>>>>>>>>> The SSVM going and downloading the built-in template is a >>>>>>>>>> good >>>>>>>>> milestone >>>>>>>>> in a CloudStack build. >>>>>>>>>> >>>>>>>>>> To be honest the mgmt. server should be able to go get the >>>> template >>>>>>>>> itself if required rather than making it a user installation >>> step. >>>>>>>>> great idea, looking forward to your PR. >>>>>>>>> >>>>>>>>>> >>>>>>>>>> Kind regards, >>>>>>>>>> >>>>>>>>>> Paul Angus >>>>>>>>>> >>>>>>>>>> paul.an...@shapeblue.com >>>>>>>>>> www.shapeblue.com >>>>>>>>>> 53 Chandos Place, Covent Garden, London WC2N 4HSUK >>>>>>>>>> @shapeblue >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -Original Message- >>>>>>>>>> From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] >>>>>>>>>> Sent: 19 May 2016 23:06 >>>>>>>>>> To: dev >>>>>>>>>> Subject: Re: Migrating CloudStack content from >>>> download.cloud.com >>>>>>>>>> >>>>>>>>>> sounds good, so if we put both sections together the worry is >>>> over. >>>>>> acs >>>>>>>>> is a complex system and requires a lot of reading so let''s >>>>>>>>> not >>> put >>>>> it >>>>>>>>> in a >>>>>>>>> different section. would be duplicate code anyhow. >>>>>>>>>> >>>>>>>>>> On Thu, May 19, 2016 at 11:56 PM, Chiradeep Vittal < >>>>>>>>> chirade...@gmail.com> >>>
RE: [DISCUSS] The Apache CloudStack Community Road Map
No problem Will, Happy to take on the heavy lifting (mouse clicking). + Rome wasn't built in a day and all that... See you next week :) Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 27 May 2016 19:30 To: dev@cloudstack.apache.org Subject: Re: [DISCUSS] The Apache CloudStack Community Road Map Nice initiative Paul. Unfortunately I won't have much time over the next couple weeks to support you on this (other than face to face next week). Looking forward to seeing you then. :) *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Fri, May 27, 2016 at 12:16 PM, Paul Angus wrote: > Hey Guys, > > We hear mutterings and rumblings from the CloudStack user base that > they are unclear what's happening with CloudStack, and they're > wondering if we've all lost interest. > > There are a whole raft of things we can do to address that, but I > really don't want to get into that debate without a glass of wine in my hand. > > Instead I'd like to draw everyone's attention back to the roadmap page > which Sebastien started. > https://cwiki.apache.org/confluence/display/CLOUDSTACK/Roadmap > > I think that we should clean up what is there from last year and > update it. Then give the page some promience on the > cloudstack.apache.org so that everyone can see that we're still here > and that we're still developing new features and enhancents. > > I'm happy to get the ball rolling > > > Kind regards, > > Paul Angus > > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > >
[DISCUSS] The Apache CloudStack Community Road Map
Hey Guys, We hear mutterings and rumblings from the CloudStack user base that they are unclear what's happening with CloudStack, and they're wondering if we've all lost interest. There are a whole raft of things we can do to address that, but I really don't want to get into that debate without a glass of wine in my hand. Instead I'd like to draw everyone's attention back to the roadmap page which Sebastien started. https://cwiki.apache.org/confluence/display/CLOUDSTACK/Roadmap I think that we should clean up what is there from last year and update it. Then give the page some promience on the cloudstack.apache.org so that everyone can see that we're still here and that we're still developing new features and enhancents. I'm happy to get the ball rolling Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: XenServer 7
Rafael We don’t purely use XAPI with XenServer. XenServer 7 has a CentOS7 dom0 rather than CentOS6. We do a whole load of stuff behind the scenes with python and shell scripts a chunk of which won't work anymore. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] Sent: 25 May 2016 14:12 To: dev@cloudstack.apache.org Subject: Re: XenServer 7 Will there be any change on the XAPI? If not, it already works (just the new functions, if any, that will not be used). On Wed, May 25, 2016 at 9:59 AM, Paul Angus wrote: > Is anyone here working on XenServer 7 support for CloudStack? > > > Kind regards, > > Paul Angus > > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > -- Rafael Weingärtner
XenServer 7
Is anyone here working on XenServer 7 support for CloudStack? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: Migrating CloudStack content from download.cloud.com
I'm a -1 on adding another step to the installation process. I agree with Will, it will only be another barrier to platform adoption. The SSVM going and downloading the built-in template is a good milestone in a CloudStack build. To be honest the mgmt. server should be able to go get the template itself if required rather than making it a user installation step. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] Sent: 19 May 2016 23:06 To: dev Subject: Re: Migrating CloudStack content from download.cloud.com sounds good, so if we put both sections together the worry is over. acs is a complex system and requires a lot of reading so let''s not put it in a different section. would be duplicate code anyhow. On Thu, May 19, 2016 at 11:56 PM, Chiradeep Vittal wrote: > Well, you have to define "worry" :) > > I'm proposing an almost identical step to > > http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/ > 4.6/management-server/#prepare-the-system-vm-template > > If they can do that, then it is not a stretch to assume they can > download the default template in a similar manner. The > "cloud-install-default-template" (proposed) script can do the mirror > checking etc. > > > > > On Thu, May 19, 2016 at 2:44 PM, Will Stevens > wrote: > > > I definitely agree with this. I don't think people doing a PoC > > should > have > > to worry about getting a template installed on first setup. I think > > that is a basic feature if we want platform adoption. Getting the > > first boot process from download to first VM launched should be as > > smooth as > possible. > > > > *Will STEVENS* > > Lead Developer > > > > *CloudOps* *| *Cloud Solutions Experts > > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* > > tw @CloudOps_ > > > > On Thu, May 19, 2016 at 5:37 PM, Daan Hoogland > > > > wrote: > > > > > Chiradeep, > > > > > > It makes sense not to have this old default very insecure guest > template > > > still be downloaded but it would be nice to have some kind of > > > meta-data pointing to the latest version of an acceptable template > > > (symlink) for trial installs so PoCcers are swiftly on their way. Would > > > you agree? > > > > > > On Thu, May 19, 2016 at 8:15 PM, Chiradeep Vittal < > chirade...@gmail.com> > > > wrote: > > > > > > > Pierre, > > > > I meant the auto-download of default templates, not systemvm. > > > > Note that the initial systemvm template has to be > > > > hand-downloaded > > anyway. > > > > If you are a single hypervisor cloud, then that is all that is > needed. > > > > > > > > On Thu, May 19, 2016 at 11:08 AM, Pierre-Luc Dion < > pd...@cloudops.com> > > > > wrote: > > > > > > > > > I would be -1 about disabling the autodownload of the systemvm > > > template, > > > > > has this should be simplify deployment of a cloudstack system. > > > > > although, the download URL should be a configurable value, > > > > > maybe > in a > > > > > property file or thru the API somehow or via a pre-install command. > > > > > > > > > > I really like download.cloudstack.org + mirror. I'm looking > > > > > at > > > getting > > > > > the > > > > > DNS entry: builds.cloudstack.org for the new Jenkins and I got > > > > > no objections on using the cloudstack.org domain for community > services > > > so > > > > > I'm > > > > > pretty sure we would be ok to use download.cloudstack.org, > > > > > where > > would > > > > we > > > > > setting this up? on the current webserver of our website? > > > > > could we > ? > > > > > > > > > > > > > > > Cheers, > > > > > > > > > > PL > > > > > > > > > > On Thu, May 19, 2016 at 11:00 AM, Giles Sirett < > > > > giles.sir...@shapeblue.com > > > > > > > > > > > wrote: > > > > > > > > > > > Erik > > > > > > I agree on the existing users - not the end of the world. We > could > > > even > > > &
RE: [ANNOUNCE] Will Stevens as new Apache CloudStack VP
Thank you Sebastien and congratulations Will. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Syed Mushtaq [mailto:syed1.mush...@gmail.com] Sent: 19 May 2016 14:25 To: dev@cloudstack.apache.org Cc: us...@cloudstack.apache.org; market...@cloudstack.apache.org Subject: Re: [ANNOUNCE] Will Stevens as new Apache CloudStack VP Congratulations Will! Super excited to be working with you :) -Syed On Thu, May 19, 2016 at 5:24 AM, Daan Hoogland wrote: > thanks Sebastien, > > looking forward to a workshop on your new endevours and please have a > thought for poor Will once in a while. > > On Thu, May 19, 2016 at 10:32 AM, Jayapal Uradi < > jayapal.ur...@accelerite.com> wrote: > > > Congrats Will. > > > > Thanks, > > Jayapal > > > On 19-May-2016, at 1:54 pm, Rohit Yadav > > > > > wrote: > > > > > > Congrats Will. > > > > > > Regards, > > > Rohit Yadav > > > > > > > > > rohit.ya...@shapeblue.com > > > www.shapeblue.com > > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > > > > > > On May 19 2016, at 12:26 pm, Sebastien Goasguen > > wrote: > > > > > > Morning Everyone, > > > > > > Yesterday at the ASF board meeting, the board passed the resolution > > making Will Stevens the new Vice President of the Apache CloudStack > project. > > > > > > Join me in congratulating Will on this appointment, wish him luck and > > bring your unwavering support ! > > > > > > You may have noticed that Will took on RM duties for the new releases > > going forward and has also taken a very active role to finish bringing us > > to github based workflow and CI. Will has some updates on that front > that I > > am sure you will all like. > > > > > > -Sebastien > > > Former VP CloudStack > > > > > > > > > > DISCLAIMER > > == > > This e-mail may contain privileged and confidential information which is > > the property of Accelerite, a Persistent Systems business. It is intended > > only for the use of the individual or entity to which it is addressed. If > > you are not the intended recipient, you are not authorized to read, > retain, > > copy, print, distribute or use this message. If you have received this > > communication in error, please notify the sender and delete all copies of > > this message. Accelerite, a Persistent Systems business does not accept > any > > liability for virus infected mails. > > > > > > -- > Daan >
RE: Migrating CloudStack content from download.cloud.com
Pulling a few threads together - if the ASF would create a download.cloudstack.org page on ASF infra with the mirrorlist json in it as suggested by Nux, we can maintain just that page and add/remove mirrors at will. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: 18 May 2016 08:37 To: Giles Sirett ; dev@cloudstack.apache.org Subject: RE: Migrating CloudStack content from download.cloud.com > Op 17 mei 2016 om 10:34 schreef Giles Sirett : > > > This is a MAJOR problem and needs to be figured out before the current > download site is removed - @Raja - have Citrix committed to it being there > another year ? > > It is my understanding that Cloudstack relies on this download at > initial build/startup and then periodically if people do things like > build a new zone > > So, users environments aren't going to stop if its pulled, but nobody > would be a able to build/install cloudstack and it may cause issues as > and when users make config changes > > The problem is, for new builds, its hard coded : you start the Sec > Storage VM, CloudStack will try to download the built in template from > download.cloud.com > > My understanding is that its simple db change to make once an > environment is running (exisiting users) but *may* require a code > patch to fix the initial install > > #notideal > > Really, this should be maintained by ASF/ the project as its key to > the software working, however my understanding is it involves binaries > which ASF is never keen on (and may be some 3rd party binaries) - so > that just wont happen > > > > Apt-get is controlled by Wido et al (for which we all owe him a massive > thanks) - but you are right, it is a 3rd party dependency and arguably a > SPOF. But, if ASF wont host binaries, we're always going to have this issue. > Fully agree with you. I'am happy to host this, but for the project it is a danger. The domain name should be controlled by the project. > So, we could patch the code to point somewhere else - but where ? - by > definition its got to be something maintained by a 3rd party > > > We had this debate some time ago when talking about the repositories. We > (ShapeBlue) maintain a repo for our customers, which wev'e always opened up > as public. However, there were concerns about having a company domain name > (which I understand) - so apt-get became our preferred repo. > > > Thoughts on how to fix this: > > 1. if ASF would allow us to create the host entry > download.cloudstack.org. Its under their domain, but with the site > being with a 3rd party it could be allowed > I think that would be the best. A CNAME pointing to cloudstack.apt-get.eu for now might be enough. > 2. maybe Citrix could commit to pointing the current DNS entry to a > new location (would be simplest but may be legally complex and relies > on ongoing goodwill) > > 3. make a mod to allow users to choose the download location on > install. We can then maintain apt-get. To remove the SPOF, we could > then get the templates copied to a number of 3rd party locations and > allow people to choose which one they use > > > > > Kind Regards > Giles > > > giles.sir...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > -Original Message- > From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of > Will Stevens > Sent: 16 May 2016 18:59 > To: dev@cloudstack.apache.org > Cc: Wido den Hollander > Subject: Re: Migrating CloudStack content from download.cloud.com > > @Ian, yes, but I think there is more to it than that. We can change it going > forward and we can move everything from there over to a new domain. > I believe the problem is with all of the existing ACS or CCP installs out > there currently pointing at the download.cloud.com URL, so when it goes down, > those installs have to be updated. > > Maybe I don't understand exactly, but that is the impression I am getting > from this thread. Can this be confirmed? > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > @CloudOps_ > > On Mon, May 16, 2016 at 1:38 PM, Ian Rae wrote: > > > Hey guys, who controls apt-get.eu and given the (rather concerning) > > level of dependency on the operation of the download.cloud.com - would > > it not make sense to use a domain that is under the contro
RE: MySQL : No suitable driver found for jdbc:mysql
Thanks Rohit, I see what you're saying. The conversation was actually based on your statement 'Nick, install libmysql-java or equivalent pkg' to which I asked why a user would have to install an apparently additional component (Nick had already said that mysql-connector-java.jar was loaded). The conversation then spiralled out of control. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] Sent: 18 May 2016 03:51 To: dev@cloudstack.apache.org Cc: dev@cloudstack.apache.org Subject: Re: MySQL : No suitable driver found for jdbc:mysql Paul, rohit.ya...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue On May 17 2016, at 11:33 pm, Paul Angus wrote: @Rohit, On CentOS 7 I get [root@localhost ~]# yum install libmysql-java This is incorrect, perhaps you did not read my email: "The mysql-connector-java (on centos) or libmysql-java (on debian) package provides the jar dependency that understands jdbc and is necessary for CloudStack to communicate with MySQL, execute operations etc." The libmysql-java is the package name on debian/ubuntu, I said libmysql-java or 'equivalent' as I don't know what environment Nick was running. On CentOS, the same package that provides the mysql-java client/jar dependency is called 'mysql-connector-java'. The hullabulla raised around packaging dependency, is a non-issue. Based on what Nick has shared, his environment has oracle-java and not openjdk -- it is likely a case of missing classpath, JAVA_HOME and java jdk directory path issue in the initd/systemd script. Regards. Loaded plugins: fastestmirror base | 3.6 kB 00:00:00 epel/x86_64/metalink | 25 kB 00:00:00 epel | 4.3 kB 00:00:00 extras | 3.4 kB 00:00:00 updates | 3.4 kB 00:00:00 (1/3): epel/x86_64/group_gz | 170 kB 00:00:00 (2/3): epel/x86_64/updateinfo | 555 kB 00:00:00 (3/3): epel/x86_64/primary_db | 4.1 MB 00:00:00 Loading mirror speeds from cached hostfile * base: mirrors.clouvider.net * epel: epel.mirrors.ovh.net * extras: centos.serverspace.co.uk * updates: mirror.as29550.net No package libmysql-java available. Error: Nothing to do [root@localhost ~]# Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] Sent: 17 May 2016 18:15 To: dev@cloudstack.apache.org Subject: Re: MySQL : No suitable driver found for jdbc:mysql Nick, assuming it's a CentOS environment can you run cloudstack-setup-databases (again), make sure that database IP and cluster node IP parameters in db.properties are correct, and finally check that the jar is in the classpath in the initd/systemd script (check JAVA_HOME, jdk dirs etc.). Also watchout for errors in the logs. Oracle-java is not available from default repositories, in that case you may need to fix JAVA_HOME and jdk paths in initd scripts. Regards. From: Nick LIVENS Sent: 17 May 2016 18:34:38 To: dev@cloudstack.apache.org Subject: MySQL : No suitable driver found for jdbc:mysql Hi all, I'm facing the following issue when installing ACS 4.9.0 (current master). java.sql.SQLException: No suitable driver found for jdbc:mysql://localhost:3306/cloud?autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true at java.sql.DriverManager.getConnection(DriverManager.java:596) at java.sql.DriverManager.getConnection(DriverManager.java:215) at org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:75) at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582) at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1188) at org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106) at com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:202) at com.cloud.utils.db.Merovingian2.(Merovingian2.java:68) at com.cloud.utils.db.Merovingian2.createLockMaster(Merovingian2.java:88) First, I thought that the mysql-connector-java.jar was not loaded / installed correctly. But this jar is loaded : [root@csc-1 java]# lsof -p 14064 | grep jar | grep mysql java 14064 cloud mem REG 253,1 883899 134860304 /usr/share/java/mysql-connector-java.jar java 14064 cloud 38r REG 253,1 883899 134860304 /usr/share/java/mysql-connector-java.jar Tomcat specifics : [root@csc-1 java]# tomcat version Server version: Apache Tomcat/7.0.54 Server built: Mar 24 2015 07:49:05 Server number: 7.0.54.0 OS Name: Linux OS Version: 3.10.0-229.7.2.el7.x86_64 Architecture: a
RE: MySQL : No suitable driver found for jdbc:mysql
I completely understand the motivation and need to get stuff running. We just have to make sure that #cloudstackworks Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 17 May 2016 20:10 To: dev@cloudstack.apache.org Subject: Re: MySQL : No suitable driver found for jdbc:mysql Fair enough. I only pointed out what I was successfully using to help guide him. I have not reviewed what the documented dependencies are, I just had to get something working so I could actually do the RM role and that is basically what I got from SBP (the previous RMs). I am not claiming that what I have is perfect, I am only trying to help him get his environment working... *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Tue, May 17, 2016 at 2:10 PM, Paul Angus wrote: > My personal opinion is that a mgmt. server being 'tested' should not > have any packages or configuration on it which is not in the setup guide. > This is a prime example of why. > > 'something' is installed in the test harness which is unlikely to be > in a user's system, hiding a dependency. > > > Kind regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > -Original Message- > From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On > Behalf Of Will Stevens > Sent: 17 May 2016 19:04 > To: dev@cloudstack.apache.org > Subject: Re: MySQL : No suitable driver found for jdbc:mysql > > On CentOS7, this is what I am using without problems: > > > https://github.com/MissionCriticalCloud/bubble-toolkit/blob/9134cf8be930d0b982829da216471feaf214621f/deploy/firstboot/centos7-cloudstack-java7.sh > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > @CloudOps_ > > On Tue, May 17, 2016 at 2:03 PM, Paul Angus > wrote: > > > @Rohit, > > > > On CentOS 7 I get > > > > > > [root@localhost ~]# yum install libmysql-java Loaded plugins: > > fastestmirror base > >| 3.6 kB 00:00:00 epel/x86_64/metalink > >| 25 kB 00:00:00 epel > >| 4.3 kB 00:00:00 extras > >| 3.4 kB 00:00:00 updates > > | 3.4 kB 00:00:00 > > (1/3): epel/x86_64/group_gz > > | 170 kB 00:00:00 > > (2/3): epel/x86_64/updateinfo > > | 555 kB 00:00:00 > > (3/3): epel/x86_64/primary_db > > | 4.1 MB 00:00:00 Loading mirror speeds from > > cached hostfile > > * base: mirrors.clouvider.net > > * epel: epel.mirrors.ovh.net > > * extras: centos.serverspace.co.uk > > * updates: mirror.as29550.net > > No package libmysql-java available. > > Error: Nothing to do > > [root@localhost ~]# > > > > > > > > > > > > > > > > > > > > Kind regards, > > > > Paul Angus > > > > paul.an...@shapeblue.com > > www.shapeblue.com > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > > > > > -Original Message- > > From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] > > Sent: 17 May 2016 18:15 > > To: dev@cloudstack.apache.org > > Subject: Re: MySQL : No suitable driver found for jdbc:mysql > > > > > > Nick, assuming it's a CentOS environment can you run > > cloudstack-setup-databases (again), make sure that database IP and > cluster > > node IP parameters in db.properties are correct, and finally check that > the > > jar is in the classpath in the initd/systemd script (check JAVA_HOME, jdk > > dirs etc.). Also watchout for errors in the logs. > > > > Oracle-java is not available from default repositories, in that case you > > may need to fix JAVA_HOME and jdk paths in initd scripts. > > > > Regards. > > > > From: Nick LIVENS > > Sent: 17 May 2016 18:34:38 > > To: dev@cloudstack.apache.org > > Subject: MySQL : No suitable driver found for jdbc:mysql > > > > Hi all, > > > > I'm facing the following issue when installing ACS 4.9.0 (current > m
RE: MySQL : No suitable driver found for jdbc:mysql
My personal opinion is that a mgmt. server being 'tested' should not have any packages or configuration on it which is not in the setup guide. This is a prime example of why. 'something' is installed in the test harness which is unlikely to be in a user's system, hiding a dependency. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 17 May 2016 19:04 To: dev@cloudstack.apache.org Subject: Re: MySQL : No suitable driver found for jdbc:mysql On CentOS7, this is what I am using without problems: https://github.com/MissionCriticalCloud/bubble-toolkit/blob/9134cf8be930d0b982829da216471feaf214621f/deploy/firstboot/centos7-cloudstack-java7.sh *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Tue, May 17, 2016 at 2:03 PM, Paul Angus wrote: > @Rohit, > > On CentOS 7 I get > > > [root@localhost ~]# yum install libmysql-java Loaded plugins: > fastestmirror base >| 3.6 kB 00:00:00 epel/x86_64/metalink >| 25 kB 00:00:00 epel >| 4.3 kB 00:00:00 extras >| 3.4 kB 00:00:00 updates > | 3.4 kB 00:00:00 > (1/3): epel/x86_64/group_gz > | 170 kB 00:00:00 > (2/3): epel/x86_64/updateinfo > | 555 kB 00:00:00 > (3/3): epel/x86_64/primary_db > | 4.1 MB 00:00:00 Loading mirror speeds from > cached hostfile > * base: mirrors.clouvider.net > * epel: epel.mirrors.ovh.net > * extras: centos.serverspace.co.uk > * updates: mirror.as29550.net > No package libmysql-java available. > Error: Nothing to do > [root@localhost ~]# > > > > > > > > > > Kind regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > -Original Message- > From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] > Sent: 17 May 2016 18:15 > To: dev@cloudstack.apache.org > Subject: Re: MySQL : No suitable driver found for jdbc:mysql > > > Nick, assuming it's a CentOS environment can you run > cloudstack-setup-databases (again), make sure that database IP and cluster > node IP parameters in db.properties are correct, and finally check that the > jar is in the classpath in the initd/systemd script (check JAVA_HOME, jdk > dirs etc.). Also watchout for errors in the logs. > > Oracle-java is not available from default repositories, in that case you > may need to fix JAVA_HOME and jdk paths in initd scripts. > > Regards. > > From: Nick LIVENS > Sent: 17 May 2016 18:34:38 > To: dev@cloudstack.apache.org > Subject: MySQL : No suitable driver found for jdbc:mysql > > Hi all, > > I'm facing the following issue when installing ACS 4.9.0 (current master). > java.sql.SQLException: No suitable driver found for > jdbc:mysql://localhost:3306/cloud?autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true > at java.sql.DriverManager.getConnection(DriverManager.java:596) > at java.sql.DriverManager.getConnection(DriverManager.java:215) > at > > org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:75) > at > > org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582) > at > > org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1188) > at > > org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106) > at > > com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:202) > at com.cloud.utils.db.Merovingian2.(Merovingian2.java:68) > at > com.cloud.utils.db.Merovingian2.createLockMaster(Merovingian2.java:88) > > First, I thought that the mysql-connector-java.jar was not loaded / > installed correctly. But this jar is loaded : > [root@csc-1 java]# lsof -p 14064 | grep jar | grep mysql > java14064 cloud memREG 253,1883899 134860304 > /usr/share/java/mysql-connector-java.jar > java14064 cloud 38r REG 253,1883899 134860304 > /usr/share/java/mysql-connector-java.jar > > Tomcat specifics : > [root@csc-1 java]# tomcat version > Server version: Apache Tomcat/7.0.54 > Server bu
RE: MySQL : No suitable driver found for jdbc:mysql
@Rohit, On CentOS 7 I get [root@localhost ~]# yum install libmysql-java Loaded plugins: fastestmirror base | 3.6 kB 00:00:00 epel/x86_64/metalink | 25 kB 00:00:00 epel | 4.3 kB 00:00:00 extras | 3.4 kB 00:00:00 updates | 3.4 kB 00:00:00 (1/3): epel/x86_64/group_gz | 170 kB 00:00:00 (2/3): epel/x86_64/updateinfo | 555 kB 00:00:00 (3/3): epel/x86_64/primary_db | 4.1 MB 00:00:00 Loading mirror speeds from cached hostfile * base: mirrors.clouvider.net * epel: epel.mirrors.ovh.net * extras: centos.serverspace.co.uk * updates: mirror.as29550.net No package libmysql-java available. Error: Nothing to do [root@localhost ~]# Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] Sent: 17 May 2016 18:15 To: dev@cloudstack.apache.org Subject: Re: MySQL : No suitable driver found for jdbc:mysql Nick, assuming it's a CentOS environment can you run cloudstack-setup-databases (again), make sure that database IP and cluster node IP parameters in db.properties are correct, and finally check that the jar is in the classpath in the initd/systemd script (check JAVA_HOME, jdk dirs etc.). Also watchout for errors in the logs. Oracle-java is not available from default repositories, in that case you may need to fix JAVA_HOME and jdk paths in initd scripts. Regards. From: Nick LIVENS Sent: 17 May 2016 18:34:38 To: dev@cloudstack.apache.org Subject: MySQL : No suitable driver found for jdbc:mysql Hi all, I'm facing the following issue when installing ACS 4.9.0 (current master). java.sql.SQLException: No suitable driver found for jdbc:mysql://localhost:3306/cloud?autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true at java.sql.DriverManager.getConnection(DriverManager.java:596) at java.sql.DriverManager.getConnection(DriverManager.java:215) at org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:75) at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582) at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1188) at org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106) at com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:202) at com.cloud.utils.db.Merovingian2.(Merovingian2.java:68) at com.cloud.utils.db.Merovingian2.createLockMaster(Merovingian2.java:88) First, I thought that the mysql-connector-java.jar was not loaded / installed correctly. But this jar is loaded : [root@csc-1 java]# lsof -p 14064 | grep jar | grep mysql java14064 cloud memREG 253,1883899 134860304 /usr/share/java/mysql-connector-java.jar java14064 cloud 38r REG 253,1883899 134860304 /usr/share/java/mysql-connector-java.jar Tomcat specifics : [root@csc-1 java]# tomcat version Server version: Apache Tomcat/7.0.54 Server built: Mar 24 2015 07:49:05 Server number: 7.0.54.0 OS Name:Linux OS Version: 3.10.0-229.7.2.el7.x86_64 Architecture: amd64 JVM Version:1.7.0_85-mockbuild_2015_07_11_12_24-b00 JVM Vendor: Oracle Corporation Does anyone have an idea why I might be facing this issue? Thanks! Kind regards, Nick Livens rohit.ya...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: MySQL : No suitable driver found for jdbc:mysql
Hi Rohit, Please could you explain why user installation of libmysql-java is required. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] Sent: 17 May 2016 17:13 To: dev Subject: Re: MySQL : No suitable driver found for jdbc:mysql Nick, install libmysql-java or equivalent pkg and make sure the jar is in classpath. Regards. rohit.ya...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue On Tue, May 17, 2016 at 6:04 AM -0700, "Nick LIVENS" mailto:nick.liv...@nuagenetworks.net>> wrote: Hi all, I'm facing the following issue when installing ACS 4.9.0 (current master). java.sql.SQLException: No suitable driver found for jdbc:mysql://localhost:3306/cloud?autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true at java.sql.DriverManager.getConnection(DriverManager.java:596) at java.sql.DriverManager.getConnection(DriverManager.java:215) at org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:75) at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582) at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1188) at org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106) at com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:202) at com.cloud.utils.db.Merovingian2.(Merovingian2.java:68) at com.cloud.utils.db.Merovingian2.createLockMaster(Merovingian2.java:88) First, I thought that the mysql-connector-java.jar was not loaded / installed correctly. But this jar is loaded : [root@csc-1 java]# lsof -p 14064 | grep jar | grep mysql java14064 cloud memREG 253,1883899 134860304 /usr/share/java/mysql-connector-java.jar java14064 cloud 38r REG 253,1883899 134860304 /usr/share/java/mysql-connector-java.jar Tomcat specifics : [root@csc-1 java]# tomcat version Server version: Apache Tomcat/7.0.54 Server built: Mar 24 2015 07:49:05 Server number: 7.0.54.0 OS Name:Linux OS Version: 3.10.0-229.7.2.el7.x86_64 Architecture: amd64 JVM Version:1.7.0_85-mockbuild_2015_07_11_12_24-b00 JVM Vendor: Oracle Corporation Does anyone have an idea why I might be facing this issue? Thanks! Kind regards, Nick Livens
RE: Migrating CloudStack content from download.cloud.com
Taking a long-term view, I'm not overly keen on the project's dependence on Wido for cloudstack.apt-get.eu either. The CloudStack alliance owning whatever the domain name might be could well be the best/most neutral way forward. Now 'just' to get everyone to agree on what that domain name should be. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 16 May 2016 18:59 To: dev@cloudstack.apache.org Cc: Wido den Hollander Subject: Re: Migrating CloudStack content from download.cloud.com @Ian, yes, but I think there is more to it than that. We can change it going forward and we can move everything from there over to a new domain. I believe the problem is with all of the existing ACS or CCP installs out there currently pointing at the download.cloud.com URL, so when it goes down, those installs have to be updated. Maybe I don't understand exactly, but that is the impression I am getting from this thread. Can this be confirmed? *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Mon, May 16, 2016 at 1:38 PM, Ian Rae wrote: > Hey guys, who controls apt-get.eu and given the (rather concerning) > level of dependency on the operation of the download.cloud.com - would > it not make sense to use a domain that is under the control of party > whose alignment with CloudStack will not shift. I hesitate to > implicate the red tape of Apache Foundation, but perhaps the fabled > CloudStack alliance organization would be a good way to handle this > long term. > > On Mon, May 16, 2016 at 1:32 PM, Raja Pullela > wrote: > > Paul, > > > > trust me, it won’t be go away overnight. We are talking to Citrix > > and > requested them to keep it active for another year. > > > > Once we have the content copied over (I will work with Wido and > > verify > this) to cloudstack.apt-get.eu and update the documentation (user > guides update and create a wiki to show how an existing installation > can fixed to point to new URLs) we don’t have a dependency on > “download.cloud.com” – > right? sorry, if I am missing something here? Please let me know, > > > > best, > > Raja > > Senior Manager, Product Development > > Accelerite, > > 2055, Laurelwood Road, Santa Clara, CA 95054, USA > > Phone: 1-408-216-7010, www.accelerite.com, @accelerite > > > > > > On 5/16/16, 9:38 PM, "Paul Angus" wrote: > >>Thanks Raja, > >> > >>May I humbly suggest that someone at Accelerite speaks to Citrix > >>about > how long the content will remain on download.cloud.com? > >>Simply losing the content on download.cloud.com overnight will make > everyone look bad > >> > >>Kind regards, > >> > >>Paul Angus > >> > >>paul.an...@shapeblue.com > >>www.shapeblue.com > >>53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > >> > >>-Original Message- > >>From: Raja Pullela [mailto:raja.pull...@accelerite.com] > >>Sent: 16 May 2016 16:44 > >>To: dev@cloudstack.apache.org > >>Subject: Re: Migrating CloudStack content from download.cloud.com > >> > >>Paul, > >> > >>Yes, you are right, this change impacts both CloudStack and > CloudPlatform customers. Not sure, if I understand you correctly, the > move away from “download.cloud.com” is permanent. I don’t know how > long the content on download.cloud.com will be up/available. > >> > >>Based on Wido’s availability, we can get rest of the content to > cloudstack.apt-get.eu, hopefully, by this week ?BTW, the content on > download.cloud.com is left as is and will stay as is until Citrix > decides on what to do with it. > >> > >>Best, > >>Raja > >>Senior Manager, Product Development > >>Accelerite, > >>2055, Laurelwood Road, Santa Clara, CA 95054, USA > >>Phone: 1-408-216-7010, www.accelerite.com, @accelerite > >> > >> > >>On 5/16/16, 6:36 PM, "Paul Angus" wrote: > >> > >>>Raja, > >>> > >>>As this effects every copy of CloudStack and CloudPlatform there > >>>ever > was. Please may I ask how long we have to manage a migration away > from download.cloud.com? > >>> > >>> > >>> > >>>Kind regards, > >>> > >>&
RE: Migrating CloudStack content from download.cloud.com
Raja, http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2 returns: AccessDenied Access Denied53EAFABB1108278B fVsFcxdoTA8U3MOoToZ0VsEyQNaJ4N5xTtMhaGpxG5OgDugcrBTwOGSaCjgCs+thNukQYLrk4vY= Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Raja Pullela [mailto:raja.pull...@accelerite.com] Sent: 16 May 2016 20:07 To: dev@cloudstack.apache.org Subject: Re: Migrating CloudStack content from download.cloud.com Hi Indra, Its available on download.cloud.com – can you try to download it ? I have added this to this list to make them available on cloudstack.apt-get.eu. Best, Raja Senior Manager, Product Development Accelerite, 2055, Laurelwood Road, Santa Clara, CA 95054, USA Phone: 1-408-216-7010, www.accelerite.com, @accelerite On 5/16/16, 6:25 PM, "Raja Pullela" wrote: >Hi Indra, > >I will check this and get back. > >Best, >Raja >Senior Manager, Product Development >Accelerite, >2055, Laurelwood Road, Santa Clara, CA 95054, USA >Phone: 1-408-216-7010, www.accelerite.com, @accelerite > >On 5/14/16, 11:45 AM, "Indra Pramana" wrote: >>Dear all, >> >>Is there an alternative solution for now where I can download below URL? >> >>http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001b >>d8a0faf.qcow2.bz2 >> >>It's the default CentOS 5.5 (64-bit) no GUI template for KVM. I >>checked and the above copy is not yet on cloudstack.apt-get.eu. >> >>Looking forward to your reply, thank you. >> >>Cheers. >> >> >> >>On Sat, May 14, 2016 at 9:42 AM, Paul Angus >>wrote: >> >>> Raja, >>> >>> I've just picked up on this. >>> >>> There are a number of URLs which are hardcoded into the CloudStack >>> database for the small built-in templates. These are in just about >>> every copy of CloudStack out there. >>> >>> >>> http://download.cloud.com/templates/builtin/f59f18fb-ae94-4f97-afd2- >>> f84755767aca.vhd.bz2 >>> >>> http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c00 >>> 1bd8a0faf.qcow2.bz2 >>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2 >>> http://download.cloud.com/releases/4.3/centos6_4_64bit.vhd.bz2 >>> http://download.cloud.com/releases/2.2.0/CentOS5.3-x86_64.ova >>> http://download.cloud.com/templates/builtin/centos-7-x86_64.tar.gz >>> >>> >>> These will need copying and the CloudStack code updating to the new >>> location. >>> >>> >>> I don't think that you can deprecate download.cloud.com or it's >>> contents for some time, without causing a lot of issues for users. >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> Hi, >>> >>> >>> >>> Short Term - all the content has moved to cloudstack.apt-get.eu >>> >>> >>> >>> Which sections to be modified? >>> >>> >>> >>> The Install Guide needs to be modified. Sample links/details are >>> mentioned below for 4.6 and same needs to be updated for other >>> Released versions of Cloudstack documentation: >>> >>> >>> http://docs.cloudstack.apache.org/projects/cloudstack-installation/e >>> n/4.6/management-server/#downloading-vhd-util >>> >>> Section - Downloading vhd-util¶ >>> >>> >>> >>> What to do modified ? >>> >>> modify URL from >>> http://download.cloud.com.s3.amazonaws.com/tools/vhd-util >>> to >>> http://cloudstack.apt-get.eu/tools/vhd-util >>> >>> >>> >>> @Rajsekhar can you please update the sections ? >>> >>> >>> >>> Thanks >>> >>> Raja >>> >>> Senior Manager, Product Development >>> >>> Accelerite, >>> >>> 2055, Laurelwood Road, Santa Clara, CA 95054, USA >>> >>> Phone: 1-408-216-7010, www.accelerite.com, @accelerite >>> >>> >>> Kind regards, >>> >>> Paul Angus >>> >>> >>> Regards, >>> >>> Paul Angus >>> >>> paul.an...@shapeblue.com >>> www.shapeblue.com >>> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue >>> > > > > >DISCLAIMER >== >This e-mail may contain
RE: [Discuss] New built-in templates for CloudStack
Thanks Ian, Nux, could help us with this, but we can't have a product dependence on a third party. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Ian Duffy [mailto:i...@ianduffy.ie] Sent: 16 May 2016 19:28 To: dev@cloudstack.apache.org Subject: Re: [Discuss] New built-in templates for CloudStack Nux has a good selection of the popular OSs available over at http://dl.openvm.eu/cloudstack/ Afaik all are fairly minimal, working with cloud init, ssh key injection, password reset etc. On Monday 16 May 2016, Paul Angus wrote: > Hi All, > > As it looks like we're losing download.cloud.com and going to have to > write new database entries for all of the built-in templates, I think > that it's worth taking stock of the templates that we're using and > trying to consolidate them. > > CentOS 5.3(64-bit) no GUI (XenServer) > > CentOS 5.5(64-bit) no GUI (KVM) > > CentOS 5.6(64-bit) no GUI (XenServer) > > CentOS 6.4(64-bit) GUI (Hyperv) > > CentOS 5.3(64-bit) no GUI (vSphere) > > CentOS 7(64-bit) no GUI (LXC) > > > I think we should pick one OS and version and have that available > across all hypervisors if possible. My criteria would be small, > current, can support user-data and password reset and is an OS *most* > Linux people would be comfortable with. > > > > Thoughts? > > > > > Kind regards, > > Paul Angus > > > paul.an...@shapeblue.com www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue >
[Discuss] New built-in templates for CloudStack
Hi All, As it looks like we're losing download.cloud.com and going to have to write new database entries for all of the built-in templates, I think that it's worth taking stock of the templates that we're using and trying to consolidate them. CentOS 5.3(64-bit) no GUI (XenServer) CentOS 5.5(64-bit) no GUI (KVM) CentOS 5.6(64-bit) no GUI (XenServer) CentOS 6.4(64-bit) GUI (Hyperv) CentOS 5.3(64-bit) no GUI (vSphere) CentOS 7(64-bit) no GUI (LXC) I think we should pick one OS and version and have that available across all hypervisors if possible. My criteria would be small, current, can support user-data and password reset and is an OS *most* Linux people would be comfortable with. Thoughts? Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: Migrating CloudStack content from download.cloud.com
Thanks Raja, May I humbly suggest that someone at Accelerite speaks to Citrix about how long the content will remain on download.cloud.com? Simply losing the content on download.cloud.com overnight will make everyone look bad Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Raja Pullela [mailto:raja.pull...@accelerite.com] Sent: 16 May 2016 16:44 To: dev@cloudstack.apache.org Subject: Re: Migrating CloudStack content from download.cloud.com Paul, Yes, you are right, this change impacts both CloudStack and CloudPlatform customers. Not sure, if I understand you correctly, the move away from “download.cloud.com” is permanent. I don’t know how long the content on download.cloud.com will be up/available. Based on Wido’s availability, we can get rest of the content to cloudstack.apt-get.eu, hopefully, by this week ?BTW, the content on download.cloud.com is left as is and will stay as is until Citrix decides on what to do with it. Best, Raja Senior Manager, Product Development Accelerite, 2055, Laurelwood Road, Santa Clara, CA 95054, USA Phone: 1-408-216-7010, www.accelerite.com, @accelerite On 5/16/16, 6:36 PM, "Paul Angus" wrote: >Raja, > >As this effects every copy of CloudStack and CloudPlatform there ever was. >Please may I ask how long we have to manage a migration away from >download.cloud.com? > > > >Kind regards, > >Paul Angus > >Regards, > >Paul Angus > >paul.an...@shapeblue.com >www.shapeblue.com >53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > >-Original Message- >From: Raja Pullela [mailto:raja.pull...@accelerite.com] >Sent: 16 May 2016 13:53 >To: dev@cloudstack.apache.org >Subject: Re: Migrating CloudStack content from download.cloud.com > >Hi Paul, > >Thank you for the additional file details and I will request wido to copy >these as well. > >BTW, I agree with you there is every copy of CloudStack out there and reason >why I have requested Wido to download all the old files as well. Looks like >we missed few and get these uploaded as well. > >Please note that Citrix owns the “download.cloud.com” address and we have to >get all the CloudStack related content from there. Once we confirm on the >content move Citrix may choose to remove the content from the location. > >That said, I will get in touch with Wido again and do a complete copy such >that we have everything. > >Best, >Raja >Senior Manager, Product Development >Accelerite, >2055, Laurelwood Road, Santa Clara, CA 95054, USA >Phone: 1-408-216-7010, www.accelerite.com, @accelerite > >On 5/14/16, 7:12 AM, "Paul Angus" wrote: >>Raja, >> >>I've just picked up on this. >> >>There are a number of URLs which are hardcoded into the CloudStack database >>for the small built-in templates. These are in just about every copy of >>CloudStack out there. >> >>http://download.cloud.com/templates/builtin/f59f18fb-ae94-4f97-afd2-f8 >>4 >>755767aca.vhd.bz2 >>http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001b >>d >>8a0faf.qcow2.bz2 >>http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2 >>http://download.cloud.com/releases/4.3/centos6_4_64bit.vhd.bz2 >>http://download.cloud.com/releases/2.2.0/CentOS5.3-x86_64.ova >>http://download.cloud.com/templates/builtin/centos-7-x86_64.tar.gz >> >> >>These will need copying and the CloudStack code updating to the new location. >> >> >>I don't think that you can deprecate download.cloud.com or it's contents for >>some time, without causing a lot of issues for users. >> >> >> >> >> >> >> >> >> >>Hi, >> >> >> >>Short Term - all the content has moved to cloudstack.apt-get.eu >> >> >> >>Which sections to be modified? >> >> >> >>The Install Guide needs to be modified. Sample links/details are >>mentioned below for 4.6 and same needs to be updated for other >>Released versions of Cloudstack documentation: >> >>http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/ >>4 .6/management-server/#downloading-vhd-util >> >>Section - Downloading vhd-util¶ >> >> >> >>What to do modified ? >> >>modify URL from >>http://download.cloud.com.s3.amazonaws.com/tools/vhd-util to >>http://cloudstack.apt-get.eu/tools/vhd-util >> >> >> >>@Rajsekhar can you please update the sections ? >> >> >> >>Thanks >>
RE: Migrating CloudStack content from download.cloud.com
Raja, As this effects every copy of CloudStack and CloudPlatform there ever was. Please may I ask how long we have to manage a migration away from download.cloud.com? Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Raja Pullela [mailto:raja.pull...@accelerite.com] Sent: 16 May 2016 13:53 To: dev@cloudstack.apache.org Subject: Re: Migrating CloudStack content from download.cloud.com Hi Paul, Thank you for the additional file details and I will request wido to copy these as well. BTW, I agree with you there is every copy of CloudStack out there and reason why I have requested Wido to download all the old files as well. Looks like we missed few and get these uploaded as well. Please note that Citrix owns the “download.cloud.com” address and we have to get all the CloudStack related content from there. Once we confirm on the content move Citrix may choose to remove the content from the location. That said, I will get in touch with Wido again and do a complete copy such that we have everything. Best, Raja Senior Manager, Product Development Accelerite, 2055, Laurelwood Road, Santa Clara, CA 95054, USA Phone: 1-408-216-7010, www.accelerite.com, @accelerite On 5/14/16, 7:12 AM, "Paul Angus" wrote: >Raja, > >I've just picked up on this. > >There are a number of URLs which are hardcoded into the CloudStack database >for the small built-in templates. These are in just about every copy of >CloudStack out there. > >http://download.cloud.com/templates/builtin/f59f18fb-ae94-4f97-afd2-f84 >755767aca.vhd.bz2 >http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd >8a0faf.qcow2.bz2 >http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2 >http://download.cloud.com/releases/4.3/centos6_4_64bit.vhd.bz2 >http://download.cloud.com/releases/2.2.0/CentOS5.3-x86_64.ova >http://download.cloud.com/templates/builtin/centos-7-x86_64.tar.gz > > >These will need copying and the CloudStack code updating to the new location. > > >I don't think that you can deprecate download.cloud.com or it's contents for >some time, without causing a lot of issues for users. > > > > > > > > > >Hi, > > > >Short Term - all the content has moved to cloudstack.apt-get.eu > > > >Which sections to be modified? > > > >The Install Guide needs to be modified. Sample links/details are >mentioned below for 4.6 and same needs to be updated for other Released >versions of Cloudstack documentation: > >http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4 >.6/management-server/#downloading-vhd-util > >Section - Downloading vhd-util¶ > > > >What to do modified ? > >modify URL from >http://download.cloud.com.s3.amazonaws.com/tools/vhd-util to >http://cloudstack.apt-get.eu/tools/vhd-util > > > >@Rajsekhar can you please update the sections ? > > > >Thanks > >Raja > >Senior Manager, Product Development > >Accelerite, > >2055, Laurelwood Road, Santa Clara, CA 95054, USA > >Phone: 1-408-216-7010, www.accelerite.com, @accelerite > > >Kind regards, > >Paul Angus > > >Regards, > >Paul Angus > >paul.an...@shapeblue.com >www.shapeblue.com >53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue DISCLAIMER == This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.
RE: Migrating CloudStack content from download.cloud.com
Raja, I've just picked up on this. There are a number of URLs which are hardcoded into the CloudStack database for the small built-in templates. These are in just about every copy of CloudStack out there. http://download.cloud.com/templates/builtin/f59f18fb-ae94-4f97-afd2-f84755767aca.vhd.bz2 http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2 http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2 http://download.cloud.com/releases/4.3/centos6_4_64bit.vhd.bz2 http://download.cloud.com/releases/2.2.0/CentOS5.3-x86_64.ova http://download.cloud.com/templates/builtin/centos-7-x86_64.tar.gz These will need copying and the CloudStack code updating to the new location. I don't think that you can deprecate download.cloud.com or it's contents for some time, without causing a lot of issues for users. Hi, Short Term - all the content has moved to cloudstack.apt-get.eu Which sections to be modified? The Install Guide needs to be modified. Sample links/details are mentioned below for 4.6 and same needs to be updated for other Released versions of Cloudstack documentation: http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.6/management-server/#downloading-vhd-util Section - Downloading vhd-util¶ What to do modified ? modify URL from http://download.cloud.com.s3.amazonaws.com/tools/vhd-util to http://cloudstack.apt-get.eu/tools/vhd-util @Rajsekhar can you please update the sections ? Thanks Raja Senior Manager, Product Development Accelerite, 2055, Laurelwood Road, Santa Clara, CA 95054, USA Phone: 1-408-216-7010, www.accelerite.com, @accelerite Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
Re: Organizing CCCNA16 Hackathon
I'm keen to sit in on the Ci/CD work, but also the documentation work. (re-writing the concepts section is 'onging') Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: [ANNOUNCE] New committer: Simon Weller
Congratulations Simon! Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Erik Weber [mailto:terbol...@gmail.com] Sent: 28 April 2016 08:24 To: dev Subject: [ANNOUNCE] New committer: Simon Weller The Project Management Committee (PMC) for Apache CloudStack has asked Simon Weller to become a committer and we are pleased to announce that they have accepted. Being a committer allows many contributors to contribute more autonomously. For developers, it makes it easier to submit changes and eliminates the need to have contributions reviewed via the patch submission process. Whether contributions are development-related or otherwise, it is a recognition of a contributor's participation in the project and commitment to the project and the Apache Way. Please join me in congratulating Simon --Erik on behalf of the CloudStack PMC
Re: Multithreaded Builds
I'll collect that $5 when i come over Will. 😉 From: Daan Hoogland Sent: 23 Apr 2016 15:02 To: dev Subject: Re: Multithreaded Builds No Will, it was to prove you need extra hardware! On Sat, Apr 23, 2016 at 3:55 PM, Will Stevens wrote: > Haha. Awesome. :) > > This was more to validate that it was OK that I configure parallelism in my > CI environment. > On Apr 23, 2016 9:34 AM, "Ian Rae" wrote: > > > Ok ok, point made, we can buy you new hardware Will ;) > > > > On Saturday, 23 April 2016, Will Stevens > wrote: > > > > > Thanks for the reports guys. :) > > > On Apr 23, 2016 7:22 AM, "Paul Angus" > > > wrote: > > > > > > > My local builds (Centos6 on VMware Workstation) run happily using 4 > > > cores. > > > > The speed itself is down to my overclocked processor, but still, it > > runs > > > > stably on 4 cores running at 25% over there stock speed. > > > > > > > > mvn -T 4.0C -Dnoredist install > > > > > > > > [INFO] BUILD SUCCESS > > > > [INFO] > > > > > > ---- > > > > [INFO] Total time: 03:20 min (Wall Clock) > > > > > > > > > > > > > > > > Kind regards, > > > > > > > > Paul Angus > > > > > > > > Regards, > > > > > > > > Paul Angus > > > > > > > > paul.an...@shapeblue.com > > > > www.shapeblue.com<http://www.shapeblue.com> > > > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK > > > > @shapeblue > > > > > > > > -Original Message- > > > > From: Wido den Hollander [mailto:w...@widodh.nl ] > > > > Sent: 22 April 2016 07:57 > > > > To: dev@cloudstack.apache.org > > > > Subject: Re: Multithreaded Builds > > > > > > > > > > > > > > > > > Op 22 apr. 2016 om 00:03 heeft Will Stevens < > > williamstev...@gmail.com > > > > > > > > het volgende geschreven: > > > > > > > > > > Well the multithreaded build did complete successfully and it took. > > > > > > > > > > real7m3.933s > > > > > user25m31.969s > > > > > sys 3m2.880s > > > > > > > > > > Which compares to a non-multithreaded build on the same machine > which > > > > takes. > > > > > > > > > > real10m8.288s > > > > > user18m23.564s > > > > > sys 1m19.215s > > > > > > > > > > It is not a huge improvement, but for CI runs I will take any > minutes > > > > > I can shave. :) > > > > > > > > > > > > > Indeed! Locally I always run with 2C, works fine for me. Takes about > 6 > > > > minutes to build. > > > > > > > > Wido > > > > > > > > > Cheers, > > > > > > > > > > Will > > > > > > > > > > On Thu, Apr 21, 2016 at 5:44 PM, Will Stevens > > > > > > > > > > > wrote: > > > > > > > > > >> Is it a reasonable expectation for ACS to be able to be built > using > > > > >> the `-T 1C` flag? I am trying it now, but if it works once, it > may > > > > >> not mean that it would always work. > > > > >> > > > > >> I see a lot of messages like this: > > > > >> > > > > >> [WARNING] > > > > * > > > > >> [WARNING] * Your build is requesting parallel execution, but > project > > > > * > > > > >> [WARNING] * contains the following plugin(s) that have goals not > > > > marked * > > > > >> [WARNING] * as @threadSafe to support parallel building. > > > > * > > > > >> [WARNING] * While this /may/ work fine, please look for plugin > > updates > > > > * > > > > >> [WARNING] * and/or request plugins be made thread-safe. > > > >* > > > > >> [WARNING] * If reporting an issue, report it against the plugin in > > > > * > > > > >> [WARNING] * question, not against maven-core > > > > * > > > > >
RE: Multithreaded Builds
My local builds (Centos6 on VMware Workstation) run happily using 4 cores. The speed itself is down to my overclocked processor, but still, it runs stably on 4 cores running at 25% over there stock speed. mvn -T 4.0C -Dnoredist install [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 03:20 min (Wall Clock) Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: 22 April 2016 07:57 To: dev@cloudstack.apache.org Subject: Re: Multithreaded Builds > Op 22 apr. 2016 om 00:03 heeft Will Stevens het > volgende geschreven: > > Well the multithreaded build did complete successfully and it took. > > real7m3.933s > user25m31.969s > sys 3m2.880s > > Which compares to a non-multithreaded build on the same machine which takes. > > real10m8.288s > user18m23.564s > sys 1m19.215s > > It is not a huge improvement, but for CI runs I will take any minutes > I can shave. :) > Indeed! Locally I always run with 2C, works fine for me. Takes about 6 minutes to build. Wido > Cheers, > > Will > > On Thu, Apr 21, 2016 at 5:44 PM, Will Stevens > > wrote: > >> Is it a reasonable expectation for ACS to be able to be built using >> the `-T 1C` flag? I am trying it now, but if it works once, it may >> not mean that it would always work. >> >> I see a lot of messages like this: >> >> [WARNING] * >> [WARNING] * Your build is requesting parallel execution, but project * >> [WARNING] * contains the following plugin(s) that have goals not marked * >> [WARNING] * as @threadSafe to support parallel building. * >> [WARNING] * While this /may/ work fine, please look for plugin updates* >> [WARNING] * and/or request plugins be made thread-safe. * >> [WARNING] * If reporting an issue, report it against the plugin in* >> [WARNING] * question, not against maven-core * >> [WARNING] >> * >> [WARNING] The following plugins are not marked @threadSafe in Apache >> CloudStack Framework - Spring Life Cycle: >> [WARNING] org.apache.maven.plugins:maven-site-plugin:3.1 >> [WARNING] Enable debug to see more precisely which goals are not >> marked @threadSafe. >> [WARNING] >> * >> [WARNING] * >> [WARNING] * Your build is requesting parallel execution, but project * >> [WARNING] * contains the following plugin(s) that have goals not marked * >> [WARNING] * as @threadSafe to support parallel building. * >> [WARNING] * While this /may/ work fine, please look for plugin updates* >> [WARNING] * and/or request plugins be made thread-safe. * >> [WARNING] * If reporting an issue, report it against the plugin in* >> [WARNING] * question, not against maven-core * >> [WARNING] >> * >> [WARNING] The following plugins are not marked @threadSafe in Apache >> CloudStack API: >> [WARNING] org.apache.maven.plugins:maven-site-plugin:3.1 >> [WARNING] Enable debug to see more precisely which goals are not >> marked @threadSafe. >> [WARNING] >> * >> >> Thoughts? >> >> Will >>
RE: Here goes nothing... :)
Hi Will,
I little while back I created a matrix to attempt to keep track of the tests
and their status.
Various other projects have stopped me getting to the stage where I could start
putting anything in...
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Marvin+Test+Matrix
Kind regards,
Paul Angus
Regards,
Paul Angus
paul.an...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London WC2N 4HSUK
@shapeblue
-Original Message-
From: Will Stevens [mailto:williamstev...@gmail.com]
Sent: 22 April 2016 19:10
To: dev@cloudstack.apache.org
Subject: Here goes nothing... :)
In an effort to figure out which tests are working and which are not and to
start compiling a list of tests with issues I have written a small python
script which auto discovers and categorizes the tests in the 'smoke'
and 'component' directories.
This will be interesting:
# HARDWARE REQUIRED
echo "Running tests with required_hardware=true"
nosetests --with-marvin --marvin-config=${marvinCfg} -s -a
tags=advanced,required_hardware=true \ smoke/test_deploy_vgpu_enabled_vm.py \
smoke/test_deploy_vm_iso.py \ smoke/test_deploy_vm_root_resize.py \
smoke/test_deploy_vm_with_userdata.py \ smoke/test_internal_lb.py \
smoke/test_iso.py \ smoke/test_loadbalance.py \ smoke/test_network.py \
smoke/test_network_acl.py \ smoke/test_nic.py \ smoke/test_password_server.py \
smoke/test_primary_storage.py \ smoke/test_privategw_acl.py \
smoke/test_regions.py \ smoke/test_router_dhcphosts.py \ smoke/test_routers.py
\ smoke/test_routers_iptables_default_policy.py \
smoke/test_routers_network_ops.py \ smoke/test_service_offerings.py \
smoke/test_snapshots.py \ smoke/test_ssvm.py \ smoke/test_templates.py \
smoke/test_usage_events.py \ smoke/test_vm_life_cycle.py \
smoke/test_vm_snapshots.py \ smoke/test_volumes.py \
smoke/test_vpc_redundant.py \ smoke/test_vpc_router_nics.py \
smoke/test_vpc_vpn.py \ component/test_accounts.py \
component/test_add_remove_network.py \ component/test_blocker_bugs.py \
component/test_browse_templates.py \ component/test_browse_volumes.py \
component/test_concurrent_snapshots_limit.py \
component/test_cpu_domain_limits.py \ component/test_cpu_limits.py \
component/test_cpu_project_limits.py \ component/test_deploy_vgpu_vm.py \
component/test_deploy_vm_userdata_reg.py \
component/test_dynamic_compute_offering.py \ component/test_egress_fw_rules.py
\ component/test_escalation_listTemplateDomainAdmin.py \
component/test_escalations_instances.py \
component/test_escalations_ipaddresses.py \ component/test_escalations_isos.py
\ component/test_escalations_networks.py \
component/test_escalations_routers.py \
component/test_escalations_securitygroups.py \
component/test_escalations_snapshots.py \
component/test_escalations_templates.py \ component/test_escalations_vmware.py
\ component/test_escalations_volumes.py \
component/test_escalations_vpncustomergateways.py \ component/test_haproxy.py \
component/test_interop_xd_ccp.py \ component/test_ip_reservation.py \
component/test_lb_secondary_ip.py \ component/test_memory_limits.py \
component/test_mm_domain_limits.py \ component/test_mm_project_limits.py \
component/test_netscaler_configs.py \ component/test_netscaler_nw_off.py \
component/test_network_offering.py \ component/test_overcommit.py \
component/test_persistent_networks.py \ component/test_portable_ip.py \
component/test_project_limits.py \ component/test_project_usage.py \
component/test_ps_domain_limits.py \ component/test_ps_limits.py \
component/test_ps_resize_volume.py \
component/test_ps_resource_limits_volume.py \
component/test_recurring_snapshots.py \ component/test_reset_ssh_keypair.py \
component/test_routers.py \ component/test_security_groups.py \
component/test_shared_networks.py \
component/test_simultaneous_volume_attach.py \ component/test_snapshot_gc.py \
component/test_snapshot_limits.py \ component/test_snapshots.py \
component/test_snapshots_improvement.py \ component/test_ss_domain_limits.py \
component/test_ss_limits.py \ component/test_ss_max_limits.py \
component/test_ss_project_limits.py \ component/test_stopped_vm.py \
component/test_storage_motion.py \ component/test_templates.py \
component/test_usage.py \ component/test_VirtualRouter_alerts.py \
component/test_vm_passwdenabled.py \ component/test_vmware_drs.py \
component/test_volumes.py \ component/test_vpc.py \
component/test_vpc_network.py \ component/test_vpc_network_lbrules.py \
component/test_vpc_network_pfrules.py \
component/test_vpc_network_staticnatrule.py \ component/test_vpc_offerings.py \
component/test_vpc_routers.py \ component/test_vpc_vm_life_cycle.py \
component/test_vpc_vms_deployment.py
# HARDWARE NOT REQUIRED
echo "Running tests with required_hardware=false"
nosetests --with-marvin --marvin-config=${marvinCfg} -s -a
tags=advanced,required_hardware=false \ smoke/test_affinity_groups.py \
RE: CloudStack Logging
Hi Simon, My gut says that it's probably not worth going back before 4.3. There have been large changes since then but I think that it's better to get as much data as possible, limiting to 4.6+ might not give a particularly large install base. Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Simon Weller [mailto:swel...@ena.com] Sent: 19 April 2016 21:51 To: us...@cloudstack.apache.org; dev@cloudstack.apache.org Subject: Re: CloudStack Logging Paul, Are you wanting for focus on logs on releases later than a particular version (e.g. 4.6)? - Si ____ From: Paul Angus Sent: Tuesday, April 19, 2016 10:55 AM To: us...@cloudstack.apache.org; dev@cloudstack.apache.org Subject: RE: CloudStack Logging No problem. Good question - Any and all logs. Often, it's the mundane stuff which obscures the messages that you really need to see! Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 19 April 2016 16:53 To: dev@cloudstack.apache.org Cc: us...@cloudstack.apache.org Subject: Re: CloudStack Logging Thanks Paul. Are you looking for only logs with errors or are you just looking for just any management server logs? *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Tue, Apr 19, 2016 at 11:45 AM, Paul Angus wrote: > Thanks Will, > > As far as I know anything sensitive is removed or obfuscated (vcenter > password displayed as h**). IP addresses and hostnames are shown. > Users may want to use a tool like SED to replace IP addresses or > internal domain names > > http://forums.qrz.com/index.php?threads/remove-ip-addresses-from-log-f > iles.204196/ > > > Kind regards, > > Paul Angus > > Regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > -Original Message- > From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On > Behalf Of Will Stevens > Sent: 19 April 2016 16:40 > To: dev@cloudstack.apache.org > Cc: us...@cloudstack.apache.org > Subject: Re: CloudStack Logging > > I like this initiative Paul. I just wanted to check with you. Do you > know if there is any confidential information like credentials or the > like that is logged in the management server log? I thought we had > done a push at one point to make sure no sensitive data was logged, > but I don't remember for sure. I think knowing the answer to this > will help people feel more comfortable uploading logs. > > Thanks for the valuable initiative... > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > @CloudOps_ > > On Tue, Apr 19, 2016 at 11:34 AM, Paul Angus > > wrote: > > > Hi All, > > > > I'm running an initiative to improve CloudStack logging. I'm going > > to be analysing logs and re-categorising the DEBUG, INFO, WARN and > > ERROR where appropriate such that we can reduce the default logging > > level to INFO without losing important troubleshooting information, > > while at the same time making the management-server log far more > > readable for operational admins. > > > > To achieve this I need logs to work with. > > > > Please could anyone interested upload logs to: > > https://shapeblue.brickftp.com > > > > The logs will be treated in the strictest confidence and public > > download of the logs will not be available. > > I'm especially interested in logs which you found particularly > > difficult to read or specific messages which you think are > > misscategorised > > > > If you wish, put comments at the top of the logs or send a message > > directly or via the mailing lists pointing out specific issues. > > Please compress the logs! > > > > Kind regards, > > > > Paul Angus > > > > > > Regards, > > > > Paul Angus > > > > paul.an...@shapeblue.com > > www.shapeblue.com > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > >
RE: CloudStack Logging
No problem. Good question - Any and all logs. Often, it's the mundane stuff which obscures the messages that you really need to see! Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 19 April 2016 16:53 To: dev@cloudstack.apache.org Cc: us...@cloudstack.apache.org Subject: Re: CloudStack Logging Thanks Paul. Are you looking for only logs with errors or are you just looking for just any management server logs? *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Tue, Apr 19, 2016 at 11:45 AM, Paul Angus wrote: > Thanks Will, > > As far as I know anything sensitive is removed or obfuscated (vcenter > password displayed as h**). IP addresses and hostnames are shown. > Users may want to use a tool like SED to replace IP addresses or > internal domain names > > http://forums.qrz.com/index.php?threads/remove-ip-addresses-from-log-f > iles.204196/ > > > Kind regards, > > Paul Angus > > Regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > -Original Message- > From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On > Behalf Of Will Stevens > Sent: 19 April 2016 16:40 > To: dev@cloudstack.apache.org > Cc: us...@cloudstack.apache.org > Subject: Re: CloudStack Logging > > I like this initiative Paul. I just wanted to check with you. Do you > know if there is any confidential information like credentials or the > like that is logged in the management server log? I thought we had > done a push at one point to make sure no sensitive data was logged, > but I don't remember for sure. I think knowing the answer to this > will help people feel more comfortable uploading logs. > > Thanks for the valuable initiative... > > *Will STEVENS* > Lead Developer > > *CloudOps* *| *Cloud Solutions Experts > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw > @CloudOps_ > > On Tue, Apr 19, 2016 at 11:34 AM, Paul Angus > > wrote: > > > Hi All, > > > > I'm running an initiative to improve CloudStack logging. I'm going > > to be analysing logs and re-categorising the DEBUG, INFO, WARN and > > ERROR where appropriate such that we can reduce the default logging > > level to INFO without losing important troubleshooting information, > > while at the same time making the management-server log far more > > readable for operational admins. > > > > To achieve this I need logs to work with. > > > > Please could anyone interested upload logs to: > > https://shapeblue.brickftp.com > > > > The logs will be treated in the strictest confidence and public > > download of the logs will not be available. > > I'm especially interested in logs which you found particularly > > difficult to read or specific messages which you think are > > misscategorised > > > > If you wish, put comments at the top of the logs or send a message > > directly or via the mailing lists pointing out specific issues. > > Please compress the logs! > > > > Kind regards, > > > > Paul Angus > > > > > > Regards, > > > > Paul Angus > > > > paul.an...@shapeblue.com > > www.shapeblue.com > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > >
RE: CloudStack Logging
Thanks Will, As far as I know anything sensitive is removed or obfuscated (vcenter password displayed as h**). IP addresses and hostnames are shown. Users may want to use a tool like SED to replace IP addresses or internal domain names http://forums.qrz.com/index.php?threads/remove-ip-addresses-from-log-files.204196/ Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 19 April 2016 16:40 To: dev@cloudstack.apache.org Cc: us...@cloudstack.apache.org Subject: Re: CloudStack Logging I like this initiative Paul. I just wanted to check with you. Do you know if there is any confidential information like credentials or the like that is logged in the management server log? I thought we had done a push at one point to make sure no sensitive data was logged, but I don't remember for sure. I think knowing the answer to this will help people feel more comfortable uploading logs. Thanks for the valuable initiative... *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Tue, Apr 19, 2016 at 11:34 AM, Paul Angus wrote: > Hi All, > > I'm running an initiative to improve CloudStack logging. I'm going to > be analysing logs and re-categorising the DEBUG, INFO, WARN and ERROR > where appropriate such that we can reduce the default logging level to > INFO without losing important troubleshooting information, while at > the same time making the management-server log far more readable for > operational admins. > > To achieve this I need logs to work with. > > Please could anyone interested upload logs to: > https://shapeblue.brickftp.com > > The logs will be treated in the strictest confidence and public > download of the logs will not be available. > I'm especially interested in logs which you found particularly > difficult to read or specific messages which you think are > misscategorised > > If you wish, put comments at the top of the logs or send a message > directly or via the mailing lists pointing out specific issues. > Please compress the logs! > > Kind regards, > > Paul Angus > > > Regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue >
CloudStack Logging
Hi All, I'm running an initiative to improve CloudStack logging. I'm going to be analysing logs and re-categorising the DEBUG, INFO, WARN and ERROR where appropriate such that we can reduce the default logging level to INFO without losing important troubleshooting information, while at the same time making the management-server log far more readable for operational admins. To achieve this I need logs to work with. Please could anyone interested upload logs to: https://shapeblue.brickftp.com The logs will be treated in the strictest confidence and public download of the logs will not be available. I'm especially interested in logs which you found particularly difficult to read or specific messages which you think are misscategorised If you wish, put comments at the top of the logs or send a message directly or via the mailing lists pointing out specific issues. Please compress the logs! Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: [discuss] CloudStack logging
Hi Pierre-Luc, I have a pull request in to fix the rotating of the catalina.out logs - I'll check what it's status is. And yes, being able to view VR, CPVM and SSVM logs from mgmt. server would be awesome. Some of our clients have 1000s of VRs so, some real thought needs to go into it... Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 15 April 2016 13:57 To: dev@cloudstack.apache.org Subject: Re: [discuss] CloudStack logging Something that could be interesting also is to remove VR and systemVMs logs from the cloudstack-management.log and have them into a separate files. I'm still not sure of those logs are traps only when there is problems, if it's the case it make sense to keep them in cloudstack-management.log. Anyhow, it might be interesting to collect VR and systemVMs logs from the management servers. The log structure is also pretty stable so far which make integration with ELK fairly easy which is good! What about the catalina.out? is there any way to reduce is size? I'll update the JIRA issue with problematic troubleshooting logs that are not clear to interpret... Thanks Paul for taking that one ! PL On Fri, Apr 15, 2016 at 4:44 AM, Daan Hoogland wrote: > Paul, > > I think that asking for input is a good approach. Those that have > problem with a certain log message or - sequence are the best to say > what should be different. > > Whether we should make hundreds of PRs or one?.. neither. I would say > change anything from a big class to a small package, or get the flow > for one API call and change anything in that. That would be cross > package and may require classes in the management -, service -, > orchestration and resource layers to be revisited for several flows. > > > On Fri, Apr 15, 2016 at 10:06 AM, Paul Angus > > wrote: > > > Great, I'll pick up the issue that Wido has already created > > https://issues.apache.org/jira/browse/CLOUDSTACK-8645 > > > > Does anyone have an suggestions wrt to structure of pull requests? > > I'm inclinded to ask the community for copies of logs - particularly > > ones that people have found difficult to read so that I or others > > can work through them looking for anamolies - it's very messy from a > > thoroughness point of view - but it would return the most useful > > changes first. It > also > > puts the error msg in a context to make the categorisation more acurate. > > > > > > > > Kind regards, > > > > Paul Angus > > > > Regards, > > > > Paul Angus > > > > paul.an...@shapeblue.com > > www.shapeblue.com > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > -Original Message- > > From: Wido den Hollander [mailto:w...@widodh.nl] > > Sent: 14 April 2016 15:04 > > To: Paul Angus ; dev@cloudstack.apache.org > > Subject: Re: [discuss] CloudStack logging > > > > > > > Op 14 april 2016 om 14:49 schreef Paul Angus > > > >: > > > > > > > > > Hi All > > > > > > I think that we can all agree that CloudStack logs are very > > > difficult to read, especially for operational staff. > > > > > > I believe that the primary reason for this is that a large amount > > > of what should be INFO level events are categorised as DEBUG. The > > > logging therefore must be set at DEBUG for the logs to capture > > > these events. By defaulting the logging to DEBUG we include a lot > > > of detail which is counter-productive when using the logs to > > > diagnose operational > > issues. > > > > > > > Yes! > > > > > I think the situation can be greatly improved by reviewing the > > > categorisation of logged events and where necessary re-categorise > > > then such that INFO, WARN and ERROR logging would be sufficient > > > for an > > 'operational' admin. > > > > > > I think a phased approach where the default logging level remains > > > at DEBUG while re-categorisation occurs would mean that nothing > > > materially changes until we are happy with the categorisations. > > > Then we can default the logging level to INFO. > > > > > > > I created a issue for this a while ago: > > https://issues.apache.org/jira/browse/CLOUDSTACK-8645 > > > > Short: Yes. Just change this where needed. > > > > Wido > > > > > > > > > > > Thoughts everyone? > > > > > > > > > > > > > > > Kind regards, > > > > > > Paul Angus > > > > > > > > > Regards, > > > > > > Paul Angus > > > > > > paul.an...@shapeblue.com > > > www.shapeblue.com > > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > > > -- > Daan >
RE: [discuss] CloudStack logging
Great, I'll pick up the issue that Wido has already created https://issues.apache.org/jira/browse/CLOUDSTACK-8645 Does anyone have an suggestions wrt to structure of pull requests? I'm inclinded to ask the community for copies of logs - particularly ones that people have found difficult to read so that I or others can work through them looking for anamolies - it's very messy from a thoroughness point of view - but it would return the most useful changes first. It also puts the error msg in a context to make the categorisation more acurate. Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: 14 April 2016 15:04 To: Paul Angus ; dev@cloudstack.apache.org Subject: Re: [discuss] CloudStack logging > Op 14 april 2016 om 14:49 schreef Paul Angus : > > > Hi All > > I think that we can all agree that CloudStack logs are very difficult > to read, especially for operational staff. > > I believe that the primary reason for this is that a large amount of > what should be INFO level events are categorised as DEBUG. The > logging therefore must be set at DEBUG for the logs to capture these > events. By defaulting the logging to DEBUG we include a lot of detail > which is counter-productive when using the logs to diagnose operational > issues. > Yes! > I think the situation can be greatly improved by reviewing the > categorisation of logged events and where necessary re-categorise then > such that INFO, WARN and ERROR logging would be sufficient for an > 'operational' admin. > > I think a phased approach where the default logging level remains at > DEBUG while re-categorisation occurs would mean that nothing > materially changes until we are happy with the categorisations. Then > we can default the logging level to INFO. > I created a issue for this a while ago: https://issues.apache.org/jira/browse/CLOUDSTACK-8645 Short: Yes. Just change this where needed. Wido > > > Thoughts everyone? > > > > > Kind regards, > > Paul Angus > > > Regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: [discuss] CloudStack logging
The file in a running installation you want is: /etc/cloudstack/management/ log4j-cloud.xml It is generally dynamic - you don't have to restart mgmt. server, it just takes a few seconds to kick in. If you're looking at the source code, various components use logging - SystemVMs, KVM agents, CloudStack mgmt. servers. So there'll be multiple occurrences As Koushik says, I think ./client/tomcatconf/log4j-cloud.xml.in is the one for the mgmt. server. Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Chaz PC [mailto:dreeems4e...@hotmail.com] Sent: 14 April 2016 16:01 To: dev@cloudstack.apache.org Subject: RE: [discuss] CloudStack logging I am confused about the configuration file there two files one is named Log4j-cloud.xml The other is Log4j-cloud.xml.in What is the difference between these two files ? I hope someone can help me clear this confusion Original message From: Koushik Das Date: 14/04/2016 6:49 PM (GMT+04:00) To: dev@cloudstack.apache.org Subject: Re: [discuss] CloudStack logging Based on the namespace log level can be set. It needs to be configured in the log4j. Check client/tomcatconf/log4j-cloud.xml.in in the source code and you will get an idea. -Koushik From: williamstev...@gmail.com on behalf of Will Stevens Sent: Thursday, April 14, 2016 7:29 PM To: dev@cloudstack.apache.org Subject: Re: [discuss] CloudStack logging Do you have to recompile in order to turn off the logging for a specific package or class? If yes, that is a show stopper for almost everyone... If it only requires a management server restart, that is more realistic. *Will STEVENS* Lead Developer *CloudOps* *| *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Thu, Apr 14, 2016 at 9:48 AM, Daan Hoogland wrote: > On Thu, Apr 14, 2016 at 3:41 PM, Will Stevens > > wrote: > > > Is there an easy way to do that Daan, or is it a tedious task you > > just > have > > to power through? > > > It is hard work, mostly tedious, sometimes hilarious and most > definitely > > devops! It certainly wouldn't classify as development. > > > > > -- > Daan > DISCLAIMER == This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.
RE: [discuss] CloudStack logging
Grabbing a couple of examples - these should be debug - I can't 'do' anything with this information. INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-4119d5bc) Begin cleanup expired async-jobs INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-4119d5bc) End cleanup expired async-jobs INFO [c.c.h.v.r.VmwareResource] (DirectAgentCronJob-2:ctx-3209f65c) Scan hung worker VM to recycle INFO [c.c.h.v.r.VmwareResource] (DirectAgentCronJob-113:ctx-56d9f9f2) Scan hung worker VM to recycle Whereas this should be WARN. I wouldn't want to lose this by switching off DEBUG DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:ctx-91226be7) Detected management node left, id:2, nodeIP:10.2.0.6 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:ctx-0bccd078) Detected management node left, id:2, nodeIP:10.2.0.6 Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: 14 April 2016 15:04 To: Paul Angus ; dev@cloudstack.apache.org Subject: Re: [discuss] CloudStack logging > Op 14 april 2016 om 14:49 schreef Paul Angus : > > > Hi All > > I think that we can all agree that CloudStack logs are very difficult > to read, especially for operational staff. > > I believe that the primary reason for this is that a large amount of > what should be INFO level events are categorised as DEBUG. The > logging therefore must be set at DEBUG for the logs to capture these > events. By defaulting the logging to DEBUG we include a lot of detail > which is counter-productive when using the logs to diagnose operational > issues. > Yes! > I think the situation can be greatly improved by reviewing the > categorisation of logged events and where necessary re-categorise then > such that INFO, WARN and ERROR logging would be sufficient for an > 'operational' admin. > > I think a phased approach where the default logging level remains at > DEBUG while re-categorisation occurs would mean that nothing > materially changes until we are happy with the categorisations. Then > we can default the logging level to INFO. > I created a issue for this a while ago: https://issues.apache.org/jira/browse/CLOUDSTACK-8645 Short: Yes. Just change this where needed. Wido > > > Thoughts everyone? > > > > > Kind regards, > > Paul Angus > > > Regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
[discuss] CloudStack logging
Hi All I think that we can all agree that CloudStack logs are very difficult to read, especially for operational staff. I believe that the primary reason for this is that a large amount of what should be INFO level events are categorised as DEBUG. The logging therefore must be set at DEBUG for the logs to capture these events. By defaulting the logging to DEBUG we include a lot of detail which is counter-productive when using the logs to diagnose operational issues. I think the situation can be greatly improved by reviewing the categorisation of logged events and where necessary re-categorise then such that INFO, WARN and ERROR logging would be sufficient for an 'operational' admin. I think a phased approach where the default logging level remains at DEBUG while re-categorisation occurs would mean that nothing materially changes until we are happy with the categorisations. Then we can default the logging level to INFO. Thoughts everyone? Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: http://cloudstackcollab.org/
Will do. Thanks all. Kind regards, Paul Angus From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 07 April 2016 16:43 To: dev@cloudstack.apache.org; Paul Angus Subject: Re: http://cloudstackcollab.org/ Thanks Mike. @Paul, please use Mike's link and I will make sure that gets onto the website. :) Will STEVENS Lead Developer CloudOps | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w cloudops.com<http://cloudops.com/> | tw @CloudOps_ On Thu, Apr 7, 2016 at 11:38 AM, Tutkowski, Mike mailto:mike.tutkow...@netapp.com>> wrote: I submitted my talk using the following link (provided by Pierre-Luc): https://docs.google.com/a/solidfire.com/forms/d/1wUL2_rYDdp7VEEwwEARONzNL0PSd3jEpDKRSnvFEYC4/viewform On Thu, Apr 7, 2016 at 7:05 AM -0700, "Paul Angus" mailto:paul.an...@shapeblue.com><mailto:paul.an...@shapeblue.com<mailto:paul.an...@shapeblue.com>>> wrote: Hi All, The http://cloudstackcollab.org/ site just gives me a blank page - where can I submit a talk? Kind regards, Paul Angus Regards, Paul Angus paul.an...@shapeblue.com<mailto:paul.an...@shapeblue.com> www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
RE: http://cloudstackcollab.org/
Great, thanks. Kind regards, Paul Angus From: williamstev...@gmail.com [mailto:williamstev...@gmail.com] On Behalf Of Will Stevens Sent: 07 April 2016 15:08 To: Paul Angus Cc: dev@cloudstack.apache.org Subject: Re: http://cloudstackcollab.org/ We are having some issues with that URL right now. You can reach the site at: http://cloudstackcollab.net/ instead for now... We are still working on content and such, so expect some changes over the next day or two. I don't think we have a form for submitting talks yet, so for now you can email me your talk and I can get it to the correct people. Will STEVENS Lead Developer CloudOps | Cloud Solutions Experts 420 rue Guy | Montreal | Quebec | H3J 1S6 w cloudops.com<http://cloudops.com/> | tw @CloudOps_ On Thu, Apr 7, 2016 at 10:04 AM, Paul Angus mailto:paul.an...@shapeblue.com>> wrote: Hi All, The http://cloudstackcollab.org/ site just gives me a blank page – where can I submit a talk? Kind regards, Paul Angus paul.an...@shapeblue.com<mailto:paul.an...@shapeblue.com> www.shapeblue.com<http://www.shapeblue.com> @shapeblue Regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
