Re: Ans: About Instance Storage Live Migration on VMware
According to https://issues.apache.org/jira/browse/CLOUDSTACK-2701 it should be supported. Haven't tried it myself though. -- Erik On Fri, Feb 13, 2015 at 12:52 PM, Star Guo st...@ceph.me wrote: Yes, CloudStack 4.4.2 supports VOLUME live migration with the vm in running state ( ui and cloudmonkey ), on VMware vSphere. I have test the live migration with ROOT volume and DATA volume. And the VOLUME live migration in CloudStack API is difference from VMware vCenter Storage vMotion which the all files of the VM (.vmdk, .vmx , .vmxf and .log etc) move to another VMFS of NFS storage. My question is: Does CloudStack support Storage vMotion? Not only volume live migration. Thanks. Best Regards, Star Guo -邮件原件- 发件人: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] 发送时间: 2015年2月13日 13:32 收件人: dev@cloudstack.apache.org 主题: Re: Forward: About Instance Storage Live Migration on VMware I am curious, when you say you used VMware's Storage vMotion, do you mean the intent was to live migrate the storage underlying one of your VMs? I was not aware that CloudStack supported this. I believe CloudStack supports the offline migration of VM disks, but it seems to me that, say, offline migrating a root disk wouldn't bring along the config and log files that also shared the same datastore with that root disk (perhaps it should, though). Maybe one of our VMware gurus can explain what is the expected behavior here. On Thu, Feb 12, 2015 at 5:24 PM, Star Guo st...@ceph.me wrote: Does any one know about that ? Best Regards, Star Guo -邮件原件- 发件人: Star Guo [mailto:st...@ceph.me] 发送时间: 2015年2月12日 9:24 收件人: us...@cloudstack.apache.org 主题: About Instance Storage Live Migration on VMware Hi, All, My env is cloudstack 4.4.2 + VMware 5.5, and it works well. I deploy an instance and try to migrate the ROOT disk to another vmfs primary storage. After that I find the ROOT disk is in new vmfs primary storage but the .vmx , .vmxf and .log etc still in the origin vmfs primary storage. If I want to migrate the instance (all of the files in the floder of the instance) to new vmfs primary storage, May CloudStack 4.4.2 Support to do this ? Thanks. Best Regards, Star Guo -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play*™*
Re: [ACS450] docs around 4.5
Did SAML2 come with 4.4 or is it new in 4.5? Erik Den lørdag 7. februar 2015 skrev Pierre-Luc Dion pdion...@apache.org følgende: Apidocs for 4.5.0 is on the staging website, I'll do the push on the live site once an RC will be approved. The Release note is ready in the cloudstack-docs-rn branch 4.5, but it lack in new features which I'm sure 4.5 does contain. so if anyone is aware of new features that should be in the What's new section please let me know. Regards,
Re: [GitHub] cloudstack pull request: CLOUDSTACK-8215: SAML changing date calcu...
I did update it Sebastien :-) -- Erik On Thu, Feb 5, 2015 at 1:16 PM, sebgoa run...@gmail.com wrote: Rohit, check the review, Rajani made a suggestion and Terbolous is going to change his commit. Please revert and let's wait for an updated commit. On Feb 5, 2015, at 12:54 PM, bhaisaab g...@git.apache.org wrote: Github user bhaisaab commented on the pull request: https://github.com/apache/cloudstack/pull/71#issuecomment-73034891 Applied on both 4.5 and master. Thanks for fixing this @terbolous ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: Google Summer of Code 2015 is coming
Pure Xen support would be nice :-) (and Ceph in XenServer, but that's not really a CloudStack issue) -- Erik On Tue, Feb 3, 2015 at 9:42 AM, Sebastien Goasguen run...@gmail.com wrote: GSoC 2015 is back. Time to enter your project proposals in jira if you want to mentor. Begin forwarded message: From: Ulrich Stärk u...@apache.org Subject: Google Summer of Code 2015 is coming Date: February 2, 2015 5:44:52 PM EST To: ment...@community.apache.org Reply-To: ment...@community.apache.org Reply-To: ment...@community.apache.org Hello PMCs (incubator Mentors, please forward this email to your podlings), Google Summer of Code [1] is a program sponsored by Google allowing students to spend their summer working on open source software. Students will receive stipends for developing open source software full-time for three months. Projects will provide mentoring and project ideas, and in return have the chance to get new code developed and - most importantly - to identify and bring in new committers. The ASF will apply as a participating organization meaning individual projects don't have to apply separately. If you want to participate with your project we ask you to do the following things by no later than 2015-02-13 19:00 UTC (applications from organizations close a week later) 1. understand what it means to be a mentor [2]. 2. record your project ideas. Just create issues in JIRA, label them with gsoc2015, and they will show up at [3]. Please be as specific as possible when describing your idea. Include the programming language, the tools and skills required, but try not to scare potential students away. They are supposed to learn what's required before the program starts. Use labels, e.g. for the programming language (java, c, c++, erlang, python, brainfuck, ...) or technology area (cloud, xml, web, foo, bar, ...) and record them at [5]. Please use the COMDEV JIRA project for recording your ideas if your project doesn't use JIRA (e.g. httpd, ooo). Contact d...@community.apache.org if you need assistance. [4] contains some additional information (will be updated for 2015 shortly). 3. subscribe to ment...@community.apache.org; restricted to potential mentors, meant to be used as a private list - general discussions on the public d...@community.apache.org list as much as possible please). Use a recognized address when subscribing (@apache.org or one of your alias addresses on record). Note that the ASF isn't accepted as a participating organization yet, nevertheless you *have to* start recording your ideas now or we might not get accepted. Over the years we were able to complete hundreds of projects successfully. Some of our prior students are active contributors now! Let's make this year a success again! Cheers, Uli P.S.: Except for the private parts (label spreadsheet mostly), this email is free to be shared publicly if you want to. [1] http://www.google-melange.com/gsoc/homepage/google/gsoc2015 [2] http://community.apache.org/guide-to-being-a-mentor.html [3] http://s.apache.org/gsoc2015ideas [4] http://community.apache.org/gsoc.html [5] http://s.apache.org/gsoclabels
Re: [DISCUSS] move MinVRVersion from service to orchestration layer
On Tue, Feb 3, 2015 at 11:22 AM, Daan Hoogland daan.hoogl...@gmail.com wrote: H, not sure if this is really worthy of the tag [DISCUSS] but it is a subset of [1] In view of issues people have upgrading system vms in between ACS updates I want to move the static final MinVRVersion in the VirtualNetworkApplianceService definition to a configuration item in the NetworkOrchestrationService. I started feature/minvrversion to do this. I would like for operators to be able to set it per domain and to add a fourth element to it for their own testing/use; it would then be '4.4.2.13234' after a lot of testing;) Sounds good to me :-) -- Erik
Re: Ghost glibc vulnerability and CloudStack
Is apache httpd configured to disable hostname lookups (for access/error log)? If not it is easy to trigger a reverse dns lookup just by connecting to it (which various scanners / exploiters do regularily). That's not to say that httpd is vulnerable though, has the httpd project given any info about their codebase? -- Erik On Thu, Jan 29, 2015 at 12:18 PM, Abhinandan Prateek abhinandan.prat...@shapeblue.com wrote: The only way a user can directly reach SSVM is by using download template. To be able to get SSVM do a DNS lookup for some host as desired by the attacker, by using download template functionality looks far fetched. -- Abhinandan Prateek M +919701199011 abhinandan.prat...@shapeblue.com On 29-Jan-2015, at 4:00 pm, Nux! n...@li.nux.ro wrote: As far as the SSVM is concerned, can this be exploited remotely? Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: John Kinsella j...@stratosec.co To: dev@cloudstack.apache.org Sent: Wednesday, 28 January, 2015 21:17:42 Subject: Re: Ghost glibc vulnerability and CloudStack https://blogs.apache.org/cloudstack/entry/cloudstack_and_the_ghost_glibc has now been updated with links to download the updated SSVM John On Jan 28, 2015, at 11:55 AM, John Kinsella j...@stratosec.comailto:j...@stratosec.co wrote: There’s a new vulnerability out in most Linux distributions that has potential to be fairly severe. As it affects most Linux distributions, we’re putting mitigation steps out immediately at [1]. This affects many Linux distributions, so please review management servers, databases, storage systems, etc. An updated SSVM template is being QAed, once released the post will be updated with links and we’ll mention here as well. John 1: https://blogs.apache.org/cloudstack/entry/cloudstack_and_the_ghost_glibc Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Software Engineering http://shapeblue.com/cloudstack-software-engineering/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: [DISCUSS] we need a better SSVM solution
On Wed, Jan 28, 2015 at 9:44 PM, John Kinsella j...@stratosec.co wrote: Every time there’s an issue (security or otherwise) with the system VM ISOs, it’s a relative pain to fix. They’re sort of a closed system, people know little (relative to other ACS parts, IMHO) about their innards, and updating them is more difficult than it should be. I’d love to see a Better Way. I think these things could be dynamically built, with the option to have them connect to a configuration management (CM) system such as Puppet, Chef, Salt-Stack or whatever else floats people’s boat. Totally agree, but we should consider the fact that users might not use our builds and make it equally easy to update with a custom one. One possible use case: * User installs new ACS system. * User logs into mgmt server, goes to Templates area, clicks button to fetch default SSVM image. UI allows providing alternative URL, other options as needed. * (time passes) * Security issue is announced. User goes back into Templates area, selects SSVM template, clicks “Download updated template” and it does. Under infrastructure/system VMs and infrastrucutre/virtual routers, there’s buttons to update one or more running instances to use the new template If the user is using one of the published templates, why not just download the new one and send a notification that a new template is ready and that systemvms should be scheduled for a restart? Another possible use case: * User installs new ACS system * User uploads SSVM template that has CM agent configured to talk to their CM server (I’ve been wanting to lab this for a while now) * As ACS creates system VMs, they phone home to CM server, it provides them with instructions to install various packages and config as needed to be domr/console proxy/whatever. We provide basic “recipes” for CM systems for people to use and grow from. * Security issue is announced. User updates recipe in CM system, a few minutes later the SSVMs are up-to-date. Modification on that use case: We ship the SSVM with puppet/chef/blah installed, part of the SSVM “patch” process configures appropriate CM system. What might make the second use case easier would be to have some hooks in ACS that when a system is created/destroyed/modified, it informs 3rd party via API. (Obviously API calls for all of the above to allow process without touching the UI) Thoughts? I've wondered for quite some time why we haven't had a simple checkbox in the template register view that says 'Use as System VM' or similar. Anyway, huge +1 -- Erik
Re: i want get how to build and run cloudstack 4.4.2 in eclipse
On Tue, Jan 20, 2015 at 9:50 AM, wangyuyang1...@163.com wangyuyang1...@163.com wrote: hi: can tell me how to build and run cloudstack 4.4.2 in eclipse? can give a detail wiki? thanks! Take a look at the following wikis: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Setting+up+CloudStack+Development+Environment https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack https://cwiki.apache.org/confluence/display/CLOUDSTACK/Working+with+CloudStack+Code -- Erik wangyuyang1...@163.com
Re: CloudStack Quality Process meeting 14 jan 2014
Compile a list of wanted resources and post them, that way providers could raise their hands if they have anything to donate. -- Erik On Fri, Jan 16, 2015 at 12:35 PM, Abhinandan Prateek abhinandan.prat...@shapeblue.com wrote: The reason I asked was we can start putting the system together, maybe start with just the simulator runs and then add additional Hypervisors. AFAIK the the BVTs for simulator is a good starting point. This will also help us in knowing the gaps between what tests we have now and what we desire as per the basic cloudstack functionality that we are putting together in our meetings. On 16-Jan-2015, at 4:56 pm, Daan Hoogland daan.hoogl...@gmail.com wrote: On Fri, Jan 16, 2015 at 12:08 PM, Abhinandan Prateek abhinandan.prat...@shapeblue.com wrote: Hi Daan, Do we access to some kind of hardware to setup the CI ? good point, maybe David can shed some light here. Citrix has donated a rack to apache (and of course vedors should provide extra jenkins slaves for their tests). -- Daan Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Software Engineering http://shapeblue.com/cloudstack-software-engineering/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: weird db setup issue
I solved it by referencing the relevant queries to the cloud database. A backward compatible fix has been submitted and merged. Erik Den torsdag 15. januar 2015 skrev Raja Pullela raja.pull...@citrix.com følgende: Hi Erik, don't believe an issue was created on mysql... still needs to be investigated to why the SQL script will work on one version and not on the other? You can downgrade to 5.6.21 and try it again, in case you are interested? Raja -Original Message- From: Erik Weber [mailto:terbol...@gmail.com javascript:;] Sent: Thursday, January 15, 2015 12:40 PM To: dev Subject: Re: weird db setup issue I can't answer for Sebastien, but in my case it was 5.6.22 (installed from mysql-community repo on centos7). Do you have a link to the mysql bug? -- Erik On Wed, Jan 14, 2015 at 4:10 PM, Raja Pullela raja.pull...@citrix.com javascript:; wrote: Sebastien, Can you check your MySQL version ? Is it 5.6.22 or above ? There was an issue with MySQL 5.6.22 - where in the SQL file mentioned returns an error, runs fine on MySQL 5.6.21 and below. You can downgrade/install the MySQL that is packaged with 4.5.0 OR update the SQL to include the use cloud before the SQL command. Raja -Original Message- From: Erik Weber [mailto:terbol...@gmail.com javascript:;] Sent: Wednesday, January 14, 2015 4:53 PM To: dev Subject: Re: weird db setup issue This happens on a new installation of Citrix CloudPlatform 4.5.0 as well. If anyone has time, we should check if this happens on ACS 4.5 and fix it -- Erik On Fri, Dec 5, 2014 at 9:27 PM, Sebastien Goasguen run...@gmail.com javascript:; wrote: On Dec 5, 2014, at 9:20 AM, Rohit Yadav rohit.ya...@shapeblue.com javascript:; wrote: Hi Sebastien, Which build/version of CloudStack are you using? this is 4.3.1 from packages, ubuntu 14.04 but I think it's an issue with my setup. that schema file has not changed in more than a year and is the same in all branches. I will keep investigating. adding use cloud (like Erik mentioned) solved the issue. On 05-Dec-2014, at 7:22 pm, Erik Weber terbol...@gmail.com javascript:; wrote: On Fri, Dec 5, 2014 at 2:32 PM, Sebastien Goasguen run...@gmail.com javascript:; wrote: Hi, I am trying to dockerize the whole cloudstack installation process. When running cloudstack-setup-database I hit this weird issue: Detected local IP address as 172.17.0.25, will use as cluster management server node IP[ OK ] Preparing /etc/cloudstack/management/db.properties [ OK ] Applying /usr/share/cloudstack-management/setup/create-database.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-schema.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-database-premium.s ql [ OK ] Applying /usr/share/cloudstack-management/setup/create-schema-premium.sql We apologize for below error: *** Encountering an error when executing mysql script -- table: /usr/share/cloudstack-management/setup/create-schema-premium.sql Error: ERROR 1046 (3D000) at line 285: No database selected Does this ring a bell to anyone ? why would the first schema be created successfully and not create-schema-premium ? - the create-database* scripts doesn't need a selected database - the create-schema.sql script starts by selecting the database (use cloud;) create-schema-premium.sql doesn't have the same selection at start, and I'm no sql guru but it could be a foreign key or something else without an explicit schema that fails. you should probably be able to workaround it by adding a use cloud; early in the create-schema-premium.sql file that's my two cent. -- Erik Regards, Rohit Yadav Software Architect, ShapeBlue M. +91 88 262 30892 | rohit.ya...@shapeblue.com javascript:; Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Software Engineering http://shapeblue.com/cloudstack-software-engineering/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use
Re: Cloudstack git server is down ?
It's down for maintenance. https://blogs.apache.org/infra/entry/downtime_notice_for_the_r -- Erik On Thu, Jan 15, 2015 at 10:25 PM, Rayees Namathponnan rayees.namathpon...@citrix.com wrote: Cloudstack git server is down ? I cannot access below URL ? https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/master Regards, Rayees
Re: weird db setup issue
I can't answer for Sebastien, but in my case it was 5.6.22 (installed from mysql-community repo on centos7). Do you have a link to the mysql bug? -- Erik On Wed, Jan 14, 2015 at 4:10 PM, Raja Pullela raja.pull...@citrix.com wrote: Sebastien, Can you check your MySQL version ? Is it 5.6.22 or above ? There was an issue with MySQL 5.6.22 - where in the SQL file mentioned returns an error, runs fine on MySQL 5.6.21 and below. You can downgrade/install the MySQL that is packaged with 4.5.0 OR update the SQL to include the use cloud before the SQL command. Raja -Original Message- From: Erik Weber [mailto:terbol...@gmail.com] Sent: Wednesday, January 14, 2015 4:53 PM To: dev Subject: Re: weird db setup issue This happens on a new installation of Citrix CloudPlatform 4.5.0 as well. If anyone has time, we should check if this happens on ACS 4.5 and fix it -- Erik On Fri, Dec 5, 2014 at 9:27 PM, Sebastien Goasguen run...@gmail.com wrote: On Dec 5, 2014, at 9:20 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Sebastien, Which build/version of CloudStack are you using? this is 4.3.1 from packages, ubuntu 14.04 but I think it's an issue with my setup. that schema file has not changed in more than a year and is the same in all branches. I will keep investigating. adding use cloud (like Erik mentioned) solved the issue. On 05-Dec-2014, at 7:22 pm, Erik Weber terbol...@gmail.com wrote: On Fri, Dec 5, 2014 at 2:32 PM, Sebastien Goasguen run...@gmail.com wrote: Hi, I am trying to dockerize the whole cloudstack installation process. When running cloudstack-setup-database I hit this weird issue: Detected local IP address as 172.17.0.25, will use as cluster management server node IP[ OK ] Preparing /etc/cloudstack/management/db.properties [ OK ] Applying /usr/share/cloudstack-management/setup/create-database.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-schema.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-database-premium.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-schema-premium.sql We apologize for below error: *** Encountering an error when executing mysql script -- table: /usr/share/cloudstack-management/setup/create-schema-premium.sql Error: ERROR 1046 (3D000) at line 285: No database selected Does this ring a bell to anyone ? why would the first schema be created successfully and not create-schema-premium ? - the create-database* scripts doesn't need a selected database - the create-schema.sql script starts by selecting the database (use cloud;) create-schema-premium.sql doesn't have the same selection at start, and I'm no sql guru but it could be a foreign key or something else without an explicit schema that fails. you should probably be able to workaround it by adding a use cloud; early in the create-schema-premium.sql file that's my two cent. -- Erik Regards, Rohit Yadav Software Architect, ShapeBlue M. +91 88 262 30892 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Software Engineering http://shapeblue.com/cloudstack-software-engineering/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: weird db setup issue
On Fri, Dec 5, 2014 at 2:32 PM, Sebastien Goasguen run...@gmail.com wrote: Hi, I am trying to dockerize the whole cloudstack installation process. When running cloudstack-setup-database I hit this weird issue: Detected local IP address as 172.17.0.25, will use as cluster management server node IP[ OK ] Preparing /etc/cloudstack/management/db.properties [ OK ] Applying /usr/share/cloudstack-management/setup/create-database.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-schema.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-database-premium.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-schema-premium.sql We apologize for below error: *** Encountering an error when executing mysql script -- table: /usr/share/cloudstack-management/setup/create-schema-premium.sql Error: ERROR 1046 (3D000) at line 285: No database selected Does this ring a bell to anyone ? why would the first schema be created successfully and not create-schema-premium ? I solved the issue and it seems related to MySQL What mysql version are/were you running? I just confirmed that the SQL query is accepted on MySQL 5.1, but not on MySQL 5.6. I guess they became a bit more strict somewhere in between. Adding absolute references solves it. See PR #67 for a fix -- Erik
Re: weird db setup issue
This happens on a new installation of Citrix CloudPlatform 4.5.0 as well. If anyone has time, we should check if this happens on ACS 4.5 and fix it -- Erik On Fri, Dec 5, 2014 at 9:27 PM, Sebastien Goasguen run...@gmail.com wrote: On Dec 5, 2014, at 9:20 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Sebastien, Which build/version of CloudStack are you using? this is 4.3.1 from packages, ubuntu 14.04 but I think it's an issue with my setup. that schema file has not changed in more than a year and is the same in all branches. I will keep investigating. adding use cloud (like Erik mentioned) solved the issue. On 05-Dec-2014, at 7:22 pm, Erik Weber terbol...@gmail.com wrote: On Fri, Dec 5, 2014 at 2:32 PM, Sebastien Goasguen run...@gmail.com wrote: Hi, I am trying to dockerize the whole cloudstack installation process. When running cloudstack-setup-database I hit this weird issue: Detected local IP address as 172.17.0.25, will use as cluster management server node IP[ OK ] Preparing /etc/cloudstack/management/db.properties [ OK ] Applying /usr/share/cloudstack-management/setup/create-database.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-schema.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-database-premium.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-schema-premium.sql We apologize for below error: *** Encountering an error when executing mysql script -- table: /usr/share/cloudstack-management/setup/create-schema-premium.sql Error: ERROR 1046 (3D000) at line 285: No database selected Does this ring a bell to anyone ? why would the first schema be created successfully and not create-schema-premium ? - the create-database* scripts doesn't need a selected database - the create-schema.sql script starts by selecting the database (use cloud;) create-schema-premium.sql doesn't have the same selection at start, and I'm no sql guru but it could be a foreign key or something else without an explicit schema that fails. you should probably be able to workaround it by adding a use cloud; early in the create-schema-premium.sql file that's my two cent. -- Erik Regards, Rohit Yadav Software Architect, ShapeBlue M. +91 88 262 30892 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Software Engineering http://shapeblue.com/cloudstack-software-engineering/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: Wrong java version in System VM Template for vSphere in ACS 4.4.2
On Mon, Jan 12, 2015 at 11:20 AM, Qian Shaohua qianshao...@ctsi.com.cn wrote: Hi, the system vm template for vSphere given in ACS 4.4.2 installation guild is: http://cloudstack.apt-get.eu/systemvm/4.4/systemvm64template-4.4.1-7-vmware . ova The java installed is openjdk 1.6, not 1.7, so system vms can't get started. Can anyone check it? As far as I know the vmware template is only converted, not specifically built, so it should have the same java version as the other templates. Is this an upgraded installation? Could you log on to a systemvm and paste the contents of /etc/cloudstack-release? -- Erik
Re: Unable to add affinity group to instances in project
On Thu, Jan 8, 2015 at 9:39 PM, Prachi Damle prachi.da...@citrix.com wrote: Do you know if there's a reason behind that, or if it just hasn't been implemented? Yes it just was not implemented back then because there was some thought about deprecating projects eventually, which did not happen really.. I see, that makes sense (back then I guess). We do like the projects idea of decoupling infrastructure ownership from accounts to a group in long term solutions. We'll have to choose though, it seems, between affinity groups and projects. Supporting it now should not be a big change though, I think there is already a feature request logged https://issues.apache.org/jira/browse/CLOUDSTACK-6276 Thanks, I'll follow that for any future updates. -- Erik
Re: Unable to add affinity group to instances in project
On Thu, Jan 8, 2015 at 8:14 PM, Prachi Damle prachi.da...@citrix.com wrote: Hi Erik, Hi Prachi, thanks for coming back to me :-) Affinity groups feature does not support Projects. https://cwiki.apache.org/confluence/display/CLOUDSTACK/FS+-+Affinity-Anti-affinity+groups Do you know if there's a reason behind that, or if it just hasn't been implemented? I can't see why projects wouldn't benefit from having affinity groups, but others might have some light to shed. It fails for new deployments having affinity group rules as well. Are these new deployments using projectId parameter too? Yes, so I assume that's the same reason there. -- Erik
Unable to add affinity group to instances in project
Note: this is on ACS 4.4.1 Before I submit an issue I'd like to check if this is intended or not. When I try to update a vm in a project to have an affinity group, the api doesn't accept projectid as a parameter and fails. It fails for new deployments having affinity group rules as well. Tried searching Jira for an issue, but my Jira-foo isn't the best (yet). Working on upgrading the lab to latest 4.4 to see if it's fixed. Relevant logs: http://pastebin.com/9GUrQSFQ -- Erik
CloudStack Collab EU 2014 Slides
Is it just me or is there's a lot of slides missing on the events page? Let me now if it's possible to help progressing the uploads. -- Erik
Re: [VOTE] Release Apache CloudStack CloudMonkey 5.3.1
On Mon, Dec 15, 2014 at 7:10 AM, Rohit Yadav bhais...@apache.org wrote: Hi All, I've created a 5.3.1 release of CloudMonkey, with the following artifacts up for a vote: Git Branch and Commit SHA: https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=shortlog;h=refs/heads/master Commit: 387f0338f9715f2337a9e10c92d1c76fa5d2a381 List of changes: https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=blob_plain;f=CHANGES.md Source release (checksums and signatures are available at the same location): https://dist.apache.org/repos/dist/dev/cloudstack/cloudmonkey-5.3.1/ PGP release keys (signed using key ID 0EE3D884): https://dist.apache.org/repos/dist/release/cloudstack/KEYS Vote will be open for 72 hours. For sanity in tallying the vote, can PMC members please be sure to indicate (binding) with their vote? [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove (and reason why) Regards. +1 Testing done: + Successfully upgraded from 5.3.0 to 5.3.1 on Mac OS X + Sync works + Loading profile on the command line (with -p) works + Using param completion when not at the end of line/string works + Various daily list/reset/deploy tasks -- Erik
Re: Review Request 29087: Add Feature Root Disk Resize for XenServer 6.2.0
(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) - Erik Weber On Dec. 16, 2014, 6:07 a.m., Yitao Jiang wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29087/ --- (Updated Dec. 16, 2014, 6:07 a.m.) Review request for cloudstack, Mike Tutkowski and Min Chen. Repository: cloudstack-git Description --- Currently, only KVM support root disk resize feature in ACS 4.4.1. As we are now using Xenserver 6.2.0, and it's so convient feature, So we do some hack. Diffs - plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/XenServerStorageProcessor.java e326770 server/src/com/cloud/vm/UserVmManagerImpl.java 4fdacd5 ui/scripts/instanceWizard.js 9df6ecc Diff: https://reviews.apache.org/r/29087/diff/ Testing --- Mgmt Server : CentOS release 6.4 (Final) ACS: 4.4.1 Primary Secondary : NFS Thanks, Yitao Jiang
Re: Review Request 29087: Add Feature Root Disk Resize for XenServer 6.2.0
On Dec. 16, 2014, 10:34 a.m., Erik Weber wrote: I'm getting this error when trying to run with the latest 4.4 branch: 2014-12-16 11:01:41,025 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70) Run VM work job: com.cloud.vm.VmWorkStart for VM 1, job origin: 20 2014-12-16 11:01:41,027 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) Execute VM work job: com.cloud.vm.VmWorkStart{dcId:0,userId:1,accountId:1,vmId:1,handlerName:VirtualMachineManagerImpl} 2014-12-16 11:01:41,035 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null 2014-12-16 11:01:41,035 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) Successfully transitioned to start state for VM[ConsoleProxy|v-1-VM] reservation id = efd0d2cc-cc6f-44b3-b373-e8f0ecf3e33e 2014-12-16 11:01:41,039 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) Trying to deploy VM, vm has dcId: 1 and podId: 1 2014-12-16 11:01:41,039 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) Deploy avoids pods: null, clusters: null, hosts: null 2014-12-16 11:01:41,043 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) Deploy avoids pods: null, clusters: null, hosts: null 2014-12-16 11:01:41,044 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@663f6fad 2014-12-16 11:01:41,044 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824 2014-12-16 11:01:41,044 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) Is ROOT volume READY (pool already allocated)?: No 2014-12-16 11:01:41,044 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) Searching resources only under specified Pod: 1 2014-12-16 11:01:41,045 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1 2014-12-16 11:01:41,054 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137) Checking resources in Cluster: 1 under Pod: 1 2014-12-16 11:01:41,054 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1 2014-12-16 11:01:41,057 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137 FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]] 2014-12-16 11:01:41,061 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137 FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]] 2014-12-16 11:01:41,062 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024 2014-12-16 11:01:41,068 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:2, speed:2399) to support requested CPU: 1 and requested speed: 500 2014-12-16 11:01:41,068 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0 2014-12-16 11:01:41,071 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137 FirstFitRoutingAllocator) Hosts's actual total CPU: 4798 and CPU after applying overprovisioning: 4798 2014-12-16 11:01:41,071 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137 FirstFitRoutingAllocator) Free CPU: 4298 , Requested CPU: 500 2014-12-16 11:01:41,071 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-49:ctx-49d1b9c2 job-20/job-70 ctx-59a62137 FirstFitRoutingAllocator) Free RAM: 6890268672 , Requested RAM
Re: Cloudstack Agent Not starting
On Tue, Dec 16, 2014 at 12:37 PM, Mohamed Infaz infaz...@cse.mrt.ac.lk wrote: Hi all, I am trying to deploy cloudstack with the hypervisor kvm in a single machine where my operating system is ubuntu 14.04. I have configured the network and also i did configure the libvirt.conf file. When i start cloudstack-agent it does start at first and then as soon as i check the status of the service i see it as fails. Because of this reason i can't add a host. What could be the issue? Is there anything in /var/log/cloudstack/agent or similar? -- Erik
Re: [ANNOUNCE] New committer: Erik Weber (terbolous)
Thanks everyone :-) -- Erik On Mon, Dec 15, 2014 at 7:09 AM, Jayapal Reddy Uradi jayapalreddy.ur...@citrix.com wrote: Congrats Erik! -Jayapal On 15-Dec-2014, at 11:15 AM, Srikanteswararao Talluri srikanteswararao.tall...@citrix.com wrote: Congrats Erik! ~Talluri On 15/12/14 10:59 am, Punith S punit...@cloudbyte.com wrote: congrats Erik :) On Sun, Dec 14, 2014 at 11:32 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Congratulations, Erik! On Sat, Dec 13, 2014 at 9:16 PM, Rajani Karuturi raj...@apache.org wrote: Congratulations Eric :) On Sun, Dec 14, 2014 at 9:01 AM, Todd Pigram t...@toddpigram.com wrote: Congrats! On Saturday, December 13, 2014, ilya musayev ilya.mailing.li...@gmail.com javascript:; wrote: Congrats and welcome! On 12/13/14, 12:27 PM, Rohit Yadav wrote: Congrats Erik! On 14-Dec-2014, at 1:27 am, Nux! n...@li.nux.ro javascript:; wrote: Gratulerer :-) Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Pierre-Luc Dion pdion...@apache.org javascript:; To: dev@cloudstack.apache.org javascript:; Sent: Saturday, 13 December, 2014 17:03:32 Subject: [ANNOUNCE] New committer: Erik Weber (terbolous) The Project Management Committee (PMC) for Apache CloudStack has asked Erik Weber to become a committer and we are pleased to announce that they have accepted. Erik is doing a great job on helping the community thru the mailing list. He helped a lot on testing and troubleshooting new releases of CloudStack as well as contributing to the documentation. Thanks Erik and Congrat! Being a committer allows many contributors to contribute more autonomously. For developers, it makes it easier to submit changes and eliminates the need to have contributions reviewed via the patch submission process. Whether contributions are development-related or otherwise, it is a recognition of a contributor's participation in the project and commitment to the project and the Apache Way. Please join me in congratulating Erik Pierre-Luc on behalf of the CloudStack PMC Regards, Rohit Yadav Software Architect, ShapeBlue M. +91 88 262 30892 | rohit.ya...@shapeblue.com javascript:; Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/ iaas-cloud-design-and-build// CSForge rapid IaaS deployment framework http://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Software Engineering http://shapeblue.com/cloudstack-software- engineering/ CloudStack Infrastructure Supporthttp://shapeblue.com/ cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/ cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark. -- Todd Pigram http://about.me/ToddPigram www.linkedin.com/in/toddpigram/ @pigram86 on twitter https://plus.google.com/+ToddPigram86 Mobile - 216-224-5769 -- Sent from Windows Phone -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play* * -- regards, punith s cloudbyte.com
Re: [VOTE] Simplify CloudMonkey's branching/maintenance process
On tir. 9. des. 2014 at 14.27 Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi, CloudMonkey's git repo history is mostly linear and the work on master is simply getting synced on 5.3 branch. I want to ask the community if anyone has any objections on just keeping master as the working branch and have branches when they are needed (say documentation, feature work etc) and once they are merged they can be removed. We have git tags to identify past release so is it also alright with everyone to remove the support branches such as 5.3/5.2 etc. This way we will have: - one main working branch (master) - branch based workflow: feature branches for doing feature work, pull requests or reviewboard for bugfixes for non-committers - master is aimed to remain stable - master will have its own TravisCI and tests (in upcoming weeks) - CloudMonkey aims for progressive/rolling releases that are backward compatible with older releases and have clean upgrades For this please vote with your comments/suggestions; +1 approve +0 no opinion -1 disapprove (and reason why) +1, seems like the best thing to do. -- Erik
Re: CloudStack and Windows 2008 R2 SCSI Disk Controller issue
On Wed, Dec 10, 2014 at 10:44 PM, ilya musayev ilya.mailing.li...@gmail.com wrote: CloudStack/CloudPlatform 4.3 defaults to LSI Logic Parallel and we need to use LSI Logic SAS when windows VMs are created. Would anyone know if there is a way to override the controller through vm_details table and preset the controller to use there? Right now it takes the options of scsi and ide, i've tried changing it to osdefault (which should have addressed the issue, but it appears we are still defaulting to LSI Logic Parallel) osdefault for Windows 2008 R2 ESXi 5.1+ should be set to LSI Logic Parallel Been a known problem for a long time, only known workaround that I know of is to change the controller in the code but that would change it for all your vms. See https://cwiki.apache.org/confluence/display/CLOUDSTACK/Granular+SCSI+Controller+support+in+CloudStack+over+VMware+deployments and https://issues.apache.org/jira/browse/CLOUDSTACK-4787 -- Erik
Re: CloudStack and Windows 2008 R2 SCSI Disk Controller issue
On Wed, Dec 10, 2014 at 11:20 PM, ilya musayev ilya.mailing.li...@gmail.com wrote: Erik Would you know where in the code? Looked around, could not find the place. In 4.2, which was the last version we used with VMware, it was in plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManagerImpl.java However, it seems to have been refactored and I can't see it with the bare eye at the moment for newer versions. -- Erik
Re: CloudStack and Windows 2008 R2 SCSI Disk Controller issue
Windows 2012 R2 and Windows 8.1 (and possibly Windows 2008 R2) won't have the disk controller, and thus won't boot or otherwise be able to access the disk(s). Ref: http://kb.vmware.com/selfservice/microsites/search.do?language=en_UScmd=displayKCexternalId=2059549 -- Erik On Wed, Dec 10, 2014 at 11:54 PM, Marcus shadow...@gmail.com wrote: So just for clarification, we're saying if a VM is a windows VM, and on VMware, you cannot attach disks, correct? On Wed, Dec 10, 2014 at 2:36 PM, Erik Weber terbol...@gmail.com wrote: On Wed, Dec 10, 2014 at 11:20 PM, ilya musayev ilya.mailing.li...@gmail.com wrote: Erik Would you know where in the code? Looked around, could not find the place. In 4.2, which was the last version we used with VMware, it was in plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManagerImpl.java However, it seems to have been refactored and I can't see it with the bare eye at the moment for newer versions. -- Erik
Re: CloudStack and Windows 2008 R2 SCSI Disk Controller issue
Sateesh had a session about it during CCCEU, he might be able to update the dev list about his work. http://sched.co/X3guL1 -- Erik On Wed, Dec 10, 2014 at 11:58 PM, Erik Weber terbol...@gmail.com wrote: Windows 2012 R2 and Windows 8.1 (and possibly Windows 2008 R2) won't have the disk controller, and thus won't boot or otherwise be able to access the disk(s). Ref: http://kb.vmware.com/selfservice/microsites/search.do?language=en_UScmd=displayKCexternalId=2059549 -- Erik On Wed, Dec 10, 2014 at 11:54 PM, Marcus shadow...@gmail.com wrote: So just for clarification, we're saying if a VM is a windows VM, and on VMware, you cannot attach disks, correct? On Wed, Dec 10, 2014 at 2:36 PM, Erik Weber terbol...@gmail.com wrote: On Wed, Dec 10, 2014 at 11:20 PM, ilya musayev ilya.mailing.li...@gmail.com wrote: Erik Would you know where in the code? Looked around, could not find the place. In 4.2, which was the last version we used with VMware, it was in plugins/hypervisors/vmware/src/com/cloud/hypervisor/vmware/manager/VmwareStorageManagerImpl.java However, it seems to have been refactored and I can't see it with the bare eye at the moment for newer versions. -- Erik
Re: KVM - VM snapshot (round 2)
On Mon, Dec 8, 2014 at 12:11 PM, Vadim Kimlaychuk vadim.kimlayc...@elion.ee wrote: CS does not support memory snapshots for XenServer. Disk snapshots are working. Not sure about VmWare, but I guess it should be the same. I thought the reachest feature-set is developed for KVM. But if it does not support memory snapshots - I wonder wich hypervisor does it ? This option at user interface exists, but I didn't see it worked. Both XenServer and VMware supports memory-snapshot and live migration with CloudStack. And is one of the main reasons we chose XenServer over KVM. Now if only XenServer would get Ceph-support I'd be happy ;-) As for feature sets I find most hypervisors to support some good features with CloudStack, but none to be perfect, ie. support all. On that topic, does anyone know if there's an up to date feature matrix? -- Erik
Re: KVM - VM snapshot (round 2)
Not that I know. I take VM snaphots all the time, and don't have XS licenses. -- Erik On Mon, Dec 8, 2014 at 1:05 PM, Andrija Panic andrija.pa...@gmail.com wrote: Hm... I see that in XS 6.0.2 it was impossible to do memory snapshot unless you had a licenced XS ? Is this still the case with XS 6.2 ? On 8 December 2014 at 12:43, Erik Weber terbol...@gmail.com wrote: On Mon, Dec 8, 2014 at 12:11 PM, Vadim Kimlaychuk vadim.kimlayc...@elion.ee wrote: CS does not support memory snapshots for XenServer. Disk snapshots are working. Not sure about VmWare, but I guess it should be the same. I thought the reachest feature-set is developed for KVM. But if it does not support memory snapshots - I wonder wich hypervisor does it ? This option at user interface exists, but I didn't see it worked. Both XenServer and VMware supports memory-snapshot and live migration with CloudStack. And is one of the main reasons we chose XenServer over KVM. Now if only XenServer would get Ceph-support I'd be happy ;-) As for feature sets I find most hypervisors to support some good features with CloudStack, but none to be perfect, ie. support all. On that topic, does anyone know if there's an up to date feature matrix? -- Erik -- Andrija Panić
Re: [ACS44] router upgrade issue
This should probably happen in 4.5 branch as well I guess? -- Erik On Mon, Dec 8, 2014 at 2:51 PM, Daan Hoogland daan.hoogl...@gmail.com wrote: H, I investigated an issue some colleagues noticed and it turns out that in the update procedure the flag VirtualNetworkApplianceService.MinVRVersion is not set for versions 4.4.0-4.4.2 I have no workaround other then rebooting the routers instead of upgading/updating them. I will patch the branch to contain the correct minimal version. The higher version branches have this var still set to 4.3.0 as well. -- Daan
Re: jenkins.buildacloud.org
Also raised the issue a few days ago. Hugo seemed awfully busy. Erik Den mandag 8. desember 2014 skrev Rohit Yadav rohit.ya...@shapeblue.com følgende: On Monday 08 December 2014 09:49 PM, Will Stevens wrote: Has something happened to http://jenkins.buildacloud.org/ recently? We have not had a successful build in 3 days and the queue is growing but there does not seem to be any build slaves in action handling the workload. Is this an expected outage? The master is out of disk space (and probably few slaves too). I tried to raise this but I don't have access to the master server to try and fix this. Regards, Rohit Yadav Software Architect, ShapeBlue M. +91 8826230892 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab PS. If you see any footer below, I did not add it :) Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/ iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Software Engineeringhttp://shapeblue.com/cloudstack-software- engineering/ CloudStack Infrastructure Supporthttp://shapeblue.com/ cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/ cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: Port forwarding (web) - doesnt show real client IP
On Mon, Dec 8, 2014 at 11:42 PM, Andrija Panic andrija.pa...@gmail.com wrote: Hi, when doing port forwarding on VPC VR - port 80 - when some client access web site - only the main Public IP of the VPC is logged in apache access logs as remote IP. Why is this behaviour - and can this be changed ? My understanding is that this is kind of bug (unless needed for some other reasons) - port forwading is DNAT in essence, so only the destination IP/port should be changed, not proxied all the way, as it seems to be the case here... I read on other guys mailing list - same behavior for loadbalancer... This is common for all load balancers. Haven't checked, but you could see if the CloudStack LB expose the client IP as X-Forwarded-For header, which is the normal way of doing it. -- Erik
Re: Port forwarding (web) - doesnt show real client IP
On Mon, Dec 8, 2014 at 11:55 PM, Andrija Panic andrija.pa...@gmail.com wrote: And just to spice things a little bit, ALL remote connections appears to come from main Public IP of the VPC VR. So we can not block some stuff on firewall onVM (while doing port forwading) because all connections appear to come from main Public IP of the VPC VR. This is terrible design/bug - can we change this ? I'm on the ACS 4.3 currently... This is a NAT problem. You could use a shared network with Public IPs or Basic Networking with Public IPs. -- Erik
Re: [4.3.0] System VM 64bit build disabled?
On Fri, Dec 5, 2014 at 8:56 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Wilder, On 05-Dec-2014, at 12:27 pm, Wilder Rodrigues wrodrig...@schubergphilis.com wrote: Any ideas why? It was available earlier this week. Those were removed recently because the master had no disk space left (probably slaves too). That's the case now as well, see my previous email. -- Erik
[JENKINS] Full disk om master
Kicking of a separate email. The disk on the jenkins master is full. I tried modifying a few builds to keep fewer builds in the history, but I don't have permission to restart the slave threads. If anyone with more permissions could continue the fixing that'd be great. Filesystem Size Used Avail Use% Mounted on devtmpfs839M 0 839M 0% /dev tmpfs 854M 0 854M 0% /dev/shm tmpfs 854M 33M 821M 4% /run /dev/xvda1 9.9G 6.9G 3.0G 71% / tmpfs 854M 0 854M 0% /sys/fs/cgroup tmpfs 854M 0 854M 0% /media /dev/xvdf1 50G 47G 59M 100% /var/lib/jenkins/workspace -- Erik
Re: weird db setup issue
On Fri, Dec 5, 2014 at 2:32 PM, Sebastien Goasguen run...@gmail.com wrote: Hi, I am trying to dockerize the whole cloudstack installation process. When running cloudstack-setup-database I hit this weird issue: Detected local IP address as 172.17.0.25, will use as cluster management server node IP[ OK ] Preparing /etc/cloudstack/management/db.properties [ OK ] Applying /usr/share/cloudstack-management/setup/create-database.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-schema.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-database-premium.sql [ OK ] Applying /usr/share/cloudstack-management/setup/create-schema-premium.sql We apologize for below error: *** Encountering an error when executing mysql script -- table: /usr/share/cloudstack-management/setup/create-schema-premium.sql Error: ERROR 1046 (3D000) at line 285: No database selected Does this ring a bell to anyone ? why would the first schema be created successfully and not create-schema-premium ? - the create-database* scripts doesn't need a selected database - the create-schema.sql script starts by selecting the database (use cloud;) create-schema-premium.sql doesn't have the same selection at start, and I'm no sql guru but it could be a foreign key or something else without an explicit schema that fails. you should probably be able to workaround it by adding a use cloud; early in the create-schema-premium.sql file that's my two cent. -- Erik
Re: CloudStack and Cisco APIC integration
On Fri, Dec 5, 2014 at 2:31 PM, Bill Wade billwad...@yahoo.com.invalid wrote: I asked this on the users mailer and was referred to the dev mailer -- I’ll preface this with, “this is an End user question”.. I’m working with a private cloud provider who is looking to use CloudStack for their compute and storage orchestration and use Cisco APIC with the Nexus 9k switches for the network provisioning. I’m new to the “SDN/NFV” space and looking around I don't see support for Cisco APIC with CloudStack. Any one have experience with these two working together? Can CloudStack step aside and let APIC provision the network? I'm seeing the potential for provisioning conflicts here. I don't know what Cisco APIC does or needs to do/know about the infrastructure, but there's no explicit support in CloudStack for it that I know of. That said it doesn't necessarily mean it can't work, but it depends on what needs to happen during vm deployment. However I am afraid you're looking to do something CloudStack isn't currently capable of doing. -- Erik
Re: Please confirm this is a bug and not misconifguration - 4.3.1: Failed to create a volume from snapshot
I'm not a dev but this seems strange: 2014-12-03 12:20:46,612 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Job-Executor-166:ctx-d915e890 ctx-d7a11540) Removing pool Pool[208|IscsiLUN] from avoid set, must have been inserted when searching for another disk's tag 2014-12-03 12:20:46,614 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (Job-Executor-166:ctx-d915e890 ctx-d7a11540) Checking if storage pool is suitable, name: null ,poolId: 208 2014-12-03 12:20:46,617 DEBUG [c.c.s.StorageManagerImpl] (Job-Executor-166:ctx-d915e890 ctx-d7a11540) Checking pool 208 for storage, totalSize: 1520242262016, usedBytes: 865985363968, usedPct: 0.569636422828828, disable threshold: 0.95 First it puts pool 208 into avoid set, then it tries to check it. Hopefully someone who knows the code a bit could clarify if this is intended or a bug. -- Erik On Fri, Dec 5, 2014 at 2:02 PM, France mailingli...@isg.si wrote: Hi guys, can someone please look at the exemption from the log and confirm this is a bug and not misconfiguration. If we are on the road to 4.3.2 release, it might get fixed and included in it. Thank you! The bug report is here: https://issues.apache.org/jira/browse/CLOUDSTACK-8014 Regards, F.
Re: CloudStack Quality Process
On Mon, Dec 1, 2014 at 8:12 PM, Steve Wilson steve.wil...@citrix.com wrote: Hi Everyone, It was great to get to see a number of you at the recent CCC in Budapest. While I was there, I got to meet face to face with individuals working for several companies that have a real stake in the commercial success of the CloudStack project. After joining Citrix (and becoming involved in CloudStack) about a year ago, I’ve come to believe that we need to do more to mature our quality practices around this codebase. We all like to say #cloudstackworks (and it’s true), but this is a massive codebase that’s used in the most demanding situations. We have large telecommunications companies and enterprises who are betting their businesses on this software. It has to be great! There has been quite a bit of discussion on the mailing list in recent months about how we improve in this area. There is plenty of passion, but we haven’t made enough concrete progress as a community. In my discussions with key contributors as CCC, there was general agreement that the DEV list isn’t a good forum for hashing out these kinds of things. Email is too low-bandwidth and too impersonal. At CCC, I discussed with several people the idea that we commission a small sub team to go hash out a proposal for how we handle the following topics within the ACS community (which can then be brought back to the larger community for ratification): * Continuous integration and test automation * Gating of commits * Overall commit workflow We are looking for volunteers to commit to being part of this team. This would imply a serious commitment. We don’t want hangers on or observers. This will entail real work and late night meetings. We’re looking for people who are serious contributors to the codebase. From Citrix, David Nalley and Animesh Chaturvedi have booth told me they’re willing to commit to this project. They’ve both managed ACS releases and have a really good view into the current process — and I know both are passionate about improving our process. From my CCC discussions, I believe there are individuals from Schuberg Philis, Shape Blue and Cloud Ops who are willing to commit to this process. If you are willing to be part of this team to drive forward our community, please reply here. I'm no developer, but if there's anything I can assist with as an Ops guy I'd be happy to help. -- Erik Weber
Re: [4.3.0] System VM 64bit build disabled?
Looks like a full disk on the jenkins master. Filesystem Size Used Avail Use% Mounted on devtmpfs839M 0 839M 0% /dev tmpfs 854M 0 854M 0% /dev/shm tmpfs 854M 33M 821M 4% /run /dev/xvda1 9.9G 7.3G 2.6G 75% / tmpfs 854M 0 854M 0% /sys/fs/cgroup tmpfs 854M 0 854M 0% /media /dev/xvdf1 50G 47G 0 100% /var/lib/jenkins/workspace I don't have access to the master, so I'll have to see if I'm able to clear some space from the UI. -- Erik On Fri, Dec 5, 2014 at 8:01 AM, Wilder Rodrigues wrodrig...@schubergphilis.com wrote: Actually, the whole Jenkins seems to be dead since all slaves are dead. There are several jobs in the queue to be executed. Is there anyone looking into this? Cheers, Wilder On 05 Dec 2014, at 07:57, Wilder Rodrigues wrodrig...@schubergphilis.com mailto:wrodrig...@schubergphilis.com wrote: Hi all, Trying to download a systemvm-64 from jenkins.buildacloud.org http://jenkins.buildacloud.org/ but the build seems to be disabled. There is nothing there: http://jenkins.buildacloud.org/view/4.3/job/cloudstack-4.3-systemvm64/ Any ideas why? It was available earlier this week. Cheers, Wilder
Re: root resize support in the UI
On Mon, Dec 1, 2014 at 9:02 AM, Andrija Panic andrija.pa...@gmail.com wrote: I think it would be usefull to have that resize feature for all guests (Linux, Windows, etc) - but perhaps customizes the Resize function to perform partition resize inside Linux (if we are deploying new VM from Linux template) - or simply do not do anything inside guest OS, just resize the drive - and let the client handle partition and file system resize...it might be more clean implementation I guess...? I believe cloud-init is capable of this? -- Erik
Re: root resize support in the UI
On Mon, Dec 1, 2014 at 9:23 AM, Vadim Kimlaychuk vadim.kimlayc...@elion.ee wrote: I have done root partition resize under XenServer exactly as you described - resized drive and then using system tools on guest VM like fdisk, lvextend and ext2resize changed the size of the root. It seems that drive resize on hypervisor level is all that is needed, because it is far too complicated for hypervisor to be aware of all different types of partition layouts and file systems that might exist. Then upper layer (like CS) may take role of implementing different actions according to guest type and file system that have being used for particular guest. While OS type can be taken from template, FS type and partition type is information that is not stored in the database. Without it implementation is not feasible. It's not given that you want to resize a partition or which one, just because you resize the disk. Thus it's not feasible to assume that the orchestration layer should be capable of doing it. -- Erik
Re: CloudMonkey 5.3 not starting on Ubuntu 14.10
On Mon, Dec 1, 2014 at 11:32 AM, Andrei Mikhailovsky and...@arhont.com wrote: Hi guys, I am having issues starting cloudmonkey on ubuntu 14.10. I get the following error: $ cloudmonkey Import error in cloudmonkey.cloudmonkey : No module named packages I have the same on CentOS 6.6, cloudmonkey installed with pip -- Erik
Re: CloudMonkey 5.3 not starting on Ubuntu 14.10
On Mon, Dec 1, 2014 at 11:50 AM, sebgoa run...@gmail.com wrote: On Dec 1, 2014, at 11:44 AM, Erik Weber terbol...@gmail.com wrote: On Mon, Dec 1, 2014 at 11:32 AM, Andrei Mikhailovsky and...@arhont.com wrote: Hi guys, I am having issues starting cloudmonkey on ubuntu 14.10. I get the following error: $ cloudmonkey Import error in cloudmonkey.cloudmonkey : No module named packages I have the same on CentOS 6.6, cloudmonkey installed with pip Have you tried with virtualenv ? Are you upgrading ? Nope, all I've tried is: pip install cloudmonkey This was a fresh machine, so no upgrade. Stock CentOS 6.6. After doing yum remove python-pip, and installing pip as per the docs Rohit sent, and then doing: pip install --force-reinstall -U cloudmonkey, i now get: Traceback (most recent call last): File /usr/bin/cloudmonkey, line 5, in module from pkg_resources import load_entry_point File /usr/lib/python2.6/site-packages/pkg_resources.py, line 2655, in module working_set.require(__requires__) File /usr/lib/python2.6/site-packages/pkg_resources.py, line 648, in require needed = self.resolve(parse_requirements(requirements)) File /usr/lib/python2.6/site-packages/pkg_resources.py, line 546, in resolve raise DistributionNotFound(req) pkg_resources.DistributionNotFound: requests -- Erik
Re: CloudMonkey 5.3 not starting on Ubuntu 14.10
On Mon, Dec 1, 2014 at 11:53 AM, Erik Weber terbol...@gmail.com wrote: On Mon, Dec 1, 2014 at 11:50 AM, sebgoa run...@gmail.com wrote: On Dec 1, 2014, at 11:44 AM, Erik Weber terbol...@gmail.com wrote: On Mon, Dec 1, 2014 at 11:32 AM, Andrei Mikhailovsky and...@arhont.com wrote: Hi guys, I am having issues starting cloudmonkey on ubuntu 14.10. I get the following error: $ cloudmonkey Import error in cloudmonkey.cloudmonkey : No module named packages I have the same on CentOS 6.6, cloudmonkey installed with pip Have you tried with virtualenv ? Are you upgrading ? Nope, all I've tried is: pip install cloudmonkey This was a fresh machine, so no upgrade. Stock CentOS 6.6. After doing yum remove python-pip, and installing pip as per the docs Rohit sent, and then doing: pip install --force-reinstall -U cloudmonkey, i now get: Traceback (most recent call last): File /usr/bin/cloudmonkey, line 5, in module from pkg_resources import load_entry_point File /usr/lib/python2.6/site-packages/pkg_resources.py, line 2655, in module working_set.require(__requires__) File /usr/lib/python2.6/site-packages/pkg_resources.py, line 648, in require needed = self.resolve(parse_requirements(requirements)) File /usr/lib/python2.6/site-packages/pkg_resources.py, line 546, in resolve raise DistributionNotFound(req) pkg_resources.DistributionNotFound: requests I managed to get cloudmonkey running by doing: $ sudo easy_install --upgrade requests $ sudo easy_install --upgrade pygments I have no idea why pip couldn't fix it. -- Erik
Re: root resize support in the UI
On Mon, Dec 1, 2014 at 12:09 PM, Vadim Kimlaychuk vadim.kimlayc...@elion.ee wrote: Andrija, You did understand me correctly. I wish that for the customer disk offer could be customizable. And not just for KVM hypervisor. Particularly now I am interested in Xen and VmWare. CS admin should not have set of templates that differs only on root partition size. Swap partition can be (theoretically) located as another DATA disk and be re-sizable with existing functionality. How hard is to achieve such a requirement? Are these requirements something unusual and I should do it other way? For example we say to the customer, that you have unallocated space if you select different size and extend partition by yourself? It's not hard at all. You just need to find a developer that can spare the time to implement it in CloudStack. -- Erik
Re: [DISCUSS] Automatic usage reporting / call-home for CloudStack
On Mon, Dec 1, 2014 at 2:15 PM, Sebastien Goasguen run...@gmail.com wrote: On Dec 1, 2014, at 8:08 AM, Wido den Hollander w...@widodh.nl wrote: Hello, As a project we currently don't have a lot of insight information on about how CloudStack is being used. Surveys tell us a lot, but not everybody fills in the survey, so we still miss a lot of information. That's why I've written the Usage Reporting functionality for the management server which automatically sends back anonymous information about a CloudStack deployment. It's currently in the 'reporter' branch. [0] By default, every 7 days it generates a JSON document with: - Hosts (Number, version, type, hypervisor) - Clusters (Hypervisor en Management type) - Primary storage (Type and provider) - Zones (Network type and providers) - Instances (Number and types) This report is not complete yet, I'd like to add more information, but that will be Management Server information. The code on how this report is generated is obviously 100% Open Source, so end-users can always exactly see how the information was compiled. I want to discuss this new feature for CloudStack and the possible implications it might have. I'm opting for a opt-out. So every new or upgraded install to 4.6.0 (master) will have this enabled. Yes, we have to be very explicit in the Release Notes that this has been added. Why? It's the small price we as a project ask for using CloudStack. We want a little bit of information on how CloudStack is being used so that we can use this to make CloudStack even better. Turning it off is also just one global setting and it will never turn on again. On the server-side there is a Python flask application [1] (found in the reporter directory) which stores all the incoming information in a ElasticSearch database. From there analytics can be gathered on CloudStack deployments. It currently points to http://cs-report.widodh.nl/report which will NOT be the endpoint when this is merged into master. For 'production' I want to have https://report.cloudstack.apache.org/report where all reports are submitted. For every setup a unique ID is determined by hashing the first row in the 'version' table. This is the version + timestamp and that is hashed using SHA256. Using this unique ID we can track changes in deployments and see how they grow or shrink. Technically this wasn't that hard to implement, but the politics surrounding it might be the hardest part. What do other have to say about this? Should there be a VOTE for this feature to come into CloudStack? Opt-in, opt-out? We should ask users@ as well. I am +1 on this, As a cloudstack user I don't have any problem with this, +1. -- Erik
Re: A secure way to reset VMs password
On Thu, Nov 27, 2014 at 3:54 PM, Alireza Eskandari astro.alir...@yahoo.com.invalid wrote: HiI viewed the bash script that resets Linux password ( http://download.cloud.com/templates/4.2/bindir/cloud-set-guest-password.in)It seems that it doesn't use a secure way for transferring password string to instance.Instances on a shared network can sniff password requests and export requested password of other instances.I suggest to use SSL (https) instead of plan text.Regards I like the idea, but there's a couple of obstacles to overcome, namely which SSL certificates to use. - certificates need a subject name, ie. IP or hostname for web pages, you could solve this by making the mgmt server a CA and have each VR get a signed certificate by it, but it's complicated - if the community bundle a pre generated certificate it is commonly known and not to be trusted, also not sure how to handle subject name - assuming everyone to supply a valid certificate is quite complicated (CA must be on VR etc), and makes it considerably harder to get a working setup - using self signed causes issues with validation Don't get me wrong, I love the idea, but it's not just to flip a switch and have (proper) SSL in place. -- Erik
Re: [JENKINS] Added CentOS 7 slaves
On Wed, Nov 26, 2014 at 4:25 PM, Hugo Trippaers h...@trippaers.nl wrote: If any one needs something build or tested on CentOS 7 let me know or create a build tagged for cloudstack-buildslave-centos7 Cheers, Hugo P.S. Still looking for people willing to add slaves to jenkins. What we need are one or two fast machines capable of running the simulator tests. What would describe a fast machine? I'm currently not able to provide SSD-based machines, but providing CPU and memory shouldn't be a problem. -- Erik
Re: [ACS44] release 4.4.2 imminent
On Mon, Nov 17, 2014 at 9:56 AM, Daan Hoogland daan.hoogl...@gmail.com wrote: People, I want to make a new 4.4 release after not delivering the quality I would like for 4.4.0 and 4.4.1. I want to call on all to test the head of the 44 branch before I do. Both two prior releases have known issues within one week after release. In my opinion it would be great if we can prevent the next release from having such issues, so once again please test to your best at 4.4 and report to me (in this thread for instance). I addition to that I would like to have a test and evaluation session here @apachecon about the 4.4.2 to asses it's quality. Any of you around Budapest are welcome to join in. Wednesday is the plan. Any idea when on Wednesday it might be? Won't arrive before 14ish. -- Erik
Re: [QUESTION] How come we don't include Users@ in vote threads?
Den søndag 16. november 2014 skrev Pierre-Luc Dion pdion...@apache.org følgende: I'm not sure about adding users@ into the vote since it's more dev@ related. But, I agree it would be nice to notify users@ that we have an RC it would potentially involved more people in the test phases. I must disagree. Creating cloudstack is indeed a dev thing, but if you look at the last releases and the trouble they had we should look at and embrace any way to improve testing. Using simulator and spinning up basic zones can only reveal a minority of issues. Afaik non-pmc's aren't binding and any votes would merely be an indication, or do i misunderstand? But i do agree that providing packages are crucial, that would help us discover packaging problems as well Erik
Re: [QUESTION] How come we don't include Users@ in vote threads?
On Sun, Nov 16, 2014 at 11:44 PM, Pierre-Luc Dion pdion...@apache.org wrote: I agree that more tests are welcome, we have to try then :) On the other side, how many devs can say that they really like to do thorough release testing? My guess is that it's a rather small number. By adding users, and if testing actually gains any momentum, you can hopefully have faith in that the release has been tested and free up some developer time to do more development :-) There's one thing that should be thought of though. Users might not pay attention to dev@ and might not know when to expect an RC. So I think a 72 hours time limit for users to test is gonna be to little, $dayjobs and personal lifes might not allow all to just throw whatever they're doing to start testing. I'm not sure what the best way to remedy it is, if it's to extend the time window or introduce another term/phase. -- Erik
Re: Server 2012 R2 Bug on CS 4.4.0 with vmware hypervisor
There's an issue in jira to allow controller selection, but it has been stale for some time. This is one of the reasons we switched to xenserver. I believe there's a quick talk on ccceu about the issue. Erik Den lørdag 15. november 2014 skrev Michael Phillips mphilli7...@hotmail.com følgende: So I was unable to add a data disk to my vm running server 2012 R2 standard, so I started tracking down the issue and I think I found it. So when provisioning a vm running server 2012 R2, CS creates the VM with the LSI Logic Parallel adapter. It looks like the only reason the machine is even able to boot is becuase the ROOT drive is set to be an IDE drive, specifically (IDE 0:1). Any data disks added to the same machine are set as SCSI drives. So if I added one data disk it would be listed as SCSI 0:0. So it seems the mismatch is between the controller type CS is using and the disk type. So this bring me to the major question at hand. For server 2012 R2 vmware natively uses the LSI Logic SAS controller. Why in the world is CS not using the same controller, and is there a way around this?
Re: Buda+Pest hackathons
I'd like to discuss quality and testing with anyone interested. Erik 11. nov. 2014 17:15 skrev Daan Hoogland daan.hoogl...@gmail.com følgende: People, don't forget to lookup and contact people about the subjects you want discussed at CCEU14. I for one want to caal on everybody interested in API refactoring. Can interested people tell whther they have position statements and times of availability? looking forward to it. -- Daan
Re: [VOTE] Release Apache CloudStack CloudMonkey 5.3.0
This might already be possible without me figuring out why, but is there an easy way to list my profiles? If not, that'd be a nice feature request for a future version -- Erik On Fri, Oct 31, 2014 at 1:57 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Thanks everyone for voting so far. I found some issues in my testing which I’ve fixed, so I need to call off this voting round. I’ll start another round today. The new changes are; - Double url encoding removed and requests bugfixes - Autocompletion fixes, autocompletions for filter options and boolean api arguments - CloudMonkey becomes unicode friendly (this would need some testing) Regards. On 31-Oct-2014, at 12:56 am, Erik Weber terbol...@gmail.com wrote: On Thu, Oct 30, 2014 at 11:55 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi All, I've created a 5.3.0 release of CloudMonkey, with the following artifacts up for a vote: Git Branch and Commit SH: https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=shortlog;h=refs/heads/X.X Commit: 715630aebdcf18fbb2094893569a0c20fe7b65ab List of changes: https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=blob_plain;f=CHANGES;hb=X.X Source release (checksums and signatures are available at the same location): https://dist.apache.org/repos/dist/dev/cloudstack/cloudmonkey-5.3.0/ +1 - Successfully upgraded from earlier pip install - Worked with previous profile - Added new profile - param completion tested ok after enabling it (sweet feature by the way!) - tested various calls, list zones/serviceofferings/templates, deploy virtualmachine -- Erik Regards, Rohit Yadav Software Architect, ShapeBlue M. +91 88 262 30892 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: [VOTE] Release Apache CloudStack CloudMonkey 5.3.0 (round #2)
+1 from me again -- Erik On Fri, Oct 31, 2014 at 12:07 PM, Nux! n...@li.nux.ro wrote: +1 from me again Thanks -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Rajani Karuturi raj...@apache.org To: dev@cloudstack.apache.org Sent: Friday, 31 October, 2014 10:42:39 Subject: Re: [VOTE] Release Apache CloudStack CloudMonkey 5.3.0 (round #2) +1 (binding) tested against cloudstack 4.5 - upgraded smoothly from 5.2 - profile name in prompt works - auto complete of filters and ids works (useful. Thanks for adding this.) - tested few api calls and worked fine ~Rajani On Fri, Oct 31, 2014 at 3:36 PM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi, I forgot to fix the URLs in previous email (copied the voting email from the template); Git Branch and Commit SH: https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=shortlog;h=refs/heads/5.3 Commit: 088001e7acabb2e2c16a18f2ade84b500c8b5bb6 List of changes: https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=blob_plain;f=CHANGES;hb=5.3 Source release (checksums and signatures are available at the same location): https://dist.apache.org/repos/dist/dev/cloudstack/cloudmonkey-5.3.0/ PGP release keys (signed using 0EE3D884): https://dist.apache.org/repos/dist/release/cloudstack/KEYS Regards, Rohit Yadav Software Architect, ShapeBlue M. +91 88 262 30892 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: [VOTE] Release Apache CloudStack CloudMonkey 5.3.0
On Thu, Oct 30, 2014 at 11:55 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi All, I've created a 5.3.0 release of CloudMonkey, with the following artifacts up for a vote: Git Branch and Commit SH: https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=shortlog;h=refs/heads/X.X Commit: 715630aebdcf18fbb2094893569a0c20fe7b65ab List of changes: https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=blob_plain;f=CHANGES;hb=X.X Source release (checksums and signatures are available at the same location): https://dist.apache.org/repos/dist/dev/cloudstack/cloudmonkey-5.3.0/ +1 - Successfully upgraded from earlier pip install - Worked with previous profile - Added new profile - param completion tested ok after enabling it (sweet feature by the way!) - tested various calls, list zones/serviceofferings/templates, deploy virtualmachine -- Erik
Re: [GitHub] cloudstack pull request: debian: Fix changelog to use 4.4.1 releas...
While you are at it Rohit, would it be possible to improve the tools that set version here and there to include this ( to prevent future issues )? I guess that would have to go to master and 4.5 as well -- Erik On Mon, Oct 20, 2014 at 12:26 PM, bhaisaab g...@git.apache.org wrote: GitHub user bhaisaab opened a pull request: https://github.com/apache/cloudstack/pull/24 debian: Fix changelog to use 4.4.1 release with snapshot in the version ... Both 4.4.0 and 4.4.1 tagged releases have -snapshot in debian/changelog resulting in debian package names which should be 4.4.0 or 4.4.1 and not 4.4.0-snapshot or 4.4.1-snapshot. This is not the case in case of 4.3.1/4.3.0 and past releases. Since 4.4.1 has already been tagged, we can keep it this way. Sending this pull request just in case there is time to fix it? Regards. You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/cloudstack pullrequest-4.4.1-tag-fix Alternatively you can review and apply these changes as the patch at: https://github.com/apache/cloudstack/pull/24.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #24 commit ebb462b516c708e60edb054f1ca95ff3452e32cb Author: Rohit Yadav rohit.ya...@shapeblue.com Date: 2014-10-20T10:21:44Z debian: Fix changelog to use 4.4.1 release with snapshot in the version string Signed-off-by: Rohit Yadav rohit.ya...@shapeblue.com --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: [PROPOSAL] Move to github PR only during moratorium on commit
On Sat, Oct 18, 2014 at 11:00 AM, sebgoa run...@gmail.com wrote: After [1] I would like to officially bring up the following proposal. [Proposal] All commits come through github PR, *even* for committers. We declare a moratorium period (agreed suspension of activity) during which direct commit to master is forbidden. Only the master RM is allowed to merge PR in master (we define a master RM). If direct commit to master is done, master RM reverts without warning. Same for 4.5 and 4.4. branches. This is drastic and I am sure some folks will not like it, but here is my justification for such a measure: [Reasons]: Our commit and release processes have so far been based on the idea that development happens on master and that a release branch is cut from master (unstable development branch). Then a different set of community members harden the release branch, QA and bring it to GA level. During that time development keeps on going in master. This is an OK process if we have the luxury of having a QA team and can cope with split personality of being developers and release managers. My point of view is that as a community we cannot afford such a split brain organization and our experience overt the last year proves my point (delayed release date, broken builds, features merged without warning…) We can avoid this by cutting a release branch from a stable one (from the start), then as you (Daan) have mentioned several times, fix bugs in the release branch and merge them back in the stable source of the release (be it master). Feature development need to be done outside master, period. Not only for non-committers but also for committers. And merge request need to be called. This will help review and avoid surprises. New git workflow were proposed and shutdown, mostly calling for better CI to solve quality issues. CI will not solve our quality issues alone. We need to better police ourselves. To avoid long discussions, I propose this simple but drastic measure. We move all our commits to github PR until 4.5 is out, this stands for committers and non-committers, direct commits (especially to master) would be reverted immediately. I'm +1 to any change that could improve quality, and submitting to github as non-committer is a magnitude faster/easier than RB. -- Erik
Re: [PROPOSAL] Remove SNAPSHOT from versioning and keep tags on the release branch
On Mon, Oct 20, 2014 at 12:33 PM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi, Background: Whenever we start on a new release and cut its release branch, for example 4.5 branch, we add the -SNAPSHOT string to the version string in pom.xmls, debian/changelog and elsewhere. Just this mere action adds a divergence between release and master branches and between two minor releases as well. Also, we have seen build issue that come up just because someone forgot to add or remove -SNAPSHOT or .snapshot in debian/ or packaging. The other issue is historically we keep release tags on the release branches, by doing this it makes it easy to find commits and follow the git history. By doing a separate RC branch and then tagging on it is alright, you can still do a git fetch and git checkout tag but it break the historic convention. So, please share your views on the follow proposal that try to add simple changes: 1. Remove -SNAPSHOT suffix (and its lower/other case variants) from the source code, just change to next version and keep working on it; we don’ have to fix build systems often. 2. In future keep release tags on major release branch (for example, 4.3.0, 4.3.1 both on 4.3 branch) Is it possible somehow (git foo or something?) to find out if a tarball/branch is an official release? I mean besides relying on the version number in POMs etc. As others I agree that having some sort of indication in the package wether or not your install is an official release or not is important. But it's only important to have some metadata about it, ie. the package name or similar. So if we could improve the packaging to figure out a way to check if the release is official or not, that would be sufficient for my use case. -- Erik Weber
Re: [PROPOSAL] Move to github PR only during moratorium on commit
On Mon, Oct 20, 2014 at 7:26 PM, Chiradeep Vittal chiradeep.vit...@citrix.com wrote: Won’t this proposal make GitHub the canonical repository? I don’t see ASF infra being too happy with that. Shouldn't have to, you can still merge/push to the ASF infra repository and only the PR would live on github. It's probably a tad more hassle for the one pushing the commit. I guess Sebastien or Pierre-Luc can chime in with experiences from the doc repos. -- Erik
Re: Unreleased 4.4.1 packages on cloudstack.apt-get.eu, why?
On Mon, Oct 20, 2014 at 10:43 PM, Nux! n...@li.nux.ro wrote: Guys.. for crying out loud.. who put the 4.4.1 rpms back and regenerated the repodata? I wouldn't normally care, but this repo is advertised in many places, people have it installed, it will get used ... with unreleased, buggy software ... Please make another directory or something. :( 4.4.1 is officially voted for now, right? I'm not familiar with bylaws and such, but is there something that prohibits us from distributing before an announcement has been made? -- Erik -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Daan Hoogland daan.hoogl...@gmail.com To: dev dev@cloudstack.apache.org Sent: Friday, 10 October, 2014 08:46:05 Subject: Re: Unreleased 4.4.1 packages on cloudstack.apt-get.eu, why? I was thinking about that. I shouldn't have done this upload but had a reason to. I want to make these available for testers. maybe i can upload them without adding them to the rpm index...? On Thu, Oct 9, 2014 at 7:47 PM, Nux! n...@li.nux.ro wrote: Perhaps we need a testing repo for non-final packages? -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Daan Hoogland daan.hoogl...@gmail.com To: dev dev@cloudstack.apache.org Sent: Thursday, 9 October, 2014 17:42:50 Subject: Re: Unreleased 4.4.1 packages on cloudstack.apt-get.eu, why? i did On Thu, Oct 9, 2014 at 3:07 PM, Ian Duffy i...@ianduffy.ie wrote: Wildo, Do we have no kind of audit on uploads? On 9 October 2014 12:25, Wido den Hollander w...@widodh.nl wrote: On 10/09/2014 01:21 PM, Nux! wrote: Hello, I've noticed there are 4.4.1 packages on http://cloudstack.apt-get.eu/rhel/4.4/. Since 4.4.0 is latest release, how come? This is bad, people will install broken stuff. Can anyone fix this? I removed the packages, but I'm not sure who uploaded them. They were uploaded on September 30th at 11:12 CET. Wido Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro -- Daan -- Daan
Re: [ANNOUNCE] New PMC Member: Rajani Karuturi
On Fri, Oct 17, 2014 at 12:21 PM, Daan Hoogland daan.hoogl...@gmail.com wrote: The Project Management Committee (PMC) for Apache CloudStack are pleased to announce that Rajani Karuturi has accepted our invitation to join the PMC. Please join me in congratulating her. Congratulations! -- Erik
Re: Weird ssl keystore error while upgrading to 4.4.1
Should already be fixed in 4.4, but I don't know if it the code handles upgrades.. https://reviews.apache.org/r/24184/ was the relevant review -- Erik On Tue, Oct 14, 2014 at 10:00 AM, Daan Hoogland daan.hoogl...@gmail.com wrote: adding it to server/conf/cloudstack-sudoers.in in 4.4 branch. Is this only an issue in the 4.4 branch? On Tue, Oct 14, 2014 at 9:48 AM, Nux! n...@li.nux.ro wrote: Cheers for that, in my setup I had this appended to my sudoers file (note the missing keytool): cloud ALL =NOPASSWD : /bin/chmod, /bin/cp, /bin/mkdir, /bin/mount, /bin/umount Defaults !requiretty Adding keytool to that solved the problem. Thanks! Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Pierre-Luc Dion pdion...@apache.org To: dev@cloudstack.apache.org Sent: Tuesday, 14 October, 2014 01:58:54 Subject: Re: Weird ssl keystore error while upgrading to 4.4.1 sudo line for user cloud should look like this: cloud ALL =NOPASSWD : /bin/chmod, /bin/cp, /bin/mkdir, /bin/mount, /bin/umount, /usr/bin/keytool keytool was probably missing which cause the sudo error... On Mon, Oct 13, 2014 at 8:39 PM, Ian Duffy i...@ianduffy.ie wrote: AFAIK the sudo rights are given during the mgmt server install. Yes this happens during the cloud-setup-management stage. It modifies the sudoers file. There is one binary it attempts to execute using sudo that it doesn't have permission to do so. If memory serves me correctly its keytool. On 14 October 2014 00:54, Nux! n...@li.nux.ro wrote: Is this done automatically? If yes, we may have just found a bug. :-) Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Erik Weber terbol...@gmail.com To: dev dev@cloudstack.apache.org Sent: Monday, 13 October, 2014 20:16:53 Subject: Re: Weird ssl keystore error while upgrading to 4.4.1 AFAIK the sudo rights are given during the mgmt server install. -- Erik On Mon, Oct 13, 2014 at 7:14 PM, Nux! n...@li.nux.ro wrote: Marcus, User cloud has no sudo rights, that might be one of the causes. I have never read that this user should have sudo access. Am I wrong? Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Marcus shadow...@gmail.com To: dev@cloudstack.apache.org Sent: Monday, 13 October, 2014 18:01:15 Subject: Re: Weird ssl keystore error while upgrading to 4.4.1 2014-10-13 16:45:51,662 DEBUG [c.c.u.s.Script] (main:null) Executing: sudo keytool -genkey -keystore /etc/cloudstack/management/cloud.keystore -storepass vmops.com -keypass vmops.com -keyalg RSA -validity 3650 -dname cn=Cloudstack User,ou=management,o=management,c=Unknown 2014-10-13 16:45:51,675 DEBUG [c.c.u.s.Script] (main:null) Exit value is 1 Not sure exactly, but I notice this. Run that command manually and see -- Daan
Re: CloudStack Mirrors
I'm not familiar with Apache policies in this regard, but is there any way we could establish a set of official / supported mirrors that all answer on the same DNS address? I.e. so that we only have to document one url -- Erik On Tue, Oct 14, 2014 at 9:42 AM, Nux! n...@li.nux.ro wrote: There's a mirror at http://mirrors.coreix.net/cloudstack.apt-get.eu/ as well. HTH Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Ian Duffy i...@ianduffy.ie To: CloudStack Dev dev@cloudstack.apache.org Sent: Tuesday, 14 October, 2014 01:38:19 Subject: Re: CloudStack Mirrors Hi Mo, I'm downloading from http://cloudstack.apt-get.eu/systemvm/4.4/ Its pretty fast, can grab the systemvm in about 1 minute. The citrix guys have some on http://download.cloud.com/ as well. Hope this helps, Ian On 14 October 2014 01:18, Mo m...@daoenix.com wrote: Greetings, Has there been further discussion on setting up domains. Presently attempting to obtain the systemvm, and it’s saying 75 minute download time. I, know for sure it’s not my speed, which is 300mpbs. Has anyone else experienced this and/or have mirrors that I may not know about? // Mo — Sent from Mailbox
[INFRA] [JENKINS] Full disk on test-infra-common
Anyone that could free up some space on test-infra-common? FilesystemSize Used Avail Use% Mounted on /dev/mapper/VolGroup-lv_root 48G 30G 16G 65% / tmpfs 1.5G 0 1.5G 0% /dev/shm /dev/xvda1485M 32M 429M 7% /boot /dev/xvdb 50G 49G 0 100% /var/lib/jenkins -- Erik
Re: System VM build job slaves are down
On Mon, Oct 13, 2014 at 12:16 PM, Leo Simons lsim...@schubergphilis.com wrote: Hey folks, The machine building systemvms was originally set up elsewhere (@citrix?). It had been down for a few months so a few weeks ago Hugo put a new temporary one in place in our infrastructure. Before that setup can become permanent (we’re happy to host this) we have to do some work to shore up the containing environment, and the slave will be offline until we complete that, which may take 3 weeks or so for us to get to due to, err, being quite busy :-) Until then, of course, if someone can bring back up the original slave that has been offline for a while, that might be worth it. Can't say anything about the original slave, but we (EVRY) might be able to host one or more new slaves Send me something off-list and we'll start working on it -- Erik
Re: System VM build job slaves are down
On Mon, Oct 13, 2014 at 3:19 PM, Leo Simons lsim...@schubergphilis.com wrote: Hey Erik, On Oct 13, 2014, at 12:21 PM, Erik Weber terbol...@gmail.com wrote: On Mon, Oct 13, 2014 at 12:16 PM, Leo Simons lsim...@schubergphilis.com wrote: Hey folks, The machine building systemvms was originally set up elsewhere (@citrix?). It had been down for a few months so a few weeks ago Hugo put a new temporary one in place in our infrastructure. Before that setup can become permanent (we’re happy to host this) we have to do some work to shore up the containing environment, and the slave will be offline until we complete that, which may take 3 weeks or so for us to get to due to, err, being quite busy :-) Until then, of course, if someone can bring back up the original slave that has been offline for a while, that might be worth it. Can't say anything about the original slave, but we (EVRY) might be able to host one or more new slaves Send me something off-list and we'll start working on it Thanks for offering to help Erik, but I’m not the right person for this: I don’t have the admin access to the jenkins.buildacloud.org needed to add slaves. Seems I have Jenkins permission to add and delete a node, but not configure it, which makes it stuck in limbo. The mail was for anyone who would happen to be in a position to accept the offer and potentially help with the jenkins configuration. I'd be happy to work on getting the slave in the right state but would need help or permission to get it that far. You need a PMC member I believe, as far as I know there’s a .txt somewhere with details on how its managed…anyone? cheers, Leo
Re: Weird ssl keystore error while upgrading to 4.4.1
AFAIK the sudo rights are given during the mgmt server install. -- Erik On Mon, Oct 13, 2014 at 7:14 PM, Nux! n...@li.nux.ro wrote: Marcus, User cloud has no sudo rights, that might be one of the causes. I have never read that this user should have sudo access. Am I wrong? Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Marcus shadow...@gmail.com To: dev@cloudstack.apache.org Sent: Monday, 13 October, 2014 18:01:15 Subject: Re: Weird ssl keystore error while upgrading to 4.4.1 2014-10-13 16:45:51,662 DEBUG [c.c.u.s.Script] (main:null) Executing: sudo keytool -genkey -keystore /etc/cloudstack/management/cloud.keystore -storepass vmops.com -keypass vmops.com -keyalg RSA -validity 3650 -dname cn=Cloudstack User,ou=management,o=management,c=Unknown 2014-10-13 16:45:51,675 DEBUG [c.c.u.s.Script] (main:null) Exit value is 1 Not sure exactly, but I notice this. Run that command manually and see
Re: Unreleased 4.4.1 packages on cloudstack.apt-get.eu, why?
Or make a different folder for unreleased versions? That way you could upload daily builds as well if you ever wanted to How about - a stable/release folder, where released versions go - a rc folder, for official release versions - a nightly/dev folder, for either a nightly version or the latest master build Couple it with jenkins and it would be easy for testers to verify that a bug is fixed by upgrading their RC or dev version -- Erik On Fri, Oct 10, 2014 at 9:46 AM, Daan Hoogland daan.hoogl...@gmail.com wrote: I was thinking about that. I shouldn't have done this upload but had a reason to. I want to make these available for testers. maybe i can upload them without adding them to the rpm index...? On Thu, Oct 9, 2014 at 7:47 PM, Nux! n...@li.nux.ro wrote: Perhaps we need a testing repo for non-final packages? -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Daan Hoogland daan.hoogl...@gmail.com To: dev dev@cloudstack.apache.org Sent: Thursday, 9 October, 2014 17:42:50 Subject: Re: Unreleased 4.4.1 packages on cloudstack.apt-get.eu, why? i did On Thu, Oct 9, 2014 at 3:07 PM, Ian Duffy i...@ianduffy.ie wrote: Wildo, Do we have no kind of audit on uploads? On 9 October 2014 12:25, Wido den Hollander w...@widodh.nl wrote: On 10/09/2014 01:21 PM, Nux! wrote: Hello, I've noticed there are 4.4.1 packages on http://cloudstack.apt-get.eu/rhel/4.4/. Since 4.4.0 is latest release, how come? This is bad, people will install broken stuff. Can anyone fix this? I removed the packages, but I'm not sure who uploaded them. They were uploaded on September 30th at 11:12 CET. Wido Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro -- Daan -- Daan
Re: [EVENT] CloudStack Conference
Any info on number of registrations? -- Erik On Tue, Sep 30, 2014 at 5:23 PM, sebgoa run...@gmail.com wrote: Hi folks, CloudStack conference in Budapest, Nov 19-21 is coming up fast. Registration is open: http://events.linuxfoundation.org/events/cloudstack-collaboration-conference-europe/attend/register And we of course have a great schedule with tutorials, talks, keynotes and poster. http://events.linuxfoundation.org/events/cloudstack-collaboration-conference-europe/program/schedule Looking forward to seeing you all there, Cheers, -Sebastien
Re: [ANNOUNCE] New PMC Member: Pierre-Luc Dion
Congratulations Pierre-Luc, well done :-) 30. sep. 2014 15:50 skrev Chip Childers chipchild...@apache.org følgende: The Project Management Committee (PMC) for Apache CloudStack has asked Pierre-Luc Dion to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Pierre-Luc! -chip On behalf of the Apache CloudStack PMC
Re: [ANNOUNCE] New PMC Member: Ian Duffy
Congratulations! Erik 30. sep. 2014 15:50 skrev Chip Childers chipchild...@apache.org følgende: The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC
Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
Which systemvm did you use for the 4.3 install, and did it successfully upgrade it? Haven't had the time to test it yet, so just wanted to make sure that the systemvm issues with 4.3 templates running on 4.4 is fixed. -- Erik On Mon, Sep 29, 2014 at 2:45 PM, Wei ZHOU ustcweiz...@gmail.com wrote: +1 KVM + Advanzed zone Upgrade from 4.3.0 to 4.4.1-RC Everything looks fine. -Wei 2014-09-29 12:57 GMT+02:00 Rohit Yadav rohit.ya...@shapeblue.com: +1 Testing using KVM on Ubuntu, was able to successfully deploy a basic zone, launch VMs. On 29-Sep-2014, at 12:01 am, Daan Hoogland daan.hoogl...@gmail.com wrote: Hi All, I've created a 4.4.1 release, with the following artifacts up for a vote: Git Branch and Commit SH: https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.4-RC20140924T2100 Commit: 620ad650bdda23cabdf4c9dc480072c02c59a2d1 List of changes: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/latest/ Source release (checksums and signatures are available at the same location): https://dist.apache.org/repos/dist/dev/cloudstack/4.4.1/ PGP release keys (signed using 4096R/AA4736F3): https://dist.apache.org/repos/dist/release/cloudstack/KEYS Vote will be open for 72 hours. For sanity in tallying the vote, can PMC members please be sure to indicate (binding) with their vote? [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove (and reason why) -- Daan Regards, Rohit Yadav Software Architect, ShapeBlue M. +41 779015219 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: [VMWARE SETUP ERROR] Error seeing in brining up System VMs with Vmware setup with CS server
Which systemvm template are you using? Erik 19. sep. 2014 03:47 skrev Mike Tutkowski mike.tutkow...@solidfire.com følgende: Actually, the virtual router says it requires an upgrade. I think I can just turn that check off and re-run my create-VM test. On Thu, Sep 18, 2014 at 7:43 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: OK, I checked in a fix for this: https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commitdiff;h=18e5aa116e99906f24a292bf7546809e05c72ec2;hp=7537c33bcdda65672fdd8f81509e6885aa536932 I did notice that both before and after my fix that the virtual router is NOT coming up. The system VM being cloned and the starting of the VM looks fine. It gets to the command prompt and then a little while later is shut down and restarted. I get an error in the GUI indicating that my VM deployment failed. I don't personally know a whole lot about how the virtual router code works, so we should pass that on to an appropriate developer. On Thu, Sep 18, 2014 at 6:35 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Just destroyed and re-created my env from scratch without 8bb4022f3729154f85036c4a7f55e2de783e4909 and it works fine. I think I know what the author was intending with the code that is causing the problem, so I'll go ahead and put in what I think is a fix, re-create my env, and see if it works. On Thu, Sep 18, 2014 at 6:26 PM, ilya musayev ilya.musa...@gmail.com wrote: Thank you Mike, please keep us posted. Regards ilya On 9/18/14, 4:14 PM, Mike Tutkowski wrote: Little clarification on this: The dsName is derived from the UUID of the datastore. I mean that the dsName is derived from the UUID primary storage in the DB. On Thu, Sep 18, 2014 at 5:12 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Just a little update on this: The problem doesn't seem to have anything to do with managed storage code that was introduced back in March. The dsName is derived from the UUID of the datastore. This leads to a null being returned from diskInfoBuilder.getDiskInfoByBackingFileBaseName, which subsequently leads to a null being returned from this method (and a NullPointerException being thrown). I plan to take a look at the history of this file in gitk. private VirtualMachineDiskInfo getMatchingExistingDisk(VirtualMachineDiskInfoBuilder diskInfoBuilder, DiskTO vol) { if (diskInfoBuilder != null) { VolumeObjectTO volume = (VolumeObjectTO)vol.getData(); String dsName = volume.getDataStore().getUuid().replace(-, ); MapString, String details = vol.getDetails(); boolean isManaged = details != null Boolean.parseBoolean(details.get(DiskTO.MANAGED)); VirtualMachineDiskInfo diskInfo = diskInfoBuilder.getDiskInfoByBackingFileBaseName(isManaged ? new DatastoreFile(volume.getPath()).getFileBaseName() : volume.getPath(), dsName); On Thu, Sep 18, 2014 at 4:34 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: I think I found the magic. :) sudo mount -t nfs 192.168.129.46:/export/secondary /mnt/sec If I mount /export/secondary to /mnt/sec (I did it in a bit of a roundabout way here), then the management server is happy. I think this is only VMware thing for the management server. Does anyone know if we document this? Thanks! On Thu, Sep 18, 2014 at 4:18 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: The instructions even say the following: If your secondary storage mount point is not named /mnt/secondary, substitute your own mount point name. On Thu, Sep 18, 2014 at 4:15 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Yeah, I've been through the instructions a couple times and don't see anything that indicates why it's having trouble with /mnt/sec (it says /mnt/sec instead of /mnt/secondary in the log messages). On Thu, Sep 18, 2014 at 4:01 PM, Ritu Sabharwal rsabh...@brocade.com wrote: I have an external NFS server and it is mounted to /mnt/secondary on my CS server so seeding command I used is: /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt -m /mnt/secondary -u http://cloudstack.apt-get.eu/systemvm/4.4/systemvm64template-4.4.0-6-vmware.ova -h vmware -F I guess, if the secondary storage is local, then /export/secondary should be fine. Regards, Ritu S. -Original Message- From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] Sent: Thursday, September 18, 2014 2:34 PM To: dev@cloudstack.apache.org Cc: ilya musayev; Koushik Das; Sateesh Chodapuneedi; Adip Shetty Subject: Re: [VMWARE SETUP ERROR] Error seeing in brining up System VMs with Vmware setup with CS server The instructions to seed secondary storage for VMware look like this:
Re: [VOTE] Release Apache CloudStack 4.3.1 round #4
On Wed, Sep 10, 2014 at 5:31 PM, sebgoa run...@gmail.com wrote: Hi All, I've created a 4.3.1 release, with the following artifacts up for a vote: I don't know if packaging issues is relevant or not, but rpms require openjdk 1.6 rather than 1.7, which makes the kvm agent unable to start. [root@cloud-lab-node3 cloudstack]# cat agent/cloudstack-agent.err log4j:WARN No appenders could be found for logger (com.cloud.agent.AgentShell). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:622) at org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:177) Caused by: java.lang.UnsupportedClassVersionError: com/ceph/rados/RadosException : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:643) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:277) at java.net.URLClassLoader.access$000(URLClassLoader.java:73) at java.net.URLClassLoader$1.run(URLClassLoader.java:212) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at java.lang.ClassLoader.loadClass(ClassLoader.java:323) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) at java.lang.ClassLoader.loadClass(ClassLoader.java:268) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:190) at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:371) at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:358) at com.cloud.agent.AgentShell.start(AgentShell.java:455) ... 5 more 11/09/2014 12:07:25 5122 jsvc.exec error: Cannot start daemon -- Erik
Re: [VOTE] Release Apache CloudStack 4.3.1 round #4
On Thu, Sep 11, 2014 at 10:54 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Erik, On 11-Sep-2014, at 10:11 am, Erik Weber terbol...@gmail.com wrote: I don't know if packaging issues is relevant or not, but rpms require openjdk 1.6 rather than 1.7, which makes the kvm agent unable to start. [root@cloud-lab-node3 cloudstack]# cat agent/cloudstack-agent.err log4j:WARN No appenders could be found for logger (com.cloud.agent.AgentShell). I checked cloud.spec, The rpms requires java 1.6.0 or above, when you install cloudstack-agent does it automatically only install openjdk 1.6? If you install openjdk 1.7 does this problem go away? Yes, I only had openjdk 1.6 installed. Installing openjdk 1.7 and removing 1.6 solved the issue. Are you using the rpms from the repo I shared, those RPMs were build using JDK 1.7 so running them on 1.6 JRE/JVM can cause issues. Can you try building the rpms yourself using JDK 1.6 and running them on 1.6 and see if you can reproduce this issue. I actually used the latest from jenkins. The spec file is the same, but I can try building them myself just to be sure. -- Erik
Re: [VOTE] Release Apache CloudStack 4.3.1 round #4
I'll revert my initial message. Making sure the RPMs are built with openjdk 1.6 does indeed work, so this is a build issue. This is however something that could bite someone though. The spec requires openjdk 1.6 to build, but you can easily have both 1.6 and 1.7 installed and have it built with 1.7 if that is your default java, am I correct? I'm not saying this should warrant the vote to fail, just want to mention it. -- Erik -- Erik On Thu, Sep 11, 2014 at 11:38 AM, Erik Weber terbol...@gmail.com wrote: On Thu, Sep 11, 2014 at 10:54 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Erik, On 11-Sep-2014, at 10:11 am, Erik Weber terbol...@gmail.com wrote: I don't know if packaging issues is relevant or not, but rpms require openjdk 1.6 rather than 1.7, which makes the kvm agent unable to start. [root@cloud-lab-node3 cloudstack]# cat agent/cloudstack-agent.err log4j:WARN No appenders could be found for logger (com.cloud.agent.AgentShell). I checked cloud.spec, The rpms requires java 1.6.0 or above, when you install cloudstack-agent does it automatically only install openjdk 1.6? If you install openjdk 1.7 does this problem go away? Yes, I only had openjdk 1.6 installed. Installing openjdk 1.7 and removing 1.6 solved the issue. Are you using the rpms from the repo I shared, those RPMs were build using JDK 1.7 so running them on 1.6 JRE/JVM can cause issues. Can you try building the rpms yourself using JDK 1.6 and running them on 1.6 and see if you can reproduce this issue. I actually used the latest from jenkins. The spec file is the same, but I can try building them myself just to be sure. -- Erik
Re: [VOTE] Release Apache CloudStack 4.3.1 round #4
On Thu, Sep 11, 2014 at 3:15 PM, Rohit Yadav rohit.ya...@shapeblue.com wrote: On 11-Sep-2014, at 2:06 pm, Erik Weber terbol...@gmail.com wrote: The spec requires openjdk 1.6 to build, but you can easily have both 1.6 and 1.7 installed and have it built with 1.7 if that is your default java, am I correct? I'm not saying this should warrant the vote to fail, just want to mention it. Thanks, you’re right. I think for 4.4.1 and master/4.5.0 we can fix it to have it built by 1.7 jdk and the packages requires 1.7.0 or above when they get installed. Isn't that already done? Ref the change to java 1.7 earlier this year. the cloud.spec in branch 4.4 requires java7, so I think this only applies to previous versions, and a note in the build section of the docs is probably enough. -- Erik
Re: [VOTE] Release Apache CloudStack 4.3.1 round #4
On Thu, Sep 11, 2014 at 3:01 PM, Nux! n...@li.nux.ro wrote: Hello, I've upgraded and it looks ok for now. I have used these system VMs http://jenkins.buildacloud.org/view/4.3/job/cloudstack-4.3-systemvm/ and added them as systemvm-kvm-4.3 in the Templates. I expected them to replace SystemVM Template (KVM), but they are still listed as systemvm-kvm-4.3 alongside the old ones. Other than that everything seems ok for now. Is there an upgrade path from 4.3.0 systemvm template to 4.3.1? Log on to a newly deployed one and check /etc/cloudstack-version -- Erik
Re: [VOTE] Release Apache CloudStack 4.3.1 round #4
Except heartbleed fix. I was merely checking if it's even poosible to do an automated upgrade. The way i know the upgrade process we add some sql magic to check for new systemvm templates. If that's not made for 4.3.1 it won't do much good to add it as systemvm-hypervisor-version. Erik 11. sep. 2014 15:45 skrev Wei ZHOU ustcweiz...@gmail.com følgende: As far as I know, there is no systemvm change during upgrade from 4.3.0 to 4.3.1 2014-09-11 15:22 GMT+02:00 Erik Weber terbol...@gmail.com: On Thu, Sep 11, 2014 at 3:01 PM, Nux! n...@li.nux.ro wrote: Hello, I've upgraded and it looks ok for now. I have used these system VMs http://jenkins.buildacloud.org/view/4.3/job/cloudstack-4.3-systemvm/ and added them as systemvm-kvm-4.3 in the Templates. I expected them to replace SystemVM Template (KVM), but they are still listed as systemvm-kvm-4.3 alongside the old ones. Other than that everything seems ok for now. Is there an upgrade path from 4.3.0 systemvm template to 4.3.1? Log on to a newly deployed one and check /etc/cloudstack-version -- Erik
Re: [VOTE] Release Apache CloudStack 4.3.1 round #4
Do we have an official upgrade path for those who want to upgrade? Erik 12. sep. 2014 01:15 skrev Rohit Yadav rohit.ya...@shapeblue.com følgende: HI, On 11-Sep-2014, at 9:56 pm, Wei ZHOU ustcweiz...@gmail.com wrote: Sorry I just notice Rohit made a systemvm template change (commit 3a0f1550289a8a2a50b0f786821cec2e5c914e62) on 9th, September. The systemvm template will be built based on debian 7.5.0 instead of 7.4.0 The quoted commit and changes to use 7.5.0 instead of 7.4.0 was done on 4.4 and master branches. On 4.3 branch it was changes from 7.0.0 to 7.5.0. This does not change the systemvms internal packages but save some bandwidth while building them (and have the latest stable kernel from 7.5.0) because we do a apt-get update before installing packages (tools/appliances/systemvm**/postinstall.sh). Other than this the only major change in systemvms was apache rewrite rules from CLOUDSTACK-7405 fix. So, while using 4.3.1 systemvms is recommended but not mandatory. Regards, Rohit Yadav Software Architect, ShapeBlue M. +41 779015219 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: Clarification on github or and TravisCI
On Wed, Sep 3, 2014 at 1:15 PM, Ian Duffy i...@ianduffy.ie wrote: It's doable but have not yet discussed and voted if we wanted to make it an official mechanism. Would love to see it happen. I recall review board being a massive pain point for a few reasons: +1 as a non-committer it is far easier to cope with the github way of doing things. -- Erik
Re: Unable to start a VM due to insufficient capacity
Give us more of the logs. Preferably everything from the moment you press launch until the exception occurs. -- Erik On Mon, Sep 1, 2014 at 3:18 PM, Giri Prasad g_p...@yahoo.com.invalid wrote: Hello, I have installed cs 4.3 on Ubuntu 14.04 LTS. Created the usual infra, registered a couple of ISO's, and tried to created a instance using the ISO, via the gui. Comes out with some error. Any ideas on how to fix this? Thanks Regards, Giri 2014-09-01 17:21:26,551 DEBUG [c.c.a.ApiServlet] (catalina-exec-6:ctx-703486f7 ctx-ee65bd67) ===END=== XXX.XXX.XXX.5 -- GET command=queryAsyncJobResultjobId=1b7d53c6-256a-4721-b69c-d68c1f6d7d42response=jsonsessionkey=e6F89zbOUS4dR2%2FmrkznQBxeQ%2BM%3D_=1409572286355 2014-09-01 17:21:26,733 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-6:ctx-d1e72afb) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605) at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237) at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:622) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy169.startVirtualMachine(Unknown Source) at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:443) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161) at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109) at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:701) Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|ubuntu-12-04-64bit-admin-Instance]Scope=interface com.cloud.dc.DataCenter; id=1 at
Re: Error running client of Cloudstackclient
On Thu, Aug 28, 2014 at 8:52 AM, Giri Prasad g_p...@yahoo.com.invalid wrote: Hello, I have cs running fine accessible thru gui. I have installed cloudstackclient, and generated the php wrapper (using generator.php). When calling this wrapper function, some error comes up. Any indeas to fix this? Thanks Regards, Giri The program *** echo Including CloudStackClient.php program . ; echo Invoking the CloudStackClient function to login; $cloudstack = new CloudStackClient( http://XXX.XXX.XXX.5:8080/client/;, aa, bb ); echo Invoking the ListVirutalMachines function ; $vms = $cloudstack-listVirtualMachines(); foreach ($vms as $vm) { echo({$vm-id} : {$vm-name} {$vm-state}); } Error Message * php index.php PHP Warning: PHP Startup: Unable to load dynamic library '/usr/lib/php5/20090626/mysqlnd.so' - /usr/lib/php5/20090626/mysqlnd.so: cannot open shared object file: No such file or directory in Unknown on line 0 You seem to miss the mysql module files. Including CloudStackClient.php program . Invoking the CloudStackClient function to loginInvoking the ListVirutalMachines function PHP Fatal error: Uncaught exception 'CloudStackClientException' with message 'The server did not issue a json response.' in /var/www/BaseCloudStackClient.php:95 Stack trace: #0 /var/www/CloudStackClient.php(280): BaseCloudStackClient-request('listVirtualMach...', Array) #1 /var/www/index.php(18): CloudStackClient-listVirtualMachines() #2 {main} thrown in /var/www/BaseCloudStackClient.php on line 95 Management server log 2014-08-28 12:17:21,389 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 3-51: Processing Seq 3-51: { Cmd , MgmtId: -1, via: 3, Ver: v1, Flags: 11, [{ConsoleProxyLoadReportCommand:{_proxyVmId:2,_loadInfo:{\n \connections\: []\n},wait:0}}] } 2014-08-28 12:17:21,490 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 3-51: Sending Seq 3-51: { Ans: , MgmtId: 59392206543736, via: 3, Ver: v1, Flags: 100010, [{AgentControlAnswer:{result:true,wait:0}}] } 2014-08-28 12:17:28,115 DEBUG [cloud.server.StatsCollector] (StatsCollector-1:null) VmStatsCollector is running... 2014-08-28 12:17:29,240 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) StorageCollector is running... 2014-08-28 12:17:29,297 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 4-433651725: Received: { Ans: , MgmtId: 59392206543736, via: 4, Ver: v1, Flags: 10, { GetStorageStatsAnswer } } 2014-08-28 12:17:29,364 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 1-218497053: Received: { Ans: , MgmtId: 59392206543736, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
Re: Error running client of Cloudstackclient
You get: Uncaught exception 'CloudStackClientException' with message 'The server did not issue a json response.' Is there anything in your mgmt server that can explain why it doesn't return with a json response? Erik On Thu, Aug 28, 2014 at 9:39 AM, Giri Prasad g_p...@yahoo.com.invalid wrote: Thanks for the comment. I did, on Ubuntu 12.04 LTS: apt-get purge php5-mysqlnd /etc/init.d/apache2 restart grep -Hrv ; /etc/php5 | grep -i extension= /etc/php5/apache2/conf.d/pdo_mysql.ini:extension=pdo_mysql.so /etc/php5/apache2/conf.d/mysqli.ini:extension=mysqli.so /etc/php5/apache2/conf.d/mcrypt.ini:extension=mcrypt.so /etc/php5/apache2/conf.d/mysql.ini:extension=mysql.so /etc/php5/apache2/conf.d/pdo.ini:extension=pdo.so /etc/php5/apache2/php.ini:extension=http.so /etc/php5/fpm/conf.d/pdo_mysql.ini:extension=pdo_mysql.so /etc/php5/fpm/conf.d/mysqli.ini:extension=mysqli.so /etc/php5/fpm/conf.d/mcrypt.ini:extension=mcrypt.so /etc/php5/fpm/conf.d/mysql.ini:extension=mysql.so /etc/php5/fpm/conf.d/pdo.ini:extension=pdo.so /etc/php5/conf.d/pdo_mysql.ini:extension=pdo_mysql.so . . php index.php Including CloudStackClient.php program . Invoking the CloudStackClient function to loginInvoking the ListVirutalMachines function PHP Fatal error: Uncaught exception 'CloudStackClientException' with message 'The server did not issue a json response.' in /var/www/BaseCloudStackClient.php:95 Stack trace: #0 /var/www/CloudStackClient.php(280): BaseCloudStackClient-request('listVirtualMach...', Array) #1 /var/www/index.php(18): CloudStackClient-listVirtualMachines() #2 {main} thrown in /var/www/BaseCloudStackClient.php on line 95 From: Erik Weber terbol...@gmail.com To: dev dev@cloudstack.apache.org; Giri Prasad g_p...@yahoo.com Sent: Thursday, 28 August 2014 12:31 PM Subject: Re: Error running client of Cloudstackclient On Thu, Aug 28, 2014 at 8:52 AM, Giri Prasad g_p...@yahoo.com.invalid wrote: Hello, I have cs running fine accessible thru gui. I have installed cloudstackclient, and generated the php wrapper (using generator.php). When calling this wrapper function, some error comes up. Any indeas to fix this? Thanks Regards, Giri The program *** echo Including CloudStackClient.php program . ; echo Invoking the CloudStackClient function to login; $cloudstack = new CloudStackClient( http://XXX.XXX.XXX.5:8080/client/;, aa, bb ); echo Invoking the ListVirutalMachines function ; $vms = $cloudstack-listVirtualMachines(); foreach ($vms as $vm) { echo({$vm-id} : {$vm-name} {$vm-state}); } Error Message * php index.php PHP Warning: PHP Startup: Unable to load dynamic library '/usr/lib/php5/20090626/mysqlnd.so' - /usr/lib/php5/20090626/mysqlnd.so: cannot open shared object file: No such file or directory in Unknown on line 0 You seem to miss the mysql module files. Including CloudStackClient.php program . Invoking the CloudStackClient function to loginInvoking the ListVirutalMachines function PHP Fatal error: Uncaught exception 'CloudStackClientException' with message 'The server did not issue a json response.' in /var/www/BaseCloudStackClient.php:95 Stack trace: #0 /var/www/CloudStackClient.php(280): BaseCloudStackClient-request('listVirtualMach...', Array) #1 /var/www/index.php(18): CloudStackClient-listVirtualMachines() #2 {main} thrown in /var/www/BaseCloudStackClient.php on line 95 Management server log 2014-08-28 12:17:21,389 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 3-51: Processing Seq 3-51: { Cmd , MgmtId: -1, via: 3, Ver: v1, Flags: 11, [{ConsoleProxyLoadReportCommand:{_proxyVmId:2,_loadInfo:{\n \connections\: []\n},wait:0}}] } 2014-08-28 12:17:21,490 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 3-51: Sending Seq 3-51: { Ans: , MgmtId: 59392206543736, via: 3, Ver: v1, Flags: 100010, [{AgentControlAnswer:{result:true,wait:0}}] } 2014-08-28 12:17:28,115 DEBUG [cloud.server.StatsCollector] (StatsCollector-1:null) VmStatsCollector is running... 2014-08-28 12:17:29,240 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) StorageCollector is running... 2014-08-28 12:17:29,297 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 4-433651725: Received: { Ans: , MgmtId: 59392206543736, via: 4, Ver: v1, Flags: 10, { GetStorageStatsAnswer } } 2014-08-28 12:17:29,364 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 1-218497053: Received: { Ans: , MgmtId
Re: [DISCUSS] Changing the way password reset works, or allowing the cloud-init way
On Wed, Aug 27, 2014 at 1:04 AM, John Kinsella j...@stratosec.co wrote: On Aug 26, 2014, at 1:34 PM, Erik Weber terbol...@gmail.com wrote: If I understand correctly, we currently deploy a web server on port 8080 on Slight correction: A processes on the VR listens on port 8080, and hands any connections to a UNIX script. Calling it a web server is way too kind. Thanks for the clarification :-) Also, you’re just looking at the unix use-case. The Windows agent is close sourced the last I checked. You're right, I haven't checked the Windows part. I see that cloudbase-init is ASL2, but I haven't verified if it works in this scenario or not, ie. I don't know if they have the ACS provider. Cloud-init doesn’t feel like the best solution, as the one good thing the current setup does is remove the password from the VR after it’s fetched. Thought there was a bug filed on this, but I don’t see it?
Re: [DISCUSS] Changing the way password reset works, or allowing the cloud-init way
On Wed, Aug 27, 2014 at 4:47 AM, Marcus shadow...@gmail.com wrote: We had set up an agent in the VM that listens on the virtio serial port, similar to how the virtual router gets its configurations now in KVM. Host to guest communication is an option, and is fairly standardized (qemu guest agent, VMware tools, xen tools). It takes a little more work to write a daemon, but you could do a lot more with it. I'm not entirely convinced the current design is broken enough to warrant a redesign (or at least I wouldn't want to see compatibility go away). I'm not saying it is broken in any way. I'm just saying that considering the fact that most people already use cloud-init for keys or bootstrapping or whatever, it would be great if we atleast discuss the possibility to somehow provide it with password resets as well. I'm not directly suggesting that we ditch the current way to do password resets either, I don't mind it being there. After all using cloud-init to password reset is currently working, but that you cannot update user-data after vm launch is a limiting factor in ACS. If we had that, which I think we should regardless of passwords, we could easily document how to do it as a first phase thing. -- Erik
[DISCUSS] Changing the way password reset works, or allowing the cloud-init way
If I understand correctly, we currently deploy a web server on port 8080 on the VR and send a specially crafted request to retrieve the password. This requires special made scripts or software on the guest vms to execute the password reset. At the same time cloud-init has become the de facto standard of pushing configuration to guest vms. cloud-init does support password resets out of the box, through the usage of user-data. There are a couple of issues with this that I can think of, and there are probably more that I currently cannot think of, but hopefully someone else might :-) - we cannot change/update user-data (yet) in acs (i think?) - if the vm has an existing user-data, we have to modify it. how to handle custom scripts as user-data? - should we clean up the user-data after some time? how to pick up that the cloud-init has run? If you want to test how this works you can deploy a machine with cloud-init installed. I used this[1] from Lucian as source for its configuration. After that, you have to manually log on to the VR, go to /var/www/html/userdata/vm ip/ and modify the user-data file. Example content is here[2]. Then on your test machine, issue: rm -rf /var/lib/cloud/ cloud-init init cloud-init modules --mode config cloud-init modules --mode final If you chose to use the random password generator it will display on the screen. This is most likely beyond my programming skills, so I cannot say what amount of effort it would take to accomplish. [1] http://dl.openvm.eu/cloudstack/centos/ks/vanilla/7/post_cloudstack.ks [2] https://gist.github.com/terbolous/e0ab09afaa6be2a5f3bb -- Erik
Re: Review Request 25023: CLOUDSTACK-7405: Allow VR metadata to be accessed without trailing slash
On Aug. 26, 2014, 8:39 p.m., Fred Clift wrote: ./systemvm/patches/debian/config/var/www/html/latest/.htaccess That file has a stub-version of the file, and is pre-seeded with one rewrite rule... looks like this: Options +FollowSymLinks RewriteEngine On #RewriteBase / RewriteRule ^user-data$ ../userdata/%{REMOTE_ADDR}/user-data [L,NC,QSA] That rule also probably needs to be updated. You might also want to look at https://reviews.apache.org/r/25065/ and perhaps we could combine our patches... I tested by deleting the .htaccess and restarting the VR. This is the total content of .htaccess: Options +FollowSymLinks RewriteEngine On RewriteRule ^user-data/?$ ../userdata/%{REMOTE_ADDR}/user-data [L,NC,QSA] RewriteRule ^service-offering/?$ ../metadata/%{REMOTE_ADDR}/service-offering [L,NC,QSA] RewriteRule ^meta-data/(.+[^/])/?$ ../metadata/%{REMOTE_ADDR}/$1 [L,NC,QSA] RewriteRule ^meta-data/?$ ../metadata/%{REMOTE_ADDR}/meta-data [L,NC,QSA] RewriteRule ^availability-zone/?$ ../metadata/%{REMOTE_ADDR}/availability-zone [L,NC,QSA] RewriteRule ^local-ipv4/?$ ../metadata/%{REMOTE_ADDR}/local-ipv4 [L,NC,QSA] RewriteRule ^local-hostname/?$ ../metadata/%{REMOTE_ADDR}/local-hostname [L,NC,QSA] RewriteRule ^public-ipv4/?$ ../metadata/%{REMOTE_ADDR}/public-ipv4 [L,NC,QSA] RewriteRule ^public-hostname/?$ ../metadata/%{REMOTE_ADDR}/public-hostname [L,NC,QSA] RewriteRule ^instance-id/?$ ../metadata/%{REMOTE_ADDR}/instance-id [L,NC,QSA] RewriteRule ^vm-id/?$ ../metadata/%{REMOTE_ADDR}/vm-id [L,NC,QSA] RewriteRule ^public-keys/?$ ../metadata/%{REMOTE_ADDR}/public-keys [L,NC,QSA] RewriteRule ^cloud-identifier/?$ ../metadata/%{REMOTE_ADDR}/cloud-identifier [L,NC,QSA] I don't mind combining the patches. If you want to provide it and receive credit I believe this patch has been commited to the 4.3 branch. You can probably provide a patch based on that :-) - Erik --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25023/#review51588 --- On Aug. 25, 2014, 7:55 p.m., Erik Weber wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25023/ --- (Updated Aug. 25, 2014, 7:55 p.m.) Review request for cloudstack, Marcus Sorensen, Sebastien Goasguen, and Wido den Hollander. Bugs: CLOUDSTACK-7405 https://issues.apache.org/jira/browse/CLOUDSTACK-7405 Repository: cloudstack-git Description --- As per https://issues.apache.org/jira/browse/CLOUDSTACK-7405 cloud-init expects to be able to get meta-data directory without using a trailing slash. Ultimately this should be fixed in cloud-init, but it's an unintrusive fix in cloudstack Diffs - systemvm/patches/debian/config/opt/cloud/bin/vmdata.py f508032 Diff: https://reviews.apache.org/r/25023/diff/ Testing --- tested with curl that both new and old url works [root@jenkins ~]# curl -I -s 10.30.81.1/latest/meta-data/vm-id | grep HTTP HTTP/1.1 200 OK [root@jenkins ~]# curl -I -s 10.30.81.1/latest/meta-data | grep HTTP HTTP/1.1 200 OK Thanks, Erik Weber
Re: [DISCUSS] Changing the way password reset works, or allowing the cloud-init way
On Tue, Aug 26, 2014 at 11:44 PM, Nux! n...@li.nux.ro wrote: Hi Erik and thanks for your effort. Using user data is a nice idea. Let's see what more experienced programmers have to say on this. Sure thing One thing that I noticed; though it might have been OK in your particular case, rm -rf /var/lib/cloud/ is a bad idea as it can include various useful scripts along that path. As you noticed I copy the cloudstack-set-password script in /var/lib/cloud/scripts/per-boot, so that's one example. :-) Guess I should note that this was on a test vm, to force refreshing the user-data. It can probably be done with in a less harmful way. DO NOT DO THIS ON ANYTHING IN PRODUCTION :-) -- Erik
Re: cloud-init issue
On Mon, Aug 25, 2014 at 1:16 PM, Wido den Hollander w...@widodh.nl wrote: On 08/25/2014 12:12 PM, Sebastien Goasguen wrote: Folks, There is an outstanding issue with cloud-init compatibility. The VR serves the instance metadata through a web server but there is a trailing slash issue: https://issues.apache.org/jira/browse/CLOUDSTACK-7405 Does anyone know where the settings for this web server are located in the cloudstack code ? So I think that is done in systemvm/patches/debian/ config/opt/cloud/bin/vmdata.py It adds a RewriteRule to the .htaccess like: entry = RewriteRule ^meta-data/(.+)$ ../ + folder + /%{REMOTE_ADDR}/$1 [L,NC,QSA] I'm not a big mod_rewrite guru however. Adding a line with RewriteRule ^meta-data$ ../ + folder +/%{REMOTE_ADDR}/$1 [L,NC,QSA] should suffice. Tested on a VR with this config: RewriteRule ^meta-data/(.+)$ ../metadata/%{REMOTE_ADDR}/$1 [L,NC,QSA] RewriteRule ^meta-data/$ ../metadata/%{REMOTE_ADDR}/meta-data [L,NC,QSA] RewriteRule ^meta-data$ ../metadata/%{REMOTE_ADDR}/meta-data [L,NC,QSA] [root@jenkins ~]# curl 10.30.81.1/latest/meta-data service-offering availability-zone local-ipv4 local-hostname public-ipv4 public-hostname instance-id vm-id public-keys cloud-identifier Erik Wido -sebastien
Re: cloud-init issue
On Mon, Aug 25, 2014 at 1:27 PM, Erik Weber terbol...@gmail.com wrote: On Mon, Aug 25, 2014 at 1:16 PM, Wido den Hollander w...@widodh.nl wrote: On 08/25/2014 12:12 PM, Sebastien Goasguen wrote: Folks, There is an outstanding issue with cloud-init compatibility. The VR serves the instance metadata through a web server but there is a trailing slash issue: https://issues.apache.org/jira/browse/CLOUDSTACK-7405 Does anyone know where the settings for this web server are located in the cloudstack code ? So I think that is done in systemvm/patches/debian/ config/opt/cloud/bin/vmdata.py It adds a RewriteRule to the .htaccess like: entry = RewriteRule ^meta-data/(.+)$ ../ + folder + /%{REMOTE_ADDR}/$1 [L,NC,QSA] I'm not a big mod_rewrite guru however. Adding a line with RewriteRule ^meta-data$ ../ + folder +/%{REMOTE_ADDR}/$1 [L,NC,QSA] should suffice. small typo there... Tested on a VR with this config: RewriteRule ^meta-data/(.+)$ ../metadata/%{REMOTE_ADDR}/$1 [L,NC,QSA] RewriteRule ^meta-data/$ ../metadata/%{REMOTE_ADDR}/meta-data [L,NC,QSA] RewriteRule ^meta-data$ ../metadata/%{REMOTE_ADDR}/meta-data [L,NC,QSA] A better solution is probably to make the last slash conditional, like this: RewriteRule ^meta-data/?$ ../metadata/%{REMOTE_ADDR}/meta-data [L,NC,QSA] tested: [root@jenkins ~]# curl -I -s 10.30.81.1/latest/meta-data/ | grep HTTP HTTP/1.1 200 OK [root@jenkins ~]# curl -I -s 10.30.81.1/latest/meta-data | grep HTTP HTTP/1.1 200 OK Erik
Review Request 25023: CLOUDSTACK-7405: Allow VR metadata to be accessed without trailing slash
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25023/ --- Review request for cloudstack and Marcus Sorensen. Bugs: CLOUDSTACK-7405 https://issues.apache.org/jira/browse/CLOUDSTACK-7405 Repository: cloudstack-git Description --- As per https://issues.apache.org/jira/browse/CLOUDSTACK-7405 cloud-init expects to be able to get meta-data directory without using a trailing slash. Ultimately this should be fixed in cloud-init, but it's an unintrusive fix in cloudstack Diffs - systemvm/patches/debian/config/opt/cloud/bin/vmdata.py f508032 Diff: https://reviews.apache.org/r/25023/diff/ Testing --- tested with curl that both new and old url works [root@jenkins ~]# curl -I -s 10.30.81.1/latest/meta-data/vm-id | grep HTTP HTTP/1.1 200 OK [root@jenkins ~]# curl -I -s 10.30.81.1/latest/meta-data | grep HTTP HTTP/1.1 200 OK Thanks, Erik Weber
Re: cloud-init issue
On Mon, Aug 25, 2014 at 6:02 PM, Carlos Reátegui create...@gmail.com wrote: Not sure about this ‘fix’. If the goal is to match AWS here is the way it works compared to 4.3. The actual fix was just for the reported url, ie. meta-data 1) /latest/user-data On AWS one can query /latest/user-data with or without the trailing slash and BOTH return the user-data On ACS 4.3 /latest/user-data works but with trailing / returns a 404. 2) /latest/meta-data On AWS /latest/meta-data returns a 301 pointing to trailing / version. With a trailing slash it return the meta-data objects available. Is it required to respons with 301, or is 200 with the actual content ok? On ACS 4.3 /latest/meta-data returns 404. With a trailing slash it returns the meta-data objects available. 3) /latest/meta-data/object On AWS with and without / returns the object value(s) On ACS 4.3 without a / it returns the value. With the / it returns a 404. I'll work on an improved patch that fixes all the URLs. Erik
Re: Review Request 25023: CLOUDSTACK-7405: Allow VR metadata to be accessed without trailing slash
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25023/ --- (Updated Aug. 25, 2014, 7:55 p.m.) Review request for cloudstack, Marcus Sorensen, Sebastien Goasguen, and Wido den Hollander. Changes --- This should make all the urls accessible with and without trailing slash. Testing done: without trailing slash: [root@jenkins ~]# for i in local-hostname local-ipv4 vm-id instance-id ; do curl -s -I 10.30.81.1/latest/meta-data/$i | grep HTTP; done HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK with trailing slash: [root@jenkins ~]# for i in local-hostname local-ipv4 vm-id instance-id ; do curl -s -I 10.30.81.1/latest/meta-data/$i/ | grep HTTP; done HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK HTTP/1.1 200 OK Bugs: CLOUDSTACK-7405 https://issues.apache.org/jira/browse/CLOUDSTACK-7405 Repository: cloudstack-git Description --- As per https://issues.apache.org/jira/browse/CLOUDSTACK-7405 cloud-init expects to be able to get meta-data directory without using a trailing slash. Ultimately this should be fixed in cloud-init, but it's an unintrusive fix in cloudstack Diffs (updated) - systemvm/patches/debian/config/opt/cloud/bin/vmdata.py f508032 Diff: https://reviews.apache.org/r/25023/diff/ Testing --- tested with curl that both new and old url works [root@jenkins ~]# curl -I -s 10.30.81.1/latest/meta-data/vm-id | grep HTTP HTTP/1.1 200 OK [root@jenkins ~]# curl -I -s 10.30.81.1/latest/meta-data | grep HTTP HTTP/1.1 200 OK Thanks, Erik Weber
Re: cloud-init issue
I've uploaded a new patch to reviewboard. Erik On Mon, Aug 25, 2014 at 9:32 PM, Erik Weber terbol...@gmail.com wrote: On Mon, Aug 25, 2014 at 6:02 PM, Carlos Reátegui create...@gmail.com wrote: Not sure about this ‘fix’. If the goal is to match AWS here is the way it works compared to 4.3. The actual fix was just for the reported url, ie. meta-data 1) /latest/user-data On AWS one can query /latest/user-data with or without the trailing slash and BOTH return the user-data On ACS 4.3 /latest/user-data works but with trailing / returns a 404. 2) /latest/meta-data On AWS /latest/meta-data returns a 301 pointing to trailing / version. With a trailing slash it return the meta-data objects available. Is it required to respons with 301, or is 200 with the actual content ok? On ACS 4.3 /latest/meta-data returns 404. With a trailing slash it returns the meta-data objects available. 3) /latest/meta-data/object On AWS with and without / returns the object value(s) On ACS 4.3 without a / it returns the value. With the / it returns a 404. I'll work on an improved patch that fixes all the URLs. Erik
Re: [PROPOSAL] Using continuous integration to maintain our code quality...
On Wed, May 7, 2014 at 2:03 AM, Alex Huang alex.hu...@citrix.com wrote: Hi All, This is something I brought up a long time ago but really didn't have the resources to get it all up and running until now. Throughout the past year, Edison, Prasanna, Amogh, Bharat, Koushik, Talluri, and others have been chipping away at it. At this point, we finally pull together a continuous integration setup that we can use to make sure that CloudStack master and the currently release branch are always stable. This is getting pretty close to be completed and we like to share it with the community in hopes that we can reduce/eliminate that problems we've seen with our recent releases. Currently, the physical hardware are hosted by Citrix but we'll be more than willing to donate the work to infra when that's all settled. This does require effort from the community to make a change in their development process. These steps are detailed at [1]. I like to get feedback on what everyone think about this. What have we done: - We replaced a large selection of the BVT tests to run with the simulator instead of actual hardware. This shortens the duration of each BVT run. Today, a BVT that runs tests for XenServer and KVM completes in 30-40 minutes. How much is running with Simulator instead of actual hardware? My issue with this is that you're testing against a flawless simulator in terms of testing, while with actual hardware you are bound to hit bugs/issues that might not be due to ACS code but ACS still has to handle it. As an example, could you run a test on the tags '4.4.0' and '4.3.0' and report the result? They both had fundamental flaws, where the one was practically useless for a week or so, and the other had major issues with KVM, and if the BVT doesn't encounter those because it's using the simulator I see it as a burden rather than a gift, since you're relying on a false result. -- Erik