db upgrade 4.1.1 - master
Can someone please have a look at https://reviews.apache.org/r/13317/ thanks, Daan
Review Board giving 502 proxy error on creating review request with patch
Without patch I am able to create review request but then I am not able to upload patch. Thanks, Anshul
Re: Review Request 13373: keep the existing changes in cloud-set-guest-sshkey.in to make sure we do not break the backward compatibility.
On Aug. 7, 2013, 10:43 p.m., Sheng Yang wrote: Look fine to me. Make sure when you test it, you tested both way(with data-center or not). Tested both the code paths ie with data-center and without datacenter. - bharat --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13373/#review24838 --- On Aug. 7, 2013, 1:25 p.m., bharat kumar wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13373/ --- (Updated Aug. 7, 2013, 1:25 p.m.) Review request for cloudstack, Jayapal Reddy and Sheng Yang. Bugs: Cloudstack-4138 Repository: cloudstack-git Description --- keep the existing changes in cloud-set-guest-sshkey.in to make sure we do not break the backward compatibility. Diffs - setup/bindir/cloud-set-guest-sshkey.in 9436b03 Diff: https://reviews.apache.org/r/13373/diff/ Testing --- Tested on 4.2 Thanks, bharat kumar
Re: Review Request 13373: keep the existing changes in cloud-set-guest-sshkey.in to make sure we do not break the backward compatibility.
On Aug. 7, 2013, 10:43 p.m., Sheng Yang wrote: Look fine to me. Make sure when you test it, you tested both way(with data-center or not). bharat kumar wrote: Tested both the code paths ie with data-center and without datacenter. sorry with data-server and without data-server - bharat --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13373/#review24838 --- On Aug. 7, 2013, 1:25 p.m., bharat kumar wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13373/ --- (Updated Aug. 7, 2013, 1:25 p.m.) Review request for cloudstack, Jayapal Reddy and Sheng Yang. Bugs: Cloudstack-4138 Repository: cloudstack-git Description --- keep the existing changes in cloud-set-guest-sshkey.in to make sure we do not break the backward compatibility. Diffs - setup/bindir/cloud-set-guest-sshkey.in 9436b03 Diff: https://reviews.apache.org/r/13373/diff/ Testing --- Tested on 4.2 Thanks, bharat kumar
firewall rules application
H, I noted that in some of the 4.1 versions I have been testing setting a firewall rule fails. This seems to be when a router is not fully initialized, is it? the stack trace seems to reflect this, but the error message just says Failed to create firewall rule or Failed to delete firewall rule com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply ip association, virtual router is not in the right state at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3445) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.associatePublicIP(VirtualNetworkApplianceManagerImpl.java:3272) at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.associatePublicIP(VpcVirtualNetworkApplianceManagerImpl.java:554) at com.cloud.network.element.VirtualRouterElement.applyIps(VirtualRouterElement.java:438) at com.cloud.network.NetworkManagerImpl.applyIpAssociations(NetworkManagerImpl.java:625) at com.cloud.network.NetworkManagerImpl.applyRules(NetworkManagerImpl.java:2380) at com.cloud.network.firewall.FirewallManagerImpl.applyRules(FirewallManagerImpl.java:500) at com.cloud.network.firewall.FirewallManagerImpl.applyFirewallRules(FirewallManagerImpl.java:630) at com.cloud.network.firewall.FirewallManagerImpl.applyIngressFirewallRules(FirewallManagerImpl.java:603) at org.apache.cloudstack.api.command.user.firewall.CreateFirewallRuleCmd.execute(CreateFirewallRuleCmd.java:124) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Can someone confirm my suspicion? thanks, Daan
Re: Review Board giving 502 proxy error on creating review request with patch
Send the patch over email when reviewboard is down with the subject as formatted by git format-patch. If you know your reviewers don't hesitate to include them in the to list. On Thu, Aug 08, 2013 at 08:26:30AM +, Anshul Gangwar wrote: Without patch I am able to create review request but then I am not able to upload patch. Thanks, Anshul -- Prasanna., Powered by BigRock.com
Re: Master build failure
Dave's been attempting to fix this and it looks to be intertwined in a few commits. Large swaths of code has moved around. I'll revert to last known state from Jenkins if we can't figure out a simple fix so Dave can proceed. On Thu, Aug 08, 2013 at 04:11:36PM +0900, Dave Cahill wrote: Hi, As Prasanna noted in IRC, the cloudstack-master-maven Jenkins build is failing with a similar error: https://builds.apache.org/job/cloudstack-master-maven/2645/console Failed to execute goal on project cloud-engine-components-api: Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-components-api:jar:4.3.0-SNAPSHOT: Could not find artifact org.apache.cloudstack:cloud-framework-config:jar:4.3.0-SNAPSHOT in Nexus (http://repository.apache.org/snapshots) cause : Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-components-api:jar:4.3.0-SNAPSHOT: Could not find artifact org.apache.cloudstack:cloud-framework-config:jar:4.3.0-SNAPSHOT in Nexus (http://repository.apache.org/snapshots) Thanks, Dave. On Thu, Aug 8, 2013 at 3:53 PM, Dave Cahill dcah...@midokura.com wrote: Hi, I'm seeing a build failure with master - I've checked the usual gotchas, but this seems to be something else. Possibly related to the 4.2.0 to 4.3.0 update? The missing dependency is cloud-engine-compute. It's listed as a dependency in engine/service/pom.xml with no type specified, which AFAIK defaults to jar. So my understanding is that it's trying to download version 4.3.0-SNAPSHOT of the cloud-engine-compute jar from repository.apache.org. How does the jar get uploaded there in the first place? Maybe that's a step we missed when witching from 4.2.0 to 4.3.0? Here's what I ran: # Nuke my local maven cache $ rm -rf ~/.m2/repository # Get latest master $ git pull # Clean any files hanging around my git working copy just in case $ git clean -dxf # Build $ mvn clean install -P developer,systemvm -DskipTests Here's the error I got: [ERROR] Failed to execute goal on project cloud-engine-service: Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-service:war:4.3.0-SNAPSHOT: Failure to find org.apache.cloudstack:cloud-engine-compute:jar:4.3.0-SNAPSHOT in http://repository.apache.org/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots has elapsed or updates are forced - [Help 1] Thanks, Dave. -- Prasanna., Powered by BigRock.com
Re: Review Request 10428: (CLOUDSTACK-2017) implement network bandwidth rate limits for VMs for KVM
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/10428/#review24860 --- Commit a77f77c07505856fbaf438646d590a3f984d05c2 in branch refs/heads/4.1 from Wei Zhou [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=a77f77c ] CLOUDSTACK-2017: network throttling implementation for KVM - ASF Subversion and Git Services On April 12, 2013, 6:33 a.m., Wei Zhou wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/10428/ --- (Updated April 12, 2013, 6:33 a.m.) Review request for cloudstack. Bugs: CLOUDSTACK-2017 Repository: cloudstack-git Description --- Adding bandwidth inbound and outbound limitations in VM XML file to implement network bandwidth rate limits for VMs for KVM. It is supported since libvirt 0.9.4. The patch only applies on CloudStack 4.0.1 branch. If commited, I will change it to support 4.1 and master branch. Diffs - plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/BridgeVifDriver.java f406c86 plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtDomainXMLParser.java b622b6d plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtVMDef.java ba6c715 Diff: https://reviews.apache.org/r/10428/diff/ Testing --- Testing manually ok. The VMs need to stop and start to make network bandwidth limits effective. Thanks, Wei Zhou
[Doc] Default Password Encoding Mechanism, SHA256Salt, Doc for Review
Hi, Default Password Encoding Mechanism, SHA256Salt, Doc is ready for review. The doc is attached at https://issues.apache.org/jira/browse/CLOUDSTACK-1815. Please provide your feedback. Regards -Radhika
Review Request 13424: CLOUDSTACK-4123: 3.0.6 to ASF 4.2 Upgrade: On Adding VMWare Cluster to the Setup, 3.0.6 System VM Template for VMWare is downloaded instead of 4.2
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13424/ --- Review request for cloudstack and Kishan Kavala. Bugs: CLOUDSTACK-4123 Repository: cloudstack-git Description --- CLOUDSTACK-4123: 3.0.6 to ASF 4.2 Upgrade: On Adding VMWare Cluster to the Setup, 3.0.6 System VM Template for VMWare is downloaded instead of 4.2 Updating the new system template URLs for the existing templates during upgrade to 4.2. If new 4.2 system template is registered before upgrade then marking the old templates as removed during upgrade. Diffs - engine/schema/src/com/cloud/upgrade/dao/Upgrade410to420.java 0941408 Diff: https://reviews.apache.org/r/13424/diff/ Testing --- Thanks, Harikrishna Patnala
Re: Master build failure
Reverted the range 30c33415..f6a2c817bc. Master builds now. Others who've checked in after these will still retain their commits but please build before push. It's clear we are only worried about 4.2 now but we are breaking master for those who are beginning to work ahead for 4.3 On Thu, Aug 08, 2013 at 02:15:58PM +0530, Prasanna Santhanam wrote: Dave's been attempting to fix this and it looks to be intertwined in a few commits. Large swaths of code has moved around. I'll revert to last known state from Jenkins if we can't figure out a simple fix so Dave can proceed. On Thu, Aug 08, 2013 at 04:11:36PM +0900, Dave Cahill wrote: Hi, As Prasanna noted in IRC, the cloudstack-master-maven Jenkins build is failing with a similar error: https://builds.apache.org/job/cloudstack-master-maven/2645/console Failed to execute goal on project cloud-engine-components-api: Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-components-api:jar:4.3.0-SNAPSHOT: Could not find artifact org.apache.cloudstack:cloud-framework-config:jar:4.3.0-SNAPSHOT in Nexus (http://repository.apache.org/snapshots) cause : Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-components-api:jar:4.3.0-SNAPSHOT: Could not find artifact org.apache.cloudstack:cloud-framework-config:jar:4.3.0-SNAPSHOT in Nexus (http://repository.apache.org/snapshots) Thanks, Dave. On Thu, Aug 8, 2013 at 3:53 PM, Dave Cahill dcah...@midokura.com wrote: Hi, I'm seeing a build failure with master - I've checked the usual gotchas, but this seems to be something else. Possibly related to the 4.2.0 to 4.3.0 update? The missing dependency is cloud-engine-compute. It's listed as a dependency in engine/service/pom.xml with no type specified, which AFAIK defaults to jar. So my understanding is that it's trying to download version 4.3.0-SNAPSHOT of the cloud-engine-compute jar from repository.apache.org. How does the jar get uploaded there in the first place? Maybe that's a step we missed when witching from 4.2.0 to 4.3.0? Here's what I ran: # Nuke my local maven cache $ rm -rf ~/.m2/repository # Get latest master $ git pull # Clean any files hanging around my git working copy just in case $ git clean -dxf # Build $ mvn clean install -P developer,systemvm -DskipTests Here's the error I got: [ERROR] Failed to execute goal on project cloud-engine-service: Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-service:war:4.3.0-SNAPSHOT: Failure to find org.apache.cloudstack:cloud-engine-compute:jar:4.3.0-SNAPSHOT in http://repository.apache.org/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots has elapsed or updates are forced - [Help 1] Thanks, Dave. -- Prasanna., Powered by BigRock.com -- Prasanna., Powered by BigRock.com
RE: 2013-08-01 Japanese CloudStack Community Weekly Update
We started to post Japanese CloudStack Community Weekly Update. # # # # New board member Satoru Nakaya: VMware expert. He helps to answer question posted in us...@cloudstack.jp. He is also publishing CloudStack and VMware corroboration information Takuma Nakajima: He helps lots of CloudStack events and key member of the evaluation project for Ceph and CloudStack. # Next board meeting 8/9 18:00 at Creationline # Projects ## Globalization (L10n / i18n) (led by Chiba san and Shimazaki san) Chiba san is mainly working for 4.2 localization ## Develop OSS Cloud Certification LPI Japan is very positive to build new certification, OSS Cloud based on Apache CloudStack. LPI Japan almost agreed. Final decision will be done by the middle of August. ## 4.1 / 4.2 evaluation project (led by Oge san from JCSUG)) # Project page: http://180.37.182.53/projects/cloudstack4-1-pj # Theme a : Support for EC2 Query API b : Resize Volumes Feature c : Added Region Support d : Auto-Completing Shell for CloudStack, API Discovery Service e : Persistent Networks without Running VM, Add/Remove Network on VM f : API Request Throttling g : Support Inline Mode for F5 and SRX h : AutoScale i : The Upgrade evaluation from old version j : Events Framework k : L3 Router Functionality in Nicira NVP Plugin l : S3 Backed Secondary Storage m : User and Domain Admin Can Create API Key and Secret, Egress Firewall Rules for Guest Networks, Reset SSH Key to Access VM n : Cloudstack Ceph RBD Setup# Media communications / Books # CloudStack book (from Shoueisha): Published on 2013/01/29 Printed: 1st: 3000, 2nd: 2500 Books sold by 2013/06/04 since 2013/01/29: 3087 Electric version: http://goo.gl/xISJj Created CloudStack Book digest video: http://cloudstack.jp/cloudstack%E5%BE%B9%E5%BA%95%E5%85%A5%E9%96%80 # Another CloudStack book covered 4.1(from Impress): Oge san is writing now. # CloudStack serialization at IT Media Creationline has posted 12 articles since http://www.atmarkit.co.jp/ait/kw/cloudstack_privatecloud.html since 2011/8/11 ## Event [8/2] 13th Japan CloudStack User Group Meeting in Osaka: Slideshare and Video are in http://atnd.org/events/40712. 1. CCC13 report @Creationline 2. Snapshot deep dive @Fujitsu KCN 3. Autoscale deep dive @Citrix 4. CloudStack + Ceph/RBD @Citrix 5. Other 4.1 new feature deep dive @NTT Communications 6. CloudStack LXC @Joe's Cloud Computing 7. CloudStack + Scalr / CloudStack API @Joe's Cloud Computing 8. CloudStack + Nicira @VMware 9. Multi Hypervisor operation Tips @KDDI [8/3] OSC Kyoto: JCSUG will have a session and booth. http://www.ospn.jp/osc2013-kyoto/ Created new banner and flyer. [9/12] 14th Japan CloudStack User Group Meeting in Tokoyo: Under consideration. [9/12] Cloud Show Japan: JCSUG will have a session. http://cloudshow.jp/ [9/13] JCSUG considers to have meetup at Hokkaido [9/14] OSC Hokkaido: JCSUG will have a session and booth. [9/19] Arai san will introduce CloudStack at SDN Japan [10/19, 20]: OSC Tokyo: JCSUG will have a session and booth. [11/16] OSC Fukuoka: JCSUG may have a session and booth. [2014/2/E] CloudStack Day: JCSUG started to consider CloudStack 1 day event on Feb, 2014. Not decided yet. If you have any comment, please let ad...@cloudstack.jp know. Thanks, JCSUG (Japan CloudStack User Group) Web: http://cloudstack.jp Ustream http://www.ustream.tv/channel/cloudstackja YouTube: http://www.youtube.com/channel/UCB_l4yMR2rE6VWa_H-THPWQ Twitter: @cloudstackja Facebook: https://www.facebook.com/cloudstackjapan Admin ML: ad...@cloudstack.jp User ML: us...@cloudstack.jp -Original Message- From: Kimihiko Kitase Sent: Thursday, August 01, 2013 12:00 PM To: market...@cloudstack.apache.org; dev@cloudstack.apache.org; us...@cloudstack.jp Cc: ad...@cloudstack.jp Subject: 2013-08-01 Japanese CloudStack Community Weekly Update We started to post Japanese CloudStack Community Weekly Update. # # # # New board member Tadashi Mishima: He was the member of Open Source Conference committee. And now he works for cloud implementation at major SIer in Japan. He helped CloudStack community at LinuxCon and CloudOpen Japan and had a ZABBIX and CloudStack session at OSS Monitoring study group. # Next board meeting 8/9 18:00 at Creationline # Projects ## Globalization (L10n / i18n) (led by Chiba san and Shimazaki san)
2013-08-08 Japanese CloudStack Community Weekly Update
Changed the title... -Original Message- From: Kimihiko Kitase Sent: Thursday, August 08, 2013 6:15 PM To: market...@cloudstack.apache.org; dev@cloudstack.apache.org; us...@cloudstack.apache.org Cc: 'ad...@cloudstack.jp' Subject: RE: 2013-08-01 Japanese CloudStack Community Weekly Update We started to post Japanese CloudStack Community Weekly Update. # # # # New board member Satoru Nakaya: VMware expert. He helps to answer question posted in us...@cloudstack.jp. He is also publishing CloudStack and VMware corroboration information Takuma Nakajima: He helps lots of CloudStack events and key member of the evaluation project for Ceph and CloudStack. # Next board meeting 8/9 18:00 at Creationline # Projects ## Globalization (L10n / i18n) (led by Chiba san and Shimazaki san) Chiba san is mainly working for 4.2 localization ## Develop OSS Cloud Certification LPI Japan is very positive to build new certification, OSS Cloud based on Apache CloudStack. LPI Japan almost agreed. Final decision will be done by the middle of August. ## 4.1 / 4.2 evaluation project (led by Oge san from JCSUG)) # Project page: http://180.37.182.53/projects/cloudstack4-1-pj # Theme a : Support for EC2 Query API b : Resize Volumes Feature c : Added Region Support d : Auto-Completing Shell for CloudStack, API Discovery Service e : Persistent Networks without Running VM, Add/Remove Network on VM f : API Request Throttling g : Support Inline Mode for F5 and SRX h : AutoScale i : The Upgrade evaluation from old version j : Events Framework k : L3 Router Functionality in Nicira NVP Plugin l : S3 Backed Secondary Storage m : User and Domain Admin Can Create API Key and Secret, Egress Firewall Rules for Guest Networks, Reset SSH Key to Access VM n : Cloudstack Ceph RBD Setup# Media communications / Books # CloudStack book (from Shoueisha): Published on 2013/01/29 Printed: 1st: 3000, 2nd: 2500 Books sold by 2013/06/04 since 2013/01/29: 3087 Electric version: http://goo.gl/xISJj Created CloudStack Book digest video: http://cloudstack.jp/cloudstack%E5%BE%B9%E5%BA%95%E5%85%A5%E9%96%80 # Another CloudStack book covered 4.1(from Impress): Oge san is writing now. # CloudStack serialization at IT Media Creationline has posted 12 articles since http://www.atmarkit.co.jp/ait/kw/cloudstack_privatecloud.html since 2011/8/11 ## Event [8/2] 13th Japan CloudStack User Group Meeting in Osaka: Slideshare and Video are in http://atnd.org/events/40712. 1. CCC13 report @Creationline 2. Snapshot deep dive @Fujitsu KCN 3. Autoscale deep dive @Citrix 4. CloudStack + Ceph/RBD @Citrix 5. Other 4.1 new feature deep dive @NTT Communications 6. CloudStack LXC @Joe's Cloud Computing 7. CloudStack + Scalr / CloudStack API @Joe's Cloud Computing 8. CloudStack + Nicira @VMware 9. Multi Hypervisor operation Tips @KDDI [8/3] OSC Kyoto: JCSUG will have a session and booth. http://www.ospn.jp/osc2013-kyoto/ Created new banner and flyer. [9/12] 14th Japan CloudStack User Group Meeting in Tokoyo: Under consideration. [9/12] Cloud Show Japan: JCSUG will have a session. http://cloudshow.jp/ [9/13] JCSUG considers to have meetup at Hokkaido [9/14] OSC Hokkaido: JCSUG will have a session and booth. [9/19] Arai san will introduce CloudStack at SDN Japan [10/19, 20]: OSC Tokyo: JCSUG will have a session and booth. [11/16] OSC Fukuoka: JCSUG may have a session and booth. [2014/2/E] CloudStack Day: JCSUG started to consider CloudStack 1 day event on Feb, 2014. Not decided yet. If you have any comment, please let ad...@cloudstack.jp know. Thanks, JCSUG (Japan CloudStack User Group) Web: http://cloudstack.jp Ustream http://www.ustream.tv/channel/cloudstackja YouTube: http://www.youtube.com/channel/UCB_l4yMR2rE6VWa_H-THPWQ Twitter: @cloudstackja Facebook: https://www.facebook.com/cloudstackjapan Admin ML: ad...@cloudstack.jp User ML: us...@cloudstack.jp -Original Message- From: Kimihiko Kitase Sent: Thursday, August 01, 2013 12:00 PM To: market...@cloudstack.apache.org; dev@cloudstack.apache.org; us...@cloudstack.jp Cc: ad...@cloudstack.jp Subject: 2013-08-01 Japanese CloudStack Community Weekly Update We started to post Japanese CloudStack Community Weekly Update. # # # # New board member Tadashi Mishima: He was the member of Open Source Conference committee. And now he works for cloud implementation
Review Request 13423: fix for CLOUDSTACK-2187: catalina log filled with ClassNotFoundException for snmp and syslog
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13423/ --- Review request for cloudstack, Devdeep Singh and Sateesh Chodapuneedi. Repository: cloudstack-git Description --- aswapi webapps7080 uses the same log4j-cloud.xml as other cloudstack client webapps. log4j-cloud.xml uses the snmp and syslog alerts plugin classes. Hence the java.lang.ClassNotFoundException: org.apache.cloudstack.syslog.AlertsSyslogAppender coming from awsapi webapp as those plugins are not added as dependency for awsapi. Diffs - awsapi/pom.xml 9463f24 Diff: https://reviews.apache.org/r/13423/diff/ Testing --- verfied by manually copying the plugin jars to awsapi webapp lib. Thanks, Anshul Gangwar
Review Request 13425: Update Maven repo location for MidoNet dependencies
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13425/ --- Review request for cloudstack. Repository: cloudstack-git Description --- The existing Maven repo in the POM will be unavailable soon, so I have changed it to cs-maven.midokura.com. Diffs - plugins/network-elements/midonet/pom.xml 060e8a48c635b606c10fcfdef84e37edffaff551 Diff: https://reviews.apache.org/r/13425/diff/ Testing --- Nuked local Maven cache with: rm -rf ~/.m2/repository Ran full build, successful: mvn clean install -P developer,systemvm -DskipTests Thanks, Dave Cahill
Review Request 13426: Update Maven repo location for MidoNet dependencies
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13426/ --- Review request for cloudstack and Prasanna Santhanam. Repository: cloudstack-git Description --- This is the 4.2 branch version of the change I just submitted to master The existing Maven repo in the POM will be unavailable soon, so I have changed it to cs-maven.midokura.com. Diffs - plugins/network-elements/midonet/pom.xml bfd59a9274c5764d056692afbfc27489f74f100d Diff: https://reviews.apache.org/r/13426/diff/ Testing --- Nuked local Maven cache with: rm -rf ~/.m2/repository Ran full build, successful: mvn clean install -P developer,systemvm -DskipTests Thanks, Dave Cahill
anyone please: firewall rules application
I feel I am on a ghost hunt. On Thu, Aug 8, 2013 at 10:32 AM, Daan Hoogland daan.hoogl...@gmail.com wrote: H, I noted that in some of the 4.1 versions I have been testing setting a firewall rule fails. This seems to be when a router is not fully initialized, is it? the stack trace seems to reflect this, but the error message just says Failed to create firewall rule or Failed to delete firewall rule com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply ip association, virtual router is not in the right state at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3445) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.associatePublicIP(VirtualNetworkApplianceManagerImpl.java:3272) at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.associatePublicIP(VpcVirtualNetworkApplianceManagerImpl.java:554) at com.cloud.network.element.VirtualRouterElement.applyIps(VirtualRouterElement.java:438) at com.cloud.network.NetworkManagerImpl.applyIpAssociations(NetworkManagerImpl.java:625) at com.cloud.network.NetworkManagerImpl.applyRules(NetworkManagerImpl.java:2380) at com.cloud.network.firewall.FirewallManagerImpl.applyRules(FirewallManagerImpl.java:500) at com.cloud.network.firewall.FirewallManagerImpl.applyFirewallRules(FirewallManagerImpl.java:630) at com.cloud.network.firewall.FirewallManagerImpl.applyIngressFirewallRules(FirewallManagerImpl.java:603) at org.apache.cloudstack.api.command.user.firewall.CreateFirewallRuleCmd.execute(CreateFirewallRuleCmd.java:124) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Can someone confirm my suspicion? thanks, Daan
Re: Review Request 12849: added backwards compatibility code to Networks enums
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12849/ --- (Updated Aug. 8, 2013, 11:16 a.m.) Review request for cloudstack, Chiradeep Vittal, Dave Cahill, Koushik Das, and Sheng Yang. Changes --- making extra sure to remove as much objections as possible Repository: cloudstack-git Description --- Both BroadcastDomainType and IsolationType needed some extra code for backwards compatibility Diffs (updated) - api/src/com/cloud/network/Networks.java c76c3d4 api/test/com/cloud/network/NetworksTest.java 31114e8 Diff: https://reviews.apache.org/r/12849/diff/ Testing --- Thanks, daan Hoogland
Re: Review Request 13426: Update Maven repo location for MidoNet dependencies
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13426/#review24869 --- Ship it! - Prasanna Santhanam On Aug. 8, 2013, 10:05 a.m., Dave Cahill wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13426/ --- (Updated Aug. 8, 2013, 10:05 a.m.) Review request for cloudstack and Prasanna Santhanam. Repository: cloudstack-git Description --- This is the 4.2 branch version of the change I just submitted to master The existing Maven repo in the POM will be unavailable soon, so I have changed it to cs-maven.midokura.com. Diffs - plugins/network-elements/midonet/pom.xml bfd59a9274c5764d056692afbfc27489f74f100d Diff: https://reviews.apache.org/r/13426/diff/ Testing --- Nuked local Maven cache with: rm -rf ~/.m2/repository Ran full build, successful: mvn clean install -P developer,systemvm -DskipTests Thanks, Dave Cahill
Re: Review Request 13377: CLOUDSTACK-4021: [Automation] TestExplicitDedication.test_01_deploy_vm_with_explicit_dedication failed to deploy VM
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13377/#review24870 --- Commit ac6b26ff810cd2f3a9f7de0fa7bb481dd0781be3 in branch refs/heads/master from Saksham Srivastava [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=ac6b26f ] CLOUDSTACK-4021:[Automation] TestExplicitDedication.test_01_deploy_vm_with_explicit_dedication failed to deploy VM Signed-off-by: Prasanna Santhanam t...@apache.org (cherry picked from commit 8191f5c6902b3c0d677858ef851f1eade8871d8d) - ASF Subversion and Git Services On Aug. 7, 2013, 4:18 p.m., Saksham Srivastava wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13377/ --- (Updated Aug. 7, 2013, 4:18 p.m.) Review request for cloudstack, Devdeep Singh and Prasanna Santhanam. Bugs: CLOUDSTACK-4021 Repository: cloudstack-git Description --- Test case integration.component.test_explicit_dedication.TestExplicitDedication.test_01_deploy_vm_with_explicit_dedication fails if it does not find an empty hosts. In case there is at least 1 empty host present, that host is dedicated and a vm is deployed using explicit dedication affinity group. Added check that skips the test in case there are no empty hosts found. Diffs - test/integration/component/test_explicit_dedication.py e1991ac Diff: https://reviews.apache.org/r/13377/diff/ Testing --- If there are no empty hosts present, the test returns without further dedication or deploying vms. If there is a single empty host present, the host is dedicated and vm is deployed. Thanks, Saksham Srivastava
Re: Review Request 13377: CLOUDSTACK-4021: [Automation] TestExplicitDedication.test_01_deploy_vm_with_explicit_dedication failed to deploy VM
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13377/#review24871 --- Commit 8191f5c6902b3c0d677858ef851f1eade8871d8d in branch refs/heads/4.2 from Saksham Srivastava [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=8191f5c ] CLOUDSTACK-4021:[Automation] TestExplicitDedication.test_01_deploy_vm_with_explicit_dedication failed to deploy VM Signed-off-by: Prasanna Santhanam t...@apache.org - ASF Subversion and Git Services On Aug. 7, 2013, 4:18 p.m., Saksham Srivastava wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13377/ --- (Updated Aug. 7, 2013, 4:18 p.m.) Review request for cloudstack, Devdeep Singh and Prasanna Santhanam. Bugs: CLOUDSTACK-4021 Repository: cloudstack-git Description --- Test case integration.component.test_explicit_dedication.TestExplicitDedication.test_01_deploy_vm_with_explicit_dedication fails if it does not find an empty hosts. In case there is at least 1 empty host present, that host is dedicated and a vm is deployed using explicit dedication affinity group. Added check that skips the test in case there are no empty hosts found. Diffs - test/integration/component/test_explicit_dedication.py e1991ac Diff: https://reviews.apache.org/r/13377/diff/ Testing --- If there are no empty hosts present, the test returns without further dedication or deploying vms. If there is a single empty host present, the host is dedicated and vm is deployed. Thanks, Saksham Srivastava
Re: Review Request 13377: CLOUDSTACK-4021: [Automation] TestExplicitDedication.test_01_deploy_vm_with_explicit_dedication failed to deploy VM
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13377/#review24872 --- Ship it! - Prasanna Santhanam On Aug. 7, 2013, 4:18 p.m., Saksham Srivastava wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13377/ --- (Updated Aug. 7, 2013, 4:18 p.m.) Review request for cloudstack, Devdeep Singh and Prasanna Santhanam. Bugs: CLOUDSTACK-4021 Repository: cloudstack-git Description --- Test case integration.component.test_explicit_dedication.TestExplicitDedication.test_01_deploy_vm_with_explicit_dedication fails if it does not find an empty hosts. In case there is at least 1 empty host present, that host is dedicated and a vm is deployed using explicit dedication affinity group. Added check that skips the test in case there are no empty hosts found. Diffs - test/integration/component/test_explicit_dedication.py e1991ac Diff: https://reviews.apache.org/r/13377/diff/ Testing --- If there are no empty hosts present, the test returns without further dedication or deploying vms. If there is a single empty host present, the host is dedicated and vm is deployed. Thanks, Saksham Srivastava
Re: Review Request 13377: CLOUDSTACK-4021: [Automation] TestExplicitDedication.test_01_deploy_vm_with_explicit_dedication failed to deploy VM
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13377/#review24873 --- Ship it! - Prasanna Santhanam On Aug. 7, 2013, 4:18 p.m., Saksham Srivastava wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13377/ --- (Updated Aug. 7, 2013, 4:18 p.m.) Review request for cloudstack, Devdeep Singh and Prasanna Santhanam. Bugs: CLOUDSTACK-4021 Repository: cloudstack-git Description --- Test case integration.component.test_explicit_dedication.TestExplicitDedication.test_01_deploy_vm_with_explicit_dedication fails if it does not find an empty hosts. In case there is at least 1 empty host present, that host is dedicated and a vm is deployed using explicit dedication affinity group. Added check that skips the test in case there are no empty hosts found. Diffs - test/integration/component/test_explicit_dedication.py e1991ac Diff: https://reviews.apache.org/r/13377/diff/ Testing --- If there are no empty hosts present, the test returns without further dedication or deploying vms. If there is a single empty host present, the host is dedicated and vm is deployed. Thanks, Saksham Srivastava
Re: Review Request 13375: CLOUDSTACK-4144 Make specifyVlan to false for shared network
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13375/#review24875 --- Commit f1734ed71d80055fa9749ecc13a2028fd2d103c8 in branch refs/heads/master from Girish Shilamkar [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=f1734ed ] CLOUDSTACK-4144 Make specifyVlan to false for shared network Signed-off-by: Prasanna Santhanam t...@apache.org - ASF Subversion and Git Services On Aug. 7, 2013, 12:50 p.m., Girish Shilamkar wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13375/ --- (Updated Aug. 7, 2013, 12:50 p.m.) Review request for cloudstack and Prasanna Santhanam. Bugs: CLOUDSTACK-4144 Repository: cloudstack-git Description --- CLOUDSTACK-4144 Make specifyVlan to false for shared network Diffs - test/integration/component/test_vpc_vm_life_cycle.py 9b10133 Diff: https://reviews.apache.org/r/13375/diff/ Testing --- Thanks, Girish Shilamkar
Re: Review Request 12849: added backwards compatibility code to Networks enums
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12849/ --- (Updated Aug. 8, 2013, 11:51 a.m.) Review request for cloudstack, Chiradeep Vittal, Dave Cahill, Koushik Das, and Sheng Yang. Changes --- extra description Repository: cloudstack-git Description (updated) --- Both BroadcastDomainType and IsolationType needed some extra code for backwards compatibility. All over the code calls are done to URI.getHost() to retrieve ids of broadcastdomains. These id obviously are not hosts so this call is confusing and requires maintenance all over the code base. Also for different types the value returned by getHost has different meaning. vlan://1 is id 1 of course but others might be ranges of vlans or colon separated values. To make things worse a NiciraNvp has an uri of the form lswitch:uuid without the forward slashes. To make the system more maintainable in this perspect the changes in this patch were made. It is my intention to replace the calls to getHost by the member call getValueFrom or the static method getValue in time. In this way maintenance is centralized and an overview of differnces and quirks is easily found Diffs - api/src/com/cloud/network/Networks.java c76c3d4 api/test/com/cloud/network/NetworksTest.java 31114e8 Diff: https://reviews.apache.org/r/12849/diff/ Testing (updated) --- unit tests for different kind of BroadcastDomainType.values Thanks, daan Hoogland
Re: anyone please: firewall rules application
Check the host logs (in xen /var/log/SMlog) to see which script is causing the failure. Thanks, jayapal On 08-Aug-2013, at 4:43 PM, Daan Hoogland daan.hoogl...@gmail.com wrote: I feel I am on a ghost hunt. On Thu, Aug 8, 2013 at 10:32 AM, Daan Hoogland daan.hoogl...@gmail.com wrote: H, I noted that in some of the 4.1 versions I have been testing setting a firewall rule fails. This seems to be when a router is not fully initialized, is it? the stack trace seems to reflect this, but the error message just says Failed to create firewall rule or Failed to delete firewall rule com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply ip association, virtual router is not in the right state at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3445) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.associatePublicIP(VirtualNetworkApplianceManagerImpl.java:3272) at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.associatePublicIP(VpcVirtualNetworkApplianceManagerImpl.java:554) at com.cloud.network.element.VirtualRouterElement.applyIps(VirtualRouterElement.java:438) at com.cloud.network.NetworkManagerImpl.applyIpAssociations(NetworkManagerImpl.java:625) at com.cloud.network.NetworkManagerImpl.applyRules(NetworkManagerImpl.java:2380) at com.cloud.network.firewall.FirewallManagerImpl.applyRules(FirewallManagerImpl.java:500) at com.cloud.network.firewall.FirewallManagerImpl.applyFirewallRules(FirewallManagerImpl.java:630) at com.cloud.network.firewall.FirewallManagerImpl.applyIngressFirewallRules(FirewallManagerImpl.java:603) at org.apache.cloudstack.api.command.user.firewall.CreateFirewallRuleCmd.execute(CreateFirewallRuleCmd.java:124) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Can someone confirm my suspicion? thanks, Daan
Re: Comment about Data Disk Offering when creating a VM from an ISO
The JIRA ticket is: https://issues.apache.org/jira/browse/CLOUDSTACK-4164 --- Yu-Heng (Ryan) Lei, Associate Reasearcher Chunghwa Telecom Laboratories / Cloud Computing Laboratory ryan...@cht.com.twhttps://email.cht.com.tw/owa/redir.aspx?C=-wE1FEC3G0SWYpVkiWo8SsDdf3ZqO9AIuAPTzRnFYCUi-z4YljtI_hyVKkNHfn9F1Bn-vUWJnQ4.URL=mailto%3aryanlei%40cht.com.tw or ryanlei750...@gmail.com On Thu, Aug 8, 2013 at 5:17 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: I went ahead and logged a JIRA ticket for this issue. On Wed, Aug 7, 2013 at 10:14 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: That sounds reasonable to me. Do you know if a bug exists for this or perhaps I should create one? On Wed, Aug 7, 2013 at 2:03 AM, Ryan Lei ryan...@cht.com.tw wrote: I noticed this issue long ago, and I agree with you. In my understanding, while the tab in the VM wizard always says Data Disk Offering, if you create a VM using ISO, this step actually means Root Disk Offering. If this is the case, the tab name should depend on whether the user chooses Select Template (Data Disk Offering) or Select ISO (Root Disk Offering). --- Yu-Heng (Ryan) Lei, Associate Reasearcher Chunghwa Telecom Laboratories / Cloud Computing Laboratory ryan...@cht.com.tw https://email.cht.com.tw/owa/redir.aspx?C=-wE1FEC3G0SWYpVkiWo8SsDdf3ZqO9AIuAPTzRnFYCUi-z4YljtI_hyVKkNHfn9F1Bn-vUWJnQ4.URL=mailto%3aryanlei%40cht.com.tw or ryanlei750...@gmail.com On Wed, Aug 7, 2013 at 9:12 AM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Hi, I noticed while creating a VM from an ISO today that I am taken to a page in the wizard that talks about a Data Disk Offering. It seems a bit confusing to me because I don't actually get a data disk once the wizard has spun up the VM. This Data Disk Offering page is displayed to collect data regarding the size of the root disk the VM will have. Any thoughts on this? Is this a known issue or should I log a bug? Thanks! -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloudhttp://solidfire.com/solution/overview/?video=play *™* -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play *™* -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloudhttp://solidfire.com/solution/overview/?video=play *™*
RE: [ACS 42] Disk Read Write Rate (BPS/IOPS) options while creating Compute Offering
Thanks Wido. Regards, Sailaja.M -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: Thursday, August 08, 2013 4:33 PM To: dev@cloudstack.apache.org Subject: Re: [ACS 42] Disk Read Write Rate (BPS/IOPS) options while creating Compute Offering On 08/08/2013 12:18 PM, Sailaja Mada wrote: Hi, This is the observation while creating Compute Offering with 4.2 . We have additional fields like Disk Read Write Rate (BPS/IOPS) . I am not sure how relevant they are with Compute offering. These are observed again with Disk offering if QOS Type is selected as hypervisor . I think it is for deploying from a template, just like you can add storage tags to a compute offering. When deploying from a template rather then a ISO you can't select a disk offering for the root disk. Wido Can you please clarify this. Thanks, Sailaja.M
Re: Review Request 13001: Automation: Adding test cases for CPU limits from Limit Resources.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13001/ --- (Updated Aug. 8, 2013, 12:51 p.m.) Review request for cloudstack, Girish Shilamkar, sailaja mada, Sanjay Tripathi, and Prasanna Santhanam. Changes --- Updated CPU limit resources tests as per review. Repository: cloudstack-git Description --- Adding test cases for CPU limits from Limit Resources. Marvin changes have to be picked up from Memory Limits patch (https://reviews.apache.org/r/11626/). Those are not included in this patch. Diffs (updated) - test/integration/component/cpu_limits/test_cpu_limits.py PRE-CREATION test/integration/component/cpu_limits/test_domain_limits.py PRE-CREATION test/integration/component/cpu_limits/test_maximum_limits.py PRE-CREATION test/integration/component/cpu_limits/test_project_limits.py PRE-CREATION tools/marvin/marvin/integration/lib/base.py b5d086b tools/marvin/marvin/integration/lib/common.py 4f5acef Diff: https://reviews.apache.org/r/13001/diff/ Testing --- Thanks, Gaurav Aradhye
Re: Review Request 13001: Automation: Adding test cases for CPU limits from Limit Resources.
On July 31, 2013, 6:08 a.m., Sanjay Tripathi wrote: test/integration/component/cpu_limits/test_cpu_limits.py, line 216 https://reviews.apache.org/r/13001/diff/2/?file=330095#file330095line216 This test should be of assigning VM to other account and not of Migrating VM, because assigning VM to other account changes the resource count for both the accounts, on the other hand, migrate VM to other host will not affect any count because VM still belongs to the same account. Hi Sanjay, This test verifies the same according to test scenario that the resource count should not change after migrating. Will add new test case for assigning VM on top of this. - Gaurav --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13001/#review24321 --- On Aug. 8, 2013, 12:51 p.m., Gaurav Aradhye wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13001/ --- (Updated Aug. 8, 2013, 12:51 p.m.) Review request for cloudstack, Girish Shilamkar, sailaja mada, Sanjay Tripathi, and Prasanna Santhanam. Repository: cloudstack-git Description --- Adding test cases for CPU limits from Limit Resources. Marvin changes have to be picked up from Memory Limits patch (https://reviews.apache.org/r/11626/). Those are not included in this patch. Diffs - test/integration/component/cpu_limits/test_cpu_limits.py PRE-CREATION test/integration/component/cpu_limits/test_domain_limits.py PRE-CREATION test/integration/component/cpu_limits/test_maximum_limits.py PRE-CREATION test/integration/component/cpu_limits/test_project_limits.py PRE-CREATION tools/marvin/marvin/integration/lib/base.py b5d086b tools/marvin/marvin/integration/lib/common.py 4f5acef Diff: https://reviews.apache.org/r/13001/diff/ Testing --- Thanks, Gaurav Aradhye
RE: [jira] [Commented] (CLOUDSTACK-4179) [Performance Testing] Time taken for Deploy VM async job to complete is considerably higher
The increase in deployVM time is due to the dedicated resources feature. I have updated the issue with my analysis. Need some inputs from the original devs. -Koushik -Original Message- From: Koushik Das (JIRA) [mailto:j...@apache.org] Sent: Thursday, August 08, 2013 6:37 PM To: cloudstack-iss...@incubator.apache.org Subject: [jira] [Commented] (CLOUDSTACK-4179) [Performance Testing] Time taken for Deploy VM async job to complete is considerably higher [ https://issues.apache.org/jira/browse/CLOUDSTACK- 4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment- tabpanelfocusedCommentId=13733464#comment-13733464 ] Koushik Das commented on CLOUDSTACK-4179: - The fix is to optimize the following code in checkForNonDedicatedResources(). Also I am not sure why it gets called twice during a VM deployment (have debugged through the code). Need to check with the developer for dedicated resources. ListHostPodVO podsInDc = _podDao.listByDataCenterId(dc.getId()); for (HostPodVO pod : podsInDc) { DedicatedResourceVO dedicatedPod = _dedicatedDao.findByPodId(pod.getId()); if (dedicatedPod != null) { avoids.addPod(dedicatedPod.getPodId()); if (s_logger.isDebugEnabled()) { s_logger.debug(Cannot use this dedicated pod + pod.getName() + .); } } } ListClusterVO clusterInDc = _clusterDao.listClustersByDcId(dc.getId()); for (ClusterVO cluster : clusterInDc) { DedicatedResourceVO dedicatedCluster = _dedicatedDao.findByClusterId(cluster.getId()); if (dedicatedCluster != null) { avoids.addCluster(dedicatedCluster.getClusterId()); if (s_logger.isDebugEnabled()) { s_logger.debug(Cannot use this dedicated Cluster + cluster.getName() + .); } } } ListHostVO hostInDc = _hostDao.listByDataCenterId(dc.getId()); for (HostVO host : hostInDc) { DedicatedResourceVO dedicatedHost = _dedicatedDao.findByHostId(host.getId()); if (dedicatedHost != null) { avoids.addHost(dedicatedHost.getHostId()); if (s_logger.isDebugEnabled()) { s_logger.debug(Cannot use this dedicated host + host.getName() + .); } } } [Performance Testing] Time taken for Deploy VM async job to complete is considerably higher -- - Key: CLOUDSTACK-4179 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4179 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.2.0 Environment: Simulated VMs and hosts, advanced zone, RVR Reporter: Sowmya Krishnan Assignee: Koushik Das Priority: Critical Fix For: 4.2.0 Attachments: async_job_time.out, job-109.log Following setup is used to create performance test bed: Advanced zone, 2 Management Servers, 124 Pods [Each Pod having 2 Clusters] 248 Clusters [Each cluster having 8 hosts and one primary storage] 2000 Hosts 4000 User accounts [Each account having one network] ~8000 Virtual Routers Following config parameters were used in both the management servers - Java heap size = 5 GB - db.cloud.maxActive = 250 - db.cloud.url.params=prepStmtCacheSize=517cachePrepStmts=trueprepS tmt CacheSqlLimit=4096includeInnodbStatusInDeadlockExceptions=truelogSlo wQueries=true Tried deploying around 4000 Simulator VMs across 4K accounts. Noticing considerably higher time for deploy VM async job to complete as compared to baseline results. Some of the Baseline results are documented here: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Baseline+Report s+for+Pre-4.x+Performance+Runs On an average, it is now taking 70-80 seconds for deployVM to complete as compared to 10-15 seconds earlier. From the logs, it appears in some cases, DeploymentPlanningManager takes time to kick in.: 2013-08-07 01:52:09,785 DEBUG [cloud.network.NetworkModelImpl] (Job-Executor-105:job-109 = [ 19ccfecb-c815-497a-9ff1-70d590025af3 ]) Service SecurityGroup is not supported in the network id=304 2013-08-07 01:52:37,288 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-105:job- 109 = [ 19ccfecb-c815-497a-9ff1-70d590025af3 ]) Deploy avoids pods: null, clusters: null, hosts: null ... ... 2013-08-07 01:52:41,199 DEBUG
Re: 4.1.1 Build issue for CentOS - errors on AWSAPI depenencies
On Thu, Aug 08, 2013 at 12:06:16PM +0530, Amit Das wrote: Hi, Do we have any workaround for this issue ? Regards, Amit *CloudByte Inc.* http://www.cloudbyte.com/ Since I didn't have time to figure out what was going wrong, I copied the missing jars from another machine into my .m2/repository folder. Not ideal, but it worked as a workaround. On Mon, Aug 5, 2013 at 11:55 PM, Chip Childers chip.child...@sungard.comwrote: Hi all, Trying to build 4.1.1 into the appropriate RPMs, and I'm hitting the following error during the process. Any clues / ideas? I've cleaned our ~/.m2/repository and tried again, but same issue. [INFO] Apache CloudStack AWS API Bridge .. FAILURE [55.762s] [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 5:14.484s [INFO] Finished at: Mon Aug 05 19:20:34 IST 2013 [INFO] Final Memory: 47M/206M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project cloud-awsapi: Compilation failure: Compilation failure: [ERROR] error: error reading /home/sg-user/.m2/repository/org/apache/axis2/mex/1.5.4/mex-1.5.4-impl.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/org/apache/axis2/axis2-mtompolicy/1.5.4/axis2-mtompolicy-1.5.4.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/org/apache/ws/commons/axiom/axiom-dom/1.2.10/axiom-dom-1.2.10.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/org/opensaml/opensaml1/1.1/opensaml1-1.1.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/commons-lang/commons-lang/2.3/commons-lang-2.3.jar; error in opening zip file [ERROR] - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :cloud-awsapi
RE: [jira] [Commented] (CLOUDSTACK-4179) [Performance Testing] Time taken for Deploy VM async job to complete is considerably higher
Hi Koushik, I have updated the bug with my comments. We don't have to loop through resources and check them one at a time. We need to run a better query and add all the dedicated resources to the avoid set. Regards, Devdeep -Original Message- From: Koushik Das Sent: Thursday, August 08, 2013 6:40 PM To: dev@cloudstack.apache.org; cloudstack-iss...@incubator.apache.org Cc: Devdeep Singh; Prachi Damle Subject: RE: [jira] [Commented] (CLOUDSTACK-4179) [Performance Testing] Time taken for Deploy VM async job to complete is considerably higher The increase in deployVM time is due to the dedicated resources feature. I have updated the issue with my analysis. Need some inputs from the original devs. -Koushik -Original Message- From: Koushik Das (JIRA) [mailto:j...@apache.org] Sent: Thursday, August 08, 2013 6:37 PM To: cloudstack-iss...@incubator.apache.org Subject: [jira] [Commented] (CLOUDSTACK-4179) [Performance Testing] Time taken for Deploy VM async job to complete is considerably higher [ https://issues.apache.org/jira/browse/CLOUDSTACK- 4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment- tabpanelfocusedCommentId=13733464#comment-13733464 ] Koushik Das commented on CLOUDSTACK-4179: - The fix is to optimize the following code in checkForNonDedicatedResources(). Also I am not sure why it gets called twice during a VM deployment (have debugged through the code). Need to check with the developer for dedicated resources. ListHostPodVO podsInDc = _podDao.listByDataCenterId(dc.getId()); for (HostPodVO pod : podsInDc) { DedicatedResourceVO dedicatedPod = _dedicatedDao.findByPodId(pod.getId()); if (dedicatedPod != null) { avoids.addPod(dedicatedPod.getPodId()); if (s_logger.isDebugEnabled()) { s_logger.debug(Cannot use this dedicated pod + pod.getName() + .); } } } ListClusterVO clusterInDc = _clusterDao.listClustersByDcId(dc.getId()); for (ClusterVO cluster : clusterInDc) { DedicatedResourceVO dedicatedCluster = _dedicatedDao.findByClusterId(cluster.getId()); if (dedicatedCluster != null) { avoids.addCluster(dedicatedCluster.getClusterId()); if (s_logger.isDebugEnabled()) { s_logger.debug(Cannot use this dedicated Cluster + cluster.getName() + .); } } } ListHostVO hostInDc = _hostDao.listByDataCenterId(dc.getId()); for (HostVO host : hostInDc) { DedicatedResourceVO dedicatedHost = _dedicatedDao.findByHostId(host.getId()); if (dedicatedHost != null) { avoids.addHost(dedicatedHost.getHostId()); if (s_logger.isDebugEnabled()) { s_logger.debug(Cannot use this dedicated host + host.getName() + .); } } } [Performance Testing] Time taken for Deploy VM async job to complete is considerably higher -- - Key: CLOUDSTACK-4179 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4179 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.2.0 Environment: Simulated VMs and hosts, advanced zone, RVR Reporter: Sowmya Krishnan Assignee: Koushik Das Priority: Critical Fix For: 4.2.0 Attachments: async_job_time.out, job-109.log Following setup is used to create performance test bed: Advanced zone, 2 Management Servers, 124 Pods [Each Pod having 2 Clusters] 248 Clusters [Each cluster having 8 hosts and one primary storage] 2000 Hosts 4000 User accounts [Each account having one network] ~8000 Virtual Routers Following config parameters were used in both the management servers - Java heap size = 5 GB - db.cloud.maxActive = 250 - db.cloud.url.params=prepStmtCacheSize=517cachePrepStmts=trueprepS tmt CacheSqlLimit=4096includeInnodbStatusInDeadlockExceptions=truelogSlo wQueries=true Tried deploying around 4000 Simulator VMs across 4K accounts. Noticing considerably higher time for deploy VM async job to complete as compared to baseline results. Some of the Baseline results are documented here: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Baseline+Report
Review Request 13431: CLOUDSTACK-3842: G11N: SC: Some regression issues occurred on build#4.2-256.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13431/ --- Review request for cloudstack and Devdeep Singh. Bugs: CLOUDSTACK-3842 Repository: cloudstack-git Description --- CLOUDSTACK-3842: G11N: SC: Some regression issues occurred on build#4.2-256. https://issues.apache.org/jira/browse/CLOUDSTACK-3842 Diffs - client/WEB-INF/classes/resources/messages_ja.properties 0c61c13 client/WEB-INF/classes/resources/messages_zh_CN.properties 496c2e9 Diff: https://reviews.apache.org/r/13431/diff/ Testing --- Thanks, Sanjay Tripathi
Re: Review Request 13431: CLOUDSTACK-3842: G11N: SC: Some regression issues occurred on build#4.2-256.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13431/ --- (Updated Aug. 8, 2013, 1:56 p.m.) Review request for cloudstack, Brian Federle and Devdeep Singh. Changes --- Adding Brian. Bugs: CLOUDSTACK-3842 Repository: cloudstack-git Description --- CLOUDSTACK-3842: G11N: SC: Some regression issues occurred on build#4.2-256. https://issues.apache.org/jira/browse/CLOUDSTACK-3842 Diffs - client/WEB-INF/classes/resources/messages_ja.properties 0c61c13 client/WEB-INF/classes/resources/messages_zh_CN.properties 496c2e9 Diff: https://reviews.apache.org/r/13431/diff/ Testing --- Thanks, Sanjay Tripathi
Re: Review Request 13223: (CLOUDSTACK-2729) use file lock to prevent concurrent refreshPool/deleteVolume on KVM shared storage pool
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13223/#review24880 --- Commit b2ed632396fb57fedd7f88d36408299167f963c0 in branch refs/heads/master from Wei Zhou [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=b2ed632 ] CLOUDSTACK-2729: use spd.getTargetPath instead of mount path to fix issue on local storage - ASF Subversion and Git Services On Aug. 5, 2013, 6:07 p.m., Wei Zhou wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13223/ --- (Updated Aug. 5, 2013, 6:07 p.m.) Review request for cloudstack, edison su and Wido den Hollander. Bugs: CLOUDSTACK-2729 Repository: cloudstack-git Description --- The storage pool issue (CLOUDSTACK-2729) is because of a bug in libvirt (https://bugzilla.redhat.com/show_bug.cgi?id=977706) We need to prevent deleting a volume when refreshing the pool. This patch use a simple file lock to implement it. PS: I have tested another file lock similar to Read/Write file lock, but it was very unstable. Diffs - plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/storage/LibvirtStorageAdaptor.java b8a9f0f Diff: https://reviews.apache.org/r/13223/diff/ Testing --- Applied on 4.0.2 and 4.0.1 Testing On 4.0.1 From 20,June 3 nodes, create a VM on each node every 15 minutes. Destroy the VMs 5 minutes later. expunge.inteval = 600 (10 minutes), expunge.worker = 2 Testing On 4.0.2 From 01,July 2 nodes, create two VMs on each node every 5 minutes. Destroy the VMs 4 minutes later. expunge.inteval = 600 (10 minutes), expunge.worker = 2 Thanks, Wei Zhou
Re: Review Request 13223: (CLOUDSTACK-2729) use file lock to prevent concurrent refreshPool/deleteVolume on KVM shared storage pool
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13223/#review24881 --- Commit ea50c6663fcff4b166fc43cb652638e3c1080c64 in branch refs/heads/4.2 from Wei Zhou [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=ea50c66 ] CLOUDSTACK-2729: use spd.getTargetPath instead of mount path to fix issue on local storage (cherry picked from commit b2ed632396fb57fedd7f88d36408299167f963c0) - ASF Subversion and Git Services On Aug. 5, 2013, 6:07 p.m., Wei Zhou wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13223/ --- (Updated Aug. 5, 2013, 6:07 p.m.) Review request for cloudstack, edison su and Wido den Hollander. Bugs: CLOUDSTACK-2729 Repository: cloudstack-git Description --- The storage pool issue (CLOUDSTACK-2729) is because of a bug in libvirt (https://bugzilla.redhat.com/show_bug.cgi?id=977706) We need to prevent deleting a volume when refreshing the pool. This patch use a simple file lock to implement it. PS: I have tested another file lock similar to Read/Write file lock, but it was very unstable. Diffs - plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/storage/LibvirtStorageAdaptor.java b8a9f0f Diff: https://reviews.apache.org/r/13223/diff/ Testing --- Applied on 4.0.2 and 4.0.1 Testing On 4.0.1 From 20,June 3 nodes, create a VM on each node every 15 minutes. Destroy the VMs 5 minutes later. expunge.inteval = 600 (10 minutes), expunge.worker = 2 Testing On 4.0.2 From 01,July 2 nodes, create two VMs on each node every 5 minutes. Destroy the VMs 4 minutes later. expunge.inteval = 600 (10 minutes), expunge.worker = 2 Thanks, Wei Zhou
Re: Review Request 13223: (CLOUDSTACK-2729) use file lock to prevent concurrent refreshPool/deleteVolume on KVM shared storage pool
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13223/#review24882 --- Commit 630d2561d2b13882892799507613823bcc04b4ac in branch refs/heads/4.1 from Wei Zhou [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=630d256 ] CLOUDSTACK-2729: use spd.getTargetPath instead of mount path to fix issue on local storage (cherry picked from commit b2ed632396fb57fedd7f88d36408299167f963c0) - ASF Subversion and Git Services On Aug. 5, 2013, 6:07 p.m., Wei Zhou wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13223/ --- (Updated Aug. 5, 2013, 6:07 p.m.) Review request for cloudstack, edison su and Wido den Hollander. Bugs: CLOUDSTACK-2729 Repository: cloudstack-git Description --- The storage pool issue (CLOUDSTACK-2729) is because of a bug in libvirt (https://bugzilla.redhat.com/show_bug.cgi?id=977706) We need to prevent deleting a volume when refreshing the pool. This patch use a simple file lock to implement it. PS: I have tested another file lock similar to Read/Write file lock, but it was very unstable. Diffs - plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/storage/LibvirtStorageAdaptor.java b8a9f0f Diff: https://reviews.apache.org/r/13223/diff/ Testing --- Applied on 4.0.2 and 4.0.1 Testing On 4.0.1 From 20,June 3 nodes, create a VM on each node every 15 minutes. Destroy the VMs 5 minutes later. expunge.inteval = 600 (10 minutes), expunge.worker = 2 Testing On 4.0.2 From 01,July 2 nodes, create two VMs on each node every 5 minutes. Destroy the VMs 4 minutes later. expunge.inteval = 600 (10 minutes), expunge.worker = 2 Thanks, Wei Zhou
Re: 4.1.1 Build issue for CentOS - errors on AWSAPI depenencies
We downloaded the RPMs from the mirror site got the installation done. Regards, Amit *CloudByte Inc.* http://www.cloudbyte.com/ On Thu, Aug 8, 2013 at 6:42 PM, Chip Childers chip.child...@sungard.comwrote: On Thu, Aug 08, 2013 at 12:06:16PM +0530, Amit Das wrote: Hi, Do we have any workaround for this issue ? Regards, Amit *CloudByte Inc.* http://www.cloudbyte.com/ Since I didn't have time to figure out what was going wrong, I copied the missing jars from another machine into my .m2/repository folder. Not ideal, but it worked as a workaround. On Mon, Aug 5, 2013 at 11:55 PM, Chip Childers chip.child...@sungard.comwrote: Hi all, Trying to build 4.1.1 into the appropriate RPMs, and I'm hitting the following error during the process. Any clues / ideas? I've cleaned our ~/.m2/repository and tried again, but same issue. [INFO] Apache CloudStack AWS API Bridge .. FAILURE [55.762s] [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 5:14.484s [INFO] Finished at: Mon Aug 05 19:20:34 IST 2013 [INFO] Final Memory: 47M/206M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project cloud-awsapi: Compilation failure: Compilation failure: [ERROR] error: error reading /home/sg-user/.m2/repository/org/apache/axis2/mex/1.5.4/mex-1.5.4-impl.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/org/apache/axis2/axis2-mtompolicy/1.5.4/axis2-mtompolicy-1.5.4.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/org/apache/ws/commons/axiom/axiom-dom/1.2.10/axiom-dom-1.2.10.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/org/opensaml/opensaml1/1.1/opensaml1-1.1.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/commons-lang/commons-lang/2.3/commons-lang-2.3.jar; error in opening zip file [ERROR] - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :cloud-awsapi
RE: Master build failure
Yup. That was the reason why it worked on my machine but doesn't work on jenkins. It had a copy of the jar in the local maven cache so it continued to build even though it's missing. Thanks for reverting. Will fix. I still don't understand why we have problems with Gerrit. It would have prevented exactly this type of problems. I know a lot of people are busy on 4.2. Will bring it up post 4.2 again. --Alex From: Dave Cahill [mailto:dcah...@midokura.com] Sent: Thursday, August 8, 2013 3:45 AM To: dev@cloudstack.apache.org; Dave Cahill; Alex Huang Subject: Re: Master build failure Thanks Prasanna. One suggestion I have is that if anyone makes pom file changes (or any large changes at all, to be honest), that they nuke their local Maven cache (rm -rf ~/.m2/repository) and do a clean install before submitting a patch. This way, you don't end up thinking your work builds when it just happens to build due to leftover, cached jars. Alex, do you have any ideas on build stability? There have been 2 build breakages in the past few days (ref: compile error on 4.2 thread), and looking at git log I don't see much sign of review on the changes. We discussed Gerrit a while back, but I think the conclusion was that it would slow us down? Thanks, Dave. On Thu, Aug 8, 2013 at 6:13 PM, Prasanna Santhanam t...@apache.orgmailto:t...@apache.org wrote: Reverted the range 30c33415..f6a2c817bc. Master builds now. Others who've checked in after these will still retain their commits but please build before push. It's clear we are only worried about 4.2 now but we are breaking master for those who are beginning to work ahead for 4.3 On Thu, Aug 08, 2013 at 02:15:58PM +0530, Prasanna Santhanam wrote: Dave's been attempting to fix this and it looks to be intertwined in a few commits. Large swaths of code has moved around. I'll revert to last known state from Jenkins if we can't figure out a simple fix so Dave can proceed. On Thu, Aug 08, 2013 at 04:11:36PM +0900, Dave Cahill wrote: Hi, As Prasanna noted in IRC, the cloudstack-master-maven Jenkins build is failing with a similar error: https://builds.apache.org/job/cloudstack-master-maven/2645/console Failed to execute goal on project cloud-engine-components-api: Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-components-api:jar:4.3.0-SNAPSHOT: Could not find artifact org.apache.cloudstack:cloud-framework-config:jar:4.3.0-SNAPSHOT in Nexus (http://repository.apache.org/snapshots) cause : Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-components-api:jar:4.3.0-SNAPSHOT: Could not find artifact org.apache.cloudstack:cloud-framework-config:jar:4.3.0-SNAPSHOT in Nexus (http://repository.apache.org/snapshots) Thanks, Dave. On Thu, Aug 8, 2013 at 3:53 PM, Dave Cahill dcah...@midokura.commailto:dcah...@midokura.com wrote: Hi, I'm seeing a build failure with master - I've checked the usual gotchas, but this seems to be something else. Possibly related to the 4.2.0 to 4.3.0 update? The missing dependency is cloud-engine-compute. It's listed as a dependency in engine/service/pom.xml with no type specified, which AFAIK defaults to jar. So my understanding is that it's trying to download version 4.3.0-SNAPSHOT of the cloud-engine-compute jar from repository.apache.orghttp://repository.apache.org. How does the jar get uploaded there in the first place? Maybe that's a step we missed when witching from 4.2.0 to 4.3.0? Here's what I ran: # Nuke my local maven cache $ rm -rf ~/.m2/repository # Get latest master $ git pull # Clean any files hanging around my git working copy just in case $ git clean -dxf # Build $ mvn clean install -P developer,systemvm -DskipTests Here's the error I got: [ERROR] Failed to execute goal on project cloud-engine-service: Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-service:war:4.3.0-SNAPSHOT: Failure to find org.apache.cloudstack:cloud-engine-compute:jar:4.3.0-SNAPSHOT in http://repository.apache.org/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots has elapsed or updates are forced - [Help 1] Thanks, Dave. -- Prasanna., Powered by BigRock.com -- Prasanna., Powered by BigRock.com
integrate VMware vShield as SecurityGroup in Cloudstack?
hi, is there any plan to integrate VMware vShield as Security Group in Cloudstack? or any suggestion to develop this feature to work with Cloudstack? any suggestion will be appreciated!thanks. -- Thanks, Jijun
RE: anyone please: firewall rules application
Hi Daan, Here's a bit of background to logs Jayapal is referring to: http://dlafferty.blogspot.co.uk/2013/08/using-cloudstacks-log-files-xenserver.html It explains why there is a second set of logs on the XenServer hypervisor. DL -Original Message- From: Jayapal Reddy Uradi [mailto:jayapalreddy.ur...@citrix.com] Sent: 08 August 2013 12:55 To: dev@cloudstack.apache.org Subject: Re: anyone please: firewall rules application Check the host logs (in xen /var/log/SMlog) to see which script is causing the failure. Thanks, jayapal On 08-Aug-2013, at 4:43 PM, Daan Hoogland daan.hoogl...@gmail.com wrote: I feel I am on a ghost hunt. On Thu, Aug 8, 2013 at 10:32 AM, Daan Hoogland daan.hoogl...@gmail.com wrote: H, I noted that in some of the 4.1 versions I have been testing setting a firewall rule fails. This seems to be when a router is not fully initialized, is it? the stack trace seems to reflect this, but the error message just says Failed to create firewall rule or Failed to delete firewall rule com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply ip association, virtual router is not in the right state at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRule s(VirtualNetworkApplianceManagerImpl.java:3445) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.associate PublicIP(VirtualNetworkApplianceManagerImpl.java:3272) at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.associ atePublicIP(VpcVirtualNetworkApplianceManagerImpl.java:554) at com.cloud.network.element.VirtualRouterElement.applyIps(VirtualRouter Element.java:438) at com.cloud.network.NetworkManagerImpl.applyIpAssociations(NetworkMan ag erImpl.java:625) at com.cloud.network.NetworkManagerImpl.applyRules(NetworkManagerImpl .ja va:2380) at com.cloud.network.firewall.FirewallManagerImpl.applyRules(FirewallMan agerImpl.java:500) at com.cloud.network.firewall.FirewallManagerImpl.applyFirewallRules(Fir ewallManagerImpl.java:630) at com.cloud.network.firewall.FirewallManagerImpl.applyIngressFirewallRu les(FirewallManagerImpl.java:603) at org.apache.cloudstack.api.command.user.firewall.CreateFirewallRuleCmd .execute(CreateFirewallRuleCmd.java:124) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:4 3 7) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Can someone confirm my suspicion? thanks, Daan
Re: anyone please: firewall rules application
Thanks Donal, I found my ghost. Onward into the night :) On Thu, Aug 8, 2013 at 5:05 PM, Donal Lafferty donal.laffe...@citrix.com wrote: Hi Daan, Here's a bit of background to logs Jayapal is referring to: http://dlafferty.blogspot.co.uk/2013/08/using-cloudstacks-log-files-xenserver.html It explains why there is a second set of logs on the XenServer hypervisor. DL -Original Message- From: Jayapal Reddy Uradi [mailto:jayapalreddy.ur...@citrix.com] Sent: 08 August 2013 12:55 To: dev@cloudstack.apache.org Subject: Re: anyone please: firewall rules application Check the host logs (in xen /var/log/SMlog) to see which script is causing the failure. Thanks, jayapal On 08-Aug-2013, at 4:43 PM, Daan Hoogland daan.hoogl...@gmail.com wrote: I feel I am on a ghost hunt. On Thu, Aug 8, 2013 at 10:32 AM, Daan Hoogland daan.hoogl...@gmail.com wrote: H, I noted that in some of the 4.1 versions I have been testing setting a firewall rule fails. This seems to be when a router is not fully initialized, is it? the stack trace seems to reflect this, but the error message just says Failed to create firewall rule or Failed to delete firewall rule com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply ip association, virtual router is not in the right state at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRule s(VirtualNetworkApplianceManagerImpl.java:3445) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.associate PublicIP(VirtualNetworkApplianceManagerImpl.java:3272) at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.associ atePublicIP(VpcVirtualNetworkApplianceManagerImpl.java:554) at com.cloud.network.element.VirtualRouterElement.applyIps(VirtualRouter Element.java:438) at com.cloud.network.NetworkManagerImpl.applyIpAssociations(NetworkMan ag erImpl.java:625) at com.cloud.network.NetworkManagerImpl.applyRules(NetworkManagerImpl .ja va:2380) at com.cloud.network.firewall.FirewallManagerImpl.applyRules(FirewallMan agerImpl.java:500) at com.cloud.network.firewall.FirewallManagerImpl.applyFirewallRules(Fir ewallManagerImpl.java:630) at com.cloud.network.firewall.FirewallManagerImpl.applyIngressFirewallRu les(FirewallManagerImpl.java:603) at org.apache.cloudstack.api.command.user.firewall.CreateFirewallRuleCmd .execute(CreateFirewallRuleCmd.java:124) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:4 3 7) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Can someone confirm my suspicion? thanks, Daan
Re: Review Request 12098: Add PCI Passthrough to CloudStack on KVM Hypervisor
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12098/ --- (Updated Aug. 8, 2013, 3:44 p.m.) Review request for cloudstack. Changes --- Rebased on master Repository: cloudstack-git Description --- This patch adds PCI Passthrough support to CloudStack on the KVM Hypervisor as previously mentioned on the mailing list PCI Passthrough may be useful for high-performance networking devices or other hardware accelerators. This patch does not care what kind of the device it is or attempt to configure it, leaving it to the guest. Because the devices available at each agent may be different, the available devices for passthrough are configured at the agent configuration file (/etc/cloudstack/agent/agent.properties). Configuration is a comma separated list of available PCI devices and its given name. pci.devices=28:00.1|10GE,28:00.2|10GE,28:00.3|10GE,28:00.4|10GE,28:00.5|10GE,28:00.6|10GE,28:00.7|10GE,28:01.0|10GE At agent startup, the list of PCI devices is parsed and sent together with StartupRoutingCommand (in a new field, not in details). The management server then stores it in a new table “op_host_pci_devices”. If a device is added, removed, or renamed, the table is updated accordingly. The agent also probes libvirt which devices are currently in-use and send it with the command in attempt to synchronize any potential difference between the database and the actual status. The “name” of the PCI device is what is used to assign a device. In a compute offering, the user can specify the name of one or more PCI devices (as a comma-separated list) and CloudStack will find a host with the PCI device of the specified name available and assign it. A new manager, PciDeviceManager, is created to handle the allocation of PCI device. The manager implements StateListener and assigns PCI devices on state change to “starting” and also release the devices VM stop. First fit allocator and first fit planner are also modified to check for PCI device availability accordingly. For migration, intrusive migration is implementated. The PCI device is detached before migration and attached it again at the target host. This will interrupt whatever is using the device on the VM. However, it may be desirable for networking devices where the VM can use a bonding device to channel network traffic through the normal virtualized network device while the PCI Passthrough device is down. Diffs (updated) - api/src/com/cloud/agent/api/to/PciDeviceTO.java PRE-CREATION api/src/com/cloud/agent/api/to/VirtualMachineTO.java e6240ff api/src/com/cloud/offering/ServiceOffering.java 45d5f38 api/src/com/cloud/pci/PciDevice.java PRE-CREATION api/src/org/apache/cloudstack/api/ApiConstants.java 00d526d api/src/org/apache/cloudstack/api/command/admin/offering/CreateServiceOfferingCmd.java decac29 api/src/org/apache/cloudstack/api/response/ServiceOfferingResponse.java 5c5b369 client/WEB-INF/classes/resources/messages.properties 4fc09ee client/tomcatconf/applicationContext.xml.in b832b09 core/src/com/cloud/agent/api/AttachPciDevicesCommand.java PRE-CREATION core/src/com/cloud/agent/api/StartupRoutingCommand.java 5961ab0 engine/schema/src/com/cloud/host/HostPciDeviceVO.java PRE-CREATION engine/schema/src/com/cloud/host/HostVO.java c814b94 engine/schema/src/com/cloud/host/dao/HostDaoImpl.java dd26941 engine/schema/src/com/cloud/host/dao/HostPciDevicesDao.java PRE-CREATION engine/schema/src/com/cloud/host/dao/HostPciDevicesDaoImpl.java PRE-CREATION engine/schema/src/com/cloud/migration/ServiceOffering21VO.java 7a49e63 engine/schema/src/com/cloud/service/ServiceOfferingVO.java 9a262c5 plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtComputingResource.java 542136a plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtDomainXMLParser.java a283768 plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtVMDef.java 6aaabc5 server/src/com/cloud/agent/manager/allocator/impl/FirstFitAllocator.java 088591f server/src/com/cloud/alert/AlertManagerImpl.java c437a8c server/src/com/cloud/api/query/dao/ServiceOfferingJoinDaoImpl.java 945e67b server/src/com/cloud/api/query/vo/ServiceOfferingJoinVO.java 05ff5f3 server/src/com/cloud/configuration/ConfigurationManager.java 775601a server/src/com/cloud/configuration/ConfigurationManagerImpl.java 00503c5 server/src/com/cloud/deploy/DeploymentPlanningManagerImpl.java b896b84 server/src/com/cloud/hypervisor/HypervisorGuruBase.java 8a9df03 server/src/com/cloud/pci/PciDeviceManager.java PRE-CREATION server/src/com/cloud/pci/PciDeviceManagerImpl.java PRE-CREATION server/src/com/cloud/resource/ResourceManagerImpl.java beb5f4e server/src/com/cloud/vm/UserVmManagerImpl.java 07d5f64
RE: integrate VMware vShield as SecurityGroup in Cloudstack?
I don't believe anyone has requested this - consider filing enhancement request. Regards ilya -Original Message- From: Jijun [mailto:jiju...@gmail.com] Sent: Thursday, August 08, 2013 10:55 AM To: dev@cloudstack.apache.org Subject: integrate VMware vShield as SecurityGroup in Cloudstack? hi, is there any plan to integrate VMware vShield as Security Group in Cloudstack? or any suggestion to develop this feature to work with Cloudstack? any suggestion will be appreciated!thanks. -- Thanks, Jijun
Re: 4.1.1 Build issue for CentOS - errors on AWSAPI depenencies
Great! That's what I was building the RPM's for. Glad they helped. On Thu, Aug 08, 2013 at 08:18:23PM +0530, Amit Das wrote: We downloaded the RPMs from the mirror site got the installation done. Regards, Amit *CloudByte Inc.* http://www.cloudbyte.com/ On Thu, Aug 8, 2013 at 6:42 PM, Chip Childers chip.child...@sungard.comwrote: On Thu, Aug 08, 2013 at 12:06:16PM +0530, Amit Das wrote: Hi, Do we have any workaround for this issue ? Regards, Amit *CloudByte Inc.* http://www.cloudbyte.com/ Since I didn't have time to figure out what was going wrong, I copied the missing jars from another machine into my .m2/repository folder. Not ideal, but it worked as a workaround. On Mon, Aug 5, 2013 at 11:55 PM, Chip Childers chip.child...@sungard.comwrote: Hi all, Trying to build 4.1.1 into the appropriate RPMs, and I'm hitting the following error during the process. Any clues / ideas? I've cleaned our ~/.m2/repository and tried again, but same issue. [INFO] Apache CloudStack AWS API Bridge .. FAILURE [55.762s] [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 5:14.484s [INFO] Finished at: Mon Aug 05 19:20:34 IST 2013 [INFO] Final Memory: 47M/206M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project cloud-awsapi: Compilation failure: Compilation failure: [ERROR] error: error reading /home/sg-user/.m2/repository/org/apache/axis2/mex/1.5.4/mex-1.5.4-impl.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/org/apache/axis2/axis2-mtompolicy/1.5.4/axis2-mtompolicy-1.5.4.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/org/apache/ws/commons/axiom/axiom-dom/1.2.10/axiom-dom-1.2.10.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/org/opensaml/opensaml1/1.1/opensaml1-1.1.jar; error in opening zip file [ERROR] error: error reading /home/sg-user/.m2/repository/commons-lang/commons-lang/2.3/commons-lang-2.3.jar; error in opening zip file [ERROR] - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :cloud-awsapi
Re: Review Request 13323: if a failure occurs while adding VM to another network (this should be the first vm in the subnet). The ip alias created as a part of this process is not removed.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13323/#review24894 --- Committed to MASTER. - Sheng Yang On Aug. 8, 2013, 6:03 a.m., bharat kumar wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13323/ --- (Updated Aug. 8, 2013, 6:03 a.m.) Review request for cloudstack, Alena Prokharchyk and Sheng Yang. Bugs: Cloudstack-4083 Repository: cloudstack-git Description --- https://issues.apache.org/jira/browse/CLOUDSTACK-4083 if a failure occurs while adding VM to another network (this should be the first vm in the subnet). The ip alias created as a part of this process is not removed. This occurred because we were not cleaning the alias ips in the event of a failure. As a part of the fix. 1.) moved the function removeDhcpServiceInsubnet and listLastNicsInSubnet to NetworkManager (These were in VirtualMachineManagerImpl earlier.) 2.) add the call to clean ipAlias in the remove nic function of the networkManager. 3.) Modified the removeDhcpServiceInsubnet to take network ad an argument. This will help in removing only the ipAlias which belong to a particular network. Diffs - server/src/com/cloud/network/NetworkManager.java f6dbb19 server/src/com/cloud/network/NetworkManagerImpl.java 42e4093 server/src/com/cloud/vm/VirtualMachineManagerImpl.java 15a9a82 server/test/com/cloud/vpc/MockNetworkManagerImpl.java df552e4 Diff: https://reviews.apache.org/r/13323/diff/ Testing --- Tested on 4.2. created two guest networks guest1 and guest2. created VMS in both the networks. Added a VM(with no PV drivers) from guest1 to guest2. this failed and on failure ipAlias configured as part of nic creation was removed. Deleting the vm causes all the removal of all ipAliases from all the subnets in which this is the lastvm. Thanks, bharat kumar
Re: Review Request 13373: keep the existing changes in cloud-set-guest-sshkey.in to make sure we do not break the backward compatibility.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13373/#review24896 --- Ship it! Ship It! - Sheng Yang On Aug. 7, 2013, 1:25 p.m., bharat kumar wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13373/ --- (Updated Aug. 7, 2013, 1:25 p.m.) Review request for cloudstack, Jayapal Reddy and Sheng Yang. Bugs: Cloudstack-4138 Repository: cloudstack-git Description --- keep the existing changes in cloud-set-guest-sshkey.in to make sure we do not break the backward compatibility. Diffs - setup/bindir/cloud-set-guest-sshkey.in 9436b03 Diff: https://reviews.apache.org/r/13373/diff/ Testing --- Tested on 4.2 Thanks, bharat kumar
RE: [DISCUSS] CSS framework for CloudStack UI
That sounds awesome, though I'm not too much of a guru with either maven or grunt -- I would be glad to coordinate with anyone who wants to take that on. -Brian -Original Message- From: Amit Das [mailto:amit@cloudbyte.com] Sent: Tuesday, August 06, 2013 10:16 PM To: dev@cloudstack.apache.org Subject: Re: [DISCUSS] CSS framework for CloudStack UI This is definitely a great idea. Will it be feasible to decouple the front-end build from server-side build as mentioned in the following link: http://addyosmani.com/blog/making-maven-grunt/ Regards, Amit Kumar Das *CloudByte Inc.* http://www.cloudbyte.com/ On Wed, Aug 7, 2013 at 5:48 AM, Ian Duffy i...@ianduffy.ie wrote: +1 to that definitely! The only problem I cannot handle is integrating the SASS compiler (which converts .scss-.css) into the UI build phase. I've found a maven plugin at https://github.com/Jasig/sass-maven-plugin, so if anyone wants to tackle that it would be awesome. Below is a meer suggestion, I've only read about it and never done it. I believe you are able to chain grunt into the maven life cycle. This would allow us to do various things with the front end code. This includes but is not limited to: - JSHint - Unit tests via xyz(suggesting QUnit or Jasmine) framework - Static analysis of the javascript with Plato - Compiling SASS + LESS - Uglifying/Minifying - Optimise images(png crush etc.) - Dependency management of 3rd party js libs It would supply us with a bunch nicer build process for the UI elements of Cloudstack. However it would add a dependency of nodejs to the build process.
Re: Review Request 13373: keep the existing changes in cloud-set-guest-sshkey.in to make sure we do not break the backward compatibility.
On Aug. 8, 2013, 5:40 p.m., Sheng Yang wrote: Ship It! Pushed to 4.2 and MASTER. - Sheng --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13373/#review24896 --- On Aug. 7, 2013, 1:25 p.m., bharat kumar wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13373/ --- (Updated Aug. 7, 2013, 1:25 p.m.) Review request for cloudstack, Jayapal Reddy and Sheng Yang. Bugs: Cloudstack-4138 Repository: cloudstack-git Description --- keep the existing changes in cloud-set-guest-sshkey.in to make sure we do not break the backward compatibility. Diffs - setup/bindir/cloud-set-guest-sshkey.in 9436b03 Diff: https://reviews.apache.org/r/13373/diff/ Testing --- Tested on 4.2 Thanks, bharat kumar
Re: anyone please: firewall rules application
thanks, it thought it didn;t have a plugable nic. I fixed it. I read this advice in Donals blog on logging to, very helpful. regards, On Thu, Aug 8, 2013 at 7:06 PM, Alex Huang alex.hu...@citrix.com wrote: Dan, There should be a warning right above that exception. What does that warning say? It gives the actual state of the router that it thinks it's in. --Alex -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] Sent: Thursday, August 8, 2013 4:13 AM To: dev Subject: anyone please: firewall rules application I feel I am on a ghost hunt. On Thu, Aug 8, 2013 at 10:32 AM, Daan Hoogland daan.hoogl...@gmail.com wrote: H, I noted that in some of the 4.1 versions I have been testing setting a firewall rule fails. This seems to be when a router is not fully initialized, is it? the stack trace seems to reflect this, but the error message just says Failed to create firewall rule or Failed to delete firewall rule com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply ip association, virtual router is not in the right state at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRule s (VirtualNetworkApplianceManagerImpl.java:3445) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.associateP ublicIP(VirtualNetworkApplianceManagerImpl.java:3272) at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.associ a tePublicIP(VpcVirtualNetworkApplianceManagerImpl.java:554) at com.cloud.network.element.VirtualRouterElement.applyIps(VirtualRouterE lement.java:438) at com.cloud.network.NetworkManagerImpl.applyIpAssociations(NetworkMan age rImpl.java:625) at com.cloud.network.NetworkManagerImpl.applyRules(NetworkManagerImpl .jav a:2380) at com.cloud.network.firewall.FirewallManagerImpl.applyRules(FirewallMana gerImpl.java:500) at com.cloud.network.firewall.FirewallManagerImpl.applyFirewallRules(Fire wallManagerImpl.java:630) at com.cloud.network.firewall.FirewallManagerImpl.applyIngressFirewallRul es(FirewallManagerImpl.java:603) at org.apache.cloudstack.api.command.user.firewall.CreateFirewallRuleCmd. execute(CreateFirewallRuleCmd.java:124) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:4 37 ) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Can someone confirm my suspicion? thanks, Daan
Re: Review Request 13134: has_units UI Field Type
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13134/#review24899 --- Ship it! This patch looks good to me. Brian, could you please merge this patch ? - Pranav Saxena On Aug. 2, 2013, 1:37 p.m., Chris Suich wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13134/ --- (Updated Aug. 2, 2013, 1:37 p.m.) Review request for cloudstack, Brian Federle, Jessica Wang, and Pranav Saxena. Repository: cloudstack-git Description --- I have added a new dialog field type called 'has_units'. This field has an input box side by side with a select box. The select box is populated with predefined units (MB, GB, TB, for example) and uses (also predefined) conversion functions to allow automatic updating of the input box value when the units select box is changed. For some reason, it says that ui/scripts/ui/dialog.js can not be found in the repository, so I have added the patch file manually. Please let me know if there is some way to fix this. Diffs - Diff: https://reviews.apache.org/r/13134/diff/ Testing --- File Attachments https://reviews.apache.org/media/uploaded/files/2013/07/31/has_units-field.patch Thanks, Chris Suich
[DISCUSS} Root/Domain Admin user should see ALL vms - based on their permisions
This question was asked several times on dev and user mailing list. I'd like to propose following enhancement and would like to get the community feedback: Issue: Root Admin cannot see all VMs under Instance tab when all instances are selected. Root Admin user need to switch between different projects to see more vms. This approach presents a challenge as there is no single view of all VMs in ALL projects. Same would apply to a domain admin, he should be able to see all vms in his domain at a glance without looping through each project. Suggested resolution: Change the behavior of show all instances by looping through all projects and showing the vm names. We would also need to alter the Instance view and append project name column and append domain/project. What do you think? Thanks ilya
Re: [DISCUSS} Root/Domain Admin user should see ALL vms - based on their permisions
On Thu, Aug 08, 2013 at 06:54:02PM +, Musayev, Ilya wrote: This question was asked several times on dev and user mailing list. I'd like to propose following enhancement and would like to get the community feedback: Issue: Root Admin cannot see all VMs under Instance tab when all instances are selected. Root Admin user need to switch between different projects to see more vms. This approach presents a challenge as there is no single view of all VMs in ALL projects. Same would apply to a domain admin, he should be able to see all vms in his domain at a glance without looping through each project. Suggested resolution: Change the behavior of show all instances by looping through all projects and showing the vm names. We would also need to alter the Instance view and append project name column and append domain/project. What do you think? +1, and I notice that Kirk J opened CLOUDSTACK-4196
Re: Master build failure
Dave, wouldn't jenkins do a build like that? Meanng the positive cato report is a must to allow commits On Thu, Aug 8, 2013 at 4:54 PM, Alex Huang alex.hu...@citrix.com wrote: Yup. That was the reason why it worked on my machine but doesn't work on jenkins. It had a copy of the jar in the local maven cache so it continued to build even though it's missing. Thanks for reverting. Will fix. I still don't understand why we have problems with Gerrit. It would have prevented exactly this type of problems. I know a lot of people are busy on 4.2. Will bring it up post 4.2 again. --Alex From: Dave Cahill [mailto:dcah...@midokura.com] Sent: Thursday, August 8, 2013 3:45 AM To: dev@cloudstack.apache.org; Dave Cahill; Alex Huang Subject: Re: Master build failure Thanks Prasanna. One suggestion I have is that if anyone makes pom file changes (or any large changes at all, to be honest), that they nuke their local Maven cache (rm -rf ~/.m2/repository) and do a clean install before submitting a patch. This way, you don't end up thinking your work builds when it just happens to build due to leftover, cached jars. Alex, do you have any ideas on build stability? There have been 2 build breakages in the past few days (ref: compile error on 4.2 thread), and looking at git log I don't see much sign of review on the changes. We discussed Gerrit a while back, but I think the conclusion was that it would slow us down? Thanks, Dave. On Thu, Aug 8, 2013 at 6:13 PM, Prasanna Santhanam t...@apache.orgmailto:t...@apache.org wrote: Reverted the range 30c33415..f6a2c817bc. Master builds now. Others who've checked in after these will still retain their commits but please build before push. It's clear we are only worried about 4.2 now but we are breaking master for those who are beginning to work ahead for 4.3 On Thu, Aug 08, 2013 at 02:15:58PM +0530, Prasanna Santhanam wrote: Dave's been attempting to fix this and it looks to be intertwined in a few commits. Large swaths of code has moved around. I'll revert to last known state from Jenkins if we can't figure out a simple fix so Dave can proceed. On Thu, Aug 08, 2013 at 04:11:36PM +0900, Dave Cahill wrote: Hi, As Prasanna noted in IRC, the cloudstack-master-maven Jenkins build is failing with a similar error: https://builds.apache.org/job/cloudstack-master-maven/2645/console Failed to execute goal on project cloud-engine-components-api: Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-components-api:jar:4.3.0-SNAPSHOT: Could not find artifact org.apache.cloudstack:cloud-framework-config:jar:4.3.0-SNAPSHOT in Nexus (http://repository.apache.org/snapshots) cause : Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-components-api:jar:4.3.0-SNAPSHOT: Could not find artifact org.apache.cloudstack:cloud-framework-config:jar:4.3.0-SNAPSHOT in Nexus (http://repository.apache.org/snapshots) Thanks, Dave. On Thu, Aug 8, 2013 at 3:53 PM, Dave Cahill dcah...@midokura.commailto:dcah...@midokura.com wrote: Hi, I'm seeing a build failure with master - I've checked the usual gotchas, but this seems to be something else. Possibly related to the 4.2.0 to 4.3.0 update? The missing dependency is cloud-engine-compute. It's listed as a dependency in engine/service/pom.xml with no type specified, which AFAIK defaults to jar. So my understanding is that it's trying to download version 4.3.0-SNAPSHOT of the cloud-engine-compute jar from repository.apache.orghttp://repository.apache.org. How does the jar get uploaded there in the first place? Maybe that's a step we missed when witching from 4.2.0 to 4.3.0? Here's what I ran: # Nuke my local maven cache $ rm -rf ~/.m2/repository # Get latest master $ git pull # Clean any files hanging around my git working copy just in case $ git clean -dxf # Build $ mvn clean install -P developer,systemvm -DskipTests Here's the error I got: [ERROR] Failed to execute goal on project cloud-engine-service: Could not resolve dependencies for project org.apache.cloudstack:cloud-engine-service:war:4.3.0-SNAPSHOT: Failure to find org.apache.cloudstack:cloud-engine-compute:jar:4.3.0-SNAPSHOT in http://repository.apache.org/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots has elapsed or updates are forced - [Help 1] Thanks, Dave. -- Prasanna., Powered by BigRock.com -- Prasanna., Powered by BigRock.com
Re: slow review board
ah, it's come to a grinding proxy error On Thu, Aug 8, 2013 at 9:47 PM, Daan Hoogland daan.hoogl...@gmail.com wrote: H, I noticed the response times of the review board are growing. Anybody shares my feeling?
Re: Review Request 12098: Add PCI Passthrough to CloudStack on KVM Hypervisor
I've discussed this on the mailing list before. http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201306.mbox/%3CCAJA5wJTAXH0Oi0c=fXy53MB=aqyk_octmm5cvet0d7l7b+t...@mail.gmail.com%3E The idea is that I'd like the implementation to be flexible enough to support any kind of PCI Passthrough device, not just a GPU or a network card. Note that the tag specifies the name of the PCI device, not the physical ID which will be assigned by CloudStack based on available devices. To be honest, this work was assigned to me as a part of a 2-month internship program. Now that the program is over and my studies resume, I don't really have time to work on this feature anymore. Paul (CCed) has expressed interest in this feature, so he might like to continue my work. Pawit On Fri, Aug 9, 2013 at 3:18 AM, Chiradeep Vittal chiradeep.vit...@citrix.com wrote: As someone noted, ReviewBoard is down for now. In the meanwhile, can you create a wiki document and JIRA bug https://cwiki.apache.org/confluence/x/0h-VAQ https://cwiki.apache.org/confluence/x/ni-VAQ https://cwiki.apache.org/confluence/x/XUfVAQ As an end-user of the Cloud, I am not going to have any idea what or which PCI device is available, so the compute offering tag is not going to make any sense. On the other hand, if it is a tag like GPU enabled, then that would make more sense? On 8/8/13 8:44 AM, Pawit Pornkitprasan p.pa...@gmail.com wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12098/ --- (Updated Aug. 8, 2013, 3:44 p.m.) Review request for cloudstack. Changes --- Rebased on master Repository: cloudstack-git Description --- This patch adds PCI Passthrough support to CloudStack on the KVM Hypervisor as previously mentioned on the mailing list PCI Passthrough may be useful for high-performance networking devices or other hardware accelerators. This patch does not care what kind of the device it is or attempt to configure it, leaving it to the guest. Because the devices available at each agent may be different, the available devices for passthrough are configured at the agent configuration file (/etc/cloudstack/agent/agent.properties). Configuration is a comma separated list of available PCI devices and its given name. pci.devices=28:00.1|10GE,28:00.2|10GE,28:00.3|10GE,28:00.4|10GE,28:00.5|10 GE,28:00.6|10GE,28:00.7|10GE,28:01.0|10GE At agent startup, the list of PCI devices is parsed and sent together with StartupRoutingCommand (in a new field, not in details). The management server then stores it in a new table ³op_host_pci_devices². If a device is added, removed, or renamed, the table is updated accordingly. The agent also probes libvirt which devices are currently in-use and send it with the command in attempt to synchronize any potential difference between the database and the actual status. The ³name² of the PCI device is what is used to assign a device. In a compute offering, the user can specify the name of one or more PCI devices (as a comma-separated list) and CloudStack will find a host with the PCI device of the specified name available and assign it. A new manager, PciDeviceManager, is created to handle the allocation of PCI device. The manager implements StateListener and assigns PCI devices on state change to ³starting² and also release the devices VM stop. First fit allocator and first fit planner are also modified to check for PCI device availability accordingly. For migration, intrusive migration is implementated. The PCI device is detached before migration and attached it again at the target host. This will interrupt whatever is using the device on the VM. However, it may be desirable for networking devices where the VM can use a bonding device to channel network traffic through the normal virtualized network device while the PCI Passthrough device is down. Diffs (updated) - api/src/com/cloud/agent/api/to/PciDeviceTO.java PRE-CREATION api/src/com/cloud/agent/api/to/VirtualMachineTO.java e6240ff api/src/com/cloud/offering/ServiceOffering.java 45d5f38 api/src/com/cloud/pci/PciDevice.java PRE-CREATION api/src/org/apache/cloudstack/api/ApiConstants.java 00d526d api/src/org/apache/cloudstack/api/command/admin/offering/CreateServiceOffe ringCmd.java decac29 api/src/org/apache/cloudstack/api/response/ServiceOfferingResponse.java 5c5b369 client/WEB-INF/classes/resources/messages.properties 4fc09ee client/tomcatconf/applicationContext.xml.in b832b09 core/src/com/cloud/agent/api/AttachPciDevicesCommand.java PRE-CREATION core/src/com/cloud/agent/api/StartupRoutingCommand.java 5961ab0 engine/schema/src/com/cloud/host/HostPciDeviceVO.java PRE-CREATION engine/schema/src/com/cloud/host/HostVO.java c814b94 engine/schema/src/com/cloud/host/dao/HostDaoImpl.java dd26941
Re: Quick Question about System VM problem
On Thu, Aug 08, 2013 at 10:25:28PM +, Donal Lafferty wrote: There's a tag that is applied to you XenServer. AFAIK, the tag tells the management server not to download systemvm.iso Also, be careful not to overwrite the vhd-utils on a XenServer version 6.x and beyond. The vhd-util mentioned on the build from master page does not work with new versions of XenServer. It should be updated soon. What is the issue with the vhd-util on download.cloud.com? Can you please file a bug? I've been using the vhd-util on download.cloud.com and haven't faced any issues with my Xen 6.0.2 hosts. -- Prasanna., Powered by BigRock.com
Re: [Doc] Please review: CPU and RAM scaling for running VMs doc
Jessica Thanks for the draft. Looks good. Some minor modifications. Correction 1 (check for *) Make it vmware tools instead of vmtools listitemparaVM*Ware* Tools or XenServer Tools must be installed on the virtual machine./para/listitem Correction 2 (check for *) Remove the decrease word. t is not always possible to accurately predict the CPU and RAM requirements + when you first deploy a VM. + You might need to increase or *decrease* these resources at any time during the life of a VM. + You can dynamically modify CPU and RAM levels to + change these resources for a running VM without incurring any downtime. Addition 1 For dynamic scaling to work virtual machine should have XS tools / VMware tools installed on it. To ensure this Admin/User can do it in two ways :- * Admin/User while registering the template provides an input whether tools are installed on the template(or can be done using update template API). * If the user deploys a virtual machine with a template that does not have XS tools / VMware tools and later if he/she installs the tools on the VM then he can inform Cloudstack using using updatevirtualmachine API. After installation of tools and updating the virtual machine, user needs to stop and start the vm from cloudstack in order for dynamic scaling of CPU and RAM for that VM. Addition 2 Some vmware caveats Limitation - 1 - After dynamically scaling memory user might need to run a couple of commands on Linux OS for new memory to take affect. Further reading below http://kb.vmware.com/selfservice/microsites/search.do?language=en_UScmd=di splayKCexternalId=1012764 Limitation - 2 - If a VM is initially assigned a RAM of less than 3gb then it cannot be dynamically scaled beyond 3gb. Holds true for for Linux 64 bit and windows 7 32 bit guest os. Further reading below. https://www.vmware.com/support/vsphere5/doc/vsphere-esx-vcenter-server-50-r elease-notes.html Thanks, -Nitin From: Jessica Tomechak jessica.tomec...@gmail.com Date: Friday 9 August 2013 6:41 AM To: dev@cloudstack.apache.org dev@cloudstack.apache.org Cc: us...@cloudstack.apache.org us...@cloudstack.apache.org, Sudha Ponnaganti sudha.ponnaga...@citrix.com, Nitin Mehta nitin.me...@citrix.com Subject: Re: [Doc] Please review: CPU and RAM scaling for running VMs doc +cc Nitin On Thu, Aug 8, 2013 at 6:08 PM, Jessica Tomechak jessica.tomec...@gmail.com wrote: Hi, CPU and RAM scaling for running VMs doc is ready for review. You can view the updated text at the link below. This is checked in to both master and 4.2 branch. Please provide your feedback. Diff: https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=535e74d Bug: https://issues.apache.org/jira/browse/CLOUDSTACK-867 Regards, Jessica T.