Re: [01/50] git commit: updated refs/heads/master to 1290e10

2014-09-24 Thread Leo Simons
Hey hey,

On Sep 23, 2014, at 11:50 PM, David Nalley da...@gnsa.us wrote:
 On Tue, Sep 23, 2014 at 4:44 PM, Rohit Yadav rohit.ya...@shapeblue.com 
 wrote:
 Hi David,
 
 On 23-Sep-2014, at 8:31 pm, David Nalley da...@gnsa.us wrote:
 Where was the merge request for this huge merge to master? (it was at
 50 commit emails, when it stopped sending, )
 We have passed feature freeze for 4.5.0, so I am confused as why this
 was merged. Is there a reason not to revert all of this?
 
 This was the request: https://github.com/apache/cloudstack/pull/16
 And JIRA: https://issues.apache.org/jira/browse/CLOUDSTACK-7143
 We all get emails from Github PR (just re-checked) so you may find them on 
 the ML.
 
 Yes, GH PR is exactly like the Review Board emails in this particular
 aspect. My question is why is this merged into master rather than a
 feature branch, and why no [MERGE] email as per:
 https://cwiki.apache.org/confluence/display/CLOUDSTACK/Branch+Merge+Expectations

Hmm, I hadn’t seen that before; don’t think it’s linked from the “how to 
contribute” stuff. Sorry. Or is this something a committer is to do?

Can we change the rules? Because I’d guess the [MERGE] e-mail serves exactly 
the same role as a pull request: widely announcing a branch is ready to merge 
in and providing a trigger point for discussion.

It’s also interesting to consider whether you need a feature branch at all in 
the local repository for branches that were first developed (and tested) 
remotely. After all the only remaining thing you will do to that branch is to 
merge it in. The original feature branch is

  https://github.com/schubergphilis/CloudStack/tree/feature/systemvm-refactor

which has existed for a few months and was discussed here a few times (well I 
sent e-mail about it, there wasn’t much discussion…), with

  
https://github.com/schubergphilis/CloudStack/tree/feature/systemvm-refactor-for-upstream

as the re-re-rebased version of all that. This is all github standard (best?) 
practice, to the point that you cannot even create pull requests that result in 
the creation of new branches. I.e. if you look at

  
https://github.com/schubergphilis/cloudstack/compare/feature/systemvm-refactor-for-upstream

and you click the “edit” in the top row, you can’t even suggest merging to a 
new branch, there’s only existing ones listed. Of course the committer doing 
the actual upstreaming can make a different choice, but, why would you?

As for whether to take this for 4.5.0, of course the risk is not 0, but its 
pretty darn low. I also think by typical community rules just about none of the 
commits in the pull request are a new feature. Longer term the point of these 
changes is a quality increase by being just slightly more precise and 
deliberate in a few places. If you think they don’t accomplish that you should 
definitely pull it out, but then I’d like to hear what’s wrong!

If you pull it out, please do consider something more limited like

https://github.com/schubergphilis/cloudstack/commit/74c381540ebaf940bbbf471b580303488aa9c5b4
which avoids putting master version of the systemvm code into branch builds.

I would also _really_ like to see a virtualbox systemvm.box out of the official 
4.5.0 build so that we can easily use our systemvm component tests for 
regression testing the changes we’ll have for 4.5.1/4.6.0. If you back this out 
it’ll be annoying bit twiddling to make one manually.



cheers!


Leo



Re: SystemVM file name changes

2014-09-24 Thread Leo Simons
Hey Ian,

On Sep 24, 2014, at 2:04 AM, Ian Duffy i...@ianduffy.ie wrote:
 I noticed the filename of the generated systemvms changed on
 http://jenkins.buildacloud.org/job/build-systemvm64-master/
 
 They now include a [0-9]* before the hypervisor name representing the build
 number.

That’s one of the things coming out of the 1290e10 merge.

 Why do we do this? Its annoying for external resources linking to the last
 successful build.

The general concept is one of traceable and repeatable builds.

In RPM terms, given just a random binary RPM found on a random system
* it should be possible to unambiguously determine the source RPM from which it 
was built
* it should be possible to determine who or what built it, and when
* it should be possible to trace the source RPM back to the exact version 
control revision
* it should be possible to determine easily whether that binary is the same as
  another one on another machine / in another repository that has the same
  identifiers

In RPM land, the jenkins $BUILD_NUMBER should go into the RPM Release field and 
not into the RPM Version field. But in this case we don’t have RPM, or spec 
files, so there is only the filename to accomplish the same (which is why the 
branch name is also in there), and it has to be in this spot or cloudstack gets 
a bit confused.

What we do in our integration environment is to apply just a bit of logic to 
parse out the version number from the file name. I.e. to get an RPM from 
jenkins see fetch-rpms.sh included below, or to fetch the most recent systemvm 
from a directory listing see download-template.sh also included below. Would 
something like that work for you?

If not, the logic for creating the version is in build.sh:

version_tag=
if [ ! -z ${version} ]; then
  if [ ! -z ${BUILD_NUMBER} ]; then
version=${version}.${BUILD_NUMBER}
  fi
  version_tag=-${version}
elif [ ! -z ${BUILD_NUMBER} ]; then
  version=${BUILD_NUMBER}
  version_tag=-${BUILD_NUMBER}”
fi

So we can change that, or we can unset BUILD_NUMBER in the jenkins build prior 
to invocation. What do you think?

It would be much better to exclusively use yum/maven repositories and their 
logic to centralize this kind of logic server-side, or at least to be creating 
and updating symlinks to ‘latest’. That’s a work in progress...


cheers,


Leo

download-templates.sh
=
#!/bin/bash
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements.  See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership.  The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# License); you may not use this file except in compliance
# with the License.  You may obtain a copy of the License at
#
#   http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# AS IS BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied.  See the License for the
# specific language governing permissions and limitations
# under the License.

# Download systemvm templates onto secondary storage

set -e
echo $@ | grep debug /dev/null  DEBUG=1
echo $@ | grep trace /dev/null  TRACE=1

function source_common() {
  local SOURCE=${BASH_SOURCE[0]}
  DIR=$( cd -P $( dirname ${SOURCE} )  pwd )
  source ${DIR}/common.sh
}
source_common

NFS_HOST=${1:-localhost}
NFS_SECONDARY_EXPORT=${2:-/storage/secondary}
MOUNT_PATH=${3:-/mnt/secondary}
BASE_URL=${4:-https://artifacts.schubergphilis.com/artifacts/cloudstack};
TEMPLATE=${5:-systemvmtemplate}
DB_HOST=${6:-localhost}
DB_USER=${7:-root}
DB_PASSWORD=${8:-}

function find_template() {
  if ! `echo ${TEMPLATE} | egrep '^[a-zA-Z0-9]+-[0-9]+(\.[0-9]+)*$'`; then
# (apache) directory listing
# find only links
# filter by template name
# find only xen template
# strip suffix
# take the first (newest) one
newest_first=?C=M;O=D
TEMPLATE=$(curl ${BASE_URL}/${newest_first} | \
  egrep -o 'href=[^]+' | \
  egrep ${TEMPLATE} | \
  egrep -o [^/\]+-xen\.vhd\.bz2 | \
  sed 's/-xen.vhd.bz2//' |\
  head -n 1)
if [[ ${TEMPLATE} ==  ]]; then
  error No possible match found for ${TEMPLATE} at ${BASE_URL}
fi
log INFO Using template ${TEMPLATE}
  fi
}

function install_xen_template() {
  XEN_URL=${BASE_URL}/${TEMPLATE}-xen.vhd.bz2
  # KVM_URL=${BASE_URL}/${TEMPLATE}-kvm.vhd.bz2

  [ -d ${MOUNT_PATH} ] || mkdir ${MOUNT_PATH}

  mount -t nfs ${NFS_HOST}:${NFS_SECONDARY_EXPORT} ${MOUNT_PATH} || true

  
/usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt \
-F \
-m ${MOUNT_PATH} \
-h xenserver \
-u ${XEN_URL} \
-o ${DB_HOST} \
-r ${DB_USER} \
-d ${DB_PASSWORD}
}

function main() {
  find_template
  install_xen_template
}

# we only run main() if not source-d
return 2/dev/null || main



fetch-rpms.sh

Revering commit commit 093fa6f0a53bd031a09e4042c3aa25860bc947e5

2014-09-24 Thread Hugo Trippaers
Hey Anthony,


TransactionContextInterceptor is still used in the GenericDaoBase causing the 
following error when starting cloudstack:

2014-09-23 22:10:38.962:WARN::Nested in 
org.springframework.context.ApplicationContextException: Failed to start bean 
'cloudStackLifeCycle'; nested exception is 
com.cloud.utils.exception.CloudRuntimeException: Caught: null:
java.lang.NullPointerException
at 
com.cloud.utils.db.GenericDaoBase.customSearchIncludingRemoved(GenericDaoBase.java:464)
at 
com.cloud.utils.db.GenericDaoBase.customSearch(GenericDaoBase.java:515)
at 
com.cloud.upgrade.dao.VersionDaoImpl.getCurrentVersion(VersionDaoImpl.java:127)
at 
com.cloud.upgrade.DatabaseUpgradeChecker.check(DatabaseUpgradeChecker.java:424)
at 
org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle.checkIntegrity(CloudStackExtendedLifeCycle.java:65)
at 
org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle.start(CloudStackExtendedLifeCycle.java:55)
at 
org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:167)
at 
org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:51)
at 
org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:339)
at 
org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:143)

I’ve reverted the commit

commit 093fa6f0a53bd031a09e4042c3aa25860bc947e5
Author: Anthony Xu anthony...@citrix.com
Date:   Tue Sep 23 16:48:14 2014 -0700

removed unused class
 ramework/db/src/com/cloud/utils/db/TransactionContextInterceptor.java


This could have been caught by running the simulator tests. You can make 
jenkins run them for you by creating a branch called either hotfix/something or 
bugfix/something and push that branch. Jenkins will pick that up with job 
http://jenkins.buildacloud.org/view/simulator/job/simulator-hotfix-trigger/


Cheers,

Hugo

Review Request 25989: CLOUDSTACK-7620: Added SNMP mib file for snp-alerts plugin

2014-09-24 Thread Anshul Gangwar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25989/
---

Review request for cloudstack and Devdeep Singh.


Bugs: CLOUDSTACK-7620
https://issues.apache.org/jira/browse/CLOUDSTACK-7620


Repository: cloudstack-git


Description
---

Added SNMP mib file for snp-alerts plugin


Diffs
-

  plugins/alert-handlers/snmp-alerts/CS-ROOT-MIB.mib PRE-CREATION 

Diff: https://reviews.apache.org/r/25989/diff/


Testing
---

validates the MIB file using http://www.simpleweb.org/ietf/mibs/validate/


Thanks,

Anshul Gangwar



Re: Review Request 25989: CLOUDSTACK-7620: Added SNMP mib file for snp-alerts plugin

2014-09-24 Thread Anshul Gangwar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25989/
---

(Updated Sept. 24, 2014, 7:29 a.m.)


Review request for cloudstack and Devdeep Singh.


Bugs: CLOUDSTACK-7620
https://issues.apache.org/jira/browse/CLOUDSTACK-7620


Repository: cloudstack-git


Description (updated)
---

Added SNMP mib file for snmp-alerts plugin


Diffs
-

  plugins/alert-handlers/snmp-alerts/CS-ROOT-MIB.mib PRE-CREATION 

Diff: https://reviews.apache.org/r/25989/diff/


Testing
---

validates the MIB file using http://www.simpleweb.org/ietf/mibs/validate/


Thanks,

Anshul Gangwar



Build failed in Jenkins: simulator-singlerun #431

2014-09-24 Thread jenkins
See http://jenkins.buildacloud.org/job/simulator-singlerun/431/changes

Changes:

[htrippaers] CID-1240106 Remove unused variable

[htrippaers] CID-1240107 Remove unused variable

[htrippaers] Fix for CID-1232333, CID-1232334, CID-1232335, CID-1232336 and

--
[...truncated 8938 lines...]
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 2:16.017s
[INFO] Finished at: Wed Sep 24 03:52:37 EDT 2014
[INFO] Final Memory: 40M/153M
[INFO] 
[WARNING] The requested profile simulator could not be activated because it 
does not exist.
[simulator-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator
[INFO] Scanning for projects...
[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Developer Mode 4.5.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties 
(default) @ cloud-developer ---
[WARNING] Ignoring missing properties file: 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (default) @ cloud-developer ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO]  exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO]  exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer 
[INFO] 
[INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer ---
log4j:WARN No appenders could be found for logger 
(org.springframework.core.env.StandardEnvironment).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more 
info.
 WARNING: Provided file does not exist: 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override
 Initializing database=simulator with host=localhost port=3306 
username=cloud password=cloud
 Running query: drop database if exists `simulator`
 Running query: create database `simulator`
 Running query: GRANT ALL ON simulator.* to 'cloud'@`localhost` 
identified by 'cloud'
 Running query: GRANT ALL ON simulator.* to 'cloud'@`%` identified 
by 'cloud'
 Processing SQL file at 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/create-schema-simulator.sql
 Processing SQL file at 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/templates.simulator.sql
 Processing SQL file at 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/hypervisor_capabilities.simulator.sql
 Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ 
cloud-developer ---
[INFO] Installing 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.xml 
to 
/var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 20.187s
[INFO] Finished at: Wed Sep 24 03:53:01 EDT 2014
[INFO] Final Memory: 40M/177M
[INFO] 
[simulator-singlerun] $ /bin/bash -x /tmp/hudson5622629275748815465.sh
+ jps -l
+ grep -q Launcher
+ rm -f xunit.xml
+ rm -rf /tmp/MarvinLogs
+ echo Check for initialization of the management server
Check for initialization of the management server
+ COUNTER=0
+ SERVER_PID=2461
+ mvn -P systemvm,simulator -pl :cloud-client-ui jetty:run
+ '[' 0 -lt 44 ']'
+ grep -q 'Management server node 127.0.0.1 is up' jetty-output.out
+ sleep 5
+ COUNTER=1
+ '[' 1 -lt 44 ']'
+ grep -q 'Management server node 127.0.0.1 is up' jetty-output.out
+ sleep 5
+ COUNTER=2
+ '[' 2 -lt 44 ']'
+ grep -q 'Management server node 127.0.0.1 is up' jetty-output.out
+ sleep 5
+ COUNTER=3
+ '[' 3 -lt 44 ']'
+ grep -q 'Management server node 127.0.0.1 is up' 

[BLOCKED] Management server not starting

2014-09-24 Thread Alex Brett
The management server is not starting on current master builds - apparently due 
to a DB error.

https://issues.apache.org/jira/browse/CLOUDSTACK-7621 has been filed for this, 
CCing Pierre-Luc Dion as the author of some DB schema changes that are 
potential candidates for causing the problem...

Alex


Re: SystemVM file name changes

2014-09-24 Thread Ian Duffy
 The general concept is one of traceable and repeatable builds.

In the context of jenkins.buildacloud.org I would disagree with this. Only
two build jobs are ever kept. When a time arises when you need to figure
out what commit your systemvm was based of I'd be willing to bet that job
has been cleared out of jenkins ages ago.

 In RPM land, the jenkins $BUILD_NUMBER should go into the RPM Release
field and not into the RPM Version field. But in this case we don’t have
RPM, or spec files

Isn't this what we use /etc/cloudstack-release for?
You could include extra information in there if you wish, version, branch,
git sha1, etc. which would give great traceability.

The supplied download-template script is dependant on having a local
nexus/artifactory that can do searching on published build artifacts. In
the context of jenkins.buildacloud.org the system vms are not uploaded to
nexus/artifactory and just kept on the jenkins box.

The RPM one grabs a zip of all RPM is the last successful build. The zip
filename doesn't contain any version information.

Changing this causes 404s for people example:
https://mail-archives.apache.org/mod_mbox/cloudstack-users/201409.mbox/browser

On 24 September 2014 07:37, Leo Simons lsim...@schubergphilis.com wrote:

 Hey Ian,

 On Sep 24, 2014, at 2:04 AM, Ian Duffy i...@ianduffy.ie wrote:
  I noticed the filename of the generated systemvms changed on
  http://jenkins.buildacloud.org/job/build-systemvm64-master/
 
  They now include a [0-9]* before the hypervisor name representing the
 build
  number.

 That’s one of the things coming out of the 1290e10 merge.

  Why do we do this? Its annoying for external resources linking to the
 last
  successful build.

 The general concept is one of traceable and repeatable builds.

 In RPM terms, given just a random binary RPM found on a random system
 * it should be possible to unambiguously determine the source RPM from
 which it was built
 * it should be possible to determine who or what built it, and when
 * it should be possible to trace the source RPM back to the exact version
 control revision
 * it should be possible to determine easily whether that binary is the
 same as
   another one on another machine / in another repository that has the same
   identifiers

 In RPM land, the jenkins $BUILD_NUMBER should go into the RPM Release
 field and not into the RPM Version field. But in this case we don’t have
 RPM, or spec files, so there is only the filename to accomplish the same
 (which is why the branch name is also in there), and it has to be in this
 spot or cloudstack gets a bit confused.

 What we do in our integration environment is to apply just a bit of logic
 to parse out the version number from the file name. I.e. to get an RPM from
 jenkins see fetch-rpms.sh included below, or to fetch the most recent
 systemvm from a directory listing see download-template.sh also included
 below. Would something like that work for you?

 If not, the logic for creating the version is in build.sh:

 version_tag=
 if [ ! -z ${version} ]; then
   if [ ! -z ${BUILD_NUMBER} ]; then
 version=${version}.${BUILD_NUMBER}
   fi
   version_tag=-${version}
 elif [ ! -z ${BUILD_NUMBER} ]; then
   version=${BUILD_NUMBER}
   version_tag=-${BUILD_NUMBER}”
 fi

 So we can change that, or we can unset BUILD_NUMBER in the jenkins build
 prior to invocation. What do you think?

 It would be much better to exclusively use yum/maven repositories and
 their logic to centralize this kind of logic server-side, or at least to be
 creating and updating symlinks to ‘latest’. That’s a work in progress...


 cheers,


 Leo

 download-templates.sh
 =
 #!/bin/bash
 #
 # Licensed to the Apache Software Foundation (ASF) under one
 # or more contributor license agreements.  See the NOTICE file
 # distributed with this work for additional information
 # regarding copyright ownership.  The ASF licenses this file
 # to you under the Apache License, Version 2.0 (the
 # License); you may not use this file except in compliance
 # with the License.  You may obtain a copy of the License at
 #
 #   http://www.apache.org/licenses/LICENSE-2.0
 #
 # Unless required by applicable law or agreed to in writing,
 # software distributed under the License is distributed on an
 # AS IS BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
 # KIND, either express or implied.  See the License for the
 # specific language governing permissions and limitations
 # under the License.

 # Download systemvm templates onto secondary storage

 set -e
 echo $@ | grep debug /dev/null  DEBUG=1
 echo $@ | grep trace /dev/null  TRACE=1

 function source_common() {
   local SOURCE=${BASH_SOURCE[0]}
   DIR=$( cd -P $( dirname ${SOURCE} )  pwd )
   source ${DIR}/common.sh
 }
 source_common

 NFS_HOST=${1:-localhost}
 NFS_SECONDARY_EXPORT=${2:-/storage/secondary}
 MOUNT_PATH=${3:-/mnt/secondary}
 BASE_URL=${4:-https://artifacts.schubergphilis.com/artifacts/cloudstack};
 

Re: FTP connection tracking modules missing in VR after upgrade to 4.3.1; Which release will contain the fix?

2014-09-24 Thread France
Thank you for your efforts Rohit Yadav.

So i just download the files from:
http://jenkins.buildacloud.org/view/4.3/job/cloudstack-4.3-package-rpm/
install them by hand, reboot the management server, destroy the routers and 
wait for them to be recreated?

What other commits are there in this shapshot? Is it dangerous to use this 
snapshot build? Can other bugs be introduced?

Do you know maybe when official 4.3.2 will be released?

Regards,
F.

On 23 Sep 2014, at 13:33, Rohit Yadav rohit.ya...@shapeblue.com wrote:

 Hi France,
 
 On 22-Sep-2014, at 1:09 pm, France mailingli...@isg.si wrote:
 Hi guys,
 
 i have upgraded from 4.1.1 to 4.3.1 over the weekend. Amongst other 
 regressions i have found this one:
 
 https://issues.apache.org/jira/browse/CLOUDSTACK-7517
 
 So it looks like it is already well known bug and already has a fix.
 
 What can _we_ do to get the fix for 4.3 releases on our production system?
 
 I’ve cherry-picked it to 4.3 branch, you may build from source to get this 
 fix. Or, use the rpms from jenkins build.
 
 Is anyone willing to build a RPM including this fix?
 I see it was fixed only in 4.5. Taking into account what a small fix it is 
 and how important it is, maybe include it in 4.4.1 release also, because it 
 is still not released?
 Also why not add it along with other fixes to 4.3 and release 4.3.2?
 In my personal opinion, ACS has way too few bugfix releases, and lot’s of 
 people have to build their own packages because of that.
 
 RPMs and DEB from latest 4.3 branch will be made available by Jenkins here:
 http://jenkins.buildacloud.org/view/4.3
 
 Regards,
 Rohit Yadav
 Software Architect, ShapeBlue
 M. +41 779015219 | rohit.ya...@shapeblue.com
 Blog: bhaisaab.org | Twitter: @_bhaisaab
 http://shapeblue.com/cloudstack-software-engineering
 
 
 
 Find out more about ShapeBlue and our range of CloudStack related services
 
 IaaS Cloud Design  Buildhttp://shapeblue.com/iaas-cloud-design-and-build//
 CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
 CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
 CloudStack Infrastructure 
 Supporthttp://shapeblue.com/cloudstack-infrastructure-support/
 CloudStack Bootcamp Training 
 Courseshttp://shapeblue.com/cloudstack-training/
 
 This email and any attachments to it may be confidential and are intended 
 solely for the use of the individual to whom it is addressed. Any views or 
 opinions expressed are solely those of the author and do not necessarily 
 represent those of Shape Blue Ltd or related companies. If you are not the 
 intended recipient of this email, you must neither take any action based upon 
 its contents, nor copy or show it to anyone. Please contact the sender if you 
 believe you have received this email in error. Shape Blue Ltd is a company 
 incorporated in England  Wales. ShapeBlue Services India LLP is a company 
 incorporated in India and is operated under license from Shape Blue Ltd. 
 Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
 operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
 registered by The Republic of South Africa and is traded under license from 
 Shape Blue Ltd. ShapeBlue is a registered trademark.



Re: conf values for 4.4 from master

2014-09-24 Thread Daan Hoogland
On Tue, Sep 23, 2014 at 8:13 PM, Sheng Yang sh...@yasker.org wrote:

 Hi Daan,

 These are already added for 4.4's schema-430to440.sql (and your second mail
 is the same as the first case of first mail...)

​The last line is no issue indeed. the lines 797 and 798 from master are
not in the 4.4 branch:

INSERT INTO `cloud`.`configuration`(category, instance, component, name,
value, description, default_value) VALUES ('Advanced', 'DEFAULT',
'NetworkOrchestrationService', 'router.redundant.vrrp.interval', '1',
'seconds between VRRP broadcast. It would 3 times broadcast fail to trigger
fail-over mechanism of redundant router', '1') ON DUPLICATE KEY UPDATE
category='Advanced';
INSERT INTO `cloud`.`configuration`(category, instance, component, name,
value, description, default_value) VALUES ('Advanced', 'DEFAULT',
'NetworkOrchestrationService', 'router.aggregation.command.each.timeout',
'3', 'timeout in seconds for each Virtual Router command being aggregated.
The final aggregation command timeout would be determined by this timeout *
commands counts ', '3') ON DUPLICATE KEY UPDATE category='Advanced';
​


  these two lines where added by you to the file schema-430to440.sql in
  master but not in 4.4

-- 
Daan


Re: cloudstack 4.4 access return 404 after cloudstack-management restart

2014-09-24 Thread Daan Hoogland
H devs,

please review the below report by Ning Wang. I found this behaivior in our
integration test environment at Schuberg Philis as well. I have not found
the root cause yet, so any pointers are welcome. I don't think Ian's
suspicion off the machine specifications are valid. It looks like a java
class protection level or packaging issue to me.

On Tue, Sep 23, 2014 at 9:13 PM, Ning Wang wangning...@gmail.com wrote:

 thanks for your reply!
 !1765 # free -m
  total   used   free sharedbuffers cached
 Mem:129022 112989  16032  0  51641  33961
 -/+ buffers/cache:  27387 101634
 Swap:0  0  0

 On Tue, Sep 23, 2014 at 2:55 PM, Ian Duffy i...@ianduffy.ie wrote:

  How much ram do you have?
  On 23 Sep 2014 19:21, Ning Wang wangning...@gmail.com wrote:
 
   is there someone enconter this,please help!
   Thanks!!!
  
   1,the browser shows:
   HTTP Status 404 -
   ___
  
   type Status report
  
   message
  
   description The requested resource () is not available.
   
  
   Apache Tomcat/6.0.24
  
   2,the log in /var/log/cloudstack/management/catalina.out:
  
   INFO: Deploying module: jaxws-1.5.6 -
  
  
 
 file:/usr/share/cloudstack-management/webapps7080/awsapi/WEB-INF/modules/axis2-jaxws-mar-1.5.6.mar
   Sep 23, 2014 2:03:17 PM org.apache.axis2.deployment.ModuleDeployer
 deploy
   INFO: Deploying module: addressing-1.5.6 -
  
  
 
 file:/usr/share/cloudstack-bridge/webapps/awsapi/WEB-INF/lib/axis2-1.5.6.jar
   Sep 23, 2014 2:03:19 PM org.apache.catalina.loader.WebappClassLoader
   loadClass
   INFO: Illegal access: this web application instance has been stopped
   already.  Could not load
   org.apache.cloudstack.managed.context.ManagedContextTimerTask$1.  The
   eventual following stack trace is caused by an error thrown for
 debugging
   purposes as well as to attempt to terminate the thread which caused the
   illegal access, and has no functional impact.
   java.lang.IllegalStateException
   at
  
  
 
 org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1369)
   at
  
  
 
 org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1329)
   at
  
  
 
 org.apache.cloudstack.managed.context.ManagedContextTimerTask.run(ManagedContextTimerTask.java:27)
   at java.util.TimerThread.mainLoop(Timer.java:555)
   at java.util.TimerThread.run(Timer.java:505)
  
   Exception in thread Timer-2 java.lang.NoClassDefFoundError:
   org/apache/cloudstack/managed/context/ManagedContextTimerTask$1
   at
  
  
 
 org.apache.cloudstack.managed.context.ManagedContextTimerTask.run(ManagedContextTimerTask.java:27)
   at java.util.TimerThread.mainLoop(Timer.java:555)
   at java.util.TimerThread.run(Timer.java:505)
   Caused by: java.lang.ClassNotFoundException:
   org.apache.cloudstack.managed.context.ManagedContextTimerTask$1
   at
  
  
 
 org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1483)
   at
  
  
 
 org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1329)
   ... 3 more
   Sep 23, 2014 2:03:22 PM org.apache.axis2.deployment.ServiceDeployer
  deploy
   INFO: Deploying Web service: cloud-ec2.aar -
  
  
 
 file:/usr/share/cloudstack-management/webapps7080/awsapi/WEB-INF/services/cloud-ec2.aar
   Sep 23, 2014 2:03:22 PM org.apache.axis2.deployment.ServiceDeployer
  deploy
   INFO: Deploying Web service: version-1.5.6.aar -
  
  
 
 file:/usr/share/cloudstack-management/webapps7080/awsapi/WEB-INF/services/version-1.5.6.aar
   Sep 23, 2014 2:03:22 PM org.apache.axis2.util.OnDemandLogger warn
   WARNING: No transportReceiver for
   org.apache.axis2.transport.http.AxisServletListener found. An instance
  for
   HTTP will be configured automatically. Please update your axis2.xml
 file!
   Sep 23, 2014 2:03:22 PM
  
  
 
 org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor
   init
   INFO: JSR-330 'javax.inject.Inject' annotation found and supported for
   autowiring
   Sep 23, 2014 2:03:22 PM org.apache.coyote.http11.Http11NioProtocol
 start
   INFO: Starting Coyote HTTP/1.1 on http-7080
   Sep 23, 2014 2:03:22 PM org.apache.catalina.startup.Catalina start
   INFO: Server startup in 39687 ms
  
 




-- 
Daan


Re: Review Request 25837: Additional Guest OS support for vGPU Test Automation

2014-09-24 Thread sailaja mada

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25837/
---

(Updated Sept. 24, 2014, 10:31 a.m.)


Review request for cloudstack, Doug Clark, John Dilley, and Sanjay Tripathi.


Repository: cloudstack-git


Description
---

Additional Guest OS support for vGPU Test Automation


Diffs (updated)
-

  test/integration/component/test_deploy_vgpu_vm.py 081ab4b 
  tools/marvin/marvin/config/test_data.py bebcab9 

Diff: https://reviews.apache.org/r/25837/diff/


Testing
---

Yes.  Testing is done with Win7,Win8 and Win2012 templates with XS 65 tools 
installed.

All the testcases are passed


Thanks,

sailaja mada



Re: [ACS441] merge request: hotfix/4.4-7574

2014-09-24 Thread Daan Hoogland
how does this pertain to windows on xen. It looks like a pure- and
baremetal thing. I did merge!

On Wed, Sep 24, 2014 at 2:44 AM, Pierre-Luc Dion pd...@cloudops.com wrote:

 Hi Dahn,

 can you merge this branch into 4.4, I've test creation of windows 8.1,
 2012r2 and centos6.5 on xenserver.

 Thanks,

 Pierre-Luc




-- 
Daan


Review Request 25991: user vm can get a gateway ip when gateway ip is a part of the guest ip range.

2014-09-24 Thread bharat kumar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25991/
---

Review request for cloudstack and Jayapal Reddy.


Bugs: CLOUDSTACK-7536
https://issues.apache.org/jira/browse/CLOUDSTACK-7536


Repository: cloudstack-git


Description
---

user vm can get a gateway ip when gateway ip is a part of the guest ip range.
https://issues.apache.org/jira/browse/CLOUDSTACK-7536


Diffs
-

  server/src/com/cloud/configuration/ConfigurationManagerImpl.java df6ce45 

Diff: https://reviews.apache.org/r/25991/diff/


Testing
---


Thanks,

bharat kumar



Re: [BLOCKED] Management server not starting

2014-09-24 Thread Harikrishna Patnala
This is fixed by reverting the commit 093fa6f0a53bd031a09e4042c3aa25860bc947e5

https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=2503aaafef5280ce20e319c77623f9709d85151a

MS is now starting with no issues.

-Harikrishna



On 24-Sep-2014, at 2:25 pm, Alex Brett alex.br...@citrix.com wrote:

 The management server is not starting on current master builds - apparently 
 due to a DB error.
 
 https://issues.apache.org/jira/browse/CLOUDSTACK-7621 has been filed for 
 this, CCing Pierre-Luc Dion as the author of some DB schema changes that are 
 potential candidates for causing the problem...
 
 Alex



Re: Review Request 25530: CLOUDSTACK-7534: ResetVM for VM with attached datadisk fails when enable.ha.storage.migration is false

2014-09-24 Thread Kishan Kavala

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25530/#review54406
---


commit c55bc0b2d11be4820a24af426e23da3db54a0cb1

- Kishan Kavala


On Sept. 11, 2014, 11:12 a.m., Harikrishna Patnala wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/25530/
 ---
 
 (Updated Sept. 11, 2014, 11:12 a.m.)
 
 
 Review request for cloudstack and Kishan Kavala.
 
 
 Bugs: CLOUDSTACK-7534
 https://issues.apache.org/jira/browse/CLOUDSTACK-7534
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
CLOUDSTACK-7534: ResetVM for VM with attached datadisk fails when 
 enable.ha.storage.migration is false
 
 Separate global config to enable/disable Storage Migration during normal 
 deployment
 Introduced a configuration parameter named enable.storage.migration
 
 
 Diffs
 -
 
   api/src/com/cloud/vm/VirtualMachineProfile.java 29f3164 
   
 engine/orchestration/src/org/apache/cloudstack/engine/orchestration/VolumeOrchestrator.java
  afc6f63 
   server/src/com/cloud/ha/HighAvailabilityManagerImpl.java 310f361 
 
 Diff: https://reviews.apache.org/r/25530/diff/
 
 
 Testing
 ---
 
 
 Thanks,
 
 Harikrishna Patnala
 




Re: Review Request 25530: CLOUDSTACK-7534: ResetVM for VM with attached datadisk fails when enable.ha.storage.migration is false

2014-09-24 Thread Kishan Kavala

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25530/#review54405
---

Ship it!


Ship It!

- Kishan Kavala


On Sept. 11, 2014, 11:12 a.m., Harikrishna Patnala wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/25530/
 ---
 
 (Updated Sept. 11, 2014, 11:12 a.m.)
 
 
 Review request for cloudstack and Kishan Kavala.
 
 
 Bugs: CLOUDSTACK-7534
 https://issues.apache.org/jira/browse/CLOUDSTACK-7534
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
CLOUDSTACK-7534: ResetVM for VM with attached datadisk fails when 
 enable.ha.storage.migration is false
 
 Separate global config to enable/disable Storage Migration during normal 
 deployment
 Introduced a configuration parameter named enable.storage.migration
 
 
 Diffs
 -
 
   api/src/com/cloud/vm/VirtualMachineProfile.java 29f3164 
   
 engine/orchestration/src/org/apache/cloudstack/engine/orchestration/VolumeOrchestrator.java
  afc6f63 
   server/src/com/cloud/ha/HighAvailabilityManagerImpl.java 310f361 
 
 Diff: https://reviews.apache.org/r/25530/diff/
 
 
 Testing
 ---
 
 
 Thanks,
 
 Harikrishna Patnala
 




Re: Review Request 25768: changing value of cpu/mem.overprovisioning.factor for xen cluster is not affecting total memory at zone level

2014-09-24 Thread Kishan Kavala

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25768/#review54407
---

Ship it!


Commit 476733cb92634c8494fe64762d7fbc178292a754

- Kishan Kavala


On Sept. 18, 2014, 10:40 a.m., bharat kumar wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/25768/
 ---
 
 (Updated Sept. 18, 2014, 10:40 a.m.)
 
 
 Review request for cloudstack and Kishan Kavala.
 
 
 Bugs: CLOUDSTACK-7571
 https://issues.apache.org/jira/browse/CLOUDSTACK-7571
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
 https://issues.apache.org/jira/browse/CLOUDSTACK-7571
 
 
 Diffs
 -
 
   engine/schema/src/com/cloud/capacity/dao/CapacityDaoImpl.java 9cae045 
 
 Diff: https://reviews.apache.org/r/25768/diff/
 
 
 Testing
 ---
 
 Tested on master.
 
 
 Thanks,
 
 bharat kumar
 




Build failed in Jenkins: simulator-singlerun #432

2014-09-24 Thread jenkins
See http://jenkins.buildacloud.org/job/simulator-singlerun/432/changes

Changes:

[kishan] CLOUDSTACK-7534: ResetVM for VM with attached datadisk fails when 
enable.ha.storage.migration is false

--
[...truncated 8933 lines...]
[INFO] Final Memory: 42M/158M
[INFO] 
[WARNING] The requested profile simulator could not be activated because it 
does not exist.
[simulator-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator
[INFO] Scanning for projects...
[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Developer Mode 4.5.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties 
(default) @ cloud-developer ---
[WARNING] Ignoring missing properties file: 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (default) @ cloud-developer ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO]  exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO]  exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer 
[INFO] 
[INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer ---
log4j:WARN No appenders could be found for logger 
(org.springframework.core.env.StandardEnvironment).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more 
info.
 WARNING: Provided file does not exist: 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override
 Initializing database=simulator with host=localhost port=3306 
username=cloud password=cloud
 Running query: drop database if exists `simulator`
 Running query: create database `simulator`
 Running query: GRANT ALL ON simulator.* to 'cloud'@`localhost` 
identified by 'cloud'
 Running query: GRANT ALL ON simulator.* to 'cloud'@`%` identified 
by 'cloud'
 Processing SQL file at 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/create-schema-simulator.sql
 Processing SQL file at 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/templates.simulator.sql
 Processing SQL file at 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/hypervisor_capabilities.simulator.sql
 Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ 
cloud-developer ---
[INFO] Installing 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.xml 
to 
/var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 23.563s
[INFO] Finished at: Wed Sep 24 07:33:50 EDT 2014
[INFO] Final Memory: 40M/181M
[INFO] 
[simulator-singlerun] $ /bin/bash -x /tmp/hudson2533624105079268180.sh
+ jps -l
+ grep -q Launcher
+ rm -f xunit.xml
+ rm -rf /tmp/MarvinLogs
+ echo Check for initialization of the management server
Check for initialization of the management server
+ COUNTER=0
+ SERVER_PID=9968
+ mvn -P systemvm,simulator -pl :cloud-client-ui jetty:run
+ '[' 0 -lt 44 ']'
+ grep -q 'Management server node 127.0.0.1 is up' jetty-output.out
+ sleep 5
+ COUNTER=1
+ '[' 1 -lt 44 ']'
+ grep -q 'Management server node 127.0.0.1 is up' jetty-output.out
+ sleep 5
+ COUNTER=2
+ '[' 2 -lt 44 ']'
+ grep -q 'Management server node 127.0.0.1 is up' jetty-output.out
+ sleep 5
+ COUNTER=3
+ '[' 3 -lt 44 ']'
+ grep -q 'Management server node 127.0.0.1 is up' jetty-output.out
+ sleep 5
+ COUNTER=4
+ '[' 4 -lt 44 ']'
+ grep -q 'Management server node 127.0.0.1 is up' jetty-output.out
+ sleep 5
+ COUNTER=5
+ '[' 5 -lt 44 ']'
+ grep -q 'Management server node 127.0.0.1 is up' jetty-output.out
+ sleep 5
+ 

Build failed in Jenkins: simulator-singlerun #433

2014-09-24 Thread jenkins
See http://jenkins.buildacloud.org/job/simulator-singlerun/433/changes

Changes:

[kishan] CLOUDSTACK-7571 changing value of cpu/mem.overprovisioning.factor for 
xen cluster is not affecting total memory at zone level

--
[...truncated 8940 lines...]
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ 
cloud-developer ---
[INFO] Installing 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.xml 
to 
/var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 2:03.406s
[INFO] Finished at: Wed Sep 24 08:06:34 EDT 2014
[INFO] Final Memory: 42M/175M
[INFO] 
[WARNING] The requested profile simulator could not be activated because it 
does not exist.
[simulator-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator
[INFO] Scanning for projects...
[INFO] 
[INFO] 
[INFO] Building Apache CloudStack Developer Mode 4.5.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties 
(default) @ cloud-developer ---
[WARNING] Ignoring missing properties file: 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.3:process (default) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (default) @ cloud-developer ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO]  exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer 
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ 
cloud-developer ---
[INFO] Starting audit...
Audit done.

[INFO] 
[INFO]  exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer 
[INFO] 
[INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ 
cloud-developer ---
log4j:WARN No appenders could be found for logger 
(org.springframework.core.env.StandardEnvironment).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more 
info.
 WARNING: Provided file does not exist: 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override
 Initializing database=simulator with host=localhost port=3306 
username=cloud password=cloud
 Running query: drop database if exists `simulator`
 Running query: create database `simulator`
 Running query: GRANT ALL ON simulator.* to 'cloud'@`localhost` 
identified by 'cloud'
 Running query: GRANT ALL ON simulator.* to 'cloud'@`%` identified 
by 'cloud'
 Processing SQL file at 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/create-schema-simulator.sql
 Processing SQL file at 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/templates.simulator.sql
 Processing SQL file at 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/hypervisor_capabilities.simulator.sql
 Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ 
cloud-developer ---
[INFO] 
[INFO] --- maven-install-plugin:2.3.1:install (default-install) @ 
cloud-developer ---
[INFO] Installing 
http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.xml 
to 
/var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 17.848s
[INFO] Finished at: Wed Sep 24 08:06:55 EDT 2014
[INFO] Final Memory: 43M/184M
[INFO] 
[simulator-singlerun] $ /bin/bash -x /tmp/hudson2896558900789755787.sh
+ jps -l
+ grep -q Launcher
+ rm -f xunit.xml
+ rm -rf /tmp/MarvinLogs
+ echo Check for initialization of the management server
Check for initialization of the management server
+ COUNTER=0
+ SERVER_PID=16966
+ mvn -P systemvm,simulator -pl :cloud-client-ui jetty:run
+ '[' 0 -lt 44 ']'
+ grep -q 'Management server 

Re: FTP connection tracking modules missing in VR after upgrade to 4.3.1; Which release will contain the fix?

2014-09-24 Thread Rohit Yadav
Hi,

On 24-Sep-2014, at 12:04 pm, France mailingli...@isg.si wrote:
 Thank you for your efforts Rohit Yadav.

 So i just download the files from:
 http://jenkins.buildacloud.org/view/4.3/job/cloudstack-4.3-package-rpm/
 install them by hand, reboot the management server, destroy the routers and 
 wait for them to be recreated?

 What other commits are there in this shapshot? Is it dangerous to use this 
 snapshot build? Can other bugs be introduced?

You’ll have to look it up using the job that created the snapshots/debs/rpms. 
Using snapshot builds can be unreliable so should be avoided.

 Do you know maybe when official 4.3.2 will be released?

Not sure.

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +41 779015219 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design  Buildhttp://shapeblue.com/iaas-cloud-design-and-build//
CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
CloudStack Infrastructure 
Supporthttp://shapeblue.com/cloudstack-infrastructure-support/
CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England  Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.


Re: SystemVM file name changes

2014-09-24 Thread Leo Simons
On Sep 24, 2014, at 11:26 AM, Ian Duffy i...@ianduffy.ie wrote:
 The general concept is one of traceable and repeatable builds.
 
 In the context of jenkins.buildacloud.org I would disagree with this. Only
 two build jobs are ever kept. When a time arises when you need to figure
 out what commit your systemvm was based of I'd be willing to bet that job
 has been cleared out of jenkins ages ago.
 
 In RPM land, the jenkins $BUILD_NUMBER should go into the RPM Release
 field and not into the RPM Version field. But in this case we don’t have
 RPM, or spec files
 
 Isn't this what we use /etc/cloudstack-release for?
 You could include extra information in there if you wish, version, branch,
 git sha1, etc. which would give great traceability.

Sounds like a plan. I’ll see about submitting a patch tonight. The issue
is that /etc/cloudstack-release is parsed in a location or two (I forget
the details) so it kind-of has to match existing regexes.

 The supplied download-template script is dependant on having a local
 nexus/artifactory that can do searching on published build artifacts. In
 the context of jenkins.buildacloud.org the system vms are not uploaded to
 nexus/artifactory and just kept on the jenkins box.

Aren’t they published to S3 somewhere? It’d probably be better if users
fetch systemvms from S3……though one wonders why users need to fetch
systemvms built from master at all…

 Changing this causes 404s for people example:
 https://mail-archives.apache.org/mod_mbox/cloudstack-users/201409.mbox/browser

Hmm. We can’t have too many people badgering jenkins like this I guess. So
let’s improve on that!

In the meantime...
  export BUILD_NUMBER=
at the right place in the relevant build job should fix the immediate issue...


cheers,


Leo



Regarding commit 7f440854f7bcd41a1bd6581c0239cde2e98261b7

2014-09-24 Thread Devdeep Singh
Hi Daan,

I am looking into bug [1] which reports that the vmsync functionality is broken 
on master. If a vm deployed by cloudstack is stopped directly on the 
hypervisor, its state is not updated in cloudstack. I see that in commit 
7f440854f7bcd41a1bd6581c0239cde2e98261b7, a change was made to retry retrieving 
the resource status (PingCommand) to deal with network glitches. However, there 
is an issue with the commit and it has caused a regression with the vmsync 
functionality. Now, by default, the PingTask is not checking for the status of 
the resource. This breaks vmsync for all direct connected agents, which 
includes xenserver, hyper-v etc.

I'll be submitting a fix for this issue. Do let me know if you have any 
concerns with it.

[1] https://issues.apache.org/jira/browse/CLOUDSTACK-7598

Regards,
Devdeep


Urgent. Importing certificate to CS 4.3.1 using GUI

2014-09-24 Thread France
Hi guys,

i want to migrate away from realhostip.com. I have set up DNS service in no 
time, but am having problems importing certificates to ACS 3.4.1.

I created my own CA like this:

cd /etc/pki/CA
touch index.txt
echo 1000  serial
openssl genrsa -aes256 -out /etc/pki/CA/private/ca.key.pem 4096
chmod 400 /etc/pki/CA/private/ca.key.pem
 nano -w /etc/pki/tls/openssl.cnf
openssl req -new -x509 -days 63650 -key /etc/pki/CA/private/ca.key.pem  -sha256 
-extensions v3_ca -out /etc/pki/CA/certs/ca.cert.pem 


Signed my own keys and converted them to pkcs8 format like this:

cd /etc/pki/CA
openssl genrsa -out private/vse.somedomain.tld.key.pem 4096
chmod 400 private/vse.somedomain.tld.key.pem
openssl req -sha256 -new -key private/vse.somedomain.tld.key.pem  -out 
certs/vse.somedomain.tld.csr.pem
openssl ca -keyfile private/ca.key.pem -cert certs/ca.cert.pem -extensions 
usr_cert -notext -md sha256 -days 63649 -in certs/vse.somedomain.tld.csr.pem 
-out certs/vse.somedomain.tld.cert.pem
openssl pkcs8 -topk8 -in private/vse.somedomain.tld.key.pem -out 
private/vse.somedomain.tld.key.encrypted.pkcs8
openssl pkcs8 -in private/vse.somedomain.tld.key.encrypted.pkcs8 -out 
private/vse.somedomain.tld.key.pkcs8
chmod 400 private/vse.somedomain.tld.key.encrypted.pkcs8 
chmod 400 private/vse.somedomain.tld.key.pkcs8



But when trying to import it via GUI: infrastructure - SSL Certificate:
Certificate from vse.somedomain.tld.cert.pem
PKCS8 from private/vse.somedomain.tld.key.pkcs8
DNS domain suffix to: *.somedomain.tld

But it fails with:
Failed to update SSL Certificate.

Please help me upload the new certificate.
Catalina.out shows no error. I have no idea what else to check.

Thank you.
F.




[DB-CHANGE] Re: git commit: updated refs/heads/hotfix/4.4/CLOUDSTACK-7624 to 9eb8656

2014-09-24 Thread Daan Hoogland
Devs and testers,

I am going to apply a fix by Hugo that deals with an encrypted value that
is to large for the configuration.value field. If you wish to keep running
with your data make sure take appropriate action on this.

On Wed, Sep 24, 2014 at 5:25 PM, h...@apache.org wrote:

 Repository: cloudstack
 Updated Branches:
   refs/heads/hotfix/4.4/CLOUDSTACK-7624 [created] 9eb86560c


 CLOUDSTACK-7624 The value field of the configuration table is not big
 enough for some values


 Project: http://git-wip-us.apache.org/repos/asf/cloudstack/repo
 Commit: http://git-wip-us.apache.org/repos/asf/cloudstack/commit/9eb86560
 Tree: http://git-wip-us.apache.org/repos/asf/cloudstack/tree/9eb86560
 Diff: http://git-wip-us.apache.org/repos/asf/cloudstack/diff/9eb86560

 Branch: refs/heads/hotfix/4.4/CLOUDSTACK-7624
 Commit: 9eb86560c9b83456be9ee32e8b713b213baed7bb
 Parents: 7d11381
 Author: Hugo Trippaers htrippa...@schubergphilis.com
 Authored: Wed Sep 24 17:24:23 2014 +0200
 Committer: Hugo Trippaers htrippa...@schubergphilis.com
 Committed: Wed Sep 24 17:24:23 2014 +0200

 --
  .../apache/cloudstack/framework/config/impl/ConfigurationVO.java | 4 ++--
  setup/db/db/schema-440to441.sql  | 3 +++
  2 files changed, 5 insertions(+), 2 deletions(-)
 --



 http://git-wip-us.apache.org/repos/asf/cloudstack/blob/9eb86560/framework/config/src/org/apache/cloudstack/framework/config/impl/ConfigurationVO.java
 --
 diff --git
 a/framework/config/src/org/apache/cloudstack/framework/config/impl/ConfigurationVO.java
 b/framework/config/src/org/apache/cloudstack/framework/config/impl/ConfigurationVO.java
 index d7edfe0..cda96c9 100644
 ---
 a/framework/config/src/org/apache/cloudstack/framework/config/impl/ConfigurationVO.java
 +++
 b/framework/config/src/org/apache/cloudstack/framework/config/impl/ConfigurationVO.java
 @@ -43,10 +43,10 @@ public class ConfigurationVO implements Configuration {
  @Column(name = name)
  private String name;

 -@Column(name = value, length = 4095)
 +@Column(name = value, length = 8191)
  private String value;

 -@Column(name = default_value, length = 4095)
 +@Column(name = default_value, length = 8191)
  private String defaultValue;

  @Column(name = description, length = 1024)


 http://git-wip-us.apache.org/repos/asf/cloudstack/blob/9eb86560/setup/db/db/schema-440to441.sql
 --
 diff --git a/setup/db/db/schema-440to441.sql
 b/setup/db/db/schema-440to441.sql
 index d1ea8d3..337d575 100644
 --- a/setup/db/db/schema-440to441.sql
 +++ b/setup/db/db/schema-440to441.sql
 @@ -178,3 +178,6 @@ INSERT IGNORE INTO `cloud`.`guest_os_hypervisor`
 (uuid,hypervisor_type, hypervis
  INSERT IGNORE INTO `cloud`.`guest_os_hypervisor` (uuid,hypervisor_type,
 hypervisor_version, guest_os_name, guest_os_id, created, is_user_defined)
 VALUES (UUID(),'Xenserver', '6.2.5', 'CentOS 6 (64-bit)', 228, now(), 0);
  INSERT IGNORE INTO `cloud`.`guest_os_hypervisor` (uuid,hypervisor_type,
 hypervisor_version, guest_os_name, guest_os_id, created, is_user_defined)
 VALUES (UUID(),'Xenserver', '6.2.5', 'Windows 8 (64-bit)', 229, now(), 0);
  INSERT IGNORE INTO `cloud`.`guest_os_hypervisor` (uuid,hypervisor_type,
 hypervisor_version, guest_os_name, guest_os_id, created, is_user_defined)
 VALUES (UUID(),'Xenserver', '6.2.5', 'Windows Server 2012 (64-bit)', 168,
 now(), 0);
 +
 +-- Fix CLOUDSTACK-7624
 +ALTER TABLE `cloud`.`configuration` MODIFY default_value varchar(8191),
 MODIFY value varchar(8191);




-- 
Daan


Re: SystemVM file name changes

2014-09-24 Thread Ian Duffy
 Aren’t they published to S3 somewhere? It’d probably be better if users
fetch systemvms from S3……

Both not a clue what the S3 urls are though.

 though one wonders why users need to fetch
systemvms built from master at all…

Ease of access for running from the latest master branch I'd imagine.

On 24 September 2014 15:21, Leo Simons lsim...@schubergphilis.com wrote:

 On Sep 24, 2014, at 11:26 AM, Ian Duffy i...@ianduffy.ie wrote:
  The general concept is one of traceable and repeatable builds.
 
  In the context of jenkins.buildacloud.org I would disagree with this.
 Only
  two build jobs are ever kept. When a time arises when you need to figure
  out what commit your systemvm was based of I'd be willing to bet that job
  has been cleared out of jenkins ages ago.
 
  In RPM land, the jenkins $BUILD_NUMBER should go into the RPM Release
  field and not into the RPM Version field. But in this case we don’t have
  RPM, or spec files
 
  Isn't this what we use /etc/cloudstack-release for?
  You could include extra information in there if you wish, version,
 branch,
  git sha1, etc. which would give great traceability.

 Sounds like a plan. I’ll see about submitting a patch tonight. The issue
 is that /etc/cloudstack-release is parsed in a location or two (I forget
 the details) so it kind-of has to match existing regexes.

  The supplied download-template script is dependant on having a local
  nexus/artifactory that can do searching on published build artifacts. In
  the context of jenkins.buildacloud.org the system vms are not uploaded
 to
  nexus/artifactory and just kept on the jenkins box.

 Aren’t they published to S3 somewhere? It’d probably be better if users
 fetch systemvms from S3……though one wonders why users need to fetch
 systemvms built from master at all…

  Changing this causes 404s for people example:
 
 https://mail-archives.apache.org/mod_mbox/cloudstack-users/201409.mbox/browser

 Hmm. We can’t have too many people badgering jenkins like this I guess. So
 let’s improve on that!

 In the meantime...
   export BUILD_NUMBER=
 at the right place in the relevant build job should fix the immediate
 issue...


 cheers,


 Leo




Re: cloudstack 4.4 access return 404 after cloudstack-management restart

2014-09-24 Thread Ning Wang
thanks all!
the last lines of management-server.log:
!2438 # tail -50 management-server.log
2014-09-23 21:55:07,389 DEBUG [o.a.c.s.l.r.ExtensionRegistry] (main:null)
Registering extension [Baremetal Manager] in [Api Commands Registry]
2014-09-23 21:55:07,389 DEBUG [o.a.c.s.l.r.RegistryLifecycle] (main:null)
Registered com.cloud.baremetal.manager.BaremetalManagerImpl@58b5c43
2014-09-23 21:55:07,389 DEBUG [o.a.c.s.l.r.ExtensionRegistry] (main:null)
Registering extension [ApiDiscoveryServiceImpl] in [Api Commands Registry]
2014-09-23 21:55:07,389 DEBUG [o.a.c.s.l.r.RegistryLifecycle] (main:null)
Registered org.apache.cloudstack.discovery.ApiDiscoveryServiceImpl@5ca3eca9
2014-09-23 21:55:07,514 INFO  [o.a.c.s.l.CloudStackExtendedLifeCycle]
(main:null) Running system integrity checker
com.cloud.upgrade.DatabaseIntegrityChecker@3837eb50
2014-09-23 21:55:07,514 INFO  [c.c.u.DatabaseIntegrityChecker] (main:null)
Grabbing lock to check for database integrity.
2014-09-23 21:55:07,516 INFO  [c.c.u.DatabaseIntegrityChecker] (main:null)
Performing database integrity check
2014-09-23 21:55:07,526 DEBUG [c.c.u.DatabaseIntegrityChecker] (main:null)
No duplicate hosts with the same local storage found in database
2014-09-23 21:55:07,527 DEBUG [c.c.u.d.VersionDaoImpl] (main:null) Checking
to see if the database is at a version before it was the version table is
created
2014-09-23 21:55:07,530 INFO  [o.a.c.s.l.CloudStackExtendedLifeCycle]
(main:null) Running system integrity checker
org.apache.cloudstack.utils.identity.ManagementServerNode@68374cdf
2014-09-23 21:55:11,573 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.CloudStackAccountDaoImpl_EnhancerByCloudStack_72cea584
2014-09-23 21:55:11,577 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.OfferingDaoImpl_EnhancerByCloudStack_7d914de
2014-09-23 21:55:11,577 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.SMetaDaoImpl_EnhancerByCloudStack_248004d6
2014-09-23 21:55:11,578 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.UserCredentialsDaoImpl_EnhancerByCloudStack_c581cff5
2014-09-23 21:55:11,578 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.MultipartMetaDaoImpl_EnhancerByCloudStack_be88795
2014-09-23 21:55:11,578 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.CloudStackConfigurationDaoImpl_EnhancerByCloudStack_33b417b3
2014-09-23 21:55:11,578 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.BucketPolicyDaoImpl_EnhancerByCloudStack_8b4e8178
2014-09-23 21:55:11,578 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.SObjectItemDaoImpl_EnhancerByCloudStack_6f613941
2014-09-23 21:55:11,579 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.MHostMountDaoImpl_EnhancerByCloudStack_c4646d50
2014-09-23 21:55:11,579 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.MHostDaoImpl_EnhancerByCloudStack_364c8f91
2014-09-23 21:55:11,579 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.MultiPartUploadsDaoImpl_EnhancerByCloudStack_f1c134be
2014-09-23 21:55:11,579 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.SBucketDaoImpl_EnhancerByCloudStack_c2fd7189
2014-09-23 21:55:11,580 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.SAclDaoImpl_EnhancerByCloudStack_35ec4a05
2014-09-23 21:55:11,580 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.MultiPartPartsDaoImpl_EnhancerByCloudStack_bdbb5f40
2014-09-23 21:55:11,580 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.CloudStackSvcOfferingDaoImpl_EnhancerByCloudStack_bd114ba3
2014-09-23 21:55:11,580 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.SHostDaoImpl_EnhancerByCloudStack_5edf05db
2014-09-23 21:55:11,581 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.SObjectDaoImpl_EnhancerByCloudStack_45b975cc
2014-09-23 21:55:11,581 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.persist.dao.CloudStackUserDaoImpl_EnhancerByCloudStack_4107fb26
2014-09-23 21:55:11,581 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.service.core.ec2.EC2Engine_EnhancerByCloudStack_98465a7c
2014-09-23 21:55:11,624 INFO  [c.c.u.c.ComponentContext] (main:null)
Configuring
com.cloud.bridge.service.controller.s3.ServiceProvider_EnhancerByCloudStack_c376f4f1
2014-09-23 21:55:11,692 INFO  [c.c.u.c.ComponentContext] (main:null)
Starting
com.cloud.bridge.persist.dao.CloudStackAccountDaoImpl_EnhancerByCloudStack_72cea584
2014-09-23 21:55:11,692 INFO  [c.c.u.c.ComponentContext] (main:null)
Starting

SystemVM SSH Keys

2014-09-24 Thread Mo
Hello,

I just realized, upon setting up CloudStack, I am without system VM ssh keys. 
Is there a script and/or something I can do to get this generated?

- Mo




What is process for bundling third-party code with CloudStack?

2014-09-24 Thread Demetrius Tsitrelis
OWASP has some security-related modules which would be great to incorporate 
into CloudStack:

https://www.owasp.org/index.php/OWASP_Java_Encoder_Project

https://www.owasp.org/index.php/OWASP_JSON_Sanitizer

These are BSD licensed.  What is the process for bundling them into CloudStack? 
 Legal review, etc.?


Re: cloudstack 4.4 access return 404 after cloudstack-management restart

2014-09-24 Thread Daan Hoogland
Ning Wang,

Can you try the latest version of 4.4? Hugo made a fix to a db issue and I
am curious if it is related.

On Wed, Sep 24, 2014 at 6:11 PM, Ning Wang wangning...@gmail.com wrote:

 thanks all!
 the last lines of management-server.log:
 !2438 # tail -50 management-server.log
 2014-09-23 21:55:07,389 DEBUG [o.a.c.s.l.r.ExtensionRegistry] (main:null)
 Registering extension [Baremetal Manager] in [Api Commands Registry]
 2014-09-23 21:55:07,389 DEBUG [o.a.c.s.l.r.RegistryLifecycle] (main:null)
 Registered com.cloud.baremetal.manager.BaremetalManagerImpl@58b5c43
 2014-09-23 21:55:07,389 DEBUG [o.a.c.s.l.r.ExtensionRegistry] (main:null)
 Registering extension [ApiDiscoveryServiceImpl] in [Api Commands Registry]
 2014-09-23 21:55:07,389 DEBUG [o.a.c.s.l.r.RegistryLifecycle] (main:null)
 Registered org.apache.cloudstack.discovery.ApiDiscoveryServiceImpl@5ca3eca9
 2014-09-23 21:55:07,514 INFO  [o.a.c.s.l.CloudStackExtendedLifeCycle]
 (main:null) Running system integrity checker
 com.cloud.upgrade.DatabaseIntegrityChecker@3837eb50
 2014-09-23 21:55:07,514 INFO  [c.c.u.DatabaseIntegrityChecker] (main:null)
 Grabbing lock to check for database integrity.
 2014-09-23 21:55:07,516 INFO  [c.c.u.DatabaseIntegrityChecker] (main:null)
 Performing database integrity check
 2014-09-23 21:55:07,526 DEBUG [c.c.u.DatabaseIntegrityChecker] (main:null)
 No duplicate hosts with the same local storage found in database
 2014-09-23 21:55:07,527 DEBUG [c.c.u.d.VersionDaoImpl] (main:null)
 Checking to see if the database is at a version before it was the version
 table is created
 2014-09-23 21:55:07,530 INFO  [o.a.c.s.l.CloudStackExtendedLifeCycle]
 (main:null) Running system integrity checker
 org.apache.cloudstack.utils.identity.ManagementServerNode@68374cdf
 2014-09-23 21:55:11,573 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.CloudStackAccountDaoImpl_EnhancerByCloudStack_72cea584
 2014-09-23 21:55:11,577 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.OfferingDaoImpl_EnhancerByCloudStack_7d914de
 2014-09-23 21:55:11,577 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.SMetaDaoImpl_EnhancerByCloudStack_248004d6
 2014-09-23 21:55:11,578 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.UserCredentialsDaoImpl_EnhancerByCloudStack_c581cff5
 2014-09-23 21:55:11,578 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.MultipartMetaDaoImpl_EnhancerByCloudStack_be88795
 2014-09-23 21:55:11,578 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.CloudStackConfigurationDaoImpl_EnhancerByCloudStack_33b417b3
 2014-09-23 21:55:11,578 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.BucketPolicyDaoImpl_EnhancerByCloudStack_8b4e8178
 2014-09-23 21:55:11,578 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.SObjectItemDaoImpl_EnhancerByCloudStack_6f613941
 2014-09-23 21:55:11,579 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.MHostMountDaoImpl_EnhancerByCloudStack_c4646d50
 2014-09-23 21:55:11,579 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.MHostDaoImpl_EnhancerByCloudStack_364c8f91
 2014-09-23 21:55:11,579 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.MultiPartUploadsDaoImpl_EnhancerByCloudStack_f1c134be
 2014-09-23 21:55:11,579 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.SBucketDaoImpl_EnhancerByCloudStack_c2fd7189
 2014-09-23 21:55:11,580 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.SAclDaoImpl_EnhancerByCloudStack_35ec4a05
 2014-09-23 21:55:11,580 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.MultiPartPartsDaoImpl_EnhancerByCloudStack_bdbb5f40
 2014-09-23 21:55:11,580 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.CloudStackSvcOfferingDaoImpl_EnhancerByCloudStack_bd114ba3
 2014-09-23 21:55:11,580 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.SHostDaoImpl_EnhancerByCloudStack_5edf05db
 2014-09-23 21:55:11,581 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.SObjectDaoImpl_EnhancerByCloudStack_45b975cc
 2014-09-23 21:55:11,581 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.persist.dao.CloudStackUserDaoImpl_EnhancerByCloudStack_4107fb26
 2014-09-23 21:55:11,581 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 com.cloud.bridge.service.core.ec2.EC2Engine_EnhancerByCloudStack_98465a7c
 2014-09-23 21:55:11,624 INFO  [c.c.u.c.ComponentContext] (main:null)
 Configuring
 

Re: What is process for bundling third-party code with CloudStack?

2014-09-24 Thread Rohit Yadav
Can you share with us what you’re trying to do with it?

On 24-Sep-2014, at 8:10 pm, Demetrius Tsitrelis 
demetrius.tsitre...@citrix.com wrote:
 OWASP has some security-related modules which would be great to incorporate 
 into CloudStack:

 https://www.owasp.org/index.php/OWASP_Java_Encoder_Project

 https://www.owasp.org/index.php/OWASP_JSON_Sanitizer

 These are BSD licensed.  What is the process for bundling them into 
 CloudStack?  Legal review, etc.?

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +41 779015219 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design  Buildhttp://shapeblue.com/iaas-cloud-design-and-build//
CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
CloudStack Infrastructure 
Supporthttp://shapeblue.com/cloudstack-infrastructure-support/
CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England  Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.


Re: [ACS441] merge request: hotfix/4.4-7574

2014-09-24 Thread Amogh Vasekar
Same here wrt OS name, did quick search to find the relevant enum from
Vmware docs, but could not find one. Hence wondered if we even support it.
Will do a more thorough search and probably submit a merge request if
found.

Amogh 

On 9/23/14 7:15 PM, Pierre-Luc Dion pd...@cloudops.com wrote:

I guest so, but I don't know the OS name to define in VMware :-S  I don't
have a VMware system in hand.


*Pierre-Luc DION*
Architecte de Solution Cloud | Cloud Solutions Architect
t 855.652.5683

*CloudOps* Votre partenaire infonuagique* | *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
w cloudops.com *|* tw @CloudOps_


On Tue, Sep 23, 2014 at 9:22 PM, Amogh Vasekar amogh.vase...@citrix.com
wrote:

 Hi,

 Do we claim support for these OS on vmware too?

 Amogh

 On 9/23/14 5:44 PM, Pierre-Luc Dion pd...@cloudops.com wrote:

 Hi Dahn,
 
 can you merge this branch into 4.4, I've test creation of windows 8.1,
 2012r2 and centos6.5 on xenserver.
 
 Thanks,
 
 Pierre-Luc





Re: What is process for bundling third-party code with CloudStack?

2014-09-24 Thread Daan Hoogland
Demitrius,

I second Rohits request. That said the BSD license is on the A-list at [1]
so no problem there.
We must agree it makes technical sense to include them. There must be
attribution in the LICENSE file. they should be maven central includable so
we don't have to put them in our source tree. and that's it.

[1] https://www.apache.org/legal/3party.html


On Wed, Sep 24, 2014 at 8:57 PM, Rohit Yadav rohit.ya...@shapeblue.com
wrote:

 Can you share with us what you’re trying to do with it?

 On 24-Sep-2014, at 8:10 pm, Demetrius Tsitrelis 
 demetrius.tsitre...@citrix.com wrote:
  OWASP has some security-related modules which would be great to
 incorporate into CloudStack:
 
  https://www.owasp.org/index.php/OWASP_Java_Encoder_Project
 
  https://www.owasp.org/index.php/OWASP_JSON_Sanitizer
 
  These are BSD licensed.  What is the process for bundling them into
 CloudStack?  Legal review, etc.?

 Regards,
 Rohit Yadav
 Software Architect, ShapeBlue
 M. +41 779015219 | rohit.ya...@shapeblue.com
 Blog: bhaisaab.org | Twitter: @_bhaisaab



 Find out more about ShapeBlue and our range of CloudStack related services

 IaaS Cloud Design  Build
 http://shapeblue.com/iaas-cloud-design-and-build//
 CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
 CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
 CloudStack Infrastructure Support
 http://shapeblue.com/cloudstack-infrastructure-support/
 CloudStack Bootcamp Training Courses
 http://shapeblue.com/cloudstack-training/

 This email and any attachments to it may be confidential and are intended
 solely for the use of the individual to whom it is addressed. Any views or
 opinions expressed are solely those of the author and do not necessarily
 represent those of Shape Blue Ltd or related companies. If you are not the
 intended recipient of this email, you must neither take any action based
 upon its contents, nor copy or show it to anyone. Please contact the sender
 if you believe you have received this email in error. Shape Blue Ltd is a
 company incorporated in England  Wales. ShapeBlue Services India LLP is a
 company incorporated in India and is operated under license from Shape Blue
 Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
 and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
 a company registered by The Republic of South Africa and is traded under
 license from Shape Blue Ltd. ShapeBlue is a registered trademark.




-- 
Daan


Re: [ACS441] merge request: hotfix/4.4-7574

2014-09-24 Thread Daan Hoogland
wow, be quick about it. I just baked a trial release candidate :P

On Wed, Sep 24, 2014 at 9:05 PM, Amogh Vasekar amogh.vase...@citrix.com
wrote:

 Same here wrt OS name, did quick search to find the relevant enum from
 Vmware docs, but could not find one. Hence wondered if we even support it.
 Will do a more thorough search and probably submit a merge request if
 found.

 Amogh

 On 9/23/14 7:15 PM, Pierre-Luc Dion pd...@cloudops.com wrote:

 I guest so, but I don't know the OS name to define in VMware :-S  I don't
 have a VMware system in hand.
 
 
 *Pierre-Luc DION*
 Architecte de Solution Cloud | Cloud Solutions Architect
 t 855.652.5683
 
 *CloudOps* Votre partenaire infonuagique* | *Cloud Solutions Experts
 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
 w cloudops.com *|* tw @CloudOps_
 
 
 On Tue, Sep 23, 2014 at 9:22 PM, Amogh Vasekar amogh.vase...@citrix.com
 wrote:
 
  Hi,
 
  Do we claim support for these OS on vmware too?
 
  Amogh
 
  On 9/23/14 5:44 PM, Pierre-Luc Dion pd...@cloudops.com wrote:
 
  Hi Dahn,
  
  can you merge this branch into 4.4, I've test creation of windows 8.1,
  2012r2 and centos6.5 on xenserver.
  
  Thanks,
  
  Pierre-Luc
 
 




-- 
Daan


Re: [ACS441] merge request: hotfix/4.4-7574

2014-09-24 Thread Daan Hoogland
it is on branch 4.4-RC20140924T2100 and has commit-id
620ad650bdda23cabdf4c9dc480072c02c59a2d1

btw,

On Wed, Sep 24, 2014 at 9:07 PM, Daan Hoogland daan.hoogl...@gmail.com
wrote:

 wow, be quick about it. I just baked a trial release candidate :P

 On Wed, Sep 24, 2014 at 9:05 PM, Amogh Vasekar amogh.vase...@citrix.com
 wrote:

 Same here wrt OS name, did quick search to find the relevant enum from
 Vmware docs, but could not find one. Hence wondered if we even support it.
 Will do a more thorough search and probably submit a merge request if
 found.

 Amogh

 On 9/23/14 7:15 PM, Pierre-Luc Dion pd...@cloudops.com wrote:

 I guest so, but I don't know the OS name to define in VMware :-S  I don't
 have a VMware system in hand.
 
 
 *Pierre-Luc DION*
 Architecte de Solution Cloud | Cloud Solutions Architect
 t 855.652.5683
 
 *CloudOps* Votre partenaire infonuagique* | *Cloud Solutions Experts
 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
 w cloudops.com *|* tw @CloudOps_
 
 
 On Tue, Sep 23, 2014 at 9:22 PM, Amogh Vasekar amogh.vase...@citrix.com
 
 wrote:
 
  Hi,
 
  Do we claim support for these OS on vmware too?
 
  Amogh
 
  On 9/23/14 5:44 PM, Pierre-Luc Dion pd...@cloudops.com wrote:
 
  Hi Dahn,
  
  can you merge this branch into 4.4, I've test creation of windows 8.1,
  2012r2 and centos6.5 on xenserver.
  
  Thanks,
  
  Pierre-Luc
 
 




 --
 Daan




-- 
Daan


Re: Urgent. Importing certificate to CS 4.3.1 using GUI

2014-09-24 Thread Amogh Vasekar
Hi,

Couple of things :

1. The error will be logged to the cloudstack management server log file
(management-server.log) and would really help to know what it is.
2. While uploading the certificate, the domain_suffix should be
somedomain.tld and not *.somedomain.tld (the asterisk is only for global
config so that cloudstack can distinguish between HTTP and HTTPS modes)

Thanks
Amogh

On 9/24/14 7:40 AM, France mailingli...@isg.si wrote:

Hi guys,

i want to migrate away from realhostip.com. I have set up DNS service in
no time, but am having problems importing certificates to ACS 3.4.1.

I created my own CA like this:

cd /etc/pki/CA
touch index.txt
echo 1000  serial
openssl genrsa -aes256 -out /etc/pki/CA/private/ca.key.pem 4096
chmod 400 /etc/pki/CA/private/ca.key.pem
 nano -w /etc/pki/tls/openssl.cnf
openssl req -new -x509 -days 63650 -key /etc/pki/CA/private/ca.key.pem
-sha256 -extensions v3_ca -out /etc/pki/CA/certs/ca.cert.pem


Signed my own keys and converted them to pkcs8 format like this:

cd /etc/pki/CA
openssl genrsa -out private/vse.somedomain.tld.key.pem 4096
chmod 400 private/vse.somedomain.tld.key.pem
openssl req -sha256 -new -key private/vse.somedomain.tld.key.pem  -out
certs/vse.somedomain.tld.csr.pem
openssl ca -keyfile private/ca.key.pem -cert certs/ca.cert.pem
-extensions usr_cert -notext -md sha256 -days 63649 -in
certs/vse.somedomain.tld.csr.pem -out certs/vse.somedomain.tld.cert.pem
openssl pkcs8 -topk8 -in private/vse.somedomain.tld.key.pem -out
private/vse.somedomain.tld.key.encrypted.pkcs8
openssl pkcs8 -in private/vse.somedomain.tld.key.encrypted.pkcs8 -out
private/vse.somedomain.tld.key.pkcs8
chmod 400 private/vse.somedomain.tld.key.encrypted.pkcs8
chmod 400 private/vse.somedomain.tld.key.pkcs8



But when trying to import it via GUI: infrastructure - SSL Certificate:
Certificate from vse.somedomain.tld.cert.pem
PKCS8 from private/vse.somedomain.tld.key.pkcs8
DNS domain suffix to: *.somedomain.tld

But it fails with:
Failed to update SSL Certificate.

Please help me upload the new certificate.
Catalina.out shows no error. I have no idea what else to check.

Thank you.
F.





Jenkins build is back to normal : simulator-singlerun #434

2014-09-24 Thread jenkins
See http://jenkins.buildacloud.org/job/simulator-singlerun/434/changes



Re: Regarding commit 7f440854f7bcd41a1bd6581c0239cde2e98261b7

2014-09-24 Thread Daan Hoogland
Devdeep,

Guess I made a booboo. It should have read like this , agree?

cmd = resource.getCurrentStatus(_id);
while ( cmd == null  ++retried 
_HostPingRetryCount.value())
{
cmd = resource.getCurrentStatus(_id);
Thread.sleep(1000*_HostPingRetryTimer.value());
}


On Wed, Sep 24, 2014 at 4:22 PM, Devdeep Singh devdeep.si...@citrix.com
wrote:

 Hi Daan,

 I am looking into bug [1] which reports that the vmsync functionality is
 broken on master. If a vm deployed by cloudstack is stopped directly on the
 hypervisor, its state is not updated in cloudstack. I see that in commit
 7f440854f7bcd41a1bd6581c0239cde2e98261b7, a change was made to retry
 retrieving the resource status (PingCommand) to deal with network glitches.
 However, there is an issue with the commit and it has caused a regression
 with the vmsync functionality. Now, by default, the PingTask is not
 checking for the status of the resource. This breaks vmsync for all direct
 connected agents, which includes xenserver, hyper-v etc.

 I'll be submitting a fix for this issue. Do let me know if you have any
 concerns with it.

 [1] https://issues.apache.org/jira/browse/CLOUDSTACK-7598

 Regards,
 Devdeep




-- 
Daan


RE: What is process for bundling third-party code with CloudStack?

2014-09-24 Thread Demetrius Tsitrelis
Both these are at Maven Central.

CloudStack cross-site scripting defenses should be improved.  The project 
doesn't have mature encoder/sanitization for JSON and HTML so these might be 
useful for those purposes.

-Original Message-
From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] 
Sent: Wednesday, September 24, 2014 12:07 PM
To: dev
Subject: Re: What is process for bundling third-party code with CloudStack?

Demitrius,

I second Rohits request. That said the BSD license is on the A-list at [1] so 
no problem there.
We must agree it makes technical sense to include them. There must be 
attribution in the LICENSE file. they should be maven central includable so we 
don't have to put them in our source tree. and that's it.

[1] https://www.apache.org/legal/3party.html


On Wed, Sep 24, 2014 at 8:57 PM, Rohit Yadav rohit.ya...@shapeblue.com
wrote:

 Can you share with us what you’re trying to do with it?

 On 24-Sep-2014, at 8:10 pm, Demetrius Tsitrelis  
 demetrius.tsitre...@citrix.com wrote:
  OWASP has some security-related modules which would be great to
 incorporate into CloudStack:
 
  https://www.owasp.org/index.php/OWASP_Java_Encoder_Project
 
  https://www.owasp.org/index.php/OWASP_JSON_Sanitizer
 
  These are BSD licensed.  What is the process for bundling them into
 CloudStack?  Legal review, etc.?

 Regards,
 Rohit Yadav
 Software Architect, ShapeBlue
 M. +41 779015219 | rohit.ya...@shapeblue.com
 Blog: bhaisaab.org | Twitter: @_bhaisaab



 Find out more about ShapeBlue and our range of CloudStack related 
 services

 IaaS Cloud Design  Build
 http://shapeblue.com/iaas-cloud-design-and-build//
 CSForge – rapid IaaS deployment 
 frameworkhttp://shapeblue.com/csforge/
 CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
 CloudStack Infrastructure Support
 http://shapeblue.com/cloudstack-infrastructure-support/
 CloudStack Bootcamp Training Courses
 http://shapeblue.com/cloudstack-training/

 This email and any attachments to it may be confidential and are 
 intended solely for the use of the individual to whom it is addressed. 
 Any views or opinions expressed are solely those of the author and do 
 not necessarily represent those of Shape Blue Ltd or related 
 companies. If you are not the intended recipient of this email, you 
 must neither take any action based upon its contents, nor copy or show 
 it to anyone. Please contact the sender if you believe you have 
 received this email in error. Shape Blue Ltd is a company incorporated 
 in England  Wales. ShapeBlue Services India LLP is a company 
 incorporated in India and is operated under license from Shape Blue 
 Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
 Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA 
 Pty Ltd is a company registered by The Republic of South Africa and is traded 
 under license from Shape Blue Ltd. ShapeBlue is a registered trademark.




--
Daan


Re: conf values for 4.4 from master

2014-09-24 Thread Sheng Yang
Sorry I don't understand why you cannot find them in 4.4. As I pointed out
before, here are the two lines in 4.4 release, in schema-430to440.sql.

https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blob;f=setup/db/db/schema-430to440.sql;h=cd4ba3603f2d1ff67d973afef8caf9be005a4965;hb=c9672d8b5710e597bca3a81a7b06dc90c7f5b1f7#l1660
INSERT INTO `cloud`.`configuration`(category, instance, component,
name, value, description, default_value) VALUES ('Advanced',
'DEFAULT', 'NetworkOrchestrationService',
'router.redundant.vrrp.interval', '1', 'seconds between VRRP
broadcast. It would 3 times broadcast fail to trigger fail-over
mechanism of redundant router', '1') ON DUPLICATE KEY UPDATE
category='Advanced';

https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blob;f=setup/db/db/schema-430to440.sql;h=cd4ba3603f2d1ff67d973afef8caf9be005a4965;hb=c9672d8b5710e597bca3a81a7b06dc90c7f5b1f7#l1670
INSERT INTO `cloud`.`configuration`(category, instance, component,
name, value, description, default_value) VALUES ('Advanced',
'DEFAULT', 'NetworkOrchestrationService',
'router.aggregation.command.each.timeout', '3', 'timeout in seconds
for each Virtual Router command being aggregated. The final
aggregation command timeout would be determined by this timeout *
commands counts ', '3') ON DUPLICATE KEY UPDATE category='Advanced';

--Sheng

On Wed, Sep 24, 2014 at 3:16 AM, Daan Hoogland daan.hoogl...@gmail.com
wrote:

 On Tue, Sep 23, 2014 at 8:13 PM, Sheng Yang sh...@yasker.org wrote:

  Hi Daan,
 
  These are already added for 4.4's schema-430to440.sql (and your second
 mail
  is the same as the first case of first mail...)
 
 ​The last line is no issue indeed. the lines 797 and 798 from master are
 not in the 4.4 branch:

 INSERT INTO `cloud`.`configuration`(category, instance, component, name,
 value, description, default_value) VALUES ('Advanced', 'DEFAULT',
 'NetworkOrchestrationService', 'router.redundant.vrrp.interval', '1',
 'seconds between VRRP broadcast. It would 3 times broadcast fail to trigger
 fail-over mechanism of redundant router', '1') ON DUPLICATE KEY UPDATE
 category='Advanced';
 INSERT INTO `cloud`.`configuration`(category, instance, component, name,
 value, description, default_value) VALUES ('Advanced', 'DEFAULT',
 'NetworkOrchestrationService', 'router.aggregation.command.each.timeout',
 '3', 'timeout in seconds for each Virtual Router command being aggregated.
 The final aggregation command timeout would be determined by this timeout *
 commands counts ', '3') ON DUPLICATE KEY UPDATE category='Advanced';
 ​


   these two lines where added by you to the file schema-430to440.sql in
   master but not in 4.4

 --
 Daan



4.5 build failing inconsistently while executing SAMLUtilsTest

2014-09-24 Thread Rayees Namathponnan
Hi All.

4.5 build failing inconsistently while running SAMLUtilsTest,  if we re-run the 
build it works fine, anyone observed this

Defect https://issues.apache.org/jira/browse/CLOUDSTACK-7626 created for this.

Regards,
Rayees


Re: SystemVM file name changes

2014-09-24 Thread Leo Simons
On Sep 24, 2014, at 5:33 PM, Ian Duffy i...@ianduffy.ie wrote:
 Aren’t they published to S3 somewhere? It’d probably be better if users
 fetch systemvms from S3……
 
 Both not a clue what the S3 urls are though.

Based on
http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201402.mbox/%3c3f6b7b36-32a2-4f11-aeff-36a400d67...@gmail.com%3E

It ought to be
https://s3.amazonaws.com/systemvm-templates.cloudstack.org/master/32/systemvmtemplate-master-xen.vhd.bz2
https://s3.amazonaws.com/systemvm-templates.cloudstack.org/master/64/systemvm64template-master-xen.vhd.bz2

and so forth but I’m getting permission denied. Hugo, any idea?

 Isn't this what we use /etc/cloudstack-release for?
 You could include extra information in there if you wish, version,
 branch,
 git sha1, etc. which would give great traceability.
 
 Sounds like a plan. I’ll see about submitting a patch tonight. The issue
 is that /etc/cloudstack-release is parsed in a location or two (I forget
 the details) so it kind-of has to match existing regexes.

Grmbl is all I have to say.

 In the meantime...
  export BUILD_NUMBER=
 at the right place in the relevant build job should fix the immediate
 issue...

Did this. Next builds _should_ be back to their old urls.


g’night!


Leo



system vm ssh keys

2014-09-24 Thread Mo
Is there a backend script I could run to regenerate the SsH keys for the system 
vms. 

It seems somehow when I built this, those didn't get populated. During the 
installation I ran into issue, perhaps that is the reason behind this.

Either way, help would be appreciated. 

Mo

Review Request 26008: CLOUDSTACK-7627: Automated Remote Access VPN on VPC Test Cases

2014-09-24 Thread Chandan Purushothama

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26008/
---

Review request for cloudstack, sangeetha hariharan, sanjeev n, Santhosh 
Edukulla, and SrikanteswaraRao Talluri.


Summary (updated)
-

CLOUDSTACK-7627: Automated Remote Access VPN on VPC Test Cases


Bugs: CLOUDSTACK-7627
https://issues.apache.org/jira/browse/CLOUDSTACK-7627


Repository: cloudstack-git


Description (updated)
---

Test Suite for Testing Remote Access VPN on VPC. 

I successfully automated the following components:

1.VPN Client Installation on Linux
2.Component that efficiently verifies Remote VPN Access between client and the 
Server.
3.Developed a component that automates VPN Client Configuration and services.
4.Test Cases of the Feature
5.Tested the Code multiple times on XenServer and fixed the bugs.


Diffs (updated)
-

  test/integration/component/test_remotevpn_vpc.py PRE-CREATION 
  tools/marvin/marvin/config/test_data.py bebcab9 

Diff: https://reviews.apache.org/r/26008/diff/


Testing (updated)
---

Testing Done on Two Configurations: XenServer and VMWare

XenServer Test Results:

Test case 01 : Enable VPN for Public IP Address on the VPC ... === TestName: 
test_01_RemoteAccessVPN_VPC_EnableVPNAndConnecttoVM | Status : SUCCESS ===
ok
Test case 02 : Remote a VPN User ... === TestName: test_02_VPC_RemoveVPNUser | 
Status : SUCCESS ===
ok
Test case 03 : Add a Different VPN User and Test Access with already existing 
VPN User ... === TestName: test_03_VPC_AddDifferentVPNUser | Status : SUCCESS 
===
ok
Test case 04 : Add a Previously Removed VPN User from the VPC and Test the VPN 
Connectivity ... === TestName: 
test_04_VPC_AddPreviouslyRemovedVPNUserTestConnectivity | Status : SUCCESS ===
ok
Test case 05 : Disable the VPN Service on the VPC ... === TestName: 
test_05_VPC_DisableVPNServiceOnVPC | Status : SUCCESS ===
ok
Test case 06 : Enabled Previously Dsiabled VPN Access to VPC. ... === TestName: 
test_06_VPC_EnablePreviouslyDisabledVPNAccesstoVPC | Status : SUCCESS ===
ok
Test case 07 : Create Nine VPN Users to test the remote.vpn.user.limit=8 
Configuration parameter ... === TestName: 
test_07_ConfigParam_TestRemoteVPNUserLimit | Status : SUCCESS ===
ok

--
Ran 7 tests in 851.687s

OK


VMWare Test Results:

=== TestName: None | Status : EXCEPTION ===
SKIP: Only XenServer VPNClient Template is ready currently. KVM,VMWare or 
Hyper-V VPN Client Templates are not ready. Skipping the test suite for those 
configurations
  begin captured stdout  -
=== TestName: None | Status : EXCEPTION ===


-  end captured stdout  --
  begin captured logging  
CSLog: DEBUG: Obtain the Admin's API Client
CSLog: DEBUG: Get the dictionary information that will be used during CCP 
tests, from test_data.py present on the Client
CSLog: DEBUG: Payload: {'apiKey': 
u'fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQ',
 'command': 'listDomains', 'signature': '5BHLOjDELImWRpvI/16LQ/TrLRM=', 
'response': 'json'}
CSLog: DEBUG: Sending GET Cmd : listDomains===
requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection 
(1): 10.220.135.90
requests.packages.urllib3.connectionpool: DEBUG: GET 
/client/api?apiKey=fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQcommand=listDomainsresponse=jsonsignature=5BHLOjDELImWRpvI%2F16LQ%2FTrLRM%3D
 HTTP/1.1 200 159
CSLog: DEBUG: Response : [{path : u'ROOT', haschild : False, id : 
u'42ebae70-4375-11e4-86a1-66733ba24ed8', name : u'ROOT', level : 0}]
CSLog: DEBUG: Payload: {'apiKey': 
u'fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQ',
 'name': u'XenRT-Zone-0', 'command': 'listZones', 'signature': 
'MH3voxNCEMIMA3deggb/EVxAog8=', 'response': 'json'}
CSLog: DEBUG: Sending GET Cmd : listZones===
requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection 
(1): 10.220.135.90
requests.packages.urllib3.connectionpool: DEBUG: GET 
/client/api?response=jsonapiKey=fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQcommand=listZonesname=XenRT-Zone-0signature=MH3voxNCEMIMA3deggb%2FEVxAog8%3D
 HTTP/1.1 200 416
CSLog: DEBUG: Response : [{localstorageenabled : False, name : u'XenRT-Zone-0', 
guestcidraddress : u'192.168.200.0/24', tags : [], zonetoken : 
u'd8f55583-777e-3f86-9a97-8b35a24bd558', dns1 : u'10.220.247.5', 
securitygroupsenabled : False, allocationstate : u'Enabled', internaldns1 : 
u'10.220.112.11', dhcpprovider : u'VirtualRouter', networktype : u'Advanced', 
id : u'60a2c7cc-0f4f-4114-978a-f67b0aa9d25c'}]
CSLog: CRITICAL: EXCEPTION: None: 

Re: Review Request 26008: CLOUDSTACK-7627: Automated Remote Access VPN on VPC Test Cases

2014-09-24 Thread Chandan Purushothama

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26008/
---

(Updated Sept. 25, 2014, 12:15 a.m.)


Review request for cloudstack, sangeetha hariharan, sanjeev n, Santhosh 
Edukulla, and SrikanteswaraRao Talluri.


Bugs: CLOUDSTACK-7627
https://issues.apache.org/jira/browse/CLOUDSTACK-7627


Repository: cloudstack-git


Description (updated)
---

Test Suite for Testing Remote Access VPN on VPC. 

I successfully automated the following components:

1.VPN Client Installation on Linux
2.Component that efficiently verifies Remote VPN Access between client and the 
Server.
3.Developed a component that automates VPN Client Configuration and services.
4.Test Cases of the Feature
5.Tested the Code multiple times on XenServer.
6.Tested the Code multiple times on VMWare (To test Skipping of Test Cases)


Diffs
-

  test/integration/component/test_remotevpn_vpc.py PRE-CREATION 
  tools/marvin/marvin/config/test_data.py bebcab9 

Diff: https://reviews.apache.org/r/26008/diff/


Testing
---

Testing Done on Two Configurations: XenServer and VMWare

XenServer Test Results:

Test case 01 : Enable VPN for Public IP Address on the VPC ... === TestName: 
test_01_RemoteAccessVPN_VPC_EnableVPNAndConnecttoVM | Status : SUCCESS ===
ok
Test case 02 : Remote a VPN User ... === TestName: test_02_VPC_RemoveVPNUser | 
Status : SUCCESS ===
ok
Test case 03 : Add a Different VPN User and Test Access with already existing 
VPN User ... === TestName: test_03_VPC_AddDifferentVPNUser | Status : SUCCESS 
===
ok
Test case 04 : Add a Previously Removed VPN User from the VPC and Test the VPN 
Connectivity ... === TestName: 
test_04_VPC_AddPreviouslyRemovedVPNUserTestConnectivity | Status : SUCCESS ===
ok
Test case 05 : Disable the VPN Service on the VPC ... === TestName: 
test_05_VPC_DisableVPNServiceOnVPC | Status : SUCCESS ===
ok
Test case 06 : Enabled Previously Dsiabled VPN Access to VPC. ... === TestName: 
test_06_VPC_EnablePreviouslyDisabledVPNAccesstoVPC | Status : SUCCESS ===
ok
Test case 07 : Create Nine VPN Users to test the remote.vpn.user.limit=8 
Configuration parameter ... === TestName: 
test_07_ConfigParam_TestRemoteVPNUserLimit | Status : SUCCESS ===
ok

--
Ran 7 tests in 851.687s

OK


VMWare Test Results:

=== TestName: None | Status : EXCEPTION ===
SKIP: Only XenServer VPNClient Template is ready currently. KVM,VMWare or 
Hyper-V VPN Client Templates are not ready. Skipping the test suite for those 
configurations
  begin captured stdout  -
=== TestName: None | Status : EXCEPTION ===


-  end captured stdout  --
  begin captured logging  
CSLog: DEBUG: Obtain the Admin's API Client
CSLog: DEBUG: Get the dictionary information that will be used during CCP 
tests, from test_data.py present on the Client
CSLog: DEBUG: Payload: {'apiKey': 
u'fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQ',
 'command': 'listDomains', 'signature': '5BHLOjDELImWRpvI/16LQ/TrLRM=', 
'response': 'json'}
CSLog: DEBUG: Sending GET Cmd : listDomains===
requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection 
(1): 10.220.135.90
requests.packages.urllib3.connectionpool: DEBUG: GET 
/client/api?apiKey=fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQcommand=listDomainsresponse=jsonsignature=5BHLOjDELImWRpvI%2F16LQ%2FTrLRM%3D
 HTTP/1.1 200 159
CSLog: DEBUG: Response : [{path : u'ROOT', haschild : False, id : 
u'42ebae70-4375-11e4-86a1-66733ba24ed8', name : u'ROOT', level : 0}]
CSLog: DEBUG: Payload: {'apiKey': 
u'fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQ',
 'name': u'XenRT-Zone-0', 'command': 'listZones', 'signature': 
'MH3voxNCEMIMA3deggb/EVxAog8=', 'response': 'json'}
CSLog: DEBUG: Sending GET Cmd : listZones===
requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection 
(1): 10.220.135.90
requests.packages.urllib3.connectionpool: DEBUG: GET 
/client/api?response=jsonapiKey=fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQcommand=listZonesname=XenRT-Zone-0signature=MH3voxNCEMIMA3deggb%2FEVxAog8%3D
 HTTP/1.1 200 416
CSLog: DEBUG: Response : [{localstorageenabled : False, name : u'XenRT-Zone-0', 
guestcidraddress : u'192.168.200.0/24', tags : [], zonetoken : 
u'd8f55583-777e-3f86-9a97-8b35a24bd558', dns1 : u'10.220.247.5', 
securitygroupsenabled : False, allocationstate : u'Enabled', internaldns1 : 
u'10.220.112.11', dhcpprovider : u'VirtualRouter', networktype : u'Advanced', 
id : u'60a2c7cc-0f4f-4114-978a-f67b0aa9d25c'}]
CSLog: CRITICAL: EXCEPTION: None: ['Traceback (most recent call 

Re: What is process for bundling third-party code with CloudStack?

2014-09-24 Thread David Nalley
Process is to submit a patch - get that approved. Make sure that the
bundling information is documented in NOTICE.

--David

On Wed, Sep 24, 2014 at 2:10 PM, Demetrius Tsitrelis
demetrius.tsitre...@citrix.com wrote:
 OWASP has some security-related modules which would be great to incorporate 
 into CloudStack:

 https://www.owasp.org/index.php/OWASP_Java_Encoder_Project

 https://www.owasp.org/index.php/OWASP_JSON_Sanitizer

 These are BSD licensed.  What is the process for bundling them into 
 CloudStack?  Legal review, etc.?