Re: [VOTE] Apache CloudStack 4.5.0 RC2

2015-01-31 Thread Pierre-Luc Dion
Did upgraded from 4.3.1 to 4.5.0-snapshot  with XenServer 6.2.

Upgrade went smoothly,  systemvm upgraded well
so far I've only found 2 missing label in the UI:  (
label.add.isolated.guest.network, label.password.reset.confirm).
We need make sure to provide the systemvm template with the commit:
805704721fbbbcce7aecfaa8aa214cfc8ab3bdfc
 which should provide a working management VPN to Guest Network and VPC.

I'm still testing over the weekend...


For the Release-Notes,  this jira filter: 12329800  does list 4.5.0 new
features and Improvement, from it there is not much to say  for the RN, but
considering the huge amount of bug fixes contained in 4.5.0, does anyone
have insight on new stuff in this release to spice up the What's new
section?

thanks


On Thu, Jan 29, 2015 at 3:30 PM, Mike Tutkowski 
mike.tutkow...@solidfire.com wrote:

 It definitely wouldn't break my heart if we had until Monday close of
 business (say, Pacific Time) to vote.

 I haven't been able to focus as much on testing this build as I would have
 liked and could use the weekend.

 On Thursday, January 29, 2015, Rohit Yadav rohit.ya...@shapeblue.com
 wrote:

  Please note the RC2 works fine on fresh installations but failed on
  upgrade for a packaging related issue (fixable manually CLOUDSTACK-7316,
  this has been fixed on 4.5 now).
 
  Before voting I want to confirm if anyone can reproduce the following:
 
  - Register new 4.5 template, upgrade from 4.3.2 to 4.5.0 RC2 and destroy
  old systemvms
  - New secondary storage VM starts but agent status gets stuck in
  connecting state sometimes. After this I'm unable to register new
  templates though starting VMs using existing templates work.
  - Rapid logs are seen:
  https://issues.apache.org/jira/browse/CLOUDSTACK-8183 (I'm not sure how
  to fix this, still exploring)
  - Likely an environment issue, console proxy did not work in advance
  zone for me though it worked for me in basic zone
 
  On Tuesday 27 January 2015 09:53 AM, David Nalley wrote:
 
  Hi folks,
 
  I've created a 4.5.0 release candidate, with the following artifacts
  up for a vote:
 
  Git Branch and Commit SH:
  https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=
  tree;h=refs/heads/4.5-RC20150127T0405;hb=4.5-RC20150127T0405
  Commit: dbfb78d4b8ad074f602540002e8678432d258bb5
 
  Source release (checksums and signatures are available at the same
  location):
  https://dist.apache.org/repos/dist/dev/cloudstack/4.5.0-rc2/
 
  PGP release keys (signed using 6FE50F1C):
  https://dist.apache.org/repos/dist/release/cloudstack/KEYS
 
  Vote will be open for at least 72 hours.
 
  For sanity in tallying the vote, can PMC members please be sure to
  indicate (binding) with their vote?
 
  [ ] +1  approve
  [ ] +0  no opinion
  [ ] -1  disapprove (and reason why)
 
 
  --
  Regards,
  Rohit Yadav
  Software Architect, ShapeBlue
  M. +91 8826230892 | rohit.ya...@shapeblue.com
  Blog: bhaisaab.org | Twitter: @_bhaisaab
  PS. If you see any footer below, I did not add it :)
  Find out more about ShapeBlue and our range of CloudStack related
 services
 
  IaaS Cloud Design  Buildhttp://shapeblue.com/
  iaas-cloud-design-and-build//
  CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
  CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
  CloudStack Software Engineering
 http://shapeblue.com/cloudstack-software-
  engineering/
  CloudStack Infrastructure Supporthttp://shapeblue.com/
  cloudstack-infrastructure-support/
  CloudStack Bootcamp Training Courseshttp://shapeblue.com/
  cloudstack-training/
 
  This email and any attachments to it may be confidential and are intended
  solely for the use of the individual to whom it is addressed. Any views
 or
  opinions expressed are solely those of the author and do not necessarily
  represent those of Shape Blue Ltd or related companies. If you are not
 the
  intended recipient of this email, you must neither take any action based
  upon its contents, nor copy or show it to anyone. Please contact the
 sender
  if you believe you have received this email in error. Shape Blue Ltd is a
  company incorporated in England  Wales. ShapeBlue Services India LLP is
 a
  company incorporated in India and is operated under license from Shape
 Blue
  Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
 Brasil
  and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd
 is
  a company registered by The Republic of South Africa and is traded under
  license from Shape Blue Ltd. ShapeBlue is a registered trademark.
 


 --
 *Mike Tutkowski*
 *Senior CloudStack Developer, SolidFire Inc.*
 e: mike.tutkow...@solidfire.com
 o: 303.746.7302
 Advancing the way the world uses the cloud
 http://solidfire.com/solution/overview/?video=play*™*



Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread Rajani Karuturi
I think the below commits from marcus addresses them.
https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=35ede041
https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=455998ce

~Rajani

On Sat, Jan 31, 2015 at 1:31 PM, Mike Tutkowski 
mike.tutkow...@solidfire.com wrote:

 I should point out that I'm on master.

 On Saturday, January 31, 2015, Mike Tutkowski 
 mike.tutkow...@solidfire.com
 wrote:

  Hi everyone,
 
  Any news on this?
 
  I am still having trouble creating a VM on local storage on KVM (with or
  without kvmclock.disable=true in agent.properties).
 
  I'm on Ubuntu 12.04.1.
 
  Thanks!
  Mike
 
  On Sat, Jan 24, 2015 at 2:19 AM, Wilder Rodrigues 
  wrodrig...@schubergphilis.com wrote:
 
  Okay, thanks for the clarification.
 
  I will test it over the weekend.
 
  Cheers,
  Wilder
 
  On 22 Jan 2015, at 15:20, Rohit Yadav rohit.ya...@shapeblue.com wrote:
 
   Hi Wilder,
  
   If you’re testing please use latest 4.5 branch which should become the
  next RC. At the moment the latest is SHA
  d08369ad06b6d5ef801f79493c2aa4bdaeab1b83. Thanks.
  
   On 22-Jan-2015, at 6:29 pm, Wilder Rodrigues 
  wrodrig...@schubergphilis.com wrote:
  
   Hi Rohit,
  
   Tests were based on the commit id gave put in the RC1:
  8db3cbd4ff62b17a8b496026b68cf60ee0c76740
  
   Please let me know if there is a new commit ID to be used and I will
  test it.
  
   Apologies for the misunderstanding, I have been a bit away from the
  list. :)
  
   Cheers,
   Wilder
  
   On 22 Jan 2015, at 12:29, Rohit Yadav rohit.ya...@shapeblue.com
  wrote:
  
   Hi Wilder,
  
   Thanks for sharing, but I’m confused if these tests were against
  latest 4.5 branch or the RC1? Looking forward to your tests (on latest
  4.5). Thanks.
  
   Regards.
  
   On 22-Jan-2015, at 4:24 pm, Wilder Rodrigues 
  wrodrig...@schubergphilis.com wrote:
  
   Hi all,
  
   Sorry for the delay on the tests and also coming to it only after
 the
  RC has been cancelled, but I was way too busy with the redundant VPC
 work.
  
   Remarks:
  
   * I will test Basic Zone later today
   * For those willing to read, I added the whole events log after the
  tests results. :)
  
   There go my results:
  
   :: Environment ::
  
   Host: XenServer 6.2 - running under a VMware zone within our ACS
  Beta-Cloud infra
   Management Server: MacBook Pro
   Database: MySQL running locally on my MacBook Pro
  
  
   :: Advanced Zone ::
  
  
 
 ===
   Test Create Account and user for that account ... === TestName:
  test_01_create_account | Status : SUCCESS ===
   ok
   Test Sub domain allowed to launch VM  when a Domain level zone is
  created ... === TestName: test_01_add_vm_to_subdomain | Status : SUCCESS
 ===
   ok
   Test delete domain without force option ... === TestName:
  test_DeleteDomain | Status : SUCCESS ===
   ok
   Test delete domain with force option ... === TestName:
  test_forceDeleteDomain | Status : SUCCESS ===
   ok
   Test update admin details ... === TestName: test_updateAdminDetails
 |
  Status : SUCCESS ===
   ok
   Test update domain admin details ... === TestName:
  test_updateDomainAdminDetails | Status : SUCCESS ===
   ok
   Test user update API ... === TestName: test_updateUserDetails |
  Status : SUCCESS ===
   ok
   Test login API with domain ... === TestName: test_LoginApiDomain |
  Status : SUCCESS ===
   ok
   Test if Login API does not return UUID's ... === TestName:
  test_LoginApiUuidResponse | Status : SUCCESS ===
   ok
  
  
 --
   Ran 9 tests in 1094.799s
  
   OK
  
  
   Test reset virtual machine on reboot ... === TestName:
  test_01_reset_vm_on_reboot | Status : SUCCESS ===
   ok
  
  
 --
   Ran 1 test in 217.296s
  
   OK
  
  
   Test advanced zone virtual router ... === TestName:
  test_advZoneVirtualRouter | Status : SUCCESS ===
   ok
   Test Deploy Virtual Machine ... === TestName: test_deploy_vm |
 Status
  : SUCCESS ===
   ok
   Test Multiple Deploy Virtual Machine ... === TestName:
  test_deploy_vm_multiple | Status : SUCCESS ===
   ok
   Test Stop Virtual Machine ... === TestName: test_01_stop_vm | Status
  : SUCCESS ===
   ok
   Test Start Virtual Machine ... === TestName: test_02_start_vm |
  Status : SUCCESS ===
   ok
   Test Reboot Virtual Machine ... === TestName: test_03_reboot_vm |
  Status : SUCCESS ===
   ok
   Test destroy Virtual Machine ... === TestName: test_06_destroy_vm |
  Status : SUCCESS ===
   ok
   Test recover Virtual Machine ... === TestName: test_07_restore_vm |
  Status : SUCCESS ===
   ok
   Test migrate VM ... SKIP: At least two hosts should be present in
 the
  zone for migration
   Test destroy(expunge) Virtual Machine ... === TestName:
  test_09_expunge_vm | Status : SUCCESS ===
   ok
  
  
 

Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread Mike Tutkowski
I should point out that I'm on master.

On Saturday, January 31, 2015, Mike Tutkowski mike.tutkow...@solidfire.com
wrote:

 Hi everyone,

 Any news on this?

 I am still having trouble creating a VM on local storage on KVM (with or
 without kvmclock.disable=true in agent.properties).

 I'm on Ubuntu 12.04.1.

 Thanks!
 Mike

 On Sat, Jan 24, 2015 at 2:19 AM, Wilder Rodrigues 
 wrodrig...@schubergphilis.com wrote:

 Okay, thanks for the clarification.

 I will test it over the weekend.

 Cheers,
 Wilder

 On 22 Jan 2015, at 15:20, Rohit Yadav rohit.ya...@shapeblue.com wrote:

  Hi Wilder,
 
  If you’re testing please use latest 4.5 branch which should become the
 next RC. At the moment the latest is SHA
 d08369ad06b6d5ef801f79493c2aa4bdaeab1b83. Thanks.
 
  On 22-Jan-2015, at 6:29 pm, Wilder Rodrigues 
 wrodrig...@schubergphilis.com wrote:
 
  Hi Rohit,
 
  Tests were based on the commit id gave put in the RC1:
 8db3cbd4ff62b17a8b496026b68cf60ee0c76740
 
  Please let me know if there is a new commit ID to be used and I will
 test it.
 
  Apologies for the misunderstanding, I have been a bit away from the
 list. :)
 
  Cheers,
  Wilder
 
  On 22 Jan 2015, at 12:29, Rohit Yadav rohit.ya...@shapeblue.com
 wrote:
 
  Hi Wilder,
 
  Thanks for sharing, but I’m confused if these tests were against
 latest 4.5 branch or the RC1? Looking forward to your tests (on latest
 4.5). Thanks.
 
  Regards.
 
  On 22-Jan-2015, at 4:24 pm, Wilder Rodrigues 
 wrodrig...@schubergphilis.com wrote:
 
  Hi all,
 
  Sorry for the delay on the tests and also coming to it only after the
 RC has been cancelled, but I was way too busy with the redundant VPC work.
 
  Remarks:
 
  * I will test Basic Zone later today
  * For those willing to read, I added the whole events log after the
 tests results. :)
 
  There go my results:
 
  :: Environment ::
 
  Host: XenServer 6.2 - running under a VMware zone within our ACS
 Beta-Cloud infra
  Management Server: MacBook Pro
  Database: MySQL running locally on my MacBook Pro
 
 
  :: Advanced Zone ::
 
 
 ===
  Test Create Account and user for that account ... === TestName:
 test_01_create_account | Status : SUCCESS ===
  ok
  Test Sub domain allowed to launch VM  when a Domain level zone is
 created ... === TestName: test_01_add_vm_to_subdomain | Status : SUCCESS ===
  ok
  Test delete domain without force option ... === TestName:
 test_DeleteDomain | Status : SUCCESS ===
  ok
  Test delete domain with force option ... === TestName:
 test_forceDeleteDomain | Status : SUCCESS ===
  ok
  Test update admin details ... === TestName: test_updateAdminDetails |
 Status : SUCCESS ===
  ok
  Test update domain admin details ... === TestName:
 test_updateDomainAdminDetails | Status : SUCCESS ===
  ok
  Test user update API ... === TestName: test_updateUserDetails |
 Status : SUCCESS ===
  ok
  Test login API with domain ... === TestName: test_LoginApiDomain |
 Status : SUCCESS ===
  ok
  Test if Login API does not return UUID's ... === TestName:
 test_LoginApiUuidResponse | Status : SUCCESS ===
  ok
 
  --
  Ran 9 tests in 1094.799s
 
  OK
 
 
  Test reset virtual machine on reboot ... === TestName:
 test_01_reset_vm_on_reboot | Status : SUCCESS ===
  ok
 
  --
  Ran 1 test in 217.296s
 
  OK
 
 
  Test advanced zone virtual router ... === TestName:
 test_advZoneVirtualRouter | Status : SUCCESS ===
  ok
  Test Deploy Virtual Machine ... === TestName: test_deploy_vm | Status
 : SUCCESS ===
  ok
  Test Multiple Deploy Virtual Machine ... === TestName:
 test_deploy_vm_multiple | Status : SUCCESS ===
  ok
  Test Stop Virtual Machine ... === TestName: test_01_stop_vm | Status
 : SUCCESS ===
  ok
  Test Start Virtual Machine ... === TestName: test_02_start_vm |
 Status : SUCCESS ===
  ok
  Test Reboot Virtual Machine ... === TestName: test_03_reboot_vm |
 Status : SUCCESS ===
  ok
  Test destroy Virtual Machine ... === TestName: test_06_destroy_vm |
 Status : SUCCESS ===
  ok
  Test recover Virtual Machine ... === TestName: test_07_restore_vm |
 Status : SUCCESS ===
  ok
  Test migrate VM ... SKIP: At least two hosts should be present in the
 zone for migration
  Test destroy(expunge) Virtual Machine ... === TestName:
 test_09_expunge_vm | Status : SUCCESS ===
  ok
 
  --
  Ran 10 tests in 816.707s
 
  OK (SKIP=1)
 
 
  test_privategw_acl
 (integration.acs.tests.test_privategw_acl.TestPrivateGwACL) ... ===
 TestName: test_privategw_acl | Status : SUCCESS ===
  ok
 
  --
  Ran 1 test in 85.883s
 
  OK
 
 
  Test to create service offering ... === TestName:
 test_01_create_service_offering | Status : SUCCESS ===
  ok
  Test to update existing service offering ... === 

Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread Nux!
I was about to test 4.4 to 4.5 upgrade, but I'd rather have this kvmclock thing 
fixed.
When will the next RC be cut?

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

- Original Message -
 From: Rajani Karuturi raj...@apache.org
 To: dev@cloudstack.apache.org
 Sent: Saturday, 31 January, 2015 13:57:33
 Subject: Re: [VOTE] Apache CloudStack 4.5.0 RC1

 I think the below commits from marcus addresses them.
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=35ede041
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=455998ce
 
 ~Rajani
 
 On Sat, Jan 31, 2015 at 1:31 PM, Mike Tutkowski 
 mike.tutkow...@solidfire.com wrote:
 
 I should point out that I'm on master.

 On Saturday, January 31, 2015, Mike Tutkowski 
 mike.tutkow...@solidfire.com
 wrote:

  Hi everyone,
 
  Any news on this?
 
  I am still having trouble creating a VM on local storage on KVM (with or
  without kvmclock.disable=true in agent.properties).
 
  I'm on Ubuntu 12.04.1.
 
  Thanks!
  Mike
 
  On Sat, Jan 24, 2015 at 2:19 AM, Wilder Rodrigues 
  wrodrig...@schubergphilis.com wrote:
 
  Okay, thanks for the clarification.
 
  I will test it over the weekend.
 
  Cheers,
  Wilder
 
  On 22 Jan 2015, at 15:20, Rohit Yadav rohit.ya...@shapeblue.com wrote:
 
   Hi Wilder,
  
   If you’re testing please use latest 4.5 branch which should become the
  next RC. At the moment the latest is SHA
  d08369ad06b6d5ef801f79493c2aa4bdaeab1b83. Thanks.
  
   On 22-Jan-2015, at 6:29 pm, Wilder Rodrigues 
  wrodrig...@schubergphilis.com wrote:
  
   Hi Rohit,
  
   Tests were based on the commit id gave put in the RC1:
  8db3cbd4ff62b17a8b496026b68cf60ee0c76740
  
   Please let me know if there is a new commit ID to be used and I will
  test it.
  
   Apologies for the misunderstanding, I have been a bit away from the
  list. :)
  
   Cheers,
   Wilder
  
   On 22 Jan 2015, at 12:29, Rohit Yadav rohit.ya...@shapeblue.com
  wrote:
  
   Hi Wilder,
  
   Thanks for sharing, but I’m confused if these tests were against
  latest 4.5 branch or the RC1? Looking forward to your tests (on latest
  4.5). Thanks.
  
   Regards.
  
   On 22-Jan-2015, at 4:24 pm, Wilder Rodrigues 
  wrodrig...@schubergphilis.com wrote:
  
   Hi all,
  
   Sorry for the delay on the tests and also coming to it only after
 the
  RC has been cancelled, but I was way too busy with the redundant VPC
 work.
  
   Remarks:
  
   * I will test Basic Zone later today
   * For those willing to read, I added the whole events log after the
  tests results. :)
  
   There go my results:
  
   :: Environment ::
  
   Host: XenServer 6.2 - running under a VMware zone within our ACS
  Beta-Cloud infra
   Management Server: MacBook Pro
   Database: MySQL running locally on my MacBook Pro
  
  
   :: Advanced Zone ::
  
  
 
 ===
   Test Create Account and user for that account ... === TestName:
  test_01_create_account | Status : SUCCESS ===
   ok
   Test Sub domain allowed to launch VM  when a Domain level zone is
  created ... === TestName: test_01_add_vm_to_subdomain | Status : SUCCESS
 ===
   ok
   Test delete domain without force option ... === TestName:
  test_DeleteDomain | Status : SUCCESS ===
   ok
   Test delete domain with force option ... === TestName:
  test_forceDeleteDomain | Status : SUCCESS ===
   ok
   Test update admin details ... === TestName: test_updateAdminDetails
 |
  Status : SUCCESS ===
   ok
   Test update domain admin details ... === TestName:
  test_updateDomainAdminDetails | Status : SUCCESS ===
   ok
   Test user update API ... === TestName: test_updateUserDetails |
  Status : SUCCESS ===
   ok
   Test login API with domain ... === TestName: test_LoginApiDomain |
  Status : SUCCESS ===
   ok
   Test if Login API does not return UUID's ... === TestName:
  test_LoginApiUuidResponse | Status : SUCCESS ===
   ok
  
  
 --
   Ran 9 tests in 1094.799s
  
   OK
  
  
   Test reset virtual machine on reboot ... === TestName:
  test_01_reset_vm_on_reboot | Status : SUCCESS ===
   ok
  
  
 --
   Ran 1 test in 217.296s
  
   OK
  
  
   Test advanced zone virtual router ... === TestName:
  test_advZoneVirtualRouter | Status : SUCCESS ===
   ok
   Test Deploy Virtual Machine ... === TestName: test_deploy_vm |
 Status
  : SUCCESS ===
   ok
   Test Multiple Deploy Virtual Machine ... === TestName:
  test_deploy_vm_multiple | Status : SUCCESS ===
   ok
   Test Stop Virtual Machine ... === TestName: test_01_stop_vm | Status
  : SUCCESS ===
   ok
   Test Start Virtual Machine ... === TestName: test_02_start_vm |
  Status : SUCCESS ===
   ok
   Test Reboot Virtual Machine ... === TestName: test_03_reboot_vm |
  Status : SUCCESS ===
   ok
   Test destroy Virtual Machine ... === TestName: 

Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread David Nalley
On Sat, Jan 31, 2015 at 1:18 PM, Nux! n...@li.nux.ro wrote:
 I was about to test 4.4 to 4.5 upgrade, but I'd rather have this kvmclock 
 thing fixed.
 When will the next RC be cut?

 Lucian


I've already cut RC2 that should include the kvmclock fixes.

--David


Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread Mike Tutkowski
Actually, there are two sections in that doc that specify different Libvirt
versions (depending on what you need to do):

* 0.9.4
* 0.9.11 (maybe this version has to be compiled from source?)

On Sun, Feb 1, 2015 at 12:35 AM, Mike Tutkowski 
mike.tutkow...@solidfire.com wrote:

 It looks like our 4.4 docs say we should be at 0.9.11 or later (of
 libvirt).

 I see I'm at 0.9.8, but when I run sudo apt-get install libvirt-bin, it
 says I'm at the latest.

 What am I missing there? :)

 On Sun, Feb 1, 2015 at 12:09 AM, Marcus shadow...@gmail.com wrote:

 That's a different error. It says you don't even have kvmclock. Please see
 the minimum libvirt/qemu versions required since ACS 4.0:


 http://cloudstack-installation.readthedocs.org/en/4.3/hypervisor_installation.html
 On Jan 31, 2015 10:51 PM, Mike Tutkowski mike.tutkow...@solidfire.com
 wrote:

  Interesting...I should be a week past that commit, but still see the
  following:
 
  2015-01-31 00:35:50,403 INFO  [kvm.storage.LibvirtStorageAdaptor]
  (agentRequest-Handler-3:null) Attempting to create volume
  b4cd55ca-1df0-4bfb-a2b2-0bf3d582 (Filesystem) in pool
  b9bd94e9-b55a-43a6-b4db-56f24ebf135a with size 1073741824
  2015-01-31 00:35:50,633 WARN  [kvm.resource.LibvirtComputingResource]
  (agentRequest-Handler-4:null) LibvirtException
  org.libvirt.LibvirtException: internal error unknown timer name
 'kvmclock'
  at org.libvirt.ErrorHandler.processError(Unknown Source)
  at org.libvirt.Connect.processError(Unknown Source)
  at org.libvirt.Connect.processError(Unknown Source)
  at org.libvirt.Connect.domainCreateXML(Unknown Source)
  at
 
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1257)
  at
 
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3811)
  at
 
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1351)
  at com.cloud.agent.Agent.processRequest(Agent.java:503)
  at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)
  at com.cloud.utils.nio.Task.run(Task.java:84)
  at
 
 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  at
 
 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)
 
  On Sat, Jan 31, 2015 at 6:57 AM, Rajani Karuturi raj...@apache.org
  wrote:
 
   I think the below commits from marcus addresses them.
  
  
 
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=35ede041
  
  
 
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=455998ce
  
   ~Rajani
  
   On Sat, Jan 31, 2015 at 1:31 PM, Mike Tutkowski 
   mike.tutkow...@solidfire.com wrote:
  
I should point out that I'm on master.
   
On Saturday, January 31, 2015, Mike Tutkowski 
mike.tutkow...@solidfire.com
wrote:
   
 Hi everyone,

 Any news on this?

 I am still having trouble creating a VM on local storage on KVM
 (with
   or
 without kvmclock.disable=true in agent.properties).

 I'm on Ubuntu 12.04.1.

 Thanks!
 Mike

 On Sat, Jan 24, 2015 at 2:19 AM, Wilder Rodrigues 
 wrodrig...@schubergphilis.com wrote:

 Okay, thanks for the clarification.

 I will test it over the weekend.

 Cheers,
 Wilder

 On 22 Jan 2015, at 15:20, Rohit Yadav rohit.ya...@shapeblue.com
   wrote:

  Hi Wilder,
 
  If you’re testing please use latest 4.5 branch which should
 become
   the
 next RC. At the moment the latest is SHA
 d08369ad06b6d5ef801f79493c2aa4bdaeab1b83. Thanks.
 
  On 22-Jan-2015, at 6:29 pm, Wilder Rodrigues 
 wrodrig...@schubergphilis.com wrote:
 
  Hi Rohit,
 
  Tests were based on the commit id gave put in the RC1:
 8db3cbd4ff62b17a8b496026b68cf60ee0c76740
 
  Please let me know if there is a new commit ID to be used and I
  will
 test it.
 
  Apologies for the misunderstanding, I have been a bit away from
  the
 list. :)
 
  Cheers,
  Wilder
 
  On 22 Jan 2015, at 12:29, Rohit Yadav 
 rohit.ya...@shapeblue.com
 wrote:
 
  Hi Wilder,
 
  Thanks for sharing, but I’m confused if these tests were
 against
 latest 4.5 branch or the RC1? Looking forward to your tests (on
  latest
 4.5). Thanks.
 
  Regards.
 
  On 22-Jan-2015, at 4:24 pm, Wilder Rodrigues 
 wrodrig...@schubergphilis.com wrote:
 
  Hi all,
 
  Sorry for the delay on the tests and also coming to it only
  after
the
 RC has been cancelled, but I was way too busy with the redundant
 VPC
work.
 
  Remarks:
 
  * I will test Basic Zone later today
  * For those willing to read, I added the whole events log
 after
   the
 tests results. :)
 
  There go my results:
 
  :: Environment ::
   

Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread Mike Tutkowski
Thanks, Marcus

Yeah, I'm looking through some of those old threads now. I don't see how
they resolved the issue, though.

This is what I see version wise (on Ubuntu 12.04.1):

cloudstack@cloudstack-kvm1:/var/log/cloudstack/agent$ sudo kvm --version
QEMU emulator version 1.0 (qemu-kvm-1.0), Copyright (c) 2003-2008 Fabrice
Bellard

cloudstack@cloudstack-kvm1:/var/log/cloudstack/agent$ sudo libvirtd
--version
libvirtd (libvirt) 0.9.8

On Sun, Feb 1, 2015 at 12:51 AM, Marcus shadow...@gmail.com wrote:

 The minimum versions aren't always what is shipped with the OS. There's a
 thread from awhile back about this, and about how difficult it was to
 target the disparate shipping versions with how quickly things were
 changing. There were some basic incompatibilities between the centos and
 Ubuntu versions, and on top of that there were issues around missing
 functionality. Ubuntu is easy if I recall, as there are special repos that
 most Ubuntu virt users leverage anyway. With centos it is a bit trickier to
 dig up the minimum requirements. I'd like to see more guidance in the docs
 on that.

 At any rate, none of this should be new to 4.5, kvmclock has been in place
 for longer than that. The previous issue with 4.5 and the referenced fix
 was that a recent libvirt version added XML checking that didn't like our
 XML. So if you were running 0.9.11 through 1.2.? you would not have seen
 any problem, but anything newer would fail the validation. The patch
 updates the XML. These are the same sort of problems that led to a minimum
 version, rather than working out the idiosyncrasies between distros.
 On Jan 31, 2015 11:37 PM, Mike Tutkowski mike.tutkow...@solidfire.com
 wrote:

  It looks like our 4.4 docs say we should be at 0.9.11 or later (of
  libvirt).
 
  I see I'm at 0.9.8, but when I run sudo apt-get install libvirt-bin, it
  says I'm at the latest.
 
  What am I missing there? :)
 
  On Sun, Feb 1, 2015 at 12:09 AM, Marcus shadow...@gmail.com wrote:
 
   That's a different error. It says you don't even have kvmclock. Please
  see
   the minimum libvirt/qemu versions required since ACS 4.0:
  
  
  
 
 http://cloudstack-installation.readthedocs.org/en/4.3/hypervisor_installation.html
   On Jan 31, 2015 10:51 PM, Mike Tutkowski 
 mike.tutkow...@solidfire.com
  
   wrote:
  
Interesting...I should be a week past that commit, but still see the
following:
   
2015-01-31 00:35:50,403 INFO  [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) Attempting to create volume
b4cd55ca-1df0-4bfb-a2b2-0bf3d582 (Filesystem) in pool
b9bd94e9-b55a-43a6-b4db-56f24ebf135a with size 1073741824
2015-01-31 00:35:50,633 WARN  [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-4:null) LibvirtException
org.libvirt.LibvirtException: internal error unknown timer name
   'kvmclock'
at org.libvirt.ErrorHandler.processError(Unknown Source)
at org.libvirt.Connect.processError(Unknown Source)
at org.libvirt.Connect.processError(Unknown Source)
at org.libvirt.Connect.domainCreateXML(Unknown Source)
at
   
   
  
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1257)
at
   
   
  
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3811)
at
   
   
  
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1351)
at com.cloud.agent.Agent.processRequest(Agent.java:503)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)
at com.cloud.utils.nio.Task.run(Task.java:84)
at
   
   
  
 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
   
   
  
 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
   
On Sat, Jan 31, 2015 at 6:57 AM, Rajani Karuturi raj...@apache.org
wrote:
   
 I think the below commits from marcus addresses them.


   
  
 
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=35ede041


   
  
 
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=455998ce

 ~Rajani

 On Sat, Jan 31, 2015 at 1:31 PM, Mike Tutkowski 
 mike.tutkow...@solidfire.com wrote:

  I should point out that I'm on master.
 
  On Saturday, January 31, 2015, Mike Tutkowski 
  mike.tutkow...@solidfire.com
  wrote:
 
   Hi everyone,
  
   Any news on this?
  
   I am still having trouble creating a VM on local storage on KVM
   (with
 or
   without kvmclock.disable=true in agent.properties).
  
   I'm on Ubuntu 12.04.1.
  
   Thanks!
   Mike
  
   On Sat, Jan 24, 2015 at 2:19 AM, Wilder Rodrigues 
   wrodrig...@schubergphilis.com wrote:
  
   Okay, thanks for the clarification.
  
   I will test 

Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread Mike Tutkowski
I am able to manually create a VM on KVM using an ISO. I just can't create
a VM via CloudStack due to that exception.

On Sat, Jan 31, 2015 at 11:49 PM, Mike Tutkowski 
mike.tutkow...@solidfire.com wrote:

 Interesting...I should be a week past that commit, but still see the
 following:

 2015-01-31 00:35:50,403 INFO  [kvm.storage.LibvirtStorageAdaptor]
 (agentRequest-Handler-3:null) Attempting to create volume
 b4cd55ca-1df0-4bfb-a2b2-0bf3d582 (Filesystem) in pool
 b9bd94e9-b55a-43a6-b4db-56f24ebf135a with size 1073741824
 2015-01-31 00:35:50,633 WARN  [kvm.resource.LibvirtComputingResource]
 (agentRequest-Handler-4:null) LibvirtException
 org.libvirt.LibvirtException: internal error unknown timer name 'kvmclock'
 at org.libvirt.ErrorHandler.processError(Unknown Source)
 at org.libvirt.Connect.processError(Unknown Source)
 at org.libvirt.Connect.processError(Unknown Source)
 at org.libvirt.Connect.domainCreateXML(Unknown Source)
 at
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1257)
 at
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3811)
 at
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1351)
 at com.cloud.agent.Agent.processRequest(Agent.java:503)
 at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)
 at com.cloud.utils.nio.Task.run(Task.java:84)
 at
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:744)

 On Sat, Jan 31, 2015 at 6:57 AM, Rajani Karuturi raj...@apache.org
 wrote:

 I think the below commits from marcus addresses them.

 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=35ede041

 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=455998ce

 ~Rajani

 On Sat, Jan 31, 2015 at 1:31 PM, Mike Tutkowski 
 mike.tutkow...@solidfire.com wrote:

  I should point out that I'm on master.
 
  On Saturday, January 31, 2015, Mike Tutkowski 
  mike.tutkow...@solidfire.com
  wrote:
 
   Hi everyone,
  
   Any news on this?
  
   I am still having trouble creating a VM on local storage on KVM (with
 or
   without kvmclock.disable=true in agent.properties).
  
   I'm on Ubuntu 12.04.1.
  
   Thanks!
   Mike
  
   On Sat, Jan 24, 2015 at 2:19 AM, Wilder Rodrigues 
   wrodrig...@schubergphilis.com wrote:
  
   Okay, thanks for the clarification.
  
   I will test it over the weekend.
  
   Cheers,
   Wilder
  
   On 22 Jan 2015, at 15:20, Rohit Yadav rohit.ya...@shapeblue.com
 wrote:
  
Hi Wilder,
   
If you’re testing please use latest 4.5 branch which should become
 the
   next RC. At the moment the latest is SHA
   d08369ad06b6d5ef801f79493c2aa4bdaeab1b83. Thanks.
   
On 22-Jan-2015, at 6:29 pm, Wilder Rodrigues 
   wrodrig...@schubergphilis.com wrote:
   
Hi Rohit,
   
Tests were based on the commit id gave put in the RC1:
   8db3cbd4ff62b17a8b496026b68cf60ee0c76740
   
Please let me know if there is a new commit ID to be used and I
 will
   test it.
   
Apologies for the misunderstanding, I have been a bit away from the
   list. :)
   
Cheers,
Wilder
   
On 22 Jan 2015, at 12:29, Rohit Yadav rohit.ya...@shapeblue.com
   wrote:
   
Hi Wilder,
   
Thanks for sharing, but I’m confused if these tests were against
   latest 4.5 branch or the RC1? Looking forward to your tests (on latest
   4.5). Thanks.
   
Regards.
   
On 22-Jan-2015, at 4:24 pm, Wilder Rodrigues 
   wrodrig...@schubergphilis.com wrote:
   
Hi all,
   
Sorry for the delay on the tests and also coming to it only after
  the
   RC has been cancelled, but I was way too busy with the redundant VPC
  work.
   
Remarks:
   
* I will test Basic Zone later today
* For those willing to read, I added the whole events log after
 the
   tests results. :)
   
There go my results:
   
:: Environment ::
   
Host: XenServer 6.2 - running under a VMware zone within our ACS
   Beta-Cloud infra
Management Server: MacBook Pro
Database: MySQL running locally on my MacBook Pro
   
   
:: Advanced Zone ::
   
   
  
 
 ===
Test Create Account and user for that account ... === TestName:
   test_01_create_account | Status : SUCCESS ===
ok
Test Sub domain allowed to launch VM  when a Domain level zone is
   created ... === TestName: test_01_add_vm_to_subdomain | Status :
 SUCCESS
  ===
ok
Test delete domain without force option ... === TestName:
   test_DeleteDomain | Status : SUCCESS ===
ok
Test delete domain with force option ... === TestName:
   test_forceDeleteDomain | Status : SUCCESS ===
ok
Test update admin details ... === TestName:
 test_updateAdminDetails
  |
   Status : SUCCESS ===
  

Re: RBD snapshot format

2015-01-31 Thread Wido den Hollander
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1



On 01/30/2015 04:43 PM, Logan Barfield wrote:
 Hi Wido,
 
 I didn't see the format information for snapshots stored in the 
 database, so I'm assuming it references the associated volume
 format.
 

Yes, it is.

 I assume the cleanest way to get around that would be to have a 
 separate format field for snapshots, but that wouldn't really make 
 sense just for this one use case.  Another way would be to just
 have the restore (create template from snapshot, etc.) function
 always assume QCOW2 for RBD snapshots, but that's dirty, and would
 cause problems for existing snapshots.
 

That would be dirty, since I don't think we can actually know if a
snapshpot was from a RBD volume when it's on SS.

Maybe qemu-img can detect the input format? That way we don't have to
specify it.

 It seems like the best method would be to have the restore
 function look at the actual file to get the format information
 instead of pulling it from the database, though I'm not sure if
 that's even possible.
 

I think that would be the best option indeed.

 Does anyone else have any thoughts or suggestions?
 
 Thank You,
 
 Logan Barfield Tranquil Hosting
 
 
 On Thu, Jan 29, 2015 at 4:21 PM, Wido den Hollander
 w...@widodh.nl wrote:
 
 
 On 01/29/2015 10:05 PM, Logan Barfield wrote:
 Hi Wido,
 
 The relevant code for this is in:
 
 I saw that the destination format is set to QCOW2 for 
 createTemplateFromVolume, but in backupSnapshot it's set
 to use the format of the source image 
 destFile.setFormat(snapshotDisk.getFormat());
 
 I believe just changing the backupSnapshot code to the use
 QCOW2 destFile.setFormat(PhysicalDiskFormat.QCOW2); will
 work fine. I can submit a patch for that, but I wanted to
 make sure there wasn't some other reason for the RAW output
 first.
 
 
 No, that won't work. Because the management server will then still 
 think it's in RAW format and store that in the database.
 
 It has been a long time since I looked at this. I know I did some
 work in this area and made some patches.
 
 Wido
 
 
 Thank You,
 
 Logan Barfield Tranquil Hosting
 
 
 On Thu, Jan 29, 2015 at 3:52 PM, Wido den Hollander 
 w...@widodh.nl wrote:
 
 
 On 01/29/2015 05:16 PM, Logan Barfield wrote:
 I was doing some testing earlier this week on a KVM
 cluster, and noticed that when using S3 for secondary
 storage snapshots on RBD primary storage take a lot
 longer than they do with NFS primary storage.
 
 I think this is due to the NFS snapshots being 
 output/uploaded in QCOW2 format, while RBD snapshots
 are output in RAW format.  It appears that even when
 using sparse RAW files they are uploaded to S3 with the
 'allocated' size instead of the sparse size.
 
 
 The problem here lies in the code in CloudStack. Since the
 source volume is in RAW format, the snapshot also becomes
 QCOW2.
 
 I remember that I wrote some patches for this, you might want
 to look in the Git history.
 
 My question is: Is there a good reason for RBD
 snapshots to be output as RAW instead of QCOW2?  It
 appears that QCOW2 templates are automatically
 converted when deploying them as RBD, so that shouldn't
 be a problem.  The only downside I can think of would
 be having to convert the RAW RBD data to QCOW2 as an
 extra step when creating snapshots, but even that seems
 like it would take less time than uploading the RAW 
 images to S3.
 
 Thoughts?
 
 
 Like I said, I think I wrote patches for this. Qemu-img is
 used to convert the RAW RBD into the snapshot, so QCOW2
 should be no problem as output format. But the code in
 CloudStack seems to assume that the snapshot volume is always
 the same format as the source.
 
 Wido
 
 P.S.: I'm on vacation in Norway at the moment, so I'm pretty
 laggy with replying.
 
 
 Thank You,
 
 Logan Barfield Tranquil Hosting
 
-BEGIN PGP SIGNATURE-
Version: GnuPG v1

iQIcBAEBAgAGBQJUzc2zAAoJEAGbWC3bPspCLFAP/0FuGqOTlo4DW40tP4v70zQ5
cjF1s9rg9Afd4OGc6KmcG2OxR/A68xMuHxJCPwVZjFlcNLMEWx8goxmJd9qLQaMM
es1xHynmSO3owhA9d7bRhvfL4M9mf/w/oSn1IQZ5l9v7bJX9y5iGuPkMPlBT5yej
yFWA92AAEVgne1J/E4JvoZbDoyAYVecrDPmFD8oP/9R2I7MlUr5134aShBIhJPM/
UgsY06dKfAWI2cW5vZxzw4haNTk68BMgjp6IBkirHqLL1wZa7R83c8/ygXsbvStJ
z5bLrxtLtwy6d3utjwJkfdtdnAfuiqZFOKdgxvhlS30Q0Y2XGLXfA3+DLVGmDBF5
xksxiAvhpvxkJIMYZx5icFJmNVu5NiaNn6yKRTkJzA687emF4fSjn1pgTHMp+hhB
gkZcYiazrrdFU0ibFkQMNWhT80Pc9spcJEMFkX32GnXTK8EOR7hqRpGrS1LLQjnk
XrukOOOjlHnQnRS8kTP9y2Rr5zBUnB6kVwd8DYCJGYdQUPlHaMOGPC9che7HzmFg
qzNPHm/WakWotlAldYOPFzmoV16jzF+j6lpgnREZMTq3DNVk6fRH4vzjIvlWzsbF
Rrq+7KbNxYc0SJfmTBh0jV/Zpm85ed0kYzXBnekq8ryItF1e2P5t4zoVcC7XHb9n
Y2Qvi+YYYZPW6fYIiznr
=TcvA
-END PGP SIGNATURE-


Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread Marcus
The minimum versions aren't always what is shipped with the OS. There's a
thread from awhile back about this, and about how difficult it was to
target the disparate shipping versions with how quickly things were
changing. There were some basic incompatibilities between the centos and
Ubuntu versions, and on top of that there were issues around missing
functionality. Ubuntu is easy if I recall, as there are special repos that
most Ubuntu virt users leverage anyway. With centos it is a bit trickier to
dig up the minimum requirements. I'd like to see more guidance in the docs
on that.

At any rate, none of this should be new to 4.5, kvmclock has been in place
for longer than that. The previous issue with 4.5 and the referenced fix
was that a recent libvirt version added XML checking that didn't like our
XML. So if you were running 0.9.11 through 1.2.? you would not have seen
any problem, but anything newer would fail the validation. The patch
updates the XML. These are the same sort of problems that led to a minimum
version, rather than working out the idiosyncrasies between distros.
On Jan 31, 2015 11:37 PM, Mike Tutkowski mike.tutkow...@solidfire.com
wrote:

 It looks like our 4.4 docs say we should be at 0.9.11 or later (of
 libvirt).

 I see I'm at 0.9.8, but when I run sudo apt-get install libvirt-bin, it
 says I'm at the latest.

 What am I missing there? :)

 On Sun, Feb 1, 2015 at 12:09 AM, Marcus shadow...@gmail.com wrote:

  That's a different error. It says you don't even have kvmclock. Please
 see
  the minimum libvirt/qemu versions required since ACS 4.0:
 
 
 
 http://cloudstack-installation.readthedocs.org/en/4.3/hypervisor_installation.html
  On Jan 31, 2015 10:51 PM, Mike Tutkowski mike.tutkow...@solidfire.com
 
  wrote:
 
   Interesting...I should be a week past that commit, but still see the
   following:
  
   2015-01-31 00:35:50,403 INFO  [kvm.storage.LibvirtStorageAdaptor]
   (agentRequest-Handler-3:null) Attempting to create volume
   b4cd55ca-1df0-4bfb-a2b2-0bf3d582 (Filesystem) in pool
   b9bd94e9-b55a-43a6-b4db-56f24ebf135a with size 1073741824
   2015-01-31 00:35:50,633 WARN  [kvm.resource.LibvirtComputingResource]
   (agentRequest-Handler-4:null) LibvirtException
   org.libvirt.LibvirtException: internal error unknown timer name
  'kvmclock'
   at org.libvirt.ErrorHandler.processError(Unknown Source)
   at org.libvirt.Connect.processError(Unknown Source)
   at org.libvirt.Connect.processError(Unknown Source)
   at org.libvirt.Connect.domainCreateXML(Unknown Source)
   at
  
  
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1257)
   at
  
  
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3811)
   at
  
  
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1351)
   at com.cloud.agent.Agent.processRequest(Agent.java:503)
   at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)
   at com.cloud.utils.nio.Task.run(Task.java:84)
   at
  
  
 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at
  
  
 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
  
   On Sat, Jan 31, 2015 at 6:57 AM, Rajani Karuturi raj...@apache.org
   wrote:
  
I think the below commits from marcus addresses them.
   
   
  
 
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=35ede041
   
   
  
 
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=455998ce
   
~Rajani
   
On Sat, Jan 31, 2015 at 1:31 PM, Mike Tutkowski 
mike.tutkow...@solidfire.com wrote:
   
 I should point out that I'm on master.

 On Saturday, January 31, 2015, Mike Tutkowski 
 mike.tutkow...@solidfire.com
 wrote:

  Hi everyone,
 
  Any news on this?
 
  I am still having trouble creating a VM on local storage on KVM
  (with
or
  without kvmclock.disable=true in agent.properties).
 
  I'm on Ubuntu 12.04.1.
 
  Thanks!
  Mike
 
  On Sat, Jan 24, 2015 at 2:19 AM, Wilder Rodrigues 
  wrodrig...@schubergphilis.com wrote:
 
  Okay, thanks for the clarification.
 
  I will test it over the weekend.
 
  Cheers,
  Wilder
 
  On 22 Jan 2015, at 15:20, Rohit Yadav rohit.ya...@shapeblue.com
 
wrote:
 
   Hi Wilder,
  
   If you’re testing please use latest 4.5 branch which should
  become
the
  next RC. At the moment the latest is SHA
  d08369ad06b6d5ef801f79493c2aa4bdaeab1b83. Thanks.
  
   On 22-Jan-2015, at 6:29 pm, Wilder Rodrigues 
  wrodrig...@schubergphilis.com wrote:
  
   Hi Rohit,
  
   Tests were based on the commit id gave put in the RC1:
  8db3cbd4ff62b17a8b496026b68cf60ee0c76740
  
   Please let me know if 

Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread Mike Tutkowski
Interesting...I should be a week past that commit, but still see the
following:

2015-01-31 00:35:50,403 INFO  [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) Attempting to create volume
b4cd55ca-1df0-4bfb-a2b2-0bf3d582 (Filesystem) in pool
b9bd94e9-b55a-43a6-b4db-56f24ebf135a with size 1073741824
2015-01-31 00:35:50,633 WARN  [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-4:null) LibvirtException
org.libvirt.LibvirtException: internal error unknown timer name 'kvmclock'
at org.libvirt.ErrorHandler.processError(Unknown Source)
at org.libvirt.Connect.processError(Unknown Source)
at org.libvirt.Connect.processError(Unknown Source)
at org.libvirt.Connect.domainCreateXML(Unknown Source)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1257)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3811)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1351)
at com.cloud.agent.Agent.processRequest(Agent.java:503)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)
at com.cloud.utils.nio.Task.run(Task.java:84)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)

On Sat, Jan 31, 2015 at 6:57 AM, Rajani Karuturi raj...@apache.org wrote:

 I think the below commits from marcus addresses them.

 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=35ede041

 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=455998ce

 ~Rajani

 On Sat, Jan 31, 2015 at 1:31 PM, Mike Tutkowski 
 mike.tutkow...@solidfire.com wrote:

  I should point out that I'm on master.
 
  On Saturday, January 31, 2015, Mike Tutkowski 
  mike.tutkow...@solidfire.com
  wrote:
 
   Hi everyone,
  
   Any news on this?
  
   I am still having trouble creating a VM on local storage on KVM (with
 or
   without kvmclock.disable=true in agent.properties).
  
   I'm on Ubuntu 12.04.1.
  
   Thanks!
   Mike
  
   On Sat, Jan 24, 2015 at 2:19 AM, Wilder Rodrigues 
   wrodrig...@schubergphilis.com wrote:
  
   Okay, thanks for the clarification.
  
   I will test it over the weekend.
  
   Cheers,
   Wilder
  
   On 22 Jan 2015, at 15:20, Rohit Yadav rohit.ya...@shapeblue.com
 wrote:
  
Hi Wilder,
   
If you’re testing please use latest 4.5 branch which should become
 the
   next RC. At the moment the latest is SHA
   d08369ad06b6d5ef801f79493c2aa4bdaeab1b83. Thanks.
   
On 22-Jan-2015, at 6:29 pm, Wilder Rodrigues 
   wrodrig...@schubergphilis.com wrote:
   
Hi Rohit,
   
Tests were based on the commit id gave put in the RC1:
   8db3cbd4ff62b17a8b496026b68cf60ee0c76740
   
Please let me know if there is a new commit ID to be used and I will
   test it.
   
Apologies for the misunderstanding, I have been a bit away from the
   list. :)
   
Cheers,
Wilder
   
On 22 Jan 2015, at 12:29, Rohit Yadav rohit.ya...@shapeblue.com
   wrote:
   
Hi Wilder,
   
Thanks for sharing, but I’m confused if these tests were against
   latest 4.5 branch or the RC1? Looking forward to your tests (on latest
   4.5). Thanks.
   
Regards.
   
On 22-Jan-2015, at 4:24 pm, Wilder Rodrigues 
   wrodrig...@schubergphilis.com wrote:
   
Hi all,
   
Sorry for the delay on the tests and also coming to it only after
  the
   RC has been cancelled, but I was way too busy with the redundant VPC
  work.
   
Remarks:
   
* I will test Basic Zone later today
* For those willing to read, I added the whole events log after
 the
   tests results. :)
   
There go my results:
   
:: Environment ::
   
Host: XenServer 6.2 - running under a VMware zone within our ACS
   Beta-Cloud infra
Management Server: MacBook Pro
Database: MySQL running locally on my MacBook Pro
   
   
:: Advanced Zone ::
   
   
  
 
 ===
Test Create Account and user for that account ... === TestName:
   test_01_create_account | Status : SUCCESS ===
ok
Test Sub domain allowed to launch VM  when a Domain level zone is
   created ... === TestName: test_01_add_vm_to_subdomain | Status :
 SUCCESS
  ===
ok
Test delete domain without force option ... === TestName:
   test_DeleteDomain | Status : SUCCESS ===
ok
Test delete domain with force option ... === TestName:
   test_forceDeleteDomain | Status : SUCCESS ===
ok
Test update admin details ... === TestName:
 test_updateAdminDetails
  |
   Status : SUCCESS ===
ok
Test update domain admin details ... === TestName:
   test_updateDomainAdminDetails | Status : SUCCESS ===
ok
Test user update API ... === TestName: test_updateUserDetails |
   Status : SUCCESS ===
ok
Test 

Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread Marcus
That's a different error. It says you don't even have kvmclock. Please see
the minimum libvirt/qemu versions required since ACS 4.0:

http://cloudstack-installation.readthedocs.org/en/4.3/hypervisor_installation.html
On Jan 31, 2015 10:51 PM, Mike Tutkowski mike.tutkow...@solidfire.com
wrote:

 Interesting...I should be a week past that commit, but still see the
 following:

 2015-01-31 00:35:50,403 INFO  [kvm.storage.LibvirtStorageAdaptor]
 (agentRequest-Handler-3:null) Attempting to create volume
 b4cd55ca-1df0-4bfb-a2b2-0bf3d582 (Filesystem) in pool
 b9bd94e9-b55a-43a6-b4db-56f24ebf135a with size 1073741824
 2015-01-31 00:35:50,633 WARN  [kvm.resource.LibvirtComputingResource]
 (agentRequest-Handler-4:null) LibvirtException
 org.libvirt.LibvirtException: internal error unknown timer name 'kvmclock'
 at org.libvirt.ErrorHandler.processError(Unknown Source)
 at org.libvirt.Connect.processError(Unknown Source)
 at org.libvirt.Connect.processError(Unknown Source)
 at org.libvirt.Connect.domainCreateXML(Unknown Source)
 at

 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1257)
 at

 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3811)
 at

 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1351)
 at com.cloud.agent.Agent.processRequest(Agent.java:503)
 at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)
 at com.cloud.utils.nio.Task.run(Task.java:84)
 at

 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at

 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:744)

 On Sat, Jan 31, 2015 at 6:57 AM, Rajani Karuturi raj...@apache.org
 wrote:

  I think the below commits from marcus addresses them.
 
 
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=35ede041
 
 
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=455998ce
 
  ~Rajani
 
  On Sat, Jan 31, 2015 at 1:31 PM, Mike Tutkowski 
  mike.tutkow...@solidfire.com wrote:
 
   I should point out that I'm on master.
  
   On Saturday, January 31, 2015, Mike Tutkowski 
   mike.tutkow...@solidfire.com
   wrote:
  
Hi everyone,
   
Any news on this?
   
I am still having trouble creating a VM on local storage on KVM (with
  or
without kvmclock.disable=true in agent.properties).
   
I'm on Ubuntu 12.04.1.
   
Thanks!
Mike
   
On Sat, Jan 24, 2015 at 2:19 AM, Wilder Rodrigues 
wrodrig...@schubergphilis.com wrote:
   
Okay, thanks for the clarification.
   
I will test it over the weekend.
   
Cheers,
Wilder
   
On 22 Jan 2015, at 15:20, Rohit Yadav rohit.ya...@shapeblue.com
  wrote:
   
 Hi Wilder,

 If you’re testing please use latest 4.5 branch which should become
  the
next RC. At the moment the latest is SHA
d08369ad06b6d5ef801f79493c2aa4bdaeab1b83. Thanks.

 On 22-Jan-2015, at 6:29 pm, Wilder Rodrigues 
wrodrig...@schubergphilis.com wrote:

 Hi Rohit,

 Tests were based on the commit id gave put in the RC1:
8db3cbd4ff62b17a8b496026b68cf60ee0c76740

 Please let me know if there is a new commit ID to be used and I
 will
test it.

 Apologies for the misunderstanding, I have been a bit away from
 the
list. :)

 Cheers,
 Wilder

 On 22 Jan 2015, at 12:29, Rohit Yadav rohit.ya...@shapeblue.com
wrote:

 Hi Wilder,

 Thanks for sharing, but I’m confused if these tests were against
latest 4.5 branch or the RC1? Looking forward to your tests (on
 latest
4.5). Thanks.

 Regards.

 On 22-Jan-2015, at 4:24 pm, Wilder Rodrigues 
wrodrig...@schubergphilis.com wrote:

 Hi all,

 Sorry for the delay on the tests and also coming to it only
 after
   the
RC has been cancelled, but I was way too busy with the redundant VPC
   work.

 Remarks:

 * I will test Basic Zone later today
 * For those willing to read, I added the whole events log after
  the
tests results. :)

 There go my results:

 :: Environment ::

 Host: XenServer 6.2 - running under a VMware zone within our ACS
Beta-Cloud infra
 Management Server: MacBook Pro
 Database: MySQL running locally on my MacBook Pro


 :: Advanced Zone ::


   
  
 
 ===
 Test Create Account and user for that account ... === TestName:
test_01_create_account | Status : SUCCESS ===
 ok
 Test Sub domain allowed to launch VM  when a Domain level zone
 is
created ... === TestName: test_01_add_vm_to_subdomain | Status :
  SUCCESS
   ===
 ok
 Test delete domain without force option ... === TestName:
test_DeleteDomain | Status : SUCCESS ===
   

Re: [VOTE] Apache CloudStack 4.5.0 RC1

2015-01-31 Thread Mike Tutkowski
It looks like our 4.4 docs say we should be at 0.9.11 or later (of libvirt).

I see I'm at 0.9.8, but when I run sudo apt-get install libvirt-bin, it
says I'm at the latest.

What am I missing there? :)

On Sun, Feb 1, 2015 at 12:09 AM, Marcus shadow...@gmail.com wrote:

 That's a different error. It says you don't even have kvmclock. Please see
 the minimum libvirt/qemu versions required since ACS 4.0:


 http://cloudstack-installation.readthedocs.org/en/4.3/hypervisor_installation.html
 On Jan 31, 2015 10:51 PM, Mike Tutkowski mike.tutkow...@solidfire.com
 wrote:

  Interesting...I should be a week past that commit, but still see the
  following:
 
  2015-01-31 00:35:50,403 INFO  [kvm.storage.LibvirtStorageAdaptor]
  (agentRequest-Handler-3:null) Attempting to create volume
  b4cd55ca-1df0-4bfb-a2b2-0bf3d582 (Filesystem) in pool
  b9bd94e9-b55a-43a6-b4db-56f24ebf135a with size 1073741824
  2015-01-31 00:35:50,633 WARN  [kvm.resource.LibvirtComputingResource]
  (agentRequest-Handler-4:null) LibvirtException
  org.libvirt.LibvirtException: internal error unknown timer name
 'kvmclock'
  at org.libvirt.ErrorHandler.processError(Unknown Source)
  at org.libvirt.Connect.processError(Unknown Source)
  at org.libvirt.Connect.processError(Unknown Source)
  at org.libvirt.Connect.domainCreateXML(Unknown Source)
  at
 
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.startVM(LibvirtComputingResource.java:1257)
  at
 
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3811)
  at
 
 
 com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1351)
  at com.cloud.agent.Agent.processRequest(Agent.java:503)
  at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)
  at com.cloud.utils.nio.Task.run(Task.java:84)
  at
 
 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  at
 
 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)
 
  On Sat, Jan 31, 2015 at 6:57 AM, Rajani Karuturi raj...@apache.org
  wrote:
 
   I think the below commits from marcus addresses them.
  
  
 
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=35ede041
  
  
 
 https://git1-us-west.apache.org/repos/asf?p=cloudstack.git;a=commit;h=455998ce
  
   ~Rajani
  
   On Sat, Jan 31, 2015 at 1:31 PM, Mike Tutkowski 
   mike.tutkow...@solidfire.com wrote:
  
I should point out that I'm on master.
   
On Saturday, January 31, 2015, Mike Tutkowski 
mike.tutkow...@solidfire.com
wrote:
   
 Hi everyone,

 Any news on this?

 I am still having trouble creating a VM on local storage on KVM
 (with
   or
 without kvmclock.disable=true in agent.properties).

 I'm on Ubuntu 12.04.1.

 Thanks!
 Mike

 On Sat, Jan 24, 2015 at 2:19 AM, Wilder Rodrigues 
 wrodrig...@schubergphilis.com wrote:

 Okay, thanks for the clarification.

 I will test it over the weekend.

 Cheers,
 Wilder

 On 22 Jan 2015, at 15:20, Rohit Yadav rohit.ya...@shapeblue.com
   wrote:

  Hi Wilder,
 
  If you’re testing please use latest 4.5 branch which should
 become
   the
 next RC. At the moment the latest is SHA
 d08369ad06b6d5ef801f79493c2aa4bdaeab1b83. Thanks.
 
  On 22-Jan-2015, at 6:29 pm, Wilder Rodrigues 
 wrodrig...@schubergphilis.com wrote:
 
  Hi Rohit,
 
  Tests were based on the commit id gave put in the RC1:
 8db3cbd4ff62b17a8b496026b68cf60ee0c76740
 
  Please let me know if there is a new commit ID to be used and I
  will
 test it.
 
  Apologies for the misunderstanding, I have been a bit away from
  the
 list. :)
 
  Cheers,
  Wilder
 
  On 22 Jan 2015, at 12:29, Rohit Yadav 
 rohit.ya...@shapeblue.com
 wrote:
 
  Hi Wilder,
 
  Thanks for sharing, but I’m confused if these tests were
 against
 latest 4.5 branch or the RC1? Looking forward to your tests (on
  latest
 4.5). Thanks.
 
  Regards.
 
  On 22-Jan-2015, at 4:24 pm, Wilder Rodrigues 
 wrodrig...@schubergphilis.com wrote:
 
  Hi all,
 
  Sorry for the delay on the tests and also coming to it only
  after
the
 RC has been cancelled, but I was way too busy with the redundant
 VPC
work.
 
  Remarks:
 
  * I will test Basic Zone later today
  * For those willing to read, I added the whole events log
 after
   the
 tests results. :)
 
  There go my results:
 
  :: Environment ::
 
  Host: XenServer 6.2 - running under a VMware zone within our
 ACS
 Beta-Cloud infra
  Management Server: MacBook Pro
  Database: MySQL running locally on my MacBook Pro
 
 
  :: Advanced Zone ::
 
 

   
  
 
 

Re: Adding a new rewrite rule on ssvm apache

2015-01-31 Thread Rajani Karuturi
config_ssl.sh script is run as part of cloud service start and it restores
apache config from the original file (dont know why its done this way)
I added the rewrite rules before returning from config_apache2_conf in this
script and now I can see them.
Thanks for your help Daan.

~Rajani

On Sun, Jan 25, 2015 at 6:30 PM, Rajani Karuturi raj...@apache.org wrote:

 As per the logic in cloud-early-config, patch* function, it will always
 copy as long as the md5 changes. I think, something is overwriting it
 again. But, couldn't figure out what and from where.


 On Sun, Jan 25, 2015 at 16:15 PM, Daan Hoogland daan.hoogl...@gmail.com
 wrote:

 Are there option-changes that would force a copy of the apache conf
 files? I don't think these will be copied irrespectively from the
 systemvm.iso as they will be installed on the template image as well.

 On Sun, Jan 25, 2015 at 11:40 AM, Rajani Karuturi raj...@apache.org
 wrote:
  On the current master for 4.6.
 
 
  On Sun, Jan 25, 2015 at 15:22 PM, Daan Hoogland daan.hoogl...@gmail.com
 
  wrote:
 
  Rajani, which version? (dumb question, I know)
 
  I am not sure how it is used and whether it is overridden. I know this
  is a field the vr re-write for redundant-vpc touches on. Ian and
  WIlder are working on that but no code for the VR has been merged to
  master yet. Just dome of the Mananger bit.
 
  On Fri, Jan 23, 2015 at 4:24 PM, Rajani Karuturi raj...@apache.org
  javascript:; wrote:
  Hi all,
  I am trying to add new rewrite rules to ssvm apache.
  I added them in the default-ssl file under ssvm patches. This file is in
  the systemvm.iso but isn't getting overwritten in the actual
  location(/etc/apache2/sites-available/default-ssl) and hence the new
  rewrite rules aren't working.
  Anyone knows the right way to add them?Maybe I am looking at the wrong
  file?
 
  Thanks,
 
 
 
  --
  Sent from Windows Phone
 
 
 
  --
  Daan
 
 
 
  --
  Sent from Windows Phone



 --
 Daan



 --
 Sent from Windows Phone



Re: Any Plan of Distributed VR Within cloudstack?

2015-01-31 Thread Yitao Jiang
Awesome. look forward the relase and hope to make contribuation.
On Jan 31, 2015 7:28 AM, Wilder Rodrigues wrodrig...@schubergphilis.com
wrote:

 Hi Yitao,

 We, at Schuberg Philis, are currently working on the implementation of
 Redundant VPCs. We are now on the test phase and the first open demo of it
 will take place in London, 12th February, during the Cloudstack European
 User Group meeting (
 http://shapeblue.com/events/cloudstack-european-user-group-3/)

 Once the work is pushed towards master we will put some documentation on
 the Apache CS wiki and ando get the community involved with the development.

 After the 12th Feb I will send more details about the status and what we
 are using.

 Cheers,
 Wilder


 On 30 Jan 2015, at 01:16, Yitao Jiang willier...@gmail.commailto:
 willier...@gmail.com wrote:

 Hi,guys
 I just want to know is there any plan to develop distributed vr feature,
 and What's the progress now?

 ---
 Thanks,
 Yitao(依涛 姜)
 jiangyt.github.io