[Bug 590929] Re: [SRU] eucalyptus create and delete volumes sometimes fail on lvm commands (POC + ENT configs)
I've performed a full re-installation of the frontend as requested. Before any tests or registration, I've updated all eucalyptus packages to 1.6.2-0ubuntu30.4. I've also adjusted cluster1.storage.maxtotalvolumesizeingb in the web front end (set to 250). I did 10 test loops (as usual creating 40 volumes). + No Internal Errors were reported. + Space available and # of volumes correctly reported in sc-stats.log + Deletion worked perfectly But I found one (just one) failure reported by euca-describe-volumes, 10 seconds after the creation loop : VOLUME vol-526005D5 1 cluster1failed 2010-09-15T17:00:32.7Z A few seconds later, euca-describe-volumes didn't report anything about this failure, weird. But I had only 39 volumes created. This is what was reported in cloud-error.log: 12:00:34 [SystemUtil:pool-10-thread-4] ERROR com.eucalyptus.util.ExecutionException: ///usr/lib/eucalyptus/euca_rootwrap vgcreate vg-lp4W3A.. /dev/loop18 error: /var/lock/lvm/P_orphans: flock failed: Resource temporarily unavailable Can't get lock for orphan PVs com.eucalyptus.util.ExecutionException: ///usr/lib/eucalyptus/euca_rootwrap vgcreate vg-lp4W3A.. /dev/loop18 error: /var/lock/lvm/P_orphans: flock failed: Resource temporarily unavailable Can't get lock for orphan PVs at edu.ucsb.eucalyptus.util.SystemUtil.run(SystemUtil.java:91) at edu.ucsb.eucalyptus.storage.LVM2Manager.createVolumeGroup(LVM2Manager.java:170) at edu.ucsb.eucalyptus.storage.LVM2Manager.createLogicalVolume(LVM2Manager.java:430) at edu.ucsb.eucalyptus.storage.LVM2Manager.createVolume(LVM2Manager.java:476) at edu.ucsb.eucalyptus.cloud.ws.BlockStorage$VolumeCreator.run(BlockStorage.java:798) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:636) 12:00:34 [BlockStorage:pool-10-thread-4] ERROR com.eucalyptus.util.EucalyptusCloudException: Unable to create volume group vg-lp4W3A.. for /dev/loop18 -- [SRU] eucalyptus create and delete volumes sometimes fail on lvm commands (POC + ENT configs) https://bugs.launchpad.net/bugs/590929 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 590929] Re: [SRU] eucalyptus create and delete volumes sometimes fail on lvm commands (POC + ENT configs)
I've upgraded the system to euca* 1.6.2-0ubuntu30.4 (much better that only the SC). I hope that rev 1235/1236 are in this release but according to the delivery dates it should be. So the status is better but I still see some errors while creating volumes with a loop (40) : Volume: Error while communicating with Storage Controller: CreateStorageVolume:Internal Error. With the creation of 40 volumes, this error is reported only one time (max 3 times). The deletion loop does not report any errors and a vgscan shows a clean system, great. If I run the creation loop several times I see in sc-stats.log that the amount of space used and the number of managed volumes never decrease. Above the limit (Disk space reserved for volumes) the previous error msg is returned for each creation request. The *broken* system has been upgraded with lucid-proposed packages, rebooted before executing the test. -- [SRU] eucalyptus create and delete volumes sometimes fail on lvm commands (POC + ENT configs) https://bugs.launchpad.net/bugs/590929 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 590929] Re: [SRU] eucalyptus create and delete volumes sometimes fail on lvm commands (POC + ENT configs)
I've applied the fix from http://archive.ubuntu.com/ubuntu/pool/main/e/eucalyptus/eucalyptus- sc_1.6.2-0ubuntu30.4_amd64.deb and unfortunately the creation loop still reports some errors : Volume: Error while communicating with Storage Controller: CreateStorageVolume:Internal Error. Deletion loop iterates well but volumes are still present in /var/lib/eucalyptus/volumes and a quick 'sudo losetup -a' shows them all. ** Changed in: eucalyptus (Ubuntu) Status: Fix Released = Confirmed ** Changed in: jaguarundi Status: In Progress = Confirmed -- [SRU] eucalyptus create and delete volumes sometimes fail on lvm commands (POC + ENT configs) https://bugs.launchpad.net/bugs/590929 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 590846] [NEW] VNET_BRIDGE deleted from node config file after eucalyptus-nc restart
Public bug reported: The eucalyptus.conf file on the node controller comes with a blank value for VNET_BRIDGE If set manually to br0, each time you restart eucalyptus-nc or eucalyptus on the node controller your changes are lost, something rewrites it and new instances cannot be started : [EUCAERROR ] libvirt: Failed to add tap interface to bridge '': No such device (code=38) [EUCAFATAL ] hypervisor failed to start domain topology : a frontend (CLC,SC,CC, WALRUS) + one separate NC ** Affects: eucalyptus (Ubuntu) Importance: Undecided Status: New -- VNET_BRIDGE deleted from node config file after eucalyptus-nc restart https://bugs.launchpad.net/bugs/590846 You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to eucalyptus in ubuntu. -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
