Dear List, I´m evaluating a one 4.8 setup, using a ceph 0.72.2 cluster, RBD_FORMAT=2
Using the clone option instead of copying images to be able to instantiating vms quickly does make this solution very interesting for us, but I ran into a rather big issue that I´m currently not able to solve (I´m not a ceph or one expert ;-)). I could not find anything similar on the net, so it might be a configuration issue, but I currently ran out of ideas to debug it. In both test clouds, I instaniciated a virtual machine (ID 234 below) from a non-persistent image (e.g. Ubuntu 14.04 from the marketplace), did some changes (e.g. changed the hostname, thats why I discoverd the problem in the first place), updates ... software installation... After a while, when starting a new vm (ID 239) from the (still non-persistent) image I get fsck messages when booting and have packages, and e.g. the hostname from the first vm. Thank you in advance for taking a look. ############## first vm ################## onevm show 234 VIRTUAL MACHINE 234 INFORMATION ID : 234 NAME : jenkinssetup USER : op GROUP : opsadmin STATE : ACTIVE LCM_STATE : RUNNING RESCHED : No HOST : vnode6 CLUSTER ID : 102 CLUSTER : External START TIME : 11/05 16:13:16 END TIME : - DEPLOY ID : one-234 VM DISKS ID TARGET IMAGE TYPE SAVE SAVE_AS 1 vda Ubuntu-14.04-one-4.8 rbd NO - VM NICS ID NETWORK VLAN BRIDGE IP MAC 0 Net_ext yes br0 10.10.10.10 02:00:5e:e6:38:8c VIRTUAL MACHINE HISTORY SEQ HOST ACTION DS START TIME PROLOG 0 vnode6 none 103 11/05 16:13:42 6d 19h27m 0h00m01s VIRTUAL MACHINE TEMPLATE AUTOMATIC_REQUIREMENTS="CLUSTER_ID = 102 & !(PUBLIC_CLOUD = YES)" CONTEXT=[ DISK_ID="0", ETH0_DNS="10.10.10.1", ETH0_GATEWAY="10.10.10.1", ETH0_IP="10.10.10.10", ETH0_MAC="02:00:5e:e6:38:8c", ETH0_MASK="255.255.255.0", ETH0_NETWORK="10.10.10.0", HOSTNAME="jenkinssetup", NETWORK="YES", TARGET="hda" ] CPU="2" GRAPHICS=[ KEYMAP="de", LISTEN="0.0.0.0", PORT="6134", TYPE="VNC" ] MEMORY="2048" TEMPLATE_ID="15" VCPU="1" VMID="234" ############# second vm ######### onevm show 239 VIRTUAL MACHINE 239 INFORMATION ID : 239 NAME : Ubuntu 14.04 - KVM - OpenNebula 4.8-239 USER : oneadmin GROUP : oneadmin STATE : ACTIVE LCM_STATE : RUNNING RESCHED : No HOST : vnode5 CLUSTER ID : 102 CLUSTER : External START TIME : 11/12 10:35:27 END TIME : - DEPLOY ID : one-239 VIRTUAL MACHINE MONITORING USED CPU : 0 NET_RX : 959K USED MEMORY : 779.5M NET_TX : 55K PERMISSIONS OWNER : um- GROUP : --- OTHER : --- VM DISKS ID TARGET IMAGE TYPE SAVE SAVE_AS 0 vda Ubuntu-14.04-one-4.8 rbd NO - VM NICS ID NETWORK VLAN BRIDGE IP MAC 0 net-ext2 yes br0 10.10.10.105 02:00:5e:e6:35:69 VIRTUAL MACHINE HISTORY SEQ HOST ACTION DS START TIME PROLOG 0 vnode5 none 103 11/12 10:35:28 0d 01h16m 0h00m04s VIRTUAL MACHINE TEMPLATE AUTOMATIC_REQUIREMENTS="CLUSTER_ID = 102 & !(PUBLIC_CLOUD = YES)" CONTEXT=[ DISK_ID="1", ETH0_DNS="10.10.10.1", ETH0_GATEWAY="10.10.10.1", ETH0_IP="10.10.10.105", ETH0_MAC="02:00:5e:e6:35:69", ETH0_MASK="255.255.255.0", ETH0_NETWORK="10.10.10.0", NETWORK="YES", TARGET="hda" ] CPU="1" GRAPHICS=[ LISTEN="0.0.0.0", PORT="6139", TYPE="vnc" ] MEMORY="768" OS=[ ARCH="x86_64" ] TEMPLATE_ID="22" VMID="239" ################################ oneimage show 90 IMAGE 90 INFORMATION ID : 90 NAME : Ubuntu-14.04-one-4.8 USER : oneadmin GROUP : oneadmin DATASTORE : ceph TYPE : OS REGISTER TIME : 10/29 22:13:27 PERSISTENT : No SOURCE : one/one-90 PATH : http://marketplace.c12g.com/appliance/53e7c1b28fb81d6a69000003/download/0 SIZE : 10G STATE : used RUNNING_VMS : 2 PERMISSIONS OWNER : um- GROUP : --- OTHER : --- IMAGE TEMPLATE DEV_PREFIX="hd" FROM_APP="53e7c1b28fb81d6a69000003" FROM_APP_FILE="0" FROM_APP_NAME="Ubuntu 14.04 - KVM - OpenNebula 4.8" MD5="bdbd7fdced3ba5be52ba60e801c0b3e0" VIRTUAL MACHINES ID USER GROUP NAME STAT UCPU UMEM HOST TIME 234 op opsadmin jenkinssetup runn 0 2.1G vnode6 6d 19h47 239 oneadmin oneadmin Ubuntu 14.04 - runn 0 779.5M vnode5 0d 01h25 ############ datastore ############ oneadmin@oned:~$ onedatastore show 102 DATASTORE 102 INFORMATION ID : 102 NAME : ceph USER : oneadmin GROUP : opadmins CLUSTER : - TYPE : IMAGE DS_MAD : ceph TM_MAD : ceph BASE PATH : /var/lib/one//datastores/102 DISK_TYPE : RBD DATASTORE CAPACITY TOTAL: : 798.1G FREE: : 495G USED: : 263.2G LIMIT: : - PERMISSIONS OWNER : um- GROUP : u-- OTHER : --- DATASTORE TEMPLATE BASE_PATH="/var/lib/one//datastores/" BRIDGE_LIST="oned.test.cloud" CEPH_SECRET="xxxxxxxxxxxxxxxxxxxxxxxx" CEPH_USER="libvirt" CLONE_TARGET="SELF" DISK_TYPE="RBD" DS_MAD="ceph" LN_TARGET="NONE" POOL_NAME="one" RBD_FORMAT="2" TM_MAD="ceph" TYPE="IMAGE_DS" IMAGES .... 90 ############ ceph ############# rbd ls -l one| egrep 'NAME|one-90' NAME SIZE PARENT FMT PROT LOCK one-90 10240M 2 one-90@234-1 10240M 2 yes one-90@239-0 10240M 2 yes one-90-234-1 10240M one/one-90@234-1 2 one-90-239-0 10240M one/one-90@239-0 2
_______________________________________________ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org