Re: [one-users] [Fwd: Re: Please help me get VM running]
Hi Tino, It's the IM driver and IMM driver, so it depends of transfer method (currently I use nfs for testing). the content of src variable is an shell script. Lacking of cat argument makes Opennebula execution stop when creating an VM (onevm create VM_template_file). With IM driver, it can't get host infomation. When I revert my changes, surprisingly it succeeds. In the past, the log had the same like below. Note that after making dir "mkdir -p /tmp/one-im/", the cat has no argument. I dont know why it suceeds when I try again. === Sat Sep 18 00:00:50 2010 [InM][I]: Command execution fail: 'mkdir -p /tmp/one-im/; cat > /tmp/one-im//one_im-91090fd8b53b1cf7ce51f3e4215506e3; if [ "x$?" != "x0" ]; then exit -1; fi; chmod +x /tmp/one-im//one_im-91090fd8b53b1cf7ce51f3e4215506e3; /tmp/one-im//one_im-91090fd8b53b1cf7ce51f3e4215506e3' === With VM (Xen, KVM) driver, it can't deploy VMs. Here is the log when create 1 new VM. It failed. Note at cat command. === Fri Sep 17 23:47:58 2010 [VMM][D]: Message received: LOG - 35 Command execution fail: 'mkdir -p /srv/cloud/one/var/35/images && cat > /srv/cloud/one/var/35/images/deployment.0 && virsh --connect qemu:///system create /srv/cloud/one/var/35/images/deployment.0' === Tino Vazquez wrote: Hi Cuong, This is actually not a bug, since those script snips shown are intended to "cat" something coming from the stdin into a file. If you revert your changes, what is exactly the problems and what is shown in the logs? It is important that you state your chosen storage method (ssh or nfs). Regards, -Tino -- Constantino Vázquez Blanco | dsa-research.org/tinova Virtualization Technology Engineer / Researcher OpenNebula Toolkit | opennebula.org On Tue, Sep 14, 2010 at 12:12 PM, Cuong Hoang Bui wrote: -- ** Regards, Cuong Hoang Bui c...@cteklab.net bhcuong2...@gmail.com ** Same, please forward it to the opennebula mailing list. -- Constantino Vázquez Blanco | dsa-research.org/tinova Virtualization Technology Engineer / Researcher OpenNebula Toolkit | opennebula.org On Fri, Sep 10, 2010 at 12:21 PM, Cuong Hoang Bui wrote: Hi Tino, Below is the vm.template file in the dir /srv/cloud/one/share/examples. The document shows that it's easy to get VM running, but up to now I just add node successfully, VM not running. I'm stuck at VM definition file. That's the disk image file. Where does it come from? I want to start up an VM, then install a fresh OS inside the VM. The next thing is that, I install OpenNebula from OpenNebula Express. There're some small bugs that makes OpenNebula not function properly. I dont understand why these bugs appears 1. Bug 1 in file one_im_ssh.rb, function execute Original: src = "'mkdir -p #...@remote_dir}; cat > #...@remote_script};" \ " if [ \"x$?\" != \"x0\" ]; then exit -1; fi;" \ " chmod +x #...@remote_script}; #...@remote_script}'" Modified: src = "'mkdir -p #...@remote_dir}; cat *...@script}* > #...@remote_script};" \ " if [ \"x$?\" != \"x0\" ]; then exit -1; fi;" \ " chmod +x #...@remote_script}; #...@remote_script}'" 2. Bug 2 in file one_vmm_xen.rb Original: cmd = "cat > #{remote_dfile} && #{XEN[:create]} #{remote_dfile}" Modified: cmd = "cat *#{local_dfile}* > #{remote_dfile} && #{XEN[:create]} #{remote_dfile}" 3. Bug 3 in one_vmm_kvm.rb, the same as xen at bug 2. These makes broken operation of OpenNebula. These bugs make me crazy due to I'm a newbie to OpenNebula. I dont understand why these bugs appears up to now (from the release in 2009). I'm using version 1.4.0 on CentOS 5.4 x64. #--- # VM definition example #--- NAME = "vm-example" CPU= 0.5 MEMORY = 128 # --- kernel & boot device --- OS = [ kernel = "/vmlinuz", initrd = "/initrd.img", root = "sda1" ] # --- 2 disks --- DISK = [ source = "/local/xen/domains/etch/disk.img", target = "sda1", readonly = "no" ] DISK = [ source = "/local/xen/domains/etch/swap.img", target = "sda2", readonly = "no" ] # --- 1 NIC --- NIC = [ mac="00:ff:72:17:20:27"] NIC = [ NETWORK="Private LAN"] # --- VNC server --- GRAPHICS = [ type= "vnc", listen = "127.0.0.1", port= "5"] # --- Context --- CONTEXT = [ hostname = "$NAME", ip_private = "$NIC[IP, NETWORK=\"Private LAN\"]", ip_gen = "10.0.0.$VM_ID"] -- ** Regards, Cuong Hoang Bui c...@cteklab.net bhcuong2...@gmail.com ** ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org -- ** Regards, Cuong Hoang Bui c...@cteklab.net bhcuong2...@gmail.com ** ___ Users mailing list Users@lists.openn
Re: [one-users] [Fwd: Re: Please help me get VM running]
Hi Cuong, This is actually not a bug, since those script snips shown are intended to "cat" something coming from the stdin into a file. If you revert your changes, what is exactly the problems and what is shown in the logs? It is important that you state your chosen storage method (ssh or nfs). Regards, -Tino -- Constantino Vázquez Blanco | dsa-research.org/tinova Virtualization Technology Engineer / Researcher OpenNebula Toolkit | opennebula.org On Tue, Sep 14, 2010 at 12:12 PM, Cuong Hoang Bui wrote: > > -- > ** > Regards, > Cuong Hoang Bui > c...@cteklab.net > bhcuong2...@gmail.com > ** > > > Same, please forward it to the opennebula mailing list. > -- > Constantino Vázquez Blanco | dsa-research.org/tinova > Virtualization Technology Engineer / Researcher > OpenNebula Toolkit | opennebula.org > > > > On Fri, Sep 10, 2010 at 12:21 PM, Cuong Hoang Bui > wrote: >> Hi Tino, >> >> Below is the vm.template file in the dir /srv/cloud/one/share/examples. >> The >> document shows that it's easy to get VM running, but up to now I just add >> node successfully, VM not running. >> I'm stuck at VM definition file. That's the disk image file. Where does it >> come from? I want to start up an VM, then install a fresh OS inside the >> VM. >> >> The next thing is that, I install OpenNebula from OpenNebula Express. >> There're some small bugs that makes OpenNebula not function properly. I >> dont >> understand why these bugs appears >> 1. Bug 1 in file one_im_ssh.rb, function execute >> Original: >> src = "'mkdir -p #...@remote_dir}; cat > #...@remote_script};" \ >> " if [ \"x$?\" != \"x0\" ]; then exit -1; fi;" \ >> " chmod +x #...@remote_script}; #...@remote_script}'" >> >> Modified: >> src = "'mkdir -p #...@remote_dir}; cat *...@script}* > #...@remote_script};" >> \ >> " if [ \"x$?\" != \"x0\" ]; then exit -1; fi;" \ >> " chmod +x #...@remote_script}; #...@remote_script}'" >> >> 2. Bug 2 in file one_vmm_xen.rb >> Original: >> cmd = "cat > #{remote_dfile} && #{XEN[:create]} #{remote_dfile}" >> >> Modified: >> cmd = "cat *#{local_dfile}* > #{remote_dfile} && #{XEN[:create]} >> #{remote_dfile}" >> >> 3. Bug 3 in one_vmm_kvm.rb, the same as xen at bug 2. >> >> These makes broken operation of OpenNebula. These bugs make me crazy due >> to >> I'm a newbie to OpenNebula. I dont understand why these bugs appears up to >> now (from the release in 2009). I'm using version 1.4.0 on CentOS 5.4 x64. >> >> >> #--- >> # VM definition example >> #--- >> >> NAME = "vm-example" >> >> CPU = 0.5 >> MEMORY = 128 >> >> # --- kernel & boot device --- >> >> OS = [ >> kernel = "/vmlinuz", >> initrd = "/initrd.img", >> root = "sda1" ] >> >> # --- 2 disks --- >> >> DISK = [ >> source = "/local/xen/domains/etch/disk.img", >> target = "sda1", >> readonly = "no" ] >> >> DISK = [ >> source = "/local/xen/domains/etch/swap.img", >> target = "sda2", >> readonly = "no" ] >> >> # --- 1 NIC --- >> >> NIC = [ mac="00:ff:72:17:20:27"] >> >> NIC = [ NETWORK="Private LAN"] >> >> >> # --- VNC server --- >> >> GRAPHICS = [ >> type = "vnc", listen = "127.0.0.1", >> port = "5"] >> >> # --- Context --- >> >> CONTEXT = [ >> hostname = "$NAME", >> ip_private = "$NIC[IP, NETWORK=\"Private LAN\"]", >> ip_gen = "10.0.0.$VM_ID"] >> >> -- >> ** >> Regards, >> Cuong Hoang Bui >> c...@cteklab.net >> bhcuong2...@gmail.com >> ** >> >> > > ___ > Users mailing list > Users@lists.opennebula.org > http://lists.opennebula.org/listinfo.cgi/users-opennebula.org > > ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] OCCI: multipart POST request with java-client
Hi, sorry for the late response. After building+installing opennebula directly from the git repository the curl upload now works!!! :-) Thank you for the great support! Marco -Original Message- From: dmamol...@gmail.com [mailto:dmamol...@gmail.com] On Behalf Of Daniel Molina Aranda Sent: Friday, September 10, 2010 2:54 PM To: Strutz, Marco Cc: Tino Vazquez; users@lists.opennebula.org Subject: Re: [one-users] OCCI: multipart POST request with java-client Hi Marco, I think you are not using the last source in which the bug was fixed. You have to switch to the one-2.0 branch. ➜ git clone git://opennebula.org/one.git ➜ git checkout one-2.0 ➜ scons ... Would you mind to check if the problems still persist using this version? Regards On 10 September 2010 13:51, Strutz, Marco wrote: http://virtualbox.one.de:4567/storage/0 name="testfile_ttyLinux"/> -- Daniel Molina, Cloud Technology Engineer/Researcher DSA Research Group: web http://dsa-research.org and blog http://blog.dsa-research.org OpenNebula Open Source Toolkit for Cloud Computing: http://www.OpenNebula.org ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] Roadmap of opennebula 2.0 release
Hi We plan to make a release candidate next week. The repo is now frozen and major bugs fixed. After the RC we plan to make 2.0 final a week later but this depends in the problems testers found, so there is room for a RC2 before final. Cheers Ruben On Thu, Sep 16, 2010 at 8:27 AM, Cuong Hoang Bui wrote: > Hi. > > After I read the spec of OpenNebula 2.0, I found that it's very very great. > I dont know when it's released. Thank very much to OpenNebula developers, > also community. > > -- > ** > Regards, > Cuong Hoang Bui > c...@cteklab.net > bhcuong2...@gmail.com > ** > > ___ > Users mailing list > Users@lists.opennebula.org > http://lists.opennebula.org/listinfo.cgi/users-opennebula.org > -- Dr. Ruben Santiago Montero Associate Professor (Profesor Titular), Complutense University of Madrid URL: http://dsa-research.org/doku.php?id=people:ruben Weblog: http://blog.dsa-research.org/?author=7 ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] Virtual networking isolation in version 2.0
On Thu, Sep 16, 2010 at 7:21 PM, Cuong Hoang Bui >... After these 4 VMs in runnung state, if I log in to > VM belonging to red network, set it to IP belonging to blue network, then it > can connect to VMs in blue network? Is it the right way to use network > isolation feature? I'm sorry when asking this question due to I dont have > enough machines to do this test. No, VMs in red network will not see any blue traffic. You need to configure the ebtables hook or a VLANs in your switch to do this, though Cheers > > http://www.opennebula.org/documentation:rel2.0:nm > > -- > ** > Regards, > Cuong Hoang Bui > c...@cteklab.net > bhcuong2...@gmail.com > ** > > ___ > Users mailing list > Users@lists.opennebula.org > http://lists.opennebula.org/listinfo.cgi/users-opennebula.org > -- Dr. Ruben Santiago Montero Associate Professor (Profesor Titular), Complutense University of Madrid URL: http://dsa-research.org/doku.php?id=people:ruben Weblog: http://blog.dsa-research.org/?author=7 ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] [ExternalEmail] Trying to understand VCPU and CPU parameters in VM template
Hi CPU is the capacity you request. The goal is to implement a user driven consolidation process. The scheduler and tracks the CPU allocated by each VM so the total CPU (requested) does not exceed the available one. For example you have a host with 1 CPU. This means that opennebula can put there: one VM with CPU=1 or, two VMs with CPU=0.5 Depending on the workload of the VM you can guide the consolidation actually made in the cluster. Also depending on the hypervisor we try to forced that capacity allocation. For example in xen, the driver uses the credit scheduler so a 1 CPU VM actually tends to use 2 times the cpu cyles of a 0.5 CPU VM. VCPU is just the number of cores of the VM. Cheers Ruben On Fri, Sep 17, 2010 at 8:01 AM, wrote: > I just noticed that in the deployment file (I’m deploying to kvm) only the > VCPU value is used. The CPU value from the template does not appear in the > deployment.0 file. Does this mean the CPU parameter is not supported in > kvm? > > > > Carsten > > > > From: users-boun...@lists.opennebula.org > [mailto:users-boun...@lists.opennebula.org] On Behalf Of > carsten.friedr...@csiro.au > Sent: Friday, 17 September 2010 10:33 > To: users@lists.opennebula.org > Subject: [ExternalEmail] [one-users] Trying to understand VCPU and CPU > parameters in VM template > > > > From the documentation: > > > > CPU Percentage of CPU divided by 100 required for the Virtual Machine. Half > a processor is written 0.5. > > VCPU Number of virtual cpus. This value is optional, the default hypervisor > behavior is used, usually one virtual CPU > > > > I’m not quite clear how these vlaues are interpreted: E.g. if I specify CPU > 0.5 and VCPU 2, does this mean I get 2 virtual CPUs each getting 50% of a > real host CPU, or does this mean I get 2 VCPUs which together can use up to > 50% of a host CPU, i.e. each VCPU basically gets 25% of a real CPU? > > > > Cheers, > > Carsten > > > > ___ > Users mailing list > Users@lists.opennebula.org > http://lists.opennebula.org/listinfo.cgi/users-opennebula.org > > -- Dr. Ruben Santiago Montero Associate Professor (Profesor Titular), Complutense University of Madrid URL: http://dsa-research.org/doku.php?id=people:ruben Weblog: http://blog.dsa-research.org/?author=7 ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] blktap module and image files with "holes"
Hi Rubén, Qemu provides an utility to create sparse images. I have compared the sparse image generated by the dd command and by the qemu-img command, and although they offer the same functionality, they are not the same: $ dd if=/dev/zero of=sparse-dd.img bs=1 count=1 seek=1073741823 2>/dev/null $ qemu-img create -f raw sparse-qemu.img 1G Formatting 'sparse-qemu.img', fmt=raw size=1073741824 $ ls -l sparse-* -rw-r--r-- 1 jmelis jmelis 1073741824 Sep 17 12:07 sparse-dd.img -rw-r--r-- 1 jmelis jmelis 1073741824 Sep 17 12:07 sparse-qemu.img $ du sparse-* 4 sparse-dd.img 0 sparse-qemu.img You could try: exec_and_log "ssh $DST_HOST qemu-img create -f raw $DST_PATH $SIZE" see if it gives a better result? Make sure you have the qemu utils installed in the worker node. regards, Jaime On Fri, Sep 17, 2010 at 9:22 AM, Ruben Diez wrote: > Hi: > > Recently, we has study a strange issue about the i/o performance in virtual > machines created with OpenNebula over xen > > The symptoms of these i/o related issues was: > > 1) A massive "scp" command to the VM report various "stalled" status and are > very slow. > 2) dd command of the type "dd if=/dev/urandom bs=1M count=500 of=probe.raw" > fail sometimes (usually after a heavy "scp" stress), by writing less data > that it would do. > > After a lot of tests, we found this: > > The problem appears in the disks (usually scratch) created with the '' type > = "fs" '' way in opennebula. When the xen "deployment.0" file is created, > the blktap module is used (with the xen "tap:aio" mechanism). > > OpenNebula creates the scratch disk by using dd for make files "with holes". > This is very fast, but these archives seems to fail when are used by xen > with the blktap module... > > If in the "tm_mkimage.sh" file we change the line: > > exec_and_log "ssh $DST_HOST dd if=/dev/zero of=$DST_PATH bs=1 count=1 > seek=${SIZE}M" > > by this one: > > exec_and_log "ssh $DST_HOST dd if=/dev/zero of=$DST_PATH bs=1M > count=${SIZE}" > > the problems disappears > > But then the VM deployment is slow, if the scratch disk is large > > The system is a Centos 5.5. The xen hypervisor version is the standard one > with centos 5.5: the "3.0.3", and the kernel is a "2.6.18-194.8.1.el5xen" > > We suppose that this issue is a bug in the blktap module distributed with > xen. One possibility is to upgrade the xen version. There are a centos xen > repository at http://www.gitco.de/repo/, but it is only the hypervisor. The > blktap module seems to be distributed with the xen patched kernel Any of > you know about a centos xen-kernel recent version repository?? Are the > compilation the only way to upgrade the xen kernel to a recent version??? > > Regards. > > > > > > > > > ___ > Users mailing list > Users@lists.opennebula.org > http://lists.opennebula.org/listinfo.cgi/users-opennebula.org > ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] using iSCSI storage
Hi Michael, See if this thread [1] helps you in any way. Regards, -Tino [1] http://lists.opennebula.org/pipermail/users-opennebula.org/2010-September/002799.html -- Constantino Vázquez Blanco | dsa-research.org/tinova Virtualization Technology Engineer / Researcher OpenNebula Toolkit | opennebula.org On Tue, Sep 14, 2010 at 8:20 PM, Michael W. Lucas wrote: > Hi, > > I'm running ON 1.4 on Ubuntu 9, with worker nodes running KVM on > Ubuntu 10.04 I'd like to specify an iSCSI target for a VM's storage on > a per-VM basis. Is this possible? Is anyone doing anything like > this? It seems it should be possible. > > I see references to using LVM, but my iSCSI targets don't run Linux; > only the KVM worker nodes. > > Thanks, > ==ml > > -- > Michael W. Lucas mwlu...@blackhelicopters.org > http://www.MichaelWLucas.com/, http://blather.MichaelWLucas.com/ > New book available: Network Flow Analysis > http://www.networkflowanalysis.com/ > ___ > Users mailing list > Users@lists.opennebula.org > http://lists.opennebula.org/listinfo.cgi/users-opennebula.org > ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
[one-users] blktap module and image files with "holes"
Hi: Recently, we has study a strange issue about the i/o performance in virtual machines created with OpenNebula over xen The symptoms of these i/o related issues was: 1) A massive "scp" command to the VM report various "stalled" status and are very slow. 2) dd command of the type "dd if=/dev/urandom bs=1M count=500 of=probe.raw" fail sometimes (usually after a heavy "scp" stress), by writing less data that it would do. After a lot of tests, we found this: The problem appears in the disks (usually scratch) created with the '' type = "fs" '' way in opennebula. When the xen "deployment.0" file is created, the blktap module is used (with the xen "tap:aio" mechanism). OpenNebula creates the scratch disk by using dd for make files "with holes". This is very fast, but these archives seems to fail when are used by xen with the blktap module... If in the "tm_mkimage.sh" file we change the line: exec_and_log "ssh $DST_HOST dd if=/dev/zero of=$DST_PATH bs=1 count=1 seek=${SIZE}M" by this one: exec_and_log "ssh $DST_HOST dd if=/dev/zero of=$DST_PATH bs=1M count=${SIZE}" the problems disappears But then the VM deployment is slow, if the scratch disk is large The system is a Centos 5.5. The xen hypervisor version is the standard one with centos 5.5: the "3.0.3", and the kernel is a "2.6.18-194.8.1.el5xen" We suppose that this issue is a bug in the blktap module distributed with xen. One possibility is to upgrade the xen version. There are a centos xen repository at http://www.gitco.de/repo/, but it is only the hypervisor. The blktap module seems to be distributed with the xen patched kernel Any of you know about a centos xen-kernel recent version repository?? Are the compilation the only way to upgrade the xen kernel to a recent version??? Regards. ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org