Re: [one-users] [Fwd: Re: Please help me get VM running]

2010-09-17 Thread Cuong Hoang Bui

Hi Tino,

It's the IM driver and IMM driver, so it depends of transfer method 
(currently I use nfs for testing). the content of src variable is an 
shell script. Lacking of cat argument makes Opennebula execution stop 
when creating an VM (onevm create VM_template_file).


With IM driver, it can't get host infomation. When I revert my changes, 
surprisingly it succeeds. In the past, the log had the same like below. 
Note that after making dir "mkdir -p /tmp/one-im/", the cat has no 
argument. I dont know why it suceeds when I try again.

===
Sat Sep 18 00:00:50 2010 [InM][I]: Command execution fail: 'mkdir -p 
/tmp/one-im/; cat > 
/tmp/one-im//one_im-91090fd8b53b1cf7ce51f3e4215506e3; if [ "x$?" != "x0" 
]; then exit -1; fi; chmod +x 
/tmp/one-im//one_im-91090fd8b53b1cf7ce51f3e4215506e3; 
/tmp/one-im//one_im-91090fd8b53b1cf7ce51f3e4215506e3'

===

With VM (Xen, KVM) driver, it can't deploy VMs.  Here is the log when 
create 1 new VM. It failed. Note at cat command.

===
Fri Sep 17 23:47:58 2010 [VMM][D]: Message received: LOG - 35 Command 
execution fail: 'mkdir -p /srv/cloud/one/var/35/images && cat > 
/srv/cloud/one/var/35/images/deployment.0 && virsh --connect 
qemu:///system create /srv/cloud/one/var/35/images/deployment.0'

===



Tino Vazquez wrote:

Hi Cuong,

This is actually not a bug, since those script snips shown are
intended to "cat" something coming from the stdin into a file.

If you revert your changes, what is exactly the problems and what is
shown in the logs? It is important that you state your chosen storage
method (ssh or nfs).

Regards,

-Tino

--
Constantino Vázquez Blanco | dsa-research.org/tinova
Virtualization Technology Engineer / Researcher
OpenNebula Toolkit | opennebula.org



On Tue, Sep 14, 2010 at 12:12 PM, Cuong Hoang Bui  wrote:
  

--
**
Regards,
Cuong Hoang Bui
c...@cteklab.net
bhcuong2...@gmail.com
**


Same, please forward it to the opennebula mailing list.
--
Constantino Vázquez Blanco | dsa-research.org/tinova
Virtualization Technology Engineer / Researcher
OpenNebula Toolkit | opennebula.org



On Fri, Sep 10, 2010 at 12:21 PM, Cuong Hoang Bui 
wrote:


Hi Tino,

Below is the vm.template file in the dir /srv/cloud/one/share/examples.
The
document shows that it's easy to get VM running, but up to now I just add
node successfully, VM not running.
I'm stuck at VM definition file. That's the disk image file. Where does it
come from? I want to start up an VM, then install a fresh OS inside the
VM.

The next thing is that, I install OpenNebula from OpenNebula Express.
There're some small bugs that makes OpenNebula not function properly. I
dont
understand why these bugs appears
1. Bug 1 in file one_im_ssh.rb, function execute
Original:
src = "'mkdir -p #...@remote_dir}; cat  > #...@remote_script};" \
" if [ \"x$?\" != \"x0\" ]; then exit -1; fi;" \
" chmod +x #...@remote_script}; #...@remote_script}'"

Modified:
src = "'mkdir -p #...@remote_dir}; cat *...@script}* > #...@remote_script};" \
" if [ \"x$?\" != \"x0\" ]; then exit -1; fi;" \
" chmod +x #...@remote_script}; #...@remote_script}'"

2. Bug 2 in file one_vmm_xen.rb
Original:
cmd = "cat   > #{remote_dfile} && #{XEN[:create]} #{remote_dfile}"

Modified:
cmd = "cat *#{local_dfile}*  > #{remote_dfile} && #{XEN[:create]}
#{remote_dfile}"

3. Bug 3 in one_vmm_kvm.rb, the same as xen at bug 2.

These makes broken operation of OpenNebula. These bugs make me crazy due
to
I'm a newbie to OpenNebula. I dont understand why these bugs appears up to
now (from the release in 2009). I'm using version 1.4.0 on CentOS 5.4 x64.


#---
# VM definition example
#---

NAME = "vm-example"

CPU= 0.5
MEMORY = 128

# --- kernel & boot device ---

OS = [
 kernel   = "/vmlinuz",
 initrd   = "/initrd.img",
 root = "sda1" ]

# --- 2 disks ---

DISK = [
 source   = "/local/xen/domains/etch/disk.img",
 target   = "sda1",
 readonly = "no" ]

DISK = [
 source   = "/local/xen/domains/etch/swap.img",
 target   = "sda2",
 readonly = "no" ]

# --- 1 NIC ---

NIC = [ mac="00:ff:72:17:20:27"]

NIC = [ NETWORK="Private LAN"]


# --- VNC server ---

GRAPHICS = [
 type= "vnc",  listen  = "127.0.0.1",
 port= "5"]

# --- Context ---

CONTEXT = [
 hostname   = "$NAME",
 ip_private = "$NIC[IP, NETWORK=\"Private LAN\"]",
 ip_gen = "10.0.0.$VM_ID"]

--
**
Regards,
Cuong Hoang Bui
c...@cteklab.net
bhcuong2...@gmail.com
**


  

___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org





--
**
Regards,
Cuong Hoang Bui
c...@cteklab.net
bhcuong2...@gmail.com
**

___
Users mailing list
Users@lists.openn

Re: [one-users] [Fwd: Re: Please help me get VM running]

2010-09-17 Thread Tino Vazquez
Hi Cuong,

This is actually not a bug, since those script snips shown are
intended to "cat" something coming from the stdin into a file.

If you revert your changes, what is exactly the problems and what is
shown in the logs? It is important that you state your chosen storage
method (ssh or nfs).

Regards,

-Tino

--
Constantino Vázquez Blanco | dsa-research.org/tinova
Virtualization Technology Engineer / Researcher
OpenNebula Toolkit | opennebula.org



On Tue, Sep 14, 2010 at 12:12 PM, Cuong Hoang Bui  wrote:
>
> --
> **
> Regards,
> Cuong Hoang Bui
> c...@cteklab.net
> bhcuong2...@gmail.com
> **
>
>
> Same, please forward it to the opennebula mailing list.
> --
> Constantino Vázquez Blanco | dsa-research.org/tinova
> Virtualization Technology Engineer / Researcher
> OpenNebula Toolkit | opennebula.org
>
>
>
> On Fri, Sep 10, 2010 at 12:21 PM, Cuong Hoang Bui 
> wrote:
>> Hi Tino,
>>
>> Below is the vm.template file in the dir /srv/cloud/one/share/examples.
>> The
>> document shows that it's easy to get VM running, but up to now I just add
>> node successfully, VM not running.
>> I'm stuck at VM definition file. That's the disk image file. Where does it
>> come from? I want to start up an VM, then install a fresh OS inside the
>> VM.
>>
>> The next thing is that, I install OpenNebula from OpenNebula Express.
>> There're some small bugs that makes OpenNebula not function properly. I
>> dont
>> understand why these bugs appears
>> 1. Bug 1 in file one_im_ssh.rb, function execute
>> Original:
>> src = "'mkdir -p #...@remote_dir}; cat  > #...@remote_script};" \
>>             " if [ \"x$?\" != \"x0\" ]; then exit -1; fi;" \
>>             " chmod +x #...@remote_script}; #...@remote_script}'"
>>
>> Modified:
>> src = "'mkdir -p #...@remote_dir}; cat *...@script}* > #...@remote_script};" 
>> \
>>             " if [ \"x$?\" != \"x0\" ]; then exit -1; fi;" \
>>             " chmod +x #...@remote_script}; #...@remote_script}'"
>>
>> 2. Bug 2 in file one_vmm_xen.rb
>> Original:
>> cmd = "cat   > #{remote_dfile} && #{XEN[:create]} #{remote_dfile}"
>>
>> Modified:
>> cmd = "cat *#{local_dfile}*  > #{remote_dfile} && #{XEN[:create]}
>> #{remote_dfile}"
>>
>> 3. Bug 3 in one_vmm_kvm.rb, the same as xen at bug 2.
>>
>> These makes broken operation of OpenNebula. These bugs make me crazy due
>> to
>> I'm a newbie to OpenNebula. I dont understand why these bugs appears up to
>> now (from the release in 2009). I'm using version 1.4.0 on CentOS 5.4 x64.
>>
>> 
>> #---
>> # VM definition example
>> #---
>>
>> NAME = "vm-example"
>>
>> CPU    = 0.5
>> MEMORY = 128
>>
>> # --- kernel & boot device ---
>>
>> OS = [
>>  kernel   = "/vmlinuz",
>>  initrd   = "/initrd.img",
>>  root     = "sda1" ]
>>
>> # --- 2 disks ---
>>
>> DISK = [
>>  source   = "/local/xen/domains/etch/disk.img",
>>  target   = "sda1",
>>  readonly = "no" ]
>>
>> DISK = [
>>  source   = "/local/xen/domains/etch/swap.img",
>>  target   = "sda2",
>>  readonly = "no" ]
>>
>> # --- 1 NIC ---
>>
>> NIC = [ mac="00:ff:72:17:20:27"]
>>
>> NIC = [ NETWORK="Private LAN"]
>>
>>
>> # --- VNC server ---
>>
>> GRAPHICS = [
>>  type    = "vnc",              listen  = "127.0.0.1",
>>  port    = "5"]
>>
>> # --- Context ---
>>
>> CONTEXT = [
>>  hostname   = "$NAME",
>>  ip_private = "$NIC[IP, NETWORK=\"Private LAN\"]",
>>  ip_gen     = "10.0.0.$VM_ID"]
>>
>> --
>> **
>> Regards,
>> Cuong Hoang Bui
>> c...@cteklab.net
>> bhcuong2...@gmail.com
>> **
>>
>>
>
> ___
> Users mailing list
> Users@lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>
>
___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] OCCI: multipart POST request with java-client

2010-09-17 Thread Strutz, Marco
Hi,

sorry for the late response.
After building+installing opennebula directly from the git repository the curl 
upload now works!!! :-)

Thank you for the great support!



Marco

-Original Message-
From: dmamol...@gmail.com [mailto:dmamol...@gmail.com] On Behalf Of Daniel 
Molina Aranda
Sent: Friday, September 10, 2010 2:54 PM
To: Strutz, Marco
Cc: Tino Vazquez; users@lists.opennebula.org
Subject: Re: [one-users] OCCI: multipart POST request with java-client

Hi Marco,

I think you are not using the last source in which the bug was fixed. You have 
to switch to the one-2.0 branch.

➜ git clone git://opennebula.org/one.git ➜ git checkout one-2.0 ➜ scons ...

Would you mind to check if the problems still persist using this version?

Regards



On 10 September 2010 13:51, Strutz, Marco  
wrote:


   http://virtualbox.one.de:4567/storage/0 
name="testfile_ttyLinux"/>





--
Daniel Molina, Cloud Technology Engineer/Researcher DSA Research Group: web 
http://dsa-research.org and blog http://blog.dsa-research.org OpenNebula Open 
Source Toolkit for Cloud Computing: http://www.OpenNebula.org

___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] Roadmap of opennebula 2.0 release

2010-09-17 Thread Ruben S. Montero
Hi

We plan to make a release candidate next week. The repo is now frozen
and major bugs fixed. After the RC we plan to make 2.0 final a week
later but this depends in the problems testers found, so there is room
for a RC2 before final.

Cheers

Ruben


On Thu, Sep 16, 2010 at 8:27 AM, Cuong Hoang Bui  wrote:
> Hi.
>
> After I read the spec of OpenNebula 2.0, I found that it's very very great.
> I dont know when it's released. Thank very much to OpenNebula developers,
> also community.
>
> --
> **
> Regards,
> Cuong Hoang Bui
> c...@cteklab.net
> bhcuong2...@gmail.com
> **
>
> ___
> Users mailing list
> Users@lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>



-- 
Dr. Ruben Santiago Montero
Associate Professor (Profesor Titular), Complutense University of Madrid

URL: http://dsa-research.org/doku.php?id=people:ruben
Weblog: http://blog.dsa-research.org/?author=7
___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] Virtual networking isolation in version 2.0

2010-09-17 Thread Ruben S. Montero
On Thu, Sep 16, 2010 at 7:21 PM, Cuong Hoang Bui
>... After these 4 VMs in runnung state, if I log in to
> VM belonging to red network, set it to IP belonging to blue network, then it
> can connect to VMs in blue network? Is it the right way to use network
> isolation feature? I'm sorry when asking this question due to I dont have
> enough machines to do this test.

No, VMs in red network will not see any blue traffic. You need to
configure the ebtables hook or a VLANs in your switch to do this,
though

Cheers

>
> http://www.opennebula.org/documentation:rel2.0:nm
>
> --
> **
> Regards,
> Cuong Hoang Bui
> c...@cteklab.net
> bhcuong2...@gmail.com
> **
>
> ___
> Users mailing list
> Users@lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>



-- 
Dr. Ruben Santiago Montero
Associate Professor (Profesor Titular), Complutense University of Madrid

URL: http://dsa-research.org/doku.php?id=people:ruben
Weblog: http://blog.dsa-research.org/?author=7
___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] [ExternalEmail] Trying to understand VCPU and CPU parameters in VM template

2010-09-17 Thread Ruben S. Montero
Hi

CPU is the capacity you request. The goal is to implement a user
driven consolidation process. The scheduler and tracks the CPU
allocated by each VM so the total CPU (requested) does not exceed the
available one.

For example you have a host with 1 CPU. This means that opennebula can
put there: one VM with CPU=1 or, two VMs with CPU=0.5 Depending on the
workload of the VM you can guide the consolidation actually made in
the cluster.

Also depending on the hypervisor we try to forced that capacity
allocation. For example in xen, the driver uses the credit scheduler
so a 1 CPU VM actually tends to use 2 times the cpu cyles of a 0.5 CPU
VM.

VCPU is just the number of cores of the VM.


Cheers

Ruben
On Fri, Sep 17, 2010 at 8:01 AM,   wrote:
> I just noticed that in the deployment file (I’m deploying to kvm) only the
> VCPU value is used. The CPU value from the template does not appear in the
> deployment.0 file. Does this mean the CPU  parameter is not supported in
> kvm?
>
>
>
> Carsten
>
>
>
> From: users-boun...@lists.opennebula.org
> [mailto:users-boun...@lists.opennebula.org] On Behalf Of
> carsten.friedr...@csiro.au
> Sent: Friday, 17 September 2010 10:33
> To: users@lists.opennebula.org
> Subject: [ExternalEmail] [one-users] Trying to understand VCPU and CPU
> parameters in VM template
>
>
>
> From the documentation:
>
>
>
> CPU Percentage of CPU divided by 100 required for the Virtual Machine. Half
> a processor is written 0.5.
>
> VCPU Number of virtual cpus. This value is optional, the default hypervisor
> behavior is used, usually one virtual CPU
>
>
>
> I’m not quite clear how these vlaues are interpreted: E.g. if I specify CPU
> 0.5 and VCPU 2, does this mean I get 2 virtual CPUs each getting 50% of a
> real host CPU, or does this mean I get 2 VCPUs which together can use up to
> 50% of a host CPU, i.e. each VCPU basically gets 25% of a real CPU?
>
>
>
> Cheers,
>
> Carsten
>
>
>
> ___
> Users mailing list
> Users@lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>
>



-- 
Dr. Ruben Santiago Montero
Associate Professor (Profesor Titular), Complutense University of Madrid

URL: http://dsa-research.org/doku.php?id=people:ruben
Weblog: http://blog.dsa-research.org/?author=7
___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] blktap module and image files with "holes"

2010-09-17 Thread Jaime Melis
Hi Rubén,

Qemu provides an utility to create sparse images. I have compared the
sparse image generated by the dd command and by the qemu-img command,
and although they offer the same functionality, they are not the same:

$ dd if=/dev/zero of=sparse-dd.img bs=1 count=1 seek=1073741823 2>/dev/null
$ qemu-img create -f raw sparse-qemu.img 1G
Formatting 'sparse-qemu.img', fmt=raw size=1073741824
$ ls -l sparse-*
-rw-r--r-- 1 jmelis jmelis 1073741824 Sep 17 12:07 sparse-dd.img
-rw-r--r-- 1 jmelis jmelis 1073741824 Sep 17 12:07 sparse-qemu.img
$ du sparse-*
4   sparse-dd.img
0   sparse-qemu.img

You could try:
exec_and_log "ssh $DST_HOST qemu-img create -f raw $DST_PATH $SIZE"
see if it gives a better result? Make sure you have the qemu utils
installed in the worker node.

regards,
Jaime


On Fri, Sep 17, 2010 at 9:22 AM, Ruben Diez  wrote:
> Hi:
>
> Recently, we has study a strange issue about the i/o performance in virtual
> machines created with OpenNebula over xen
>
> The symptoms of these i/o related issues was:
>
> 1) A massive "scp" command to the VM report various "stalled" status and are
> very slow.
> 2) dd command of the type "dd if=/dev/urandom bs=1M count=500 of=probe.raw"
> fail sometimes (usually after a heavy "scp" stress), by writing less data
> that it would do.
>
> After a lot of tests, we found this:
>
> The problem appears in the disks (usually scratch) created with the  '' type
>   = "fs" '' way in opennebula. When the xen "deployment.0" file is created,
> the blktap module is used (with the xen "tap:aio" mechanism).
>
> OpenNebula creates the scratch disk by using dd for make files "with holes".
> This is very fast, but these archives seems to fail when are used by xen
> with the blktap module...
>
> If in the "tm_mkimage.sh" file we change the line:
>
> exec_and_log "ssh $DST_HOST dd if=/dev/zero of=$DST_PATH bs=1 count=1
> seek=${SIZE}M"
>
> by this one:
>
> exec_and_log "ssh $DST_HOST dd if=/dev/zero of=$DST_PATH bs=1M
> count=${SIZE}"
>
> the problems disappears
>
> But then the VM deployment is slow, if the scratch disk is large
>
> The system is a Centos 5.5. The xen hypervisor version is the standard one
> with centos 5.5: the "3.0.3", and the kernel is a "2.6.18-194.8.1.el5xen"
>
> We suppose that this issue is a bug in the blktap module distributed with
> xen. One possibility is to upgrade the xen version. There are a centos xen
> repository at http://www.gitco.de/repo/, but it is only the hypervisor. The
> blktap module seems to be distributed with the xen patched kernel Any of
> you know about a centos xen-kernel recent version repository?? Are the
> compilation the only way to upgrade the xen kernel to a recent version???
>
> Regards.
>
>
>
>
>
>
>
>
> ___
> Users mailing list
> Users@lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>
___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] using iSCSI storage

2010-09-17 Thread Tino Vazquez
Hi Michael,

See if this thread [1] helps you in any way.

Regards,

-Tino

[1] 
http://lists.opennebula.org/pipermail/users-opennebula.org/2010-September/002799.html

--
Constantino Vázquez Blanco | dsa-research.org/tinova
Virtualization Technology Engineer / Researcher
OpenNebula Toolkit | opennebula.org



On Tue, Sep 14, 2010 at 8:20 PM, Michael W. Lucas
 wrote:
> Hi,
>
> I'm running ON 1.4 on Ubuntu 9, with worker nodes running KVM on
> Ubuntu 10.04 I'd like to specify an iSCSI target for a VM's storage on
> a per-VM basis.  Is this possible?  Is anyone doing anything like
> this?  It seems it should be possible.
>
> I see references to using LVM, but my iSCSI targets don't run Linux;
> only the KVM worker nodes.
>
> Thanks,
> ==ml
>
> --
> Michael W. Lucas        mwlu...@blackhelicopters.org
> http://www.MichaelWLucas.com/, http://blather.MichaelWLucas.com/
> New book available: Network Flow Analysis
> http://www.networkflowanalysis.com/
> ___
> Users mailing list
> Users@lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>
___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


[one-users] blktap module and image files with "holes"

2010-09-17 Thread Ruben Diez

Hi:

Recently, we has study a strange issue about the i/o performance in 
virtual machines created with OpenNebula over xen


The symptoms of these i/o related issues was:

1) A massive "scp" command to the VM report various "stalled" status and 
are very slow.
2) dd command of the type "dd if=/dev/urandom bs=1M count=500 
of=probe.raw" fail sometimes (usually after a heavy "scp" stress), by 
writing less data that it would do.


After a lot of tests, we found this:

The problem appears in the disks (usually scratch) created with the  '' 
type   = "fs" '' way in opennebula. When the xen "deployment.0" file is 
created, the blktap module is used (with the xen "tap:aio" mechanism).


OpenNebula creates the scratch disk by using dd for make files "with 
holes". This is very fast, but these archives seems to fail when are 
used by xen with the blktap module...


If in the "tm_mkimage.sh" file we change the line:

exec_and_log "ssh $DST_HOST dd if=/dev/zero of=$DST_PATH bs=1 count=1 
seek=${SIZE}M"


by this one:

exec_and_log "ssh $DST_HOST dd if=/dev/zero of=$DST_PATH bs=1M 
count=${SIZE}"


the problems disappears

But then the VM deployment is slow, if the scratch disk is large

The system is a Centos 5.5. The xen hypervisor version is the standard 
one with centos 5.5: the "3.0.3", and the kernel is a 
"2.6.18-194.8.1.el5xen"


We suppose that this issue is a bug in the blktap module distributed 
with xen. One possibility is to upgrade the xen version. There are a 
centos xen repository at http://www.gitco.de/repo/, but it is only the 
hypervisor. The blktap module seems to be distributed with the xen 
patched kernel Any of you know about a centos xen-kernel recent 
version repository?? Are the compilation the only way to upgrade the xen 
kernel to a recent version???


Regards.








___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org