On 2014-07-11 10:17, clm_t...@hotmail.com wrote:
Dear All,
I tried to deploy opennebula 4.6.2 base glusterfs 3.5.1
all three server:
1. one server,ip is 192.168.0.198;
2. node0,ip is 192.168.0.199;
3. node1,ip is 192.168.0.200;
Datastores configuration:
[oneadmin@fc-server ]$ onedatastore show 102
DATASTORE 102 INFORMATION
ID : 102
NAME : sys
USER : oneadmin
GROUP : oneadmin
CLUSTER : c1
TYPE : SYSTEM
DS_MAD : -
TM_MAD : shared
BASE PATH : /var/lib/one//datastores/102
DISK_TYPE : FILE
DATASTORE CAPACITY
TOTAL: : 131.3G
FREE: : 123.3G
USED: : 41M
LIMIT: : -
PERMISSIONS
OWNER : um-
GROUP : u--
OTHER : ---
DATASTORE TEMPLATE
BASE_PATH="/var/lib/one//datastores/"
GLUSTER_HOST="192.168.0.199:24007"
GLUSTER_VOLUME="fc-sys"
SHARED="YES"
TM_MAD="shared"
TYPE="SYSTEM_DS"
[oneadmin@fc-server ]$ onedatastore show 103
DATASTORE 103 INFORMATION
ID : 103
NAME : img
USER : oneadmin
GROUP : oneadmin
CLUSTER : c1
TYPE : IMAGE
DS_MAD : fs
TM_MAD : shared
BASE PATH : /var/lib/one//datastores/103
DISK_TYPE :
DATASTORE CAPACITY
TOTAL: : 131.3G
FREE: : 123.3G
USED: : 41M
LIMIT: : -
PERMISSIONS
OWNER : um-
GROUP : u--
OTHER : ---
DATASTORE TEMPLATE
BASE_PATH="/var/lib/one//datastores/"
CLONE_TARGET="SYSTEM"
DISK_TYPE="GLUSTER"
DS_MAD="fs"
GLUSTER_HOST="192.168.0.199:24007"
GLUSTER_VOLUME="fc-img"
LN_TARGET="NONE"
TM_MAD="shared"
TYPE="IMAGE_DS"
192.168.0.199:/fc-sys on /var/lib/one/datastores/102 type
fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)
192.168.0.199:/fc-img on /var/lib/one/datastores/103 type
fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)
deploy image to PERSISTENT, it's ok.
[oneadmin@fc-server ]$ oneimage show 1
IMAGE 1 INFORMATION
ID : 1
NAME : ttylinux
USER : oneadmin
GROUP : oneadmin
DATASTORE : img
TYPE : OS
REGISTER TIME : 07/11 21:35:11
PERSISTENT : Yes
SOURCE : /var/lib/one//datastores/103/4c40e4068ad2ff41c8767c40f85ae786
PATH :
http://marketplace.c12g.com/appliance/4fc76a938fb81d3517000003/download/0
SIZE : 40M
STATE : used
RUNNING_VMS : 1
PERMISSIONS
OWNER : um-
GROUP : ---
OTHER : ---
IMAGE TEMPLATE
DEV_PREFIX="hd"
FROM_APP="4fc76a938fb81d3517000003"
FROM_APP_FILE="0"
FROM_APP_NAME="ttylinux - kvm"
MD5="04c7d00e88fa66d9aaa34d9cf8ad6aaa"
VIRTUAL MACHINES
ID USER GROUP NAME STAT UCPU UMEM HOST TIME
8 oneadmin oneadmin tt runn 0 512M 192.168.0. -1d 16h32
[oneadmin@fc-server tm]$
[oneadmin@fc-server 8]$ ll
total 366
-rw-rw-r-- 1 oneadmin oneadmin 992 Jul 11 13:44 deployment.0
lrwxrwxrwx 1 oneadmin oneadmin 60 Jul 11 13:44 disk.0 ->
/var/lib/one/datastores/103/4c40e4068ad2ff41c8767c40f85ae786
-rw-r--r-- 1 oneadmin oneadmin 372736 Jul 11 13:44 disk.1
lrwxrwxrwx 1 oneadmin oneadmin 36 Jul 11 13:44 disk.1.iso ->
/var/lib/one/datastores/102/8/disk.1
but deploy image to Non-persistent, it's no running.
[oneadmin@fc-server 102]$ oneimage show 1
IMAGE 1 INFORMATION
ID : 1
NAME : ttylinux
USER : oneadmin
GROUP : oneadmin
DATASTORE : img
TYPE : OS
REGISTER TIME : 07/11 21:35:11
PERSISTENT : No
SOURCE : /var/lib/one//datastores/103/4c40e4068ad2ff41c8767c40f85ae786
PATH :
http://marketplace.c12g.com/appliance/4fc76a938fb81d3517000003/download/0
SIZE : 40M
STATE : used
RUNNING_VMS : 1
PERMISSIONS
OWNER : um-
GROUP : ---
OTHER : ---
IMAGE TEMPLATE
DEV_PREFIX="hd"
FROM_APP="4fc76a938fb81d3517000003"
FROM_APP_FILE="0"
FROM_APP_NAME="ttylinux - kvm"
MD5="04c7d00e88fa66d9aaa34d9cf8ad6aaa"
VIRTUAL MACHINES
ID USER GROUP NAME STAT UCPU UMEM HOST TIME
10 oneadmin oneadmin tt fail 0 0K 0d 00h00
[oneadmin@fc-server 102]$ ls
10
[oneadmin@fc-server 102]$ cd 10
[oneadmin@fc-server 10]$ ll
total 41325
-rw-rw-r-- 1 oneadmin oneadmin 971 Jul 11 14:35 deployment.0
-rw-r--r-- 1 oneadmin oneadmin 41943040 Jul 11 14:35 disk.0
-rw-r--r-- 1 oneadmin oneadmin 372736 Jul 11 14:35 disk.1
lrwxrwxrwx 1 oneadmin oneadmin 37 Jul 11 14:35 disk.1.iso ->
/var/lib/one/datastores/102/10/disk.1
show log :
Fri Jul 11 14:35:26 2014 [DiM][D]: Deploying VM 10
Fri Jul 11 14:35:26 2014 [ReM][D]: Req:8400 UID:0 VirtualMachineDeploy
result SUCCESS, 10
Fri Jul 11 14:35:31 2014 [TM][D]: Message received: TRANSFER SUCCESS
10 -
Fri Jul 11 14:35:32 2014 [VMM][D]: Message received: LOG I 10
ExitCode: 0
Fri Jul 11 14:35:32 2014 [VMM][D]: Message received: LOG I 10
Successfully execute network driver operation: pre.
Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 Command
execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy
'/var/lib/one//datastores/102/10/deployment.0' '192.168.0.199' 10
192.168.0.199
Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 error:
Failed to create domain from
/var/lib/one//datastores/102/10/deployment.0
Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 error:
internal error process exited while connecting to monitor: qemu-kvm:
-drive
file=gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none:
could not open disk image gluster+tcp://192.168.0.199:24007/fc-
img/10/disk.0: No such file or directory
Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10
[2014-07-11 06:35:36.105637] E [afr-common.c:4157:afr_notify]
0-fc-img-replicate-0: All subvolumes are down.
Going offline until atleast one of them comes back up.
Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10
Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG E 10 Could
not create domain from /var/lib/one//datastores/102/10/deployment.0
Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10
ExitCode: 255
Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 Failed
to execute virtualization driver operation: deploy.
[oneadmin@fc-server 102]$ more /var/log/one/10.log
Fri Jul 11 14:35:26 2014 [DiM][I]: New VM state is ACTIVE.
Fri Jul 11 14:35:27 2014 [LCM][I]: New VM state is PROLOG.
Fri Jul 11 14:35:32 2014 [LCM][I]: New VM state is BOOT
Fri Jul 11 14:35:32 2014 [VMM][I]: Generating deployment file:
/var/lib/one/vms/10/deployment.0
Fri Jul 11 14:35:32 2014 [VMM][I]: ExitCode: 0
Fri Jul 11 14:35:32 2014 [VMM][I]: Successfully execute network driver
operation: pre.
Fri Jul 11 14:35:33 2014 [VMM][I]: Command execution fail: cat << EOT
| /var/tmp/one/vmm/kvm/deploy
'/var/lib/one//datastores/102/10/deployment.0' '192.168.0.199
' 10 192.168.0.199
Fri Jul 11 14:35:33 2014 [VMM][I]: error: Failed to create domain from
/var/lib/one//datastores/102/10/deployment.0
Fri Jul 11 14:35:33 2014 [VMM][I]: error: internal error process
exited while connecting to monitor: qemu-kvm: -drive
file=gluster+tcp://192.168.0.199:24007/fc-i
mg/10/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none: could
not open disk image
gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0: No such file or
direc
tory
Fri Jul 11 14:35:33 2014 [VMM][I]: [2014-07-11 06:35:36.105637] E
[afr-common.c:4157:afr_notify] 0-fc-img-replicate-0: All subvolumes
are down. Going offline unt
il atleast one of them comes back up.
Fri Jul 11 14:35:33 2014 [VMM][I]:
Fri Jul 11 14:35:33 2014 [VMM][E]: Could not create domain from
/var/lib/one//datastores/102/10/deployment.0
Fri Jul 11 14:35:33 2014 [VMM][I]: ExitCode: 255
Fri Jul 11 14:35:33 2014 [VMM][I]: Failed to execute virtualization
driver operation: deploy.
Fri Jul 11 14:35:33 2014 [VMM][E]: Error deploying virtual machine:
Could not create domain from
/var/lib/one//datastores/102/10/deployment.0
Fri Jul 11 14:35:35 2014 [DiM][I]: New VM state is FAILED
qemu-kvm: -drive
file=gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0
I think it should be
gluster+tcp://192.168.0.199:24007/fc-sys/10/disk.0
What advice do you have.Thanks.
Hi,
I've been setting up our Opennebula private cloud over the last few
weeks and I'm also
using Gluster for the storage backend. Not all info to make it work is
available in the
Opennebula docs and I was planning on submitting the necessary info.
After reading your post I decided to no longer postpone it.
have a look at this pull request :
https://github.com/vincentvdk/docs/commit/98e70a83b40b58d84e00d3180023671263e2b787
Adding the 'virt' group should fix your problem.
Regards,
Vincent
_______________________________________________
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
_______________________________________________
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
