Status: New
Owner: ----
New issue 1064 by [email protected]: Cannot install VM on Gluster bankend
storage
https://code.google.com/p/ganeti/issues/detail?id=1064
What software version are you running? Please provide the output of "gnt-
cluster --version", "gnt-cluster version", and "hspace --version".
root@node1:~# gnt-cluster --version
gnt-cluster (ganeti v2.10.7-70-g70f22ba) 2.11.6
What distribution are you using?
root@node1:~# lsb_release -a
No LSB modules are available.
Distributor ID: Debian
Description: Debian GNU/Linux 7.8 (wheezy)
Release: 7.8
Codename: wheezy
What steps will reproduce the problem?
1, root@node1:~# gluster volume create gv0 replica 2 transport tcp
node1:/root/tmp1 node1:/root/tmp2
Creation of volume gv0 has been successful. Please start the volume to
access data.
2, root@node1:~# gluster volume start gv0
Starting volume gv0 has been successful
3, root@node1:~# gnt-cluster init --vg-name=xenvg --master-netdev=eth0
--gluster-storage-dir=/var/run/ganeti/gluster -D gluster -H
kvm:kernel_path=/boot/vmlinuz-3-kvmU,initrd_path=/boot/initrd-3-kvmU -N
link=xen-br0 --enabled-hypervisor=kvm
--enabled-disk-templates=gluster,drbd,plain cluster
4, root@node1:~# sudo gnt-instance add -n node1 -o debootstrap+default -t
gluster -s 5G instance1
Wed Apr 15 05:30:13 2015 - INFO: Resolved given name 'instance1'
to 'instance1.ganeti.com'
Wed Apr 15 05:30:17 2015 * disk 0, size 5.0G
Wed Apr 15 05:30:17 2015 * creating instance disks...
Wed Apr 15 05:30:22 2015 - WARNING: Device creation failed
Failure: command execution error:
Can't create block device <Disk(type=gluster,
logical_id=('loop', 'ganeti/ce24daf6-15fc-4450-abd3-f893b342b601.0'),
children=None, visible as /dev/disk/0, size=5120m)> on node
node1.ganeti.com for instance instance1.ganeti.com: Error while executing
backend function:
Path '/var/run/ganeti/gluster/ganeti/ce24daf6-15fc-4450-abd3-f893b342b601.0'
is not acceptable for file storage
What is the expected output? What do you see instead?
Expected: Create VM on gluster backend storage successfully.
Instead: Cannot install, error happened.
Please provide any additional information below.
I can install VM successfully with plain disk template as follows.
root@node1:~# sudo gnt-instance add -n node1 -o debootstrap+default -t
plain -s 5G instance1
Wed Apr 15 05:37:53 2015 - INFO: Resolved given name 'instance1'
to 'instance1.ganeti.com'
Wed Apr 15 05:37:57 2015 * disk 0, size 5.0G
Wed Apr 15 05:37:57 2015 * creating instance disks...
Wed Apr 15 05:37:58 2015 adding instance instance1.ganeti.com to cluster
config
Wed Apr 15 05:37:59 2015 - INFO: Waiting for instance instance1.ganeti.com
to sync disks
Wed Apr 15 05:37:59 2015 - INFO: Instance instance1.ganeti.com's disks are
in sync
Wed Apr 15 05:38:00 2015 * running the instance OS create scripts...
Wed Apr 15 05:38:10 2015 * starting instance...
root@node1:~# gnt-instance list
Instance Hypervisor OS Primary_node
Status Memory
instance1.ganeti.com kvm debootstrap+default node1.ganeti.com
running 128M
Cluster infos are as follows.
root@node1:~# gnt-cluster verify
Submitted jobs 3, 4
Waiting for job 3 ...
Wed Apr 15 05:29:53 2015 * Verifying cluster config
Wed Apr 15 05:29:53 2015 * Verifying cluster certificate files
Wed Apr 15 05:29:53 2015 * Verifying hypervisor parameters
Wed Apr 15 05:29:53 2015 * Verifying all nodes belong to an existing group
Waiting for job 4 ...
Wed Apr 15 05:29:53 2015 * Verifying group 'default'
Wed Apr 15 05:29:53 2015 * Gathering data (1 nodes)
Wed Apr 15 05:29:54 2015 * Gathering disk information (1 nodes)
Wed Apr 15 05:29:54 2015 * Verifying configuration file consistency
Wed Apr 15 05:29:54 2015 * Verifying node status
Wed Apr 15 05:29:54 2015 * Verifying instance status
Wed Apr 15 05:29:54 2015 * Verifying orphan volumes
Wed Apr 15 05:29:54 2015 * Verifying N+1 Memory redundancy
Wed Apr 15 05:29:54 2015 * Other Notes
Wed Apr 15 05:29:54 2015 * Hooks Results
root@node1:~# gnt-cluster info
Cluster name: cluster.ganeti.com
Cluster UUID: db2ddf84-451a-462e-87d7-c92c5c161d7e
Creation time: 2015-04-15 05:29:39
Modification time: 2015-04-15 05:29:46
Master node: node1.ganeti.com
Architecture (this node): 64bits (x86_64)
Tags: (none)
Default hypervisor: kvm
Enabled hypervisors: kvm
Hypervisor parameters:
kvm:
acpi: True
boot_order: disk
cdrom2_image_path:
cdrom_disk_type:
cdrom_image_path:
cpu_cores: 0
cpu_mask: all
cpu_sockets: 0
cpu_threads: 0
cpu_type:
disk_cache: default
disk_type: paravirtual
floppy_image_path:
initrd_path: /boot/initrd-3-kvmU
kernel_args: ro
kernel_path: /boot/vmlinuz-3-kvmU
keymap:
kvm_extra:
kvm_flag:
kvm_path: /usr/bin/kvm
machine_version:
mem_path:
migration_bandwidth: 32
migration_downtime: 30
migration_mode: live
migration_port: 8102
nic_type: paravirtual
reboot_behavior: reboot
root_path: /dev/vda1
security_domain:
security_model: none
serial_console: True
serial_speed: 38400
soundhw:
spice_bind:
spice_image_compression:
spice_ip_version: 0
spice_jpeg_wan_compression:
spice_password_file:
spice_playback_compression: True
spice_streaming_video:
spice_tls_ciphers: HIGH:-DES:-3DES:-EXPORT:-ADH
spice_use_tls: False
spice_use_vdagent: True
spice_zlib_glz_wan_compression:
usb_devices:
usb_mouse:
use_chroot: False
use_localtime: False
user_shutdown: False
vga:
vhost_net: False
vnc_bind_address:
vnc_password_file:
vnc_tls: False
vnc_x509_path:
vnc_x509_verify: False
vnet_hdr: True
OS-specific hypervisor parameters:
OS parameters:
Hidden OSes:
Blacklisted OSes:
Cluster parameters:
candidate pool size: 10
maximal number of jobs running simultaneously: 20
master netdev: eth0
master netmask: 32
use external master IP address setup script: False
lvm volume group: xenvg
lvm reserved volumes: (none)
drbd usermode helper: /bin/true
file storage path: /srv/ganeti/file-storage
shared file storage path: /srv/ganeti/shared-file-storage
gluster storage path: /var/run/ganeti/gluster
maintenance of node health: False
uid pool:
default instance allocator: hail
default instance allocator parameters:
primary ip version: 4
preallocation wipe disks: False
OS search path: /srv/ganeti/os
ExtStorage Providers search path: /srv/ganeti/extstorage
enabled disk templates: gluster, drbd, plain
enabled user shutdown: False
Default node parameters:
exclusive_storage: False
oob_program:
ovs: False
ovs_link:
ovs_name: switch1
spindle_count: 1
ssh_port: 22
Default instance parameters:
default:
always_failover: False
auto_balance: True
maxmem: 128
minmem: 128
spindle_use: 1
vcpus: 1
Default nic parameters:
default:
link: xen-br0
mode: bridged
vlan:
Default disk parameters:
blockdev:
diskless:
drbd:
c-delay-target: 1
c-fill-target: 0
c-max-rate: 61440
c-min-rate: 4096
c-plan-ahead: 20
data-stripes: 1
disk-barriers: n
disk-custom:
dynamic-resync: False
meta-barriers: False
meta-stripes: 1
metavg: xenvg
net-custom:
protocol: C
resync-rate: 61440
ext:
file:
gluster:
access: kernelspace
host: 127.0.0.1
port: 24007
volume: gv0
plain:
stripes: 1
rbd:
access: kernelspace
pool: rbd
sharedfile:
Instance policy - limits for instances:
bounds specs:
- max/0:
cpu-count: 8
disk-count: 16
disk-size: 1048576
memory-size: 32768
nic-count: 8
spindle-use: 12
min/0:
cpu-count: 1
disk-count: 1
disk-size: 1024
memory-size: 128
nic-count: 1
spindle-use: 1
std:
cpu-count: 1
disk-count: 1
disk-size: 1024
memory-size: 128
nic-count: 1
spindle-use: 1
allowed disk templates: drbd, plain, gluster
vcpu-ratio: 4
spindle-ratio: 32
Some logs related to gluster are in the following.
root@node1:/var/log/ganeti# grep gluster * -R
[...]
node-daemon.log:2015-04-15 05:30:17,745: ganeti-noded pid=1054 INFO RunCmd
mount -t glusterfs -o server-port=24007 127.0.0.1:/gv0
/var/run/ganeti/gluster
node-daemon.log:2015-04-15 05:30:21,946: ganeti-noded pid=1054 INFO RunCmd
umount /var/run/ganeti/gluster
node-daemon.log:
File "/usr/local/share/ganeti/2.11/ganeti/storage/gluster.py", line 456, in
Create
node-daemon.log:FileStoragePathError:
Path '/var/run/ganeti/gluster/ganeti/ce24daf6-15fc-4450-abd3-f893b342b601.0'
is not acceptable for file storage
--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings
