Re: [Openstack] storage backend for nova
Hi Sebastien, Thanks again for your reply. Sorry for disturbing you again but I am in a bit of hurry now. As you talk about that swift supports object storage so I can store the VMs data using swift. So if I have my VM instance running on my nova client and if I want to copy some massive data from my client side to VM can I use swift to store the data on behalf of VM subsequently. If so, can you help me out with this?? Again thanking you for your immense help. --Udit On Fri, Jun 29, 2012 at 11:35 AM, Sébastien Han han.sebast...@gmail.comwrote: Hi! The local file system of each instance is ephemeral, when you run the action *terminate* you will loose everything. But you can shutdown, reboot the instance without any problem. If you want to use Cinder (previously known as nova-volume), you need a storage solution which supports *block device*. Here a little reminder: - Ceph features: - object storage - block device - distributed filesystem - Swift: - *only* an object storage. So you can use it to store the VMs data. If you want to use cinder you can use this king of storage: - SAN with LVM + iSCSI - Ceph - Sheepdog - ... Check my article about that to see the big picture of the available storage solution: http://www.sebastien-han.fr/blog/2012/05/17/openstack-high-avavailability-1/ With one of those technology you will be able to attach persistant storage to your instances. Cheers! On Fri, Jun 29, 2012 at 1:26 AM, udit agarwal fzdu...@gmail.com wrote: Hi Sebastien, Thanks for your reply. Your replies have always proved beneficial to me. I want to know one more thing. In a virtual machine, storage is not persistent, so we need to attach a volume with it for storage purposes. My question is that is it possible to create our volumes in ceph or in swift (so that we can have enough space for virtual machine storage). Thanks in advance. --Udit On Thu, Jun 28, 2012 at 9:48 PM, Sébastien Han han.sebast...@gmail.comwrote: Hi, I'm sure if I understand everything but let me give a try. By default, the compute nodes store virtual instances in /var/lib/nova/instances/. Of course it's part of the compute node local FS. If you want to store this directory somewhere else, use a DFS like GlusterFS or even Ceph or a SAN. Also don't forget that you *can't *use Swift for storing your virtual instances. Hope it is what you asked for. Cheers. On Thu, Jun 28, 2012 at 1:48 AM, udit agarwal fzdu...@gmail.com wrote: Hi, I have set up Openstack in my lab with everything except storage nodes on one system and two other systems with each of them acting themselves as a storage node. I have used swift as the backend for glance so all the uploaded images are stored on these storage nodes. But when I run a virtual machine using nova, it reads the image from the storage nodes and it seems to me that it uses the local filesystem for storing instances and after I shutoff my virtual machine, it writes back to the storage nodes. But the thing that I want to implement is that if I copy some file from my local system to that virtual machine, it should automatically get stored on my storage nodes rather than occupying space on my local filesystem. Can anybody help me with this?? Thanks in advance. --Udit Agarwal ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] storage backend for nova
Hi, I have set up Openstack in my lab with everything except storage nodes on one system and two other systems with each of them acting themselves as a storage node. I have used swift as the backend for glance so all the uploaded images are stored on these storage nodes. But when I run a virtual machine using nova, it reads the image from the storage nodes and it seems to me that it uses the local filesystem for storing instances and after I shutoff my virtual machine, it writes back to the storage nodes. But the thing that I want to implement is that if I copy some file from my local system to that virtual machine, it should automatically get stored on my storage nodes rather than occupying space on my local filesystem. Can anybody help me with this?? Thanks in advance. --Udit Agarwal ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] ssh not authenticating
Hi Mandar, Thanks for your reply. But I am still stuck in the problem. I tried with cirros but with no luck. And for the next one, the system still asks me for password, but it was supposed to be password-less. Can anybody help me with this?? Thanks in advance. --Udit On Thu, Jun 21, 2012 at 6:53 PM, Vaze, Mandar mandar.v...@nttdata.comwrote: Default password for cirros is cubswin:) - including the smiley I hope you entered correct password (It is easy to ignore the last two characters thinking it is a smiley) Other options is to use password less ssh login using keypair. See http://docs.openstack.org/essex/openstack-compute/starter/content/Launch_and_manage_instances-d1e1885.html -Mandar From: openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net[mailto: openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net] On Behalf Of udit agarwal Sent: Thursday, June 21, 2012 11:13 AM To: openstack@lists.launchpad.net Subject: [Openstack] ssh not authenticating Hi, I have setup openstack on my system using the manual http://docs.openstack.org/essex/openstack-compute/install/apt/content/. I tried to run the test image cirros on my system. While I can easily ping it, I faced some problems in authenticating via ssh. First, it asks for password, even providing the correct password for the same, it re asked the password 2 more times and finally denied me the permission. I couldn't resolve this issue then. Can anybody help me with this??? thanks in advance. --Udit __ Disclaimer:This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data. If you are not the intended recipient, please advise the sender by replying promptly to this email and then delete and destroy this email and any attachments without any further use, copying or forwarding ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] ssh not authenticating
Hi, I have setup openstack on my system using the manual http://docs.openstack.org/essex/openstack-compute/install/apt/content/. I tried to run the test image cirros on my system. While I can easily ping it, I faced some problems in authenticating via ssh. First, it asks for password, even providing the correct password for the same, it re asked the password 2 more times and finally denied me the permission. I couldn't resolve this issue then. Can anybody help me with this??? thanks in advance. --Udit ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] HTTP/1.1 404 Not Found error in swift
Hi ,
Thanks Dolph for your reply. I applied your suggestion and executed the
command as curl -k -v -H 'X-Storage-User: openstackDemo:adminUser' -H
'X-Storage-Pass: 1234qwer' http://192.168.20.7:5000/v2.0/; . Now there was
no error but to my surprise, I didn't get the Auth-token and the
Storage-Url as was required to execute the next command.
The output of the command is as follows:
hp2:/etc/swift # curl -k -v -H 'X-Storage-User: openstackDemo:adminUser' -H
'X-Storage-Pass: 1234qwer' http://192.168.20.7:5000/v2.0/
* About to connect() to 192.168.20.7 port 5000 (#0)
* Trying 192.168.20.7...
* connected
* Connected to 192.168.20.7 (192.168.20.7) port 5000 (#0)
GET /v2.0/ HTTP/1.1
User-Agent: curl/7.22.0 (x86_64-unknown-linux-gnu) libcurl/7.25.0
OpenSSL/1.0.1c zlib/1.2.5 libidn/1.22 libssh2/1.4.0
Host: 192.168.20.7:5000
Accept: */*
X-Storage-User: openstackDemo:adminUser
X-Storage-Pass: 1234qwer
HTTP/1.1 200 OK
Content-Type: application/json
Vary: X-Auth-Token
Content-Length: 610
Date: Sun, 17 Jun 2012 08:10:01 GMT
* Connection #0 to host 192.168.20.7 left intact
* Closing connection #0
{version: {status: beta, updated: 2011-11-19T00:00:00Z,
media-types: [{base: application/json, type:
application/vnd.openstack.identity-v2.0+json}, {base:
application/xml, type: application/vnd.openstack.identity-v2.0+xml}],
id: v2.0, links: [{href: http://localhost:5000/v2.0/;, rel:
self}, {href:
http://docs.openstack.org/api/openstack-identity-service/2.0/content/;,
type: text/html, rel: describedby}, {href:
http://docs.openstack.org/api/openstack-identity-service/2.0/identity-dev-guide-2.0.pdf;,
type: application/pdf, rel: describedby}]}}
Can anybody help me with this??
Thanks in advance.
--Udit Agarwal
On Sun, Jun 17, 2012 at 1:46 AM, Dolph Mathews dolph.math...@gmail.comwrote:
The URL http://192.168.20.7:5000/auth/v1.0 is not one supported by
keystone; does that command work if you use http://AUTH_HOSTNAME:5000
/v2.0 instead?
For anyone interested, direct link to the doc in question:
http://docs.openstack.org/essex/openstack-compute/install/apt/content/verify-swift-installation.html
-Dolph
On Sat, Jun 16, 2012 at 6:04 AM, udit agarwal fzdu...@gmail.com wrote:
Hi,
I am setting up openstack in my lab. I followed the manual
http://docs.openstack.org/essex/openstack-compute/install/apt/content/for
installing configuring it. I have already setup keystone, glance and
swift all well on my system. But I am having problems in setting up swift.
The command swift -V 2.0 -A http://192.168.20.7:5000/v2.0 -U
openstackDemo:adminUser -K 1234qwer stat worked fine. But when I
executed the command curl -k -v -H 'X-Storage-User:
openstackDemo:adminUser' -H 'X-Storage-Pass: 1234qwer'
http://192.168.20.7:5000/auth/v1.0;, I got the following output:
* About to connect() to 192.168.20.7 port 5000 (#0)
* Trying 192.168.20.7...
* connected
* Connected to 192.168.20.7 (192.168.20.7) port 5000 (#0)
GET /auth/v1.0 HTTP/1.1
User-Agent: curl/7.22.0 (x86_64-unknown-linux-gnu) libcurl/7.25.0
OpenSSL/1.0.1c zlib/1.2.5 libidn/1.22 libssh2/1.4.0
Host: 192.168.20.7:5000
Accept: */*
X-Storage-User: openstackDemo:adminUser
X-Storage-Pass: 1234qwer
HTTP/1.1 404 Not Found
Content-Length: 154
Content-Type: text/html; charset=UTF-8
Date: Sat, 16 Jun 2012 08:04:57 GMT
html
head
title404 Not Found/title
/head
body
h1404 Not Found/h1
The resource could not be found.br /br /
/body
* Connection #0 to host 192.168.20.7 left intact
* Closing connection #0
My proxy-server.conf file is as follows:
[DEFAULT]
# bind_ip = 0.0.0.0
bind_port =
# backlog = 4096
# swift_dir = /etc/swift
#workers = 8
user = swift
#cert_file = /etc/swift/cert.crt
#key_file = /etc/swift/cert.key
# expiring_objects_container_divisor = 86400
# You can specify default log routing here if you want:
# log_name = swift
# log_facility = LOG_LOCAL0
# log_level = INFO
[pipeline:main]
pipeline = catch_errors healthcheck cache authtoken keystone proxy-server
[app:proxy-server]
use = egg:swift#proxy
# You can override the default log routing for this app here:
# set log_name = proxy-server
# set log_facility = LOG_LOCAL0
# set log_level = INFO
# set access_log_name = proxy-server
# set access_log_facility = LOG_LOCAL0
# set access_log_level = INFO
# set log_headers = False
# recheck_account_existence = 60
# recheck_container_existence = 60
# object_chunk_size = 8192
# client_chunk_size = 8192
# node_timeout = 10
# client_timeout = 60
# conn_timeout = 0.5
# How long without an error before a node's error count is reset. This
will
# also be how long before a node is reenabled after suppression is
triggered.
# error_suppression_interval = 60
# How many errors can accumulate before a node is temporarily ignored.
# error_suppression_limit = 10
# If set to 'true' any authorized user may create and delete accounts; if
# 'false' no one, even authorized, can
Re: [Openstack] HTTP/1.1 404 Not Found error in swift
Hi, Along with the errors that I posted before, I am also getting following errors on my storage nodes: container-replicator: ERROR rsync failed with 35: account-replicator : ERROR rsync failed with 35: Can anyone help me with this?? Thanks in advance. --Udit Agarwal ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] HTTP/1.1 404 Not Found error in swift
# [filter:tempurl] # use = egg:swift#tempurl # # The headers to remove from incoming requests. Simply a whitespace delimited # list of header names and names can optionally end with '*' to indicate a # prefix match. incoming_allow_headers is a list of exceptions to these # removals. # incoming_remove_headers = x-timestamp # # The headers allowed as exceptions to incoming_remove_headers. Simply a # whitespace delimited list of header names and names can optionally end with # '*' to indicate a prefix match. # incoming_allow_headers = # # The headers to remove from outgoing responses. Simply a whitespace delimited # list of header names and names can optionally end with '*' to indicate a # prefix match. outgoing_allow_headers is a list of exceptions to these # removals. # outgoing_remove_headers = x-object-meta-* # # The headers allowed as exceptions to outgoing_remove_headers. Simply a # whitespace delimited list of header names and names can optionally end with # '*' to indicate a prefix match. # outgoing_allow_headers = x-object-meta-public-* # Note: Put formpost just before your auth filter(s) in the pipeline # [filter:formpost] # use = egg:swift#formpost # Note: Just needs to be placed before the proxy-server in the pipeline. # [filter:name_check] # use = egg:swift#name_check # forbidden_chars = '` # maximum_length = 255 Can anybody help me with this?? Thanks in advance. --Udit Agarwal ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] Attribute error
Hi, On running 'service openstack-nova-api restart' I am getting error such as 'AttributeError : 'module' object has no attribute 'pipeline_factory''. Can anyone help me with this?? Thanks in advance. --Udit Agarwal ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] storage for virtual machines
Hi, I have setup nova compute and storage on different nodes. I want to create new virtual machine images on my nova compute node. I also want to configure these virtual machines to use swift(openstack storage that is setup on a different node) for their storage purposes. But I have no idea how to do this? Can anyone help me in this matter. Thanks in advance. --Udit Agarwal ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] memory allocation while creating a linux image
Hi, I am following the guide -Openstack Compute Administration Manual. I have a doubt on this page http://docs.openstack.org/trunk/openstack-compute/admin/content/creating-a-l inux-image.html which talks about creating a linux image. The thing that I can't understand is that the first line talks about creating a linux image of size 5G, but this allocation of 5G is done from which partition of our disk. Can anyone help me with this ?? Thanks in advance. --Udit Agarwal ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] setting up virtual machines with openstack
Hi, I have set up openstack-swift in my lab with 3 systems with a proxy node on one system and two storage nodes each on different system. One storage node has only one storage device while the other has 2 storage devices. The swift setup worked fine and I did some tests on it and they too worked fine. Now, I want to set up virtual machines on my system and want to run multiple virtual machine instances in parallel . But I don't know about what are the exact installation steps that are needed to be done after the swift installation. I guess I need to install Glance and nova compute to achieve the same. Please correct me if I am wrong. Can anyone help me in this matter. Thanks in advance. --Udit Agarwal ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
