Re: CS 4.5.2 Fails to Start.

2015-09-11 Thread giraffeg forestg
Hi


CLOUDSTACK-8212 might become your help.

https://issues.apache.org/jira/browse/CLOUDSTACK-8212


1. This is resolved by commenting out:
---
[root@acs ~]# vi
/usr/share/cloudstack-management/setup/db/schema-421to430.sql

 :

#realhostip changes, before changing table and adding default value
# UPDATE `cloud`.`configuration` SET value = CONCAT("*.",(SELECT
`temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
`name`="consoleproxy.u
rl.domain") AS `temptable` WHERE
`temptable`.`name`="consoleproxy.url.domain")) WHERE
`name`="consoleproxy.url.domain";
# UPDATE `cloud`.`configuration` SET `value` = CONCAT("*.",(SELECT
`temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
`name`="secstorage.ssl.cert.domain") AS `temptable` WHERE
`temptable`.`name`="secstorage.ssl.cert.domain")) WHERE
`name`="secstorage.ssl.cert.domain";
---

and,

2. stop cloudsack-management & cloudsack-usage & mariadb
3. initialize database
4. cloudstack-setup-databases
5. cloudstack-setup-management


I also the same problem has occurred.

My environment:
 CloudStack 4.5.2 (
http://packages.shapeblue.com/cloudstack/upstream/centos7/4.5)
 CentOS 7.1.1503
 mariadb-5.5.44-1



---
Satoru Nakaya

Japan CloudStack User Group
http://cloudstack.jp/


2015-09-11 23:11 GMT+09:00 Keerthiraja SJ :

> I really face this issue when I install on MariaDB. If I do the same on
> MySQL this pass it.
>
> On Fri, Sep 11, 2015 at 7:09 PM, Keerthiraja SJ 
> wrote:
>
> > Hi All,
> >
> > Today I tried to install the CS 4.5.2 on fresh box where I could able to
> > successfully deploy
> > the cloudstack-setup-databases.
> >
> > After I tried number of times the fresh installation I could see the same
> > issue been reproducing it.
> >
> > While stating the cloudstack servers I could see below error constantly.
> >
> >
> >
> >
> > *ERROR*ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: UPDATE
> > `cloud`.`configuration` SET value = CONCAT("*.",(SELECT
> `temptable`.`value`
> > FROM (SELECT * FROM `cloud`.`configuration` WHERE
> > `name`="consoleproxy.url.domain") AS `temptable` WHERE
> > `temptable`.`name`="consoleproxy.url.domain")) WHERE
> > `name`="consoleproxy.url.domain"
> > ERROR [c.c.u.d.ScriptRunner] (main:null)
> > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> > link failure
> >
> > The last packet successfully received from the server was 25 milliseconds
> > ago.  The last packet sent successfully to the server was 25 milliseconds
> > ago.
> > ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute
> upgrade
> > script: /usr/share/cloudstack-management/setup/db/schema-421to430.sql
> > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> > link failure
> >
> >
> > Caused by: java.net.SocketException: Broken pipe
> > ... 61 more
> > ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to upgrade the
> > database
> > com.cloud.utils.exception.CloudRuntimeException: Unable to execute
> upgrade
> > script: /usr/share/cloudstack-management/setup/db/schema-421to430.sql
> > at
> >
> com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:311)
> >
> > ERROR [c.c.u.d.DbUtil] (main:null) RELEASE_LOCK() throws exception
> > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> > link failure
> >
> >
> > I did this test number of times by allocating fresh box.
> >
> > Thanks,
> > Keerthi
> >
>


RE: Unable to create a deployment for VM (Additional DATADISK - API-job)

2015-09-11 Thread Somesh Naidu
Disk offering you are using "db258461-8b03-4666-b6a8-d3459b0097ff" has storage 
type as "shared".

Regards,
Somesh

-Original Message-
From: Cristian Ciobanu [mailto:cristian.c@istream.today] 
Sent: Friday, September 11, 2015 7:44 AM
To: users@cloudstack.apache.org
Subject: RE: Unable to create a deployment for VM (Additional DATADISK - 
API-job)

Hello,

    If i do the same thing from root(Admin) user, i don't have any problems.
    The problem is only when i try to deploy from the user (client_xxx) created 
via root (Admin API)
    I also tested with (client_xxx) from UI and i have same problem, i'm not 
sure why is trying to use shared storage for the data disk.

 Please see the log for the user (client_xxx when i try to deploy from UI)

2015-09-11 13:15:45,608 INFO  [a.c.c.a.ApiServer] 
(catalina-exec-21:ctx-a1888e14 ctx-dc68ea81 ctx-bb3b0eef) (userId=2 accountId=2 
sessionId=null) 172.10.10.221 -- GET 
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createServiceOffering&cpunumber=1&cpuspeed=2500&displaytext=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&issystem=false&limitcpuuse=true&memory=2460&name=_autocreated_SRV212&response=json&storagetype=local&tags=com001.myserver.comLocalStorage&signature=f2Xhn7HEr5vXtAz4wMc7lJJGSAc%3D
 200 
{"createserviceofferingresponse":{"serviceoffering":{"id":"526fe949-68cd-463f-b3ca-f042cbdd79f4","name":"_autocreated_SRV212","displaytext":"SRV212","cpunumber":1,"cpuspeed":2500,"memory":2460,"created":"2015-09-11T13:15:45+0200","storagetype":"local","provisioningtype":"thin","offerha":false,"limitcpuuse":true,"isvolatile":false,"tags":"com001.myserver.comLocalStorage","domainid":"c468ebec-2479-4897-a347-4bb96d63804d","domain":"client_3_1_cloud","issystem":false,"defaultuse":false,"iscustomized":false}}}
2015-09-11 13:15:45,657 INFO  [a.c.c.a.ApiServer] 
(catalina-exec-22:ctx-ceb574fb ctx-30cc2b3e ctx-51487e4b) (userId=2 accountId=2 
sessionId=null) 172.10.10.221 -- GET 
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createDiskOffering&customized=false&disksize=16&displaytext=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&name=_autocreated_SRV212&response=json&tags=com001.myserver.comLocalStorage&signature=zZsEWk5tDWZfAEFxTanMeweuy3Q%3D
 200 
{"creatediskofferingresponse":{"diskoffering":{"id":"db258461-8b03-4666-b6a8-d3459b0097ff","domainid":"c468ebec-2479-4897-a347-4bb96d63804d","name":"_autocreated_SRV212","displaytext":"SRV212","disksize":16,"created":"2015-09-11T13:15:45+0200","iscustomized":false,"tags":"com001.myserver.comLocalStorage","storagetype":"shared","provisioningtype":"thin","displayoffering":true}}}
2015-09-11 13:15:45,820 INFO  [a.c.c.a.ApiServer] (catalina-exec-3:ctx-cd5ff82c 
ctx-9c7257a8 ctx-06e84516) (userId=8 accountId=8 sessionId=null) 172.10.10.221 
-- GET 
account=client_3_1&apikey=oSiamYtTnncCNh8iJRiM-K5IpHqqJkryJiRSKKYCDkRoq9l_U0mzBGDQhGkYQ_pHBrrkNY0dM8B8t5gceov6MA&command=deployVirtualMachine&diskofferingid=db258461-8b03-4666-b6a8-d3459b0097ff&displayname=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&name=srv212&response=json&serviceofferingid=526fe949-68cd-463f-b3ca-f042cbdd79f4&templateid=e873ac1f-b95b-48be-863e-0d81c5307995&zoneid=a85f1632-0718-4e67-b7c6-00d566121bf4&signature=U1xUQdOsJEstqVxFgzI5IYDItfI%3D
 200 
{"deployvirtualmachineresponse":{"id":"8a736ca7-b5e6-423c-bb2c-2814d2b87925","jobid":"617c4db9-dd8e-4884-9172-03e4040f1df8"}}
2015-09-11 13:15:45,570 DEBUG [c.c.a.ApiServlet] 
(catalina-exec-21:ctx-a1888e14) ===START===  172.10.10.221 -- GET  
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createServiceOffering&cpunumber=1&cpuspeed=2500&displaytext=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&issystem=false&limitcpuuse=true&memory=2460&name=_autocreated_SRV212&response=json&storagetype=local&tags=com001.myserver.comLocalStorage&signature=f2Xhn7HEr5vXtAz4wMc7lJJGSAc%3D
2015-09-11 13:15:45,608 DEBUG [c.c.a.ApiServlet] (catalina-exec-21:ctx-a1888e14 
ctx-dc68ea81 ctx-bb3b0eef) ===END===  172.10.10.221 -- GET  
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createServiceOffering&cpunumber=1&cpuspeed=2500&displaytext=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&issystem=false&limitcpuuse=true&memory=2460&name=_autocreated_SRV212&response=json&storagetype=local&tags=com001.myserver.comLocalStorage&signature=f2Xhn7HEr5vXtAz4wMc7lJJGSAc%3D
2015-09-11 13:15:45,623 DEBUG [c.c.a.ApiServlet] 
(catalina-exec-22:ctx-ceb574fb) ===START===  172.10.10.221 -- GET  
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createDiskOffering&customized=false&disksize=16&displaytext=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&name=_autocreated_SRV212&response=json&tags=com001.myserver.comLocalStorage&signature=zZsEWk5tDWZfA

Re: Unable to add Ceph KVM node in cloudstack

2015-09-11 Thread Andrija Panic
Dont really know that to be honest... even previously, you can patch qemu
source code yourslef with RBD support - nothing stops you to do so - so
this is just decision from RH or whatever - Im just guessing - anyway it is
the way it is - ubuntu oit of the box suport, CentOS not afaik...

On 11 September 2015 at 13:56, Vadim Kimlaychuk  wrote:

> Andrija,
>
>   If RBD libvirt driver now belongs to RH does that mean Ubuntu/Debian
> will loose it some day as it is proprietary software? Haven't follow Ceph
> achievements since "Emperor"
>
> Vadim.
>
>
> On 2015-09-11 14:39, Andrija Panic wrote:
>
> Np, Im actually very disapointed by RH decision to have this approach -
>> since now CEPH/Inktank is part of RH etc...
>> I didnt want to play with Ubuntu at all (dont let me start about all the
>> possible issues/bugs we found) but I dont like idea of compiling stuff
>> on production...
>>
>> On 11 September 2015 at 13:34, Vadim Kimlaychuk 
>> wrote:
>>
>> Andrija,
>>
>> I don't have such broad experience with different CentOS/RHEL
>> versions, but I am a bit surprised that these distributions does not have
>> RBD support at all. That means they have to maintain their own
>> "restricted"
>> version of these libraries apart from mainstream. Now I am even more happy
>> with my Debian/Ubuntu installations :)
>>
>> Thank you for information!
>>
>> Vadim.
>>
>> On 2015-09-11 14:20, Andrija Panic wrote:
>>
>> Vadim,
>> afaik you are right for mgmt server. As for KVM nodes - libvirt and
>> qemu/qemu-img in CentOS6.x does NOT have RBD support at all :) I have not
>> played a lot with CentOS7, but did quick check long time ago and I thing
>> it
>> also doesnt support RBD - Red Hat wants you to buy RHEV to support RBD -
>> of
>> course, there are workarround, self-compile libvirt etc...similar for
>> qemu/qemu-img.
>>
>> I know for sure that Ubuntu 14.x suports RBD out of the box - since we are
>> running it with CEPH.
>>
>> Best
>>
>> On 11 September 2015 at 10:47, Vadim Kimlaychuk 
>> wrote:
>>
>> Andrija,
>>
>> Are you talking about CS Management server OS? I thought it does
>> not really matter if it includes libvirt or not. All calls to storage
>> should go through hypervisor and any KVM host goes with libvirt. The
>> version of libvirt for old OS may not be aligned with latest Ceph release
>> that is true. Cloud architect must check compatibility version matrix for
>> all products Ceph/KVM/CS anyway.
>>
>> Vadim.
>>
>> On 2015-09-11 11:24, Andrija Panic wrote:
>>
>> RBD for KVM comes out of the box for Ubuntu 14.x (perhaps also 12.x) -
>> not with CentOS6, and not sure really about CentOS7 (probably not also...)
>>
>> On 11 September 2015 at 09:53, Vadim Kimlaychuk 
>> wrote:
>>
>> For KVM hosts RBD comes "out of the box" with libvirt. For XenServer Ceph
>> (RBD) storage type is not yet implemented. I would say it is very
>> hypervisor-specific and does not depend much from Cloudstack.
>>
>> Regards,
>>
>> Vadim.
>>
>> On 2015-09-11 08:55, Shetty, Pradeep wrote:
>>
>> I have one question:
>> Is ceph rbd protocol supported by default on libvirt version
>> 0.10.2-54.el6.x86_64 OR do we need to compile libvirt to support rbd
>> within
>> cloudstack.
>>
>> Regards,
>> Pradeep
>>
>> -Original Message-
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: 09 September 2015 12:07
>> To: users@cloudstack.apache.org
>> Cc: Shetty, Pradeep
>> Subject: RE: Unable to add Ceph KVM node in cloudstack
>>
>> Pradeep,
>>
>> I have installed CS 4.2 with Ceph storage successfully around year ago.
>> There were no problem with configuration except the fact that you can't
>> configure RBD storage as primary storage during Zone set-up.
>> It must be NFS.
>> After Zone is set-up and running you may add another primary storage and
>> there you have list of choices where RBD type is present.
>> After RBD is added you may assign this as default storage for particular
>> cluster assuming that each cluster has its own primary storage.
>>
>> PS. I have also used Ceph object gateway to connect secondary storage. It
>> works as expected. It would be nice to know which way are you going to
>> integrate Ceph into CS?
>>
>> Vadim.
>>
>> On 2015-09-09 08:09, Shetty, Pradeep wrote:
>>
>> Please share steps for adding ceph RBD as primary storage using KVM
>> hypervisor in cloudstack.
>>
>> We are well aware of the best practices/recommendations for cloudstack.
>>
>> Regards,
>> Pradeep
>>
>> -Original Message-
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: 08 September 2015 12:14
>> To: users@cloudstack.apache.org
>> Subject: RE: Unable to add Ceph KVM node in cloudstack
>>
>> Pradeep,
>>
>> From documentation :
>> Warning -- It is NOT recommended to run services on this host not
>> controlled by CloudStack.
>>
>> Good practice -- KVM host must be virgin-clean.
>>
>> Vadim.
>>
>> On 2015-09-08 09:14, Shetty, Pradeep wrote:
>>
>> Hello Vadim,
>>
>> We have followed the same guide and using OVS version 2.3.

Re: CS 4.5.2 Fails to Start.

2015-09-11 Thread Keerthiraja SJ
I really face this issue when I install on MariaDB. If I do the same on
MySQL this pass it.

On Fri, Sep 11, 2015 at 7:09 PM, Keerthiraja SJ  wrote:

> Hi All,
>
> Today I tried to install the CS 4.5.2 on fresh box where I could able to
> successfully deploy
> the cloudstack-setup-databases.
>
> After I tried number of times the fresh installation I could see the same
> issue been reproducing it.
>
> While stating the cloudstack servers I could see below error constantly.
>
>
>
>
> *ERROR*ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: UPDATE
> `cloud`.`configuration` SET value = CONCAT("*.",(SELECT `temptable`.`value`
> FROM (SELECT * FROM `cloud`.`configuration` WHERE
> `name`="consoleproxy.url.domain") AS `temptable` WHERE
> `temptable`.`name`="consoleproxy.url.domain")) WHERE
> `name`="consoleproxy.url.domain"
> ERROR [c.c.u.d.ScriptRunner] (main:null)
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> link failure
>
> The last packet successfully received from the server was 25 milliseconds
> ago.  The last packet sent successfully to the server was 25 milliseconds
> ago.
> ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute upgrade
> script: /usr/share/cloudstack-management/setup/db/schema-421to430.sql
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> link failure
>
>
> Caused by: java.net.SocketException: Broken pipe
> ... 61 more
> ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to upgrade the
> database
> com.cloud.utils.exception.CloudRuntimeException: Unable to execute upgrade
> script: /usr/share/cloudstack-management/setup/db/schema-421to430.sql
> at
> com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:311)
>
> ERROR [c.c.u.d.DbUtil] (main:null) RELEASE_LOCK() throws exception
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> link failure
>
>
> I did this test number of times by allocating fresh box.
>
> Thanks,
> Keerthi
>


CS 4.5.2 Fails to Start.

2015-09-11 Thread Keerthiraja SJ
Hi All,

Today I tried to install the CS 4.5.2 on fresh box where I could able to
successfully deploy
the cloudstack-setup-databases.

After I tried number of times the fresh installation I could see the same
issue been reproducing it.

While stating the cloudstack servers I could see below error constantly.




*ERROR*ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: UPDATE
`cloud`.`configuration` SET value = CONCAT("*.",(SELECT `temptable`.`value`
FROM (SELECT * FROM `cloud`.`configuration` WHERE
`name`="consoleproxy.url.domain") AS `temptable` WHERE
`temptable`.`name`="consoleproxy.url.domain")) WHERE
`name`="consoleproxy.url.domain"
ERROR [c.c.u.d.ScriptRunner] (main:null)
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
link failure

The last packet successfully received from the server was 25 milliseconds
ago.  The last packet sent successfully to the server was 25 milliseconds
ago.
ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute upgrade
script: /usr/share/cloudstack-management/setup/db/schema-421to430.sql
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
link failure


Caused by: java.net.SocketException: Broken pipe
... 61 more
ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to upgrade the
database
com.cloud.utils.exception.CloudRuntimeException: Unable to execute upgrade
script: /usr/share/cloudstack-management/setup/db/schema-421to430.sql
at
com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:311)

ERROR [c.c.u.d.DbUtil] (main:null) RELEASE_LOCK() throws exception
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
link failure


I did this test number of times by allocating fresh box.

Thanks,
Keerthi


Re: Unable to add Ceph KVM node in cloudstack

2015-09-11 Thread Vadim Kimlaychuk

Andrija,

  If RBD libvirt driver now belongs to RH does that mean 
Ubuntu/Debian will loose it some day as it is proprietary software? 
Haven't follow Ceph achievements since "Emperor"


Vadim.

On 2015-09-11 14:39, Andrija Panic wrote:


Np, Im actually very disapointed by RH decision to have this approach -
since now CEPH/Inktank is part of RH etc...
I didnt want to play with Ubuntu at all (dont let me start about all 
the
possible issues/bugs we found) but I dont like idea of compiling 
stuff

on production...

On 11 September 2015 at 13:34, Vadim Kimlaychuk  
wrote:


Andrija,

I don't have such broad experience with different CentOS/RHEL
versions, but I am a bit surprised that these distributions does not 
have
RBD support at all. That means they have to maintain their own 
"restricted"
version of these libraries apart from mainstream. Now I am even more 
happy

with my Debian/Ubuntu installations :)

Thank you for information!

Vadim.

On 2015-09-11 14:20, Andrija Panic wrote:

Vadim,
afaik you are right for mgmt server. As for KVM nodes - libvirt and
qemu/qemu-img in CentOS6.x does NOT have RBD support at all :) I have 
not
played a lot with CentOS7, but did quick check long time ago and I 
thing

it
also doesnt support RBD - Red Hat wants you to buy RHEV to support RBD 
-

of
course, there are workarround, self-compile libvirt etc...similar for
qemu/qemu-img.

I know for sure that Ubuntu 14.x suports RBD out of the box - since we 
are

running it with CEPH.

Best

On 11 September 2015 at 10:47, Vadim Kimlaychuk 
wrote:

Andrija,

Are you talking about CS Management server OS? I thought it does
not really matter if it includes libvirt or not. All calls to storage
should go through hypervisor and any KVM host goes with libvirt. The
version of libvirt for old OS may not be aligned with latest Ceph 
release
that is true. Cloud architect must check compatibility version matrix 
for

all products Ceph/KVM/CS anyway.

Vadim.

On 2015-09-11 11:24, Andrija Panic wrote:

RBD for KVM comes out of the box for Ubuntu 14.x (perhaps also 12.x) -
not with CentOS6, and not sure really about CentOS7 (probably not 
also...)


On 11 September 2015 at 09:53, Vadim Kimlaychuk 
wrote:

For KVM hosts RBD comes "out of the box" with libvirt. For XenServer 
Ceph

(RBD) storage type is not yet implemented. I would say it is very
hypervisor-specific and does not depend much from Cloudstack.

Regards,

Vadim.

On 2015-09-11 08:55, Shetty, Pradeep wrote:

I have one question:
Is ceph rbd protocol supported by default on libvirt version
0.10.2-54.el6.x86_64 OR do we need to compile libvirt to support rbd
within
cloudstack.

Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 09 September 2015 12:07
To: users@cloudstack.apache.org
Cc: Shetty, Pradeep
Subject: RE: Unable to add Ceph KVM node in cloudstack

Pradeep,

I have installed CS 4.2 with Ceph storage successfully around year ago.
There were no problem with configuration except the fact that you can't
configure RBD storage as primary storage during Zone set-up.
It must be NFS.
After Zone is set-up and running you may add another primary storage 
and

there you have list of choices where RBD type is present.
After RBD is added you may assign this as default storage for 
particular

cluster assuming that each cluster has its own primary storage.

PS. I have also used Ceph object gateway to connect secondary storage. 
It

works as expected. It would be nice to know which way are you going to
integrate Ceph into CS?

Vadim.

On 2015-09-09 08:09, Shetty, Pradeep wrote:

Please share steps for adding ceph RBD as primary storage using KVM
hypervisor in cloudstack.

We are well aware of the best practices/recommendations for cloudstack.

Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 08 September 2015 12:14
To: users@cloudstack.apache.org
Subject: RE: Unable to add Ceph KVM node in cloudstack

Pradeep,

From documentation :
Warning -- It is NOT recommended to run services on this host not
controlled by CloudStack.

Good practice -- KVM host must be virgin-clean.

Vadim.

On 2015-09-08 09:14, Shetty, Pradeep wrote:

Hello Vadim,

We have followed the same guide and using OVS version 2.3.2 .

Ceph storage cluster is running on same KVM hypervisor and it fails
when adding to cloudstack.

Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 08 September 2015 11:34
To: users@cloudstack.apache.org
Cc: Shetty, Pradeep
Subject: Re: Unable to add Ceph KVM node in cloudstack

Hello Shetty,

It seems you agent or libvirt configuration is wrong. Please, specify
also do you use OVS or Linux bridge?
Did you follow this guide?
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv 
[1]

[1 [1]]
[1 [1]]
[1 [1]]
[1 [1]]
m.html
[1 [2]]

Regards,

Vadim

On 2015-09-08 08:18, Shetty, Pradeep wrote:

Hello Folks,

We are wo

Re: Unable to add Ceph KVM node in cloudstack

2015-09-11 Thread Andrija Panic
Np, Im actually very disapointed by RH decision to have this approach -
since now CEPH/Inktank is part of RH etc...
I didnt want to play with Ubuntu at all (dont let me start about all the
possible issues/bugs we found) but I dont like idea of compiling stuff
on production...

On 11 September 2015 at 13:34, Vadim Kimlaychuk  wrote:

>
> Andrija,
>
> I don't have such broad experience with different CentOS/RHEL
> versions, but I am a bit surprised that these distributions does not have
> RBD support at all. That means they have to maintain their own "restricted"
> version of these libraries apart from mainstream. Now I am even more happy
> with my Debian/Ubuntu installations :)
>
> Thank you for information!
>
> Vadim.
>
>
> On 2015-09-11 14:20, Andrija Panic wrote:
>
> Vadim,
>>
>> afaik you are right for mgmt server. As for KVM nodes - libvirt and
>> qemu/qemu-img in CentOS6.x does NOT have RBD support at all :) I have not
>> played a lot with CentOS7, but did quick check long time ago and I thing
>> it
>> also doesnt support RBD - Red Hat wants you to buy RHEV to support RBD -
>> of
>> course, there are workarround, self-compile libvirt etc...similar for
>> qemu/qemu-img.
>>
>> I know for sure that Ubuntu 14.x suports RBD out of the box - since we are
>> running it with CEPH.
>>
>> Best
>>
>> On 11 September 2015 at 10:47, Vadim Kimlaychuk 
>> wrote:
>>
>> Andrija,
>>
>> Are you talking about CS Management server OS? I thought it does
>> not really matter if it includes libvirt or not. All calls to storage
>> should go through hypervisor and any KVM host goes with libvirt. The
>> version of libvirt for old OS may not be aligned with latest Ceph release
>> that is true. Cloud architect must check compatibility version matrix for
>> all products Ceph/KVM/CS anyway.
>>
>> Vadim.
>>
>> On 2015-09-11 11:24, Andrija Panic wrote:
>>
>> RBD for KVM comes out of the box for Ubuntu 14.x (perhaps also 12.x) -
>> not with CentOS6, and not sure really about CentOS7 (probably not also...)
>>
>> On 11 September 2015 at 09:53, Vadim Kimlaychuk 
>> wrote:
>>
>> For KVM hosts RBD comes "out of the box" with libvirt. For XenServer Ceph
>> (RBD) storage type is not yet implemented. I would say it is very
>> hypervisor-specific and does not depend much from Cloudstack.
>>
>> Regards,
>>
>> Vadim.
>>
>> On 2015-09-11 08:55, Shetty, Pradeep wrote:
>>
>> I have one question:
>> Is ceph rbd protocol supported by default on libvirt version
>> 0.10.2-54.el6.x86_64 OR do we need to compile libvirt to support rbd
>> within
>> cloudstack.
>>
>> Regards,
>> Pradeep
>>
>> -Original Message-
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: 09 September 2015 12:07
>> To: users@cloudstack.apache.org
>> Cc: Shetty, Pradeep
>> Subject: RE: Unable to add Ceph KVM node in cloudstack
>>
>> Pradeep,
>>
>> I have installed CS 4.2 with Ceph storage successfully around year ago.
>> There were no problem with configuration except the fact that you can't
>> configure RBD storage as primary storage during Zone set-up.
>> It must be NFS.
>> After Zone is set-up and running you may add another primary storage and
>> there you have list of choices where RBD type is present.
>> After RBD is added you may assign this as default storage for particular
>> cluster assuming that each cluster has its own primary storage.
>>
>> PS. I have also used Ceph object gateway to connect secondary storage. It
>> works as expected. It would be nice to know which way are you going to
>> integrate Ceph into CS?
>>
>> Vadim.
>>
>> On 2015-09-09 08:09, Shetty, Pradeep wrote:
>>
>> Please share steps for adding ceph RBD as primary storage using KVM
>> hypervisor in cloudstack.
>>
>> We are well aware of the best practices/recommendations for cloudstack.
>>
>> Regards,
>> Pradeep
>>
>> -Original Message-
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: 08 September 2015 12:14
>> To: users@cloudstack.apache.org
>> Subject: RE: Unable to add Ceph KVM node in cloudstack
>>
>> Pradeep,
>>
>> From documentation :
>> Warning -- It is NOT recommended to run services on this host not
>> controlled by CloudStack.
>>
>> Good practice -- KVM host must be virgin-clean.
>>
>> Vadim.
>>
>> On 2015-09-08 09:14, Shetty, Pradeep wrote:
>>
>> Hello Vadim,
>>
>> We have followed the same guide and using OVS version 2.3.2 .
>>
>> Ceph storage cluster is running on same KVM hypervisor and it fails
>> when adding to cloudstack.
>>
>> Regards,
>> Pradeep
>>
>> -Original Message-
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: 08 September 2015 11:34
>> To: users@cloudstack.apache.org
>> Cc: Shetty, Pradeep
>> Subject: Re: Unable to add Ceph KVM node in cloudstack
>>
>> Hello Shetty,
>>
>> It seems you agent or libvirt configuration is wrong. Please, specify
>> also do you use OVS or Linux bridge?
>> Did you follow this guide?
>> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv
>> [1]
>> [1 [1]]
>>

RE: Unable to create a deployment for VM (Additional DATADISK - API-job)

2015-09-11 Thread Cristian Ciobanu
Hello,

    If i do the same thing from root(Admin) user, i don't have any problems.
    The problem is only when i try to deploy from the user (client_xxx) created 
via root (Admin API)
    I also tested with (client_xxx) from UI and i have same problem, i'm not 
sure why is trying to use shared storage for the data disk.

 Please see the log for the user (client_xxx when i try to deploy from UI)

2015-09-11 13:15:45,608 INFO  [a.c.c.a.ApiServer] 
(catalina-exec-21:ctx-a1888e14 ctx-dc68ea81 ctx-bb3b0eef) (userId=2 accountId=2 
sessionId=null) 172.10.10.221 -- GET 
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createServiceOffering&cpunumber=1&cpuspeed=2500&displaytext=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&issystem=false&limitcpuuse=true&memory=2460&name=_autocreated_SRV212&response=json&storagetype=local&tags=com001.myserver.comLocalStorage&signature=f2Xhn7HEr5vXtAz4wMc7lJJGSAc%3D
 200 
{"createserviceofferingresponse":{"serviceoffering":{"id":"526fe949-68cd-463f-b3ca-f042cbdd79f4","name":"_autocreated_SRV212","displaytext":"SRV212","cpunumber":1,"cpuspeed":2500,"memory":2460,"created":"2015-09-11T13:15:45+0200","storagetype":"local","provisioningtype":"thin","offerha":false,"limitcpuuse":true,"isvolatile":false,"tags":"com001.myserver.comLocalStorage","domainid":"c468ebec-2479-4897-a347-4bb96d63804d","domain":"client_3_1_cloud","issystem":false,"defaultuse":false,"iscustomized":false}}}
2015-09-11 13:15:45,657 INFO  [a.c.c.a.ApiServer] 
(catalina-exec-22:ctx-ceb574fb ctx-30cc2b3e ctx-51487e4b) (userId=2 accountId=2 
sessionId=null) 172.10.10.221 -- GET 
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createDiskOffering&customized=false&disksize=16&displaytext=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&name=_autocreated_SRV212&response=json&tags=com001.myserver.comLocalStorage&signature=zZsEWk5tDWZfAEFxTanMeweuy3Q%3D
 200 
{"creatediskofferingresponse":{"diskoffering":{"id":"db258461-8b03-4666-b6a8-d3459b0097ff","domainid":"c468ebec-2479-4897-a347-4bb96d63804d","name":"_autocreated_SRV212","displaytext":"SRV212","disksize":16,"created":"2015-09-11T13:15:45+0200","iscustomized":false,"tags":"com001.myserver.comLocalStorage","storagetype":"shared","provisioningtype":"thin","displayoffering":true}}}
2015-09-11 13:15:45,820 INFO  [a.c.c.a.ApiServer] (catalina-exec-3:ctx-cd5ff82c 
ctx-9c7257a8 ctx-06e84516) (userId=8 accountId=8 sessionId=null) 172.10.10.221 
-- GET 
account=client_3_1&apikey=oSiamYtTnncCNh8iJRiM-K5IpHqqJkryJiRSKKYCDkRoq9l_U0mzBGDQhGkYQ_pHBrrkNY0dM8B8t5gceov6MA&command=deployVirtualMachine&diskofferingid=db258461-8b03-4666-b6a8-d3459b0097ff&displayname=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&name=srv212&response=json&serviceofferingid=526fe949-68cd-463f-b3ca-f042cbdd79f4&templateid=e873ac1f-b95b-48be-863e-0d81c5307995&zoneid=a85f1632-0718-4e67-b7c6-00d566121bf4&signature=U1xUQdOsJEstqVxFgzI5IYDItfI%3D
 200 
{"deployvirtualmachineresponse":{"id":"8a736ca7-b5e6-423c-bb2c-2814d2b87925","jobid":"617c4db9-dd8e-4884-9172-03e4040f1df8"}}
2015-09-11 13:15:45,570 DEBUG [c.c.a.ApiServlet] 
(catalina-exec-21:ctx-a1888e14) ===START===  172.10.10.221 -- GET  
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createServiceOffering&cpunumber=1&cpuspeed=2500&displaytext=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&issystem=false&limitcpuuse=true&memory=2460&name=_autocreated_SRV212&response=json&storagetype=local&tags=com001.myserver.comLocalStorage&signature=f2Xhn7HEr5vXtAz4wMc7lJJGSAc%3D
2015-09-11 13:15:45,608 DEBUG [c.c.a.ApiServlet] (catalina-exec-21:ctx-a1888e14 
ctx-dc68ea81 ctx-bb3b0eef) ===END===  172.10.10.221 -- GET  
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createServiceOffering&cpunumber=1&cpuspeed=2500&displaytext=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&issystem=false&limitcpuuse=true&memory=2460&name=_autocreated_SRV212&response=json&storagetype=local&tags=com001.myserver.comLocalStorage&signature=f2Xhn7HEr5vXtAz4wMc7lJJGSAc%3D
2015-09-11 13:15:45,623 DEBUG [c.c.a.ApiServlet] 
(catalina-exec-22:ctx-ceb574fb) ===START===  172.10.10.221 -- GET  
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createDiskOffering&customized=false&disksize=16&displaytext=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&name=_autocreated_SRV212&response=json&tags=com001.myserver.comLocalStorage&signature=zZsEWk5tDWZfAEFxTanMeweuy3Q%3D
2015-09-11 13:15:45,657 DEBUG [c.c.a.ApiServlet] (catalina-exec-22:ctx-ceb574fb 
ctx-30cc2b3e ctx-51487e4b) ===END===  172.10.10.221 -- GET  
apikey=notmyrealapikey_vGZMOo_kGPH9AVvKzG7yEX1TeKhcxjrbGysI5-q7ASytbUYG9t-kvRVG5lkgQVD-JA5AuJpng&command=createDiskOffering&customized=false&disksize=16&displaytext=SRV212&domainid=c468ebec-2479-489

Re: Unable to add Ceph KVM node in cloudstack

2015-09-11 Thread Vadim Kimlaychuk


Andrija,

I don't have such broad experience with different CentOS/RHEL 
versions, but I am a bit surprised that these distributions does not 
have RBD support at all. That means they have to maintain their own 
"restricted" version of these libraries apart from mainstream. Now I am 
even more happy with my Debian/Ubuntu installations :)


Thank you for information!

Vadim.

On 2015-09-11 14:20, Andrija Panic wrote:


Vadim,

afaik you are right for mgmt server. As for KVM nodes - libvirt and
qemu/qemu-img in CentOS6.x does NOT have RBD support at all :) I have 
not
played a lot with CentOS7, but did quick check long time ago and I 
thing it
also doesnt support RBD - Red Hat wants you to buy RHEV to support RBD 
- of

course, there are workarround, self-compile libvirt etc...similar for
qemu/qemu-img.

I know for sure that Ubuntu 14.x suports RBD out of the box - since we 
are

running it with CEPH.

Best

On 11 September 2015 at 10:47, Vadim Kimlaychuk  
wrote:


Andrija,

Are you talking about CS Management server OS? I thought it does
not really matter if it includes libvirt or not. All calls to storage
should go through hypervisor and any KVM host goes with libvirt. The
version of libvirt for old OS may not be aligned with latest Ceph 
release
that is true. Cloud architect must check compatibility version matrix 
for

all products Ceph/KVM/CS anyway.

Vadim.

On 2015-09-11 11:24, Andrija Panic wrote:

RBD for KVM comes out of the box for Ubuntu 14.x (perhaps also 12.x) - 
not with CentOS6, and not sure really about CentOS7 (probably not 
also...)


On 11 September 2015 at 09:53, Vadim Kimlaychuk 
wrote:

For KVM hosts RBD comes "out of the box" with libvirt. For XenServer 
Ceph

(RBD) storage type is not yet implemented. I would say it is very
hypervisor-specific and does not depend much from Cloudstack.

Regards,

Vadim.

On 2015-09-11 08:55, Shetty, Pradeep wrote:

I have one question:
Is ceph rbd protocol supported by default on libvirt version
0.10.2-54.el6.x86_64 OR do we need to compile libvirt to support rbd
within
cloudstack.

Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 09 September 2015 12:07
To: users@cloudstack.apache.org
Cc: Shetty, Pradeep
Subject: RE: Unable to add Ceph KVM node in cloudstack

Pradeep,

I have installed CS 4.2 with Ceph storage successfully around year ago.
There were no problem with configuration except the fact that you can't
configure RBD storage as primary storage during Zone set-up.
It must be NFS.
After Zone is set-up and running you may add another primary storage 
and

there you have list of choices where RBD type is present.
After RBD is added you may assign this as default storage for 
particular

cluster assuming that each cluster has its own primary storage.

PS. I have also used Ceph object gateway to connect secondary storage. 
It

works as expected. It would be nice to know which way are you going to
integrate Ceph into CS?

Vadim.

On 2015-09-09 08:09, Shetty, Pradeep wrote:

Please share steps for adding ceph RBD as primary storage using KVM
hypervisor in cloudstack.

We are well aware of the best practices/recommendations for cloudstack.

Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 08 September 2015 12:14
To: users@cloudstack.apache.org
Subject: RE: Unable to add Ceph KVM node in cloudstack

Pradeep,

From documentation :
Warning -- It is NOT recommended to run services on this host not
controlled by CloudStack.

Good practice -- KVM host must be virgin-clean.

Vadim.

On 2015-09-08 09:14, Shetty, Pradeep wrote:

Hello Vadim,

We have followed the same guide and using OVS version 2.3.2 .

Ceph storage cluster is running on same KVM hypervisor and it fails
when adding to cloudstack.

Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 08 September 2015 11:34
To: users@cloudstack.apache.org
Cc: Shetty, Pradeep
Subject: Re: Unable to add Ceph KVM node in cloudstack

Hello Shetty,

It seems you agent or libvirt configuration is wrong. Please, specify
also do you use OVS or Linux bridge?
Did you follow this guide?
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv 
[1]

[1 [1]]
[1 [1]]
[1 [1]]
m.html
[1 [2]]

Regards,

Vadim

On 2015-09-08 08:18, Shetty, Pradeep wrote:

Hello Folks,

We are working on ceph(hammer, 0.94.3) implementation on kvm
hypervisor(centos 6.5) which will be integrated on cloudstack(4.4.2),

--- Single KVM node( OS- CentOS 6.5, libvirt-0.10.2-54.el6.x86_64,
openvswitch 2.3.2) + ceph hammer, cluster health is Ok.

We are unable to add the KVM host(new cluster) in cloudstack in an
existing zone, below is the error log.

> agent log-- libvirt: XML-RPC error : Cannot write data: Broken
pipe
03/09/2015 13:13:15 4882 jsvc.exec error: Service exit with a return
value of 143

Please let us know the exact steps to add Ceph KVM host to cloudstack.

Re: Unable to add Ceph KVM node in cloudstack

2015-09-11 Thread Andrija Panic
Vadim,

afaik you are right for mgmt server. As for KVM nodes - libvirt and
qemu/qemu-img in CentOS6.x does NOT have RBD support at all :) I have not
played a lot with CentOS7, but did quick check long time ago and I thing it
also doesnt support RBD - Red Hat wants you to buy RHEV to support RBD - of
course, there are workarround, self-compile libvirt etc...similar for
qemu/qemu-img.

I know for sure that Ubuntu 14.x suports RBD out of the box - since we are
running it with CEPH.

Best

On 11 September 2015 at 10:47, Vadim Kimlaychuk  wrote:

> Andrija,
>
>   Are you talking about CS Management server OS?  I thought it does
> not really matter if it includes libvirt or not. All calls to storage
> should go through hypervisor and any KVM host goes with libvirt. The
> version of libvirt for old OS may not be aligned with latest Ceph release
> that is true. Cloud architect must check compatibility version matrix for
> all products Ceph/KVM/CS anyway.
>
> Vadim.
>
>
>
> On 2015-09-11 11:24, Andrija Panic wrote:
>
> RBD for KVM comes out of the box for Ubuntu 14.x (perhaps also 12.x) - not
>> with CentOS6, and not sure really about CentOS7 (probably not also...)
>>
>> On 11 September 2015 at 09:53, Vadim Kimlaychuk 
>> wrote:
>>
>> For KVM hosts RBD comes "out of the box" with libvirt. For XenServer Ceph
>> (RBD) storage type is not yet implemented. I would say it is very
>> hypervisor-specific and does not depend much from Cloudstack.
>>
>> Regards,
>>
>> Vadim.
>>
>> On 2015-09-11 08:55, Shetty, Pradeep wrote:
>>
>> I have one question:
>> Is ceph rbd protocol supported by default on libvirt version
>> 0.10.2-54.el6.x86_64 OR do we need to compile libvirt to support rbd
>> within
>> cloudstack.
>>
>> Regards,
>> Pradeep
>>
>> -Original Message-
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: 09 September 2015 12:07
>> To: users@cloudstack.apache.org
>> Cc: Shetty, Pradeep
>> Subject: RE: Unable to add Ceph KVM node in cloudstack
>>
>> Pradeep,
>>
>> I have installed CS 4.2 with Ceph storage successfully around year ago.
>> There were no problem with configuration except the fact that you can't
>> configure RBD storage as primary storage during Zone set-up.
>> It must be NFS.
>> After Zone is set-up and running you may add another primary storage and
>> there you have list of choices where RBD type is present.
>> After RBD is added you may assign this as default storage for particular
>> cluster assuming that each cluster has its own primary storage.
>>
>> PS. I have also used Ceph object gateway to connect secondary storage. It
>> works as expected. It would be nice to know which way are you going to
>> integrate Ceph into CS?
>>
>> Vadim.
>>
>> On 2015-09-09 08:09, Shetty, Pradeep wrote:
>>
>> Please share steps for adding ceph RBD as primary storage using KVM
>> hypervisor in cloudstack.
>>
>> We are well aware of the best practices/recommendations for cloudstack.
>>
>> Regards,
>> Pradeep
>>
>> -Original Message-
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: 08 September 2015 12:14
>> To: users@cloudstack.apache.org
>> Subject: RE: Unable to add Ceph KVM node in cloudstack
>>
>> Pradeep,
>>
>> From documentation :
>> Warning -- It is NOT recommended to run services on this host not
>> controlled by CloudStack.
>>
>> Good practice -- KVM host must be virgin-clean.
>>
>> Vadim.
>>
>> On 2015-09-08 09:14, Shetty, Pradeep wrote:
>>
>> Hello Vadim,
>>
>> We have followed the same guide and using OVS version 2.3.2 .
>>
>> Ceph storage cluster is running on same KVM hypervisor and it fails
>> when adding to cloudstack.
>>
>> Regards,
>> Pradeep
>>
>> -Original Message-
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: 08 September 2015 11:34
>> To: users@cloudstack.apache.org
>> Cc: Shetty, Pradeep
>> Subject: Re: Unable to add Ceph KVM node in cloudstack
>>
>> Hello Shetty,
>>
>> It seems you agent or libvirt configuration is wrong. Please, specify
>> also do you use OVS or Linux bridge?
>> Did you follow this guide?
>> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv
>> [1]
>> [1 [1]]
>> [1 [1]]
>> m.html
>> [1 [2]]
>>
>> Regards,
>>
>> Vadim
>>
>> On 2015-09-08 08:18, Shetty, Pradeep wrote:
>>
>> Hello Folks,
>>
>> We are working on ceph(hammer, 0.94.3) implementation on kvm
>> hypervisor(centos 6.5) which will be integrated on cloudstack(4.4.2),
>>
>> --- Single KVM node( OS- CentOS 6.5, libvirt-0.10.2-54.el6.x86_64,
>> openvswitch 2.3.2) + ceph hammer, cluster health is Ok.
>>
>> We are unable to add the KVM host(new cluster) in cloudstack in an
>> existing zone, below is the error log.
>>
>> > agent log-- libvirt: XML-RPC error : Cannot write data: Broken
>> pipe
>> 03/09/2015 13:13:15 4882 jsvc.exec error: Service exit with a return
>> value of 143
>>
>> Please let us know the exact steps to add Ceph KVM host to cloudstack.
>>
>> Thanks,
>> Pradeep
>>
>> Links:
>> --
>> [1 [1]]
>>
>>
>> http://cloudsta

Re: Cloudstack 4.5.2 startup ERROR

2015-09-11 Thread Keerthiraja SJ
During the fresh implementation I could see below error in catalina.out

Error
INFO  [c.c.u.DatabaseUpgradeChecker] (main:null) Database upgrade must be
performed from 4.0.0 to 4.5.2
ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: alter table
vm_template add size bigint unsigned
ERROR [c.c.u.d.ScriptRunner] (main:null)
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column
name 'size'
ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute upgrade
script: /usr/share/cloudstack-management/setup/db/schema-40to410.sql
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column
name 'size'


Kindly help me out right now I am doing production installation.


On Fri, Sep 11, 2015 at 3:34 PM, Keerthiraja SJ  wrote:

> ariaDB [cloud]> select * from vm_template;
>
> ++-+---+--++--+-+-+--+++-+-++--+---+-+---+-+--+-+-+-+-++--+--+--+---+--+-+--+
> | id | unique_name | name  |
> uuid | public | featured | type| hvm |
> bits |
> url
> | format | created | removed | account_id |
> checksum | display_text  |
> enable_password | enable_sshkey | guest_os_id | bootable | prepopulate |
> cross_zones | extractable | hypervisor_type | source_template_id |
> template_tag | sort_key | size | state | update_count | updated |
> dynamically_scalable |
>
> ++-+---+--++--+-+-+--+++-+-++--+---+-+---+-+--+-+-+-+-++--+--+--+---+--+-+--+
> |  1 | routing-1   | SystemVM Template (XenServer) |
> cf459945-5868-11e5-9d7e-1458d04cf748 |  0 |0 | SYSTEM  |   0
> |   64 |
> http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2
> | VHD| 2015-09-11 02:38:08 | NULL|  1 |
> 74b92f031cc5c2089ee89efb81344dcf | SystemVM Template (XenServer)
> |   0 | 0 | 184 |1 |   0
> |   1 |   0 | XenServer   |   NULL |
> NULL |0 | NULL | Allocated |0 | NULL
> |0 |
> |  2 | centos53-x86_64 | CentOS 5.3(64-bit) no GUI (XenServer) |
> cf45be09-5868-11e5-9d7e-1458d04cf748 |  1 |1 | BUILTIN |   0
> |   64 |
> http://download.cloud.com/templates/builtin/f59f18fb-ae94-4f97-afd2-f84755767aca.vhd.bz2
> | VHD| 2015-09-11 02:38:08 | 2015-09-11 02:38:08 |  1 |
> b63d854a9560c013142567bbae8d98cf | CentOS 5.3(64-bit) no GUI (XenServer)
> |   0 | 0 |  12 |1 |   0
> |   1 |   1 | XenServer   |   NULL |
> NULL |0 | NULL | Allocated |0 | NULL
> |0 |
> |  3 | routing-3   | SystemVM Template (KVM)   |
> cf45d927-5868-11e5-9d7e-1458d04cf748 |  0 |0 | SYSTEM  |   0
> |   64 |
> http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2
> | QCOW2  | 2015-09-11 02:38:08 | NULL|  1 |
> 85a1bed07bf43cbf022451cb2ecae4ff | SystemVM Template (KVM)
> |   0 | 0 |  15 |1 |   0
> |   1 |   0 | KVM |   NULL |
> NULL |0 | NULL | Allocated |0 | NULL
> |0 |
> |  4 | centos55-x86_64 | CentOS 5.5(64-bit) no GUI (KVM)   |
> cf45eb74-5868-11e5-9d7e-1458d04cf748 |  1 |1 | BUILTIN |   0
> |   64 |
> http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2
> | QCOW2  | 2015-09-11 02:38:08 | NULL|  1 |
> ed0e788280ff2912ea40f7f91ca7a249 | CentOS 5.5(64-bit) no GUI (KVM)
> |   0 | 0 | 112 |1 |   0
> |   1 |   1 | KVM   

Re: Cloudstack 4.5.2 startup ERROR

2015-09-11 Thread Keerthiraja SJ
ariaDB [cloud]> select * from vm_template;
++-+---+--++--+-+-+--+++-+-++--+---+-+---+-+--+-+-+-+-++--+--+--+---+--+-+--+
| id | unique_name | name  |
uuid | public | featured | type| hvm |
bits |
url
| format | created | removed | account_id |
checksum | display_text  |
enable_password | enable_sshkey | guest_os_id | bootable | prepopulate |
cross_zones | extractable | hypervisor_type | source_template_id |
template_tag | sort_key | size | state | update_count | updated |
dynamically_scalable |
++-+---+--++--+-+-+--+++-+-++--+---+-+---+-+--+-+-+-+-++--+--+--+---+--+-+--+
|  1 | routing-1   | SystemVM Template (XenServer) |
cf459945-5868-11e5-9d7e-1458d04cf748 |  0 |0 | SYSTEM  |   0
|   64 |
http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2
| VHD| 2015-09-11 02:38:08 | NULL|  1 |
74b92f031cc5c2089ee89efb81344dcf | SystemVM Template (XenServer)
|   0 | 0 | 184 |1 |   0
|   1 |   0 | XenServer   |   NULL |
NULL |0 | NULL | Allocated |0 | NULL
|0 |
|  2 | centos53-x86_64 | CentOS 5.3(64-bit) no GUI (XenServer) |
cf45be09-5868-11e5-9d7e-1458d04cf748 |  1 |1 | BUILTIN |   0
|   64 |
http://download.cloud.com/templates/builtin/f59f18fb-ae94-4f97-afd2-f84755767aca.vhd.bz2
| VHD| 2015-09-11 02:38:08 | 2015-09-11 02:38:08 |  1 |
b63d854a9560c013142567bbae8d98cf | CentOS 5.3(64-bit) no GUI (XenServer)
|   0 | 0 |  12 |1 |   0
|   1 |   1 | XenServer   |   NULL |
NULL |0 | NULL | Allocated |0 | NULL
|0 |
|  3 | routing-3   | SystemVM Template (KVM)   |
cf45d927-5868-11e5-9d7e-1458d04cf748 |  0 |0 | SYSTEM  |   0
|   64 |
http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2
| QCOW2  | 2015-09-11 02:38:08 | NULL|  1 |
85a1bed07bf43cbf022451cb2ecae4ff | SystemVM Template (KVM)
|   0 | 0 |  15 |1 |   0
|   1 |   0 | KVM |   NULL |
NULL |0 | NULL | Allocated |0 | NULL
|0 |
|  4 | centos55-x86_64 | CentOS 5.5(64-bit) no GUI (KVM)   |
cf45eb74-5868-11e5-9d7e-1458d04cf748 |  1 |1 | BUILTIN |   0
|   64 |
http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2
| QCOW2  | 2015-09-11 02:38:08 | NULL|  1 |
ed0e788280ff2912ea40f7f91ca7a249 | CentOS 5.5(64-bit) no GUI (KVM)
|   0 | 0 | 112 |1 |   0
|   1 |   1 | KVM |   NULL |
NULL |0 | NULL | Allocated |0 | NULL
|0 |
|  5 | centos56-x86_64-xen | CentOS 5.6(64-bit) no GUI (XenServer) |
cf45fae4-5868-11e5-9d7e-1458d04cf748 |  1 |1 | BUILTIN |   0
|   64 | http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
| VHD| 2015-09-11 02:38:08 | NULL|  1 |
905cec879afd9c9d22ecc8036131a180 | CentOS 5.6(64-bit) no GUI (XenServer)
|   0 | 0 | 142 |1 |   0
|   1 |   1 | XenServer   |   NULL |
NULL |0 | NULL | Allocated |0 | NULL
|1 |
|  6 | centos64-x64| CentOS 6.4(64-bit) GUI (Hyperv)   |
cf46438e-5868-11e5-9d7e-1458d04cf748 |  1 |1 | BUILTIN |   0
|   64 | http://download.cloud

Re: Cloudstack 4.5.2 startup ERROR

2015-09-11 Thread prapul cool
Hi keerthiaja,

  In  vm_template table ,have a column with the name of 'size'. Seems your db 
deployment was not complete so can drop database and redeploy cloudstack  
Regards,
Prapul sriram,
Cloud Architect,
PSI Cloud Solutions,
Psiclouds.com. 


 On Friday, 11 September 2015 3:13 PM, Keerthiraja SJ  
wrote:
   

 ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: UPDATE
`cloud`.`configuration` SET value = CONCAT("*.",(SELECT `temptable`.`value`
FROM (SELECT * FROM `cloud`.`configuration` WHERE
`name`="consoleproxy.url.domain") AS `temptable` WHERE
`temptable`.`name`="consoleproxy.url.domain")) WHERE
`name`="consoleproxy.url.domain"
ERROR [c.c.u.d.ScriptRunner] (main:null)
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
link failure

The last packet successfully received from the server was 63 milliseconds
ago.  The last packet sent successfully to the server was 63 milliseconds
ago.
ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute upgrade
script: /usr/share/cloudstack-management/setup/db/schema-421to430.sql
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
link failure


ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to upgrade the
database

On Fri, Sep 11, 2015 at 2:46 PM, Keerthiraja SJ  wrote:

> Hi All,
>
> After successfully installation I could while starting the
> cloudstack-management ther seems to some error while connecting to my
> database.
>
> I am right now into production setup.
>
> ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to upgrade the
> database
> com.cloud.utils.exception.CloudRuntimeException: Unable to execute upgrade
> script: /usr/share/cloudstack-management/setup/db/schema-40to410.sql
>
> ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: alter table
> vm_template add size bigint unsigned
> ERROR [c.c.u.d.ScriptRunner] (main:null)
> com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column
> name 'size'
> ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute upgrade
> script: /usr/share/cloudstack-management/setup/db/schema-40to410.sql
>
>
> The Version of the MYSQL
>
> MariaDB-server-10.1.7-1.el6.x86_64
> MariaDB-common-10.1.7-1.el6.x86_64
> MariaDB-client-10.1.7-1.el6.x86_64
>
> If this is not the right version MARIADB then what version should I have
> to install.
>
> Thanks,
> Keerthi
>


  

Re: Cloudstack 4.5.2 startup ERROR

2015-09-11 Thread Keerthiraja SJ
ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: UPDATE
`cloud`.`configuration` SET value = CONCAT("*.",(SELECT `temptable`.`value`
FROM (SELECT * FROM `cloud`.`configuration` WHERE
`name`="consoleproxy.url.domain") AS `temptable` WHERE
`temptable`.`name`="consoleproxy.url.domain")) WHERE
`name`="consoleproxy.url.domain"
ERROR [c.c.u.d.ScriptRunner] (main:null)
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
link failure

The last packet successfully received from the server was 63 milliseconds
ago.  The last packet sent successfully to the server was 63 milliseconds
ago.
ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute upgrade
script: /usr/share/cloudstack-management/setup/db/schema-421to430.sql
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
link failure


ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to upgrade the
database

On Fri, Sep 11, 2015 at 2:46 PM, Keerthiraja SJ  wrote:

> Hi All,
>
> After successfully installation I could while starting the
> cloudstack-management ther seems to some error while connecting to my
> database.
>
> I am right now into production setup.
>
> ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to upgrade the
> database
> com.cloud.utils.exception.CloudRuntimeException: Unable to execute upgrade
> script: /usr/share/cloudstack-management/setup/db/schema-40to410.sql
>
> ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: alter table
> vm_template add size bigint unsigned
> ERROR [c.c.u.d.ScriptRunner] (main:null)
> com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column
> name 'size'
> ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute upgrade
> script: /usr/share/cloudstack-management/setup/db/schema-40to410.sql
>
>
> The Version of the MYSQL
>
> MariaDB-server-10.1.7-1.el6.x86_64
> MariaDB-common-10.1.7-1.el6.x86_64
> MariaDB-client-10.1.7-1.el6.x86_64
>
> If this is not the right version MARIADB then what version should I have
> to install.
>
> Thanks,
> Keerthi
>


Cloudstack 4.5.2 startup ERROR

2015-09-11 Thread Keerthiraja SJ
Hi All,

After successfully installation I could while starting the
cloudstack-management ther seems to some error while connecting to my
database.

I am right now into production setup.

ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to upgrade the
database
com.cloud.utils.exception.CloudRuntimeException: Unable to execute upgrade
script: /usr/share/cloudstack-management/setup/db/schema-40to410.sql

ERROR [c.c.u.d.ScriptRunner] (main:null) Error executing: alter table
vm_template add size bigint unsigned
ERROR [c.c.u.d.ScriptRunner] (main:null)
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column
name 'size'
ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) Unable to execute upgrade
script: /usr/share/cloudstack-management/setup/db/schema-40to410.sql


The Version of the MYSQL

MariaDB-server-10.1.7-1.el6.x86_64
MariaDB-common-10.1.7-1.el6.x86_64
MariaDB-client-10.1.7-1.el6.x86_64

If this is not the right version MARIADB then what version should I have to
install.

Thanks,
Keerthi


Re: Unable to add Ceph KVM node in cloudstack

2015-09-11 Thread Vadim Kimlaychuk

Andrija,

  Are you talking about CS Management server OS?  I thought it does 
not really matter if it includes libvirt or not. All calls to storage 
should go through hypervisor and any KVM host goes with libvirt. The 
version of libvirt for old OS may not be aligned with latest Ceph 
release that is true. Cloud architect must check compatibility version 
matrix for all products Ceph/KVM/CS anyway.


Vadim.


On 2015-09-11 11:24, Andrija Panic wrote:

RBD for KVM comes out of the box for Ubuntu 14.x (perhaps also 12.x) - 
not

with CentOS6, and not sure really about CentOS7 (probably not also...)

On 11 September 2015 at 09:53, Vadim Kimlaychuk  
wrote:


For KVM hosts RBD comes "out of the box" with libvirt. For XenServer 
Ceph

(RBD) storage type is not yet implemented. I would say it is very
hypervisor-specific and does not depend much from Cloudstack.

Regards,

Vadim.

On 2015-09-11 08:55, Shetty, Pradeep wrote:

I have one question:
Is ceph rbd protocol supported by default on libvirt version
0.10.2-54.el6.x86_64 OR do we need to compile libvirt to support rbd 
within

cloudstack.

Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 09 September 2015 12:07
To: users@cloudstack.apache.org
Cc: Shetty, Pradeep
Subject: RE: Unable to add Ceph KVM node in cloudstack

Pradeep,

I have installed CS 4.2 with Ceph storage successfully around year ago.
There were no problem with configuration except the fact that you can't
configure RBD storage as primary storage during Zone set-up.
It must be NFS.
After Zone is set-up and running you may add another primary storage 
and

there you have list of choices where RBD type is present.
After RBD is added you may assign this as default storage for 
particular

cluster assuming that each cluster has its own primary storage.

PS. I have also used Ceph object gateway to connect secondary storage. 
It

works as expected. It would be nice to know which way are you going to
integrate Ceph into CS?

Vadim.

On 2015-09-09 08:09, Shetty, Pradeep wrote:

Please share steps for adding ceph RBD as primary storage using KVM 
hypervisor in cloudstack.


We are well aware of the best practices/recommendations for cloudstack.

Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 08 September 2015 12:14
To: users@cloudstack.apache.org
Subject: RE: Unable to add Ceph KVM node in cloudstack

Pradeep,

From documentation :
Warning -- It is NOT recommended to run services on this host not
controlled by CloudStack.

Good practice -- KVM host must be virgin-clean.

Vadim.

On 2015-09-08 09:14, Shetty, Pradeep wrote:

Hello Vadim,

We have followed the same guide and using OVS version 2.3.2 .

Ceph storage cluster is running on same KVM hypervisor and it fails
when adding to cloudstack.

Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 08 September 2015 11:34
To: users@cloudstack.apache.org
Cc: Shetty, Pradeep
Subject: Re: Unable to add Ceph KVM node in cloudstack

Hello Shetty,

It seems you agent or libvirt configuration is wrong. Please, specify
also do you use OVS or Linux bridge?
Did you follow this guide?
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv 
[1]

[1 [1]]
[1 [1]]
m.html
[1 [2]]

Regards,

Vadim

On 2015-09-08 08:18, Shetty, Pradeep wrote:

Hello Folks,

We are working on ceph(hammer, 0.94.3) implementation on kvm
hypervisor(centos 6.5) which will be integrated on cloudstack(4.4.2),

--- Single KVM node( OS- CentOS 6.5, libvirt-0.10.2-54.el6.x86_64,
openvswitch 2.3.2) + ceph hammer, cluster health is Ok.

We are unable to add the KVM host(new cluster) in cloudstack in an
existing zone, below is the error log.

> agent log-- libvirt: XML-RPC error : Cannot write data: Broken
pipe
03/09/2015 13:13:15 4882 jsvc.exec error: Service exit with a return
value of 143

Please let us know the exact steps to add Ceph KVM host to cloudstack.

Thanks,
Pradeep

Links:
--
[1 [1]]

http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html 
[2]

[2]
[2 [2]]

Links:
--
[1 [1]]
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv 
[1]

[1 [1]]
[2]

http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html 
[2]

[2]


 Links:
 --
 [1] 
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv 
[1]

 [2]
 
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html 
[2]




Links:
--
[1] 
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv
[2] 
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html


Re: Unable to add Ceph KVM node in cloudstack

2015-09-11 Thread Andrija Panic
RBD for KVM comes out of the box for Ubuntu 14.x (perhaps also 12.x) - not
with CentOS6, and not sure really about CentOS7 (probably not also...)

On 11 September 2015 at 09:53, Vadim Kimlaychuk  wrote:

> For KVM hosts RBD comes "out of the box" with libvirt. For XenServer Ceph
> (RBD) storage type is not yet implemented. I would say it is very
> hypervisor-specific and does not depend much from Cloudstack.
>
> Regards,
>
> Vadim.
>
>
> On 2015-09-11 08:55, Shetty, Pradeep wrote:
>
> I have one question:
>>
>> Is ceph rbd protocol supported by default on libvirt version
>> 0.10.2-54.el6.x86_64 OR do we need to compile libvirt to support rbd within
>> cloudstack.
>>
>> Regards,
>> Pradeep
>>
>> -Original Message-
>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>> Sent: 09 September 2015 12:07
>> To: users@cloudstack.apache.org
>> Cc: Shetty, Pradeep
>> Subject: RE: Unable to add Ceph KVM node in cloudstack
>>
>> Pradeep,
>>
>> I have installed CS 4.2 with Ceph storage successfully around year ago.
>> There were no problem with configuration except the fact that you can't
>> configure RBD storage as primary storage during Zone set-up.
>> It must be NFS.
>> After Zone is set-up and running you may add another primary storage and
>> there you have list of choices where RBD type is present.
>> After RBD is added you may assign this as default storage for particular
>> cluster assuming that each cluster has its own primary storage.
>>
>> PS. I have also used Ceph object gateway to connect secondary storage. It
>> works as expected. It would be nice to know which way are you going to
>> integrate Ceph into CS?
>>
>> Vadim.
>>
>> On 2015-09-09 08:09, Shetty, Pradeep wrote:
>>
>> Please share steps for adding ceph RBD as primary storage using KVM
>>> hypervisor in cloudstack.
>>>
>>> We are well aware of the best practices/recommendations for cloudstack.
>>>
>>> Regards,
>>> Pradeep
>>>
>>> -Original Message-
>>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>>> Sent: 08 September 2015 12:14
>>> To: users@cloudstack.apache.org
>>> Subject: RE: Unable to add Ceph KVM node in cloudstack
>>>
>>> Pradeep,
>>>
>>> From documentation :
>>> Warning -- It is NOT recommended to run services on this host not
>>> controlled by CloudStack.
>>>
>>> Good practice -- KVM host must be virgin-clean.
>>>
>>> Vadim.
>>>
>>> On 2015-09-08 09:14, Shetty, Pradeep wrote:
>>>
>>> Hello Vadim,
>>>
>>> We have followed the same guide and using OVS version 2.3.2 .
>>>
>>> Ceph storage cluster is running on same KVM hypervisor and it fails
>>> when adding to cloudstack.
>>>
>>> Regards,
>>> Pradeep
>>>
>>> -Original Message-
>>> From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
>>> Sent: 08 September 2015 11:34
>>> To: users@cloudstack.apache.org
>>> Cc: Shetty, Pradeep
>>> Subject: Re: Unable to add Ceph KVM node in cloudstack
>>>
>>> Hello Shetty,
>>>
>>> It seems you agent or libvirt configuration is wrong. Please, specify
>>> also do you use OVS or Linux bridge?
>>> Did you follow this guide?
>>> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv
>>> [1]
>>> [1 [1]]
>>> m.html
>>> [1 [2]]
>>>
>>> Regards,
>>>
>>> Vadim
>>>
>>> On 2015-09-08 08:18, Shetty, Pradeep wrote:
>>>
>>> Hello Folks,
>>>
>>> We are working on ceph(hammer, 0.94.3) implementation on kvm
>>> hypervisor(centos 6.5) which will be integrated on cloudstack(4.4.2),
>>>
>>> --- Single KVM node( OS- CentOS 6.5, libvirt-0.10.2-54.el6.x86_64,
>>> openvswitch 2.3.2) + ceph hammer, cluster health is Ok.
>>>
>>> We are unable to add the KVM host(new cluster) in cloudstack in an
>>> existing zone, below is the error log.
>>>
>>> > agent log-- libvirt: XML-RPC error : Cannot write data: Broken
>>> pipe
>>> 03/09/2015 13:13:15 4882 jsvc.exec error: Service exit with a return
>>> value of 143
>>>
>>> Please let us know the exact steps to add Ceph KVM host to cloudstack.
>>>
>>> Thanks,
>>> Pradeep
>>>
>>
>> Links:
>> --
>> [1]
>>
>>
>> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html
>> [2]
>> [2 [2]]
>>
>> Links:
>> --
>> [1]
>> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv
>> [1]
>> [2]
>>
>> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html
>> [2]
>>
>
>
>
> Links:
> --
> [1] http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv
> [2]
> http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html
>



-- 

Andrija Panić


RE: Unable to add Ceph KVM node in cloudstack

2015-09-11 Thread Vadim Kimlaychuk
For KVM hosts RBD comes "out of the box" with libvirt. For XenServer 
Ceph (RBD) storage type is not yet implemented. I would say it is very 
hypervisor-specific and does not depend much from Cloudstack.


Regards,

Vadim.

On 2015-09-11 08:55, Shetty, Pradeep wrote:


I have one question:

Is ceph rbd protocol supported by default on libvirt version 
0.10.2-54.el6.x86_64 OR do we need to compile libvirt to support rbd 
within cloudstack.


Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 09 September 2015 12:07
To: users@cloudstack.apache.org
Cc: Shetty, Pradeep
Subject: RE: Unable to add Ceph KVM node in cloudstack

Pradeep,

I have installed CS 4.2 with Ceph storage successfully around year ago. 
There were no problem with configuration except the fact that you can't 
configure RBD storage as primary storage during Zone set-up.

It must be NFS.
After Zone is set-up and running you may add another primary storage 
and there you have list of choices where RBD type is present.
After RBD is added you may assign this as default storage for 
particular cluster assuming that each cluster has its own primary 
storage.


PS. I have also used Ceph object gateway to connect secondary storage. 
It works as expected. It would be nice to know which way are you going 
to integrate Ceph into CS?


Vadim.

On 2015-09-09 08:09, Shetty, Pradeep wrote:


Please share steps for adding ceph RBD as primary storage using KVM
hypervisor in cloudstack.

We are well aware of the best practices/recommendations for 
cloudstack.


Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 08 September 2015 12:14
To: users@cloudstack.apache.org
Subject: RE: Unable to add Ceph KVM node in cloudstack

Pradeep,

From documentation :
Warning -- It is NOT recommended to run services on this host not
controlled by CloudStack.

Good practice -- KVM host must be virgin-clean.

Vadim.

On 2015-09-08 09:14, Shetty, Pradeep wrote:

Hello Vadim,

We have followed the same guide and using OVS version 2.3.2 .

Ceph storage cluster is running on same KVM hypervisor and it fails
when adding to cloudstack.

Regards,
Pradeep

-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: 08 September 2015 11:34
To: users@cloudstack.apache.org
Cc: Shetty, Pradeep
Subject: Re: Unable to add Ceph KVM node in cloudstack

Hello Shetty,

It seems you agent or libvirt configuration is wrong. Please, specify
also do you use OVS or Linux bridge?
Did you follow this guide?
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv 
[1]

[1 [1]]
m.html
[1 [2]]

Regards,

Vadim

On 2015-09-08 08:18, Shetty, Pradeep wrote:

Hello Folks,

We are working on ceph(hammer, 0.94.3) implementation on kvm
hypervisor(centos 6.5) which will be integrated on cloudstack(4.4.2),

--- Single KVM node( OS- CentOS 6.5, libvirt-0.10.2-54.el6.x86_64,
openvswitch 2.3.2) + ceph hammer, cluster health is Ok.

We are unable to add the KVM host(new cluster) in cloudstack in an
existing zone, below is the error log.

> agent log-- libvirt: XML-RPC error : Cannot write data: Broken
pipe
03/09/2015 13:13:15 4882 jsvc.exec error: Service exit with a return
value of 143

Please let us know the exact steps to add Ceph KVM host to cloudstack.

Thanks,
Pradeep


Links:
--
[1]

http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html 
[2]

[2 [2]]

Links:
--
[1]
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv 
[1]

[2]
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html 
[2]




Links:
--
[1] 
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kv
[2] 
http://cloudstack-installation.readthedocs.org/en/latest/hypervisor/kvm.html