Re: Create rbd primary storage fail in CS 4.0.1

Wido den Hollander Wed, 17 Apr 2013 03:26:09 -0700

Hi,

On 04/17/2013 11:37 AM, Guangjian Liu wrote:

Thanks for your mail, you suggest compile libvirt with RBD enable.
I already build libvirt-0.10.2.tar.gz as document
http://ceph.com/docs/master/rbd/libvirt/ in my SERVER C(Ubuntu 12.04),
  Shall I build libvirt-0.10.2.tar.gz with RBD enable?  use ./configure
--enable-rbd instead autogen.sh?

Well, you don't have to add --enable-rbd to configure nor autogen.sh,but you have to make sure the development libraries for librbd areinstalled.


On CentOS do this:

yum install librbd-devel

And retry autogen.sh for libvirt, it should tell you RBD is enabled.

Wido

cd libvirt
./autogen.sh
make
sudo make install



On Wed, Apr 17, 2013 at 4:37 PM, Wido den Hollander <w...@widodh.nl> wrote:

Hi,


On 04/17/2013 01:44 AM, Guangjian Liu wrote:

Create rbd primary storage fail in CS 4.0.1
Anybody can help about it!

Environment:
1. Server A: CS 4.0.1 OS: RHEL 6.2 x86-64
2. Server B: Ceph 0.56.4  OS: RHEL 6.2 x86-64
3. Server C: KVM/Qemu OS: Ubuntu 12.04
      compile libvirt and Qemu as document
root@ubuntu:/usr/local/lib# virsh version
Compiled against library: libvirt 0.10.2
Using library: libvirt 0.10.2
Using API: QEMU 0.10.2
Running hypervisor: QEMU 1.0.0

Are you sure both libvirt and Qemu are compiled with RBD enabled?

On your CentOS system you should make sure librbd-dev is installed during
compilation of libvirt and Qemu.

The most important part is the RBD storage pool support in libvirt, that
should be enabled.

In the e-mail you send me directly I saw this:

root@ubuntu:~/scripts# virsh pool-define rbd-pool.xml error: Failed to
define pool from rbd-pool.xml error: internal error missing backend for
pool type 8

That suggest RBD storage pool support is not enabled in libvirt.

Wido


  Problem:

create primary storage fail with rbd device.

Fail log:
2013-04-16 16:27:14,224 DEBUG [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) createPool Params @ scheme - rbd storageHost -
10.0.0.41 hostPath - /cloudstack port - -1
2013-04-16 16:27:14,270 DEBUG [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) In createPool Setting poolId - 218 uuid -
5924a2df-d658-3119-8aba-**f90307683206 zoneId - 4 podId - 4 poolName -
ceph
2013-04-16 16:27:14,318 DEBUG [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) creating pool ceph on  host 18
2013-04-16 16:27:14,320 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162275: Sending  { Cmd , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 100011,
[{"CreateStoragePoolCommand":{**"add":true,"pool":{"id":218,"**
uuid":"5924a2df-d658-3119-**8aba-f90307683206","host":"10.**
0.0.41","path":"cloudstack","**userInfo":":","port":6789,"**
type":"RBD"},"localPath":"/**mnt//3cf4f0e8-781d-39d8-b81c-**
9896da212335","wait":0}}]
}
2013-04-16 16:27:14,323 DEBUG [agent.transport.Request]
(AgentManager-Handler-2:null) Seq 18-1625162275: Processing:  { Ans: ,
MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10,
[{"Answer":{"result":true,"**details":"success","wait":0}}] }
2013-04-16 16:27:14,323 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162275: Received:  { Ans: , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 10, { Answer } }
2013-04-16 16:27:14,323 DEBUG [agent.manager.**AgentManagerImpl]
(catalina-exec-9:null) Details from executing class
com.cloud.agent.api.**CreateStoragePoolCommand: success
2013-04-16 16:27:14,323 DEBUG [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) In createPool Adding the pool to each of the hosts
2013-04-16 16:27:14,323 DEBUG [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) Adding pool ceph to  host 18
2013-04-16 16:27:14,326 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162276: Sending  { Cmd , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 100011,
[{"ModifyStoragePoolCommand":{**"add":true,"pool":{"id":218,"**
uuid":"5924a2df-d658-3119-**8aba-f90307683206","host":"10.**
0.0.41","path":"cloudstack","**userInfo":":","port":6789,"**
type":"RBD"},"localPath":"/**mnt//3cf4f0e8-781d-39d8-b81c-**
9896da212335","wait":0}}]
}
2013-04-16 16:27:14,411 DEBUG [agent.transport.Request]
(AgentManager-Handler-6:null) Seq 18-1625162276: Processing:  { Ans: ,
MgmtId: 37528005876872, via: 18, Ver: v1, Flags: 10,
[{"Answer":{"result":false,"**details":"java.lang.**
NullPointerException\n\tat
com.cloud.hypervisor.kvm.**storage.LibvirtStorageAdaptor.**
createStoragePool(**LibvirtStorageAdaptor.java:**462)\n\tat
com.cloud.hypervisor.kvm.**storage.KVMStoragePoolManager.**
createStoragePool(**KVMStoragePoolManager.java:57)**\n\tat
com.cloud.hypervisor.kvm.**resource.**LibvirtComputingResource.**execute(
**LibvirtComputingResource.java:**2087)\n\tat
com.cloud.hypervisor.kvm.**resource.**LibvirtComputingResource.**
executeRequest(**LibvirtComputingResource.java:**1053)\n\tat
com.cloud.agent.Agent.**processRequest(Agent.java:518)**\n\tat
com.cloud.agent.Agent$**AgentRequestHandler.doTask(**
Agent.java:831)\n\tat
com.cloud.utils.nio.Task.run(**Task.java:83)\n\tat
java.util.concurrent.**ThreadPoolExecutor.runWorker(**
ThreadPoolExecutor.java:1146)\**n\tat
java.util.concurrent.**ThreadPoolExecutor$Worker.run(**
ThreadPoolExecutor.java:615)\**n\tat
java.lang.Thread.run(Thread.**java:679)\n","wait":0}}] }
2013-04-16 16:27:14,412 DEBUG [agent.transport.Request]
(catalina-exec-9:null) Seq 18-1625162276: Received:  { Ans: , MgmtId:
37528005876872, via: 18, Ver: v1, Flags: 10, { Answer } }
2013-04-16 16:27:14,412 DEBUG [agent.manager.**AgentManagerImpl]
(catalina-exec-9:null) Details from executing class
com.cloud.agent.api.**ModifyStoragePoolCommand:
java.lang.NullPointerException
          at
com.cloud.hypervisor.kvm.**storage.LibvirtStorageAdaptor.**
createStoragePool(**LibvirtStorageAdaptor.java:**462)
          at
com.cloud.hypervisor.kvm.**storage.KVMStoragePoolManager.**
createStoragePool(**KVMStoragePoolManager.java:57)
          at
com.cloud.hypervisor.kvm.**resource.**LibvirtComputingResource.**execute(
**LibvirtComputingResource.java:**2087)
          at
com.cloud.hypervisor.kvm.**resource.**LibvirtComputingResource.**
executeRequest(**LibvirtComputingResource.java:**1053)
          at com.cloud.agent.Agent.**processRequest(Agent.java:518)
          at com.cloud.agent.Agent$**AgentRequestHandler.doTask(**
Agent.java:831)
          at com.cloud.utils.nio.Task.run(**Task.java:83)
          at
java.util.concurrent.**ThreadPoolExecutor.runWorker(**
ThreadPoolExecutor.java:1146)
          at
java.util.concurrent.**ThreadPoolExecutor$Worker.run(**
ThreadPoolExecutor.java:615)
          at java.lang.Thread.run(Thread.**java:679)

2013-04-16 16:27:14,451 WARN  [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) Unable to establish a connection between
Host[-18-Routing] and Pool[218|RBD]
com.cloud.exception.**StorageUnavailableException: Resource
[StoragePool:218]
is unreachable: Unable establish connection from storage head to storage
pool 218 due to java.lang.NullPointerException
          at
com.cloud.hypervisor.kvm.**storage.LibvirtStorageAdaptor.**
createStoragePool(**LibvirtStorageAdaptor.java:**462)
          at
com.cloud.hypervisor.kvm.**storage.KVMStoragePoolManager.**
createStoragePool(**KVMStoragePoolManager.java:57)
          at
com.cloud.hypervisor.kvm.**resource.**LibvirtComputingResource.**execute(
**LibvirtComputingResource.java:**2087)
          at
com.cloud.hypervisor.kvm.**resource.**LibvirtComputingResource.**
executeRequest(**LibvirtComputingResource.java:**1053)
          at com.cloud.agent.Agent.**processRequest(Agent.java:518)
          at com.cloud.agent.Agent$**AgentRequestHandler.doTask(**
Agent.java:831)
          at com.cloud.utils.nio.Task.run(**Task.java:83)
          at
java.util.concurrent.**ThreadPoolExecutor.runWorker(**
ThreadPoolExecutor.java:1146)
          at
java.util.concurrent.**ThreadPoolExecutor$Worker.run(**
ThreadPoolExecutor.java:615)
          at java.lang.Thread.run(Thread.**java:679)

          at
com.cloud.storage.**StorageManagerImpl.**connectHostToSharedPool(**
StorageManagerImpl.java:1685)
          at
com.cloud.storage.**StorageManagerImpl.createPool(**
StorageManagerImpl.java:1450)
          at
com.cloud.storage.**StorageManagerImpl.createPool(**
StorageManagerImpl.java:215)
          at
com.cloud.api.commands.**CreateStoragePoolCmd.execute(**
CreateStoragePoolCmd.java:120)
          at com.cloud.api.ApiDispatcher.**dispatch(ApiDispatcher.java:**
138)
          at com.cloud.api.ApiServer.**queueCommand(ApiServer.java:**543)
          at com.cloud.api.ApiServer.**handleRequest(ApiServer.java:**422)
          at com.cloud.api.ApiServlet.**processRequest(ApiServlet.**
java:304)
          at com.cloud.api.ApiServlet.**doGet(ApiServlet.java:63)
          at javax.servlet.http.**HttpServlet.service(**
HttpServlet.java:617)
          at javax.servlet.http.**HttpServlet.service(**
HttpServlet.java:717)
          at
org.apache.catalina.core.**ApplicationFilterChain.**internalDoFilter(**
ApplicationFilterChain.java:**290)
          at
org.apache.catalina.core.**ApplicationFilterChain.**doFilter(**
ApplicationFilterChain.java:**206)
          at
org.apache.catalina.core.**StandardWrapperValve.invoke(**
StandardWrapperValve.java:233)
          at
org.apache.catalina.core.**StandardContextValve.invoke(**
StandardContextValve.java:191)
          at
org.apache.catalina.core.**StandardHostValve.invoke(**
StandardHostValve.java:127)
          at
org.apache.catalina.valves.**ErrorReportValve.invoke(**
ErrorReportValve.java:102)
          at
org.apache.catalina.valves.**AccessLogValve.invoke(**
AccessLogValve.java:555)
          at
org.apache.catalina.core.**StandardEngineValve.invoke(**
StandardEngineValve.java:109)
          at
org.apache.catalina.connector.**CoyoteAdapter.service(**
CoyoteAdapter.java:298)
          at
org.apache.coyote.http11.**Http11NioProcessor.process(**
Http11NioProcessor.java:889)
          at
org.apache.coyote.http11.**Http11NioProtocol$**Http11ConnectionHandler.**
process(Http11NioProtocol.**java:721)
          at
org.apache.tomcat.util.net.**NioEndpoint$SocketProcessor.**
run(NioEndpoint.java:2260)
          at
java.util.concurrent.**ThreadPoolExecutor.runWorker(**
ThreadPoolExecutor.java:1110)
          at
java.util.concurrent.**ThreadPoolExecutor$Worker.run(**
ThreadPoolExecutor.java:603)
          at java.lang.Thread.run(Thread.**java:679)
2013-04-16 16:27:14,452 WARN  [cloud.storage.**StorageManagerImpl]
(catalina-exec-9:null) No host can access storage pool Pool[218|RBD] on
cluster 5
2013-04-16 16:27:14,504 WARN  [cloud.api.ApiDispatcher]
(catalina-exec-9:null) class com.cloud.api.**ServerApiException : Failed
to
add storage pool
2013-04-16 16:27:15,293 DEBUG [agent.manager.**AgentManagerImpl]
(AgentManager-Handler-12:null) Ping from 18
^C
[root@RDR02S02 management]#

Re: Create rbd primary storage fail in CS 4.0.1

Reply via email to