Hi,
I use the cloudmonkey cli to bring up my infrastructure, like adding zones,
pods clusters and then adding hosts.
I noticed that when we add hosts from the gui, it appears as a POST in the
management-server.log but when we add it through the cloudmonkey cli it
goes as a GET. Also the username password have to be mentioned in the GET
(in the POST they do not show up in the log, I guess for obvious reasons).
Be that as it may, the host seems to be up after I add it through
cloudmonkey, but the system vms fail to come up and cloudstack repeatedly
tries to create them. I think cloudstack-management is not able to create a
mount point on the hypervisor. Here is the traceback in the log :-
/var/log/cloudstack/management/management-server.log
2014-02-24 15:36:15,714 WARN [xen.resource.XenServerStorageProcessor]
(DirectAgent-2:null) destoryVDIbyNameLabel failed due to there are 0 VDIs
with name cloud-5996629f-3dda-4876-9403-aec753df15b5
2014-02-24 15:36:15,714 WARN [xen.resource.XenServerStorageProcessor]
(DirectAgent-2:null) can't mount
135.227.147.110:/export/secondary/template/tmpl/1/1
to /var/run/cloud_mount/4fd17c34-7bd1-42cf-943e-9c8589b053f8
2014-02-24 15:36:15,714 WARN [xen.resource.XenServerStorageProcessor]
(DirectAgent-2:null) Catch Exception
com.cloud.utils.exception.CloudRuntimeException for template + due to
com.cloud.utils.exception.CloudRuntimeException: can't mount
135.227.147.110:/export/secondary/template/tmpl/1/1 to
/var/run/cloud_mount/4fd17c34-7bd1-42cf-943e-9c8589b053f8
com.cloud.utils.exception.CloudRuntimeException: can't mount
135.227.147.110:/export/secondary/template/tmpl/1/1 to
/var/run/cloud_mount/4fd17c34-7bd1-42cf-943e-9c8589b053f8
at
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:792)
at
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:863)
at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:70)
at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:49)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:623)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
at
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)
2014-02-24 15:36:15,715 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-2:null) Seq 1-1400700954: Response Received:
2014-02-24 15:36:15,715 DEBUG [agent.transport.Request]
(DirectAgent-2:null) Seq 1-1400700954: Processing: { Ans: , MgmtId:
159303462529040, via: 1, Ver: v1, Flags: 110,
[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch
Exception com.cloud.utils.exception.CloudRuntimeException for template +
due to com.cloud.utils.exception.CloudRuntimeException: can't mount
135.227.147.110:/export/secondary/template/tmpl/1/1 to
/var/run/cloud_mount/4fd17c34-7bd1-42cf-943e-9c8589b053f8","wait":0}}] }
2014-02-24 15:36:15,716 DEBUG [agent.manager.AgentAttache]
(DirectAgent-2:null) Seq 1-1400700954: No more commands found
=======================
On the hypervisor
[root@ovs-4-test cloud_mount]# ls -ltr
total 352
drwxr-xr-x 2 root root 4096 Feb 21 15:42
fa253032-1dc1-44bf-b35b-39c9b66d038d
drwxr-xr-x 2 root root 4096 Feb 21 15:42
21b8a8ae-4388-4715-b127-481ffe3b8bb2
drwxr-xr-x 2 root root 4096 Feb 21 15:43
3ea4ef0c-a6c7-41fa-8498-655f97c2726f
drwxr-xr-x 2 root root 4096 Feb 21 15:43
7b7bdc42-9cd4-4427-bafb-dfccbd015af3
drwxr-xr-x 2 root root 4096 Feb 21 15:44
efe978f0-c62d-4e7b-ad73-f10dd4dbea42
drwxr-xr-x 2 root root 4096 Feb 21 15:44
9f346dca-2300-40f3-b0c9-934fc2a1483f
drwxr-xr-x 2 root root 4096 Feb 21 15:44
9bf46046-ae34-4cc0-9e40-d261c4447d18
drwxr-xr-x 2 root root 4096 Feb 21 15:45
a25b6265-3f6b-4a1a-9bf6-a9eaf4f80b23
drwxr-xr-x 2 root root 4096 Feb 21 15:45
8a26c7f1-4979-45ca-9635-b663225b77f5
drwxr-xr-x 2 root root 4096 Feb 21 15:46
bfeb339f-47ed-4dfa-8dd7-0aab2597c470
drwxr-xr-x 2 root root 4096 Feb 21 15:46
0f73c1e1-a959-42b9-8314-c81baf746363
drwxr-xr-x 2 root root 4096 Feb 21 15:47
37f60c64-3fff-4e82-a221-30be6ed027c4
drwxr-xr-x 2 root root 4096 Feb 21 15:47
a8a1f38e-b9ff-4563-95d6-a19d136c9785
drwxr-xr-x 2 root root 4096 Feb 21 15:48
4838d6e0-f2d4-4cae-b9fe-63182ee474bf
drwxr-xr-x 2 root root 4096 Feb 21 15:48
75ce6ce9-3382-4a8a-b6c9-1a0633619fc7
drwxr-xr-x 2 root root 4096 Feb 21 15:49
de2bed1e-727c-4576-835f-d34491c956fe
drwxr-xr-x 2 root root 4096 Feb 21 15:49
90a46cee-72d8-4e1e-8994-eba20915c636
drwxr-xr-x 2 root root 4096 Feb 21 15:50
e8bcabdb-f79b-44c4-a30d-e48d45065340
drwxr-xr-x 2 root root 4096 Feb 21 15:50
e78c476a-28e7-4600-b7cc-45663889f11a
drwxr-xr-x 2 root root 4096 Feb 21 15:51
0a1d6f75-a5d1-4ede-bc2e-f4da1936175f
drwxr-xr-x 2 root root 4096 Feb 21 15:51
48eb9c00-722c-4071-b46b-98ea3f4e43f1
drwxr-xr-x 2 root root 4096 Feb 21 15:52
c4fc9f71-aeba-40f2-b418-0c2ba6f9f9a1
drwxr-xr-x 2 root root 4096 Feb 21 15:52
710762be-735b-4f18-bb26-14e12cc116ef
drwxr-xr-x 2 root root 4096 Feb 21 15:53
189b98e7-b6ce-48d0-a642-c82585a1841a
drwxr-xr-x 2 root root 4096 Feb 21 15:53
0f953b3f-e683-41fc-a8ca-75bb56f20875
drwxr-xr-x 2 root root 4096 Feb 21 15:54
aaf21bc2-d30e-418c-8de6-bea11e7bc712
drwxr-xr-x 2 root root 4096 Feb 21 15:54
31392f4d-06fe-4ef7-8eaf-834edaaefab7
drwxr-xr-x 2 root root 4096 Feb 21 15:55
e093d2ed-2743-44b1-84a3-0879089cbb47
drwxr-xr-x 2 root root 4096 Feb 21 15:55
d36e9561-19bd-409a-8f04-40143942a92f
drwxr-xr-x 2 root root 4096 Feb 21 15:56
298af78f-6e0a-4735-a8a1-a1cae342b4b4
drwxr-xr-x 2 root root 4096 Feb 21 15:56
71dc12a5-c7d7-43a9-8f8b-e5f9ff4e8b1f
drwxr-xr-x 2 root root 4096 Feb 21 15:57
acba7a15-2705-4cad-8b61-700dded06480
drwxr-xr-x 2 root root 4096 Feb 21 15:57
36fcfa88-31e6-4eec-be90-a667869d7e2a
drwxr-xr-x 2 root root 4096 Feb 21 15:57
e037c24d-a708-4de8-9ed3-6427ecd3e2dd
drwxr-xr-x 2 root root 4096 Feb 21 15:58
98ecee65-5498-4199-bb56-f05810739550
drwxr-xr-x 2 root root 4096 Feb 21 15:58
6b8cf417-baa4-4c40-b7ba-5b2759ffe74a
drwxr-xr-x 2 root root 4096 Feb 21 15:59
aa8c7431-fd6b-4fdb-b953-665edc855b15
drwxr-xr-x 2 root root 4096 Feb 21 15:59
d8e67b2e-34c1-470f-abcd-6a0ca5104b7f
drwxr-xr-x 2 root root 4096 Feb 21 16:00
04ba3fc4-879e-40f1-9380-2c577ef78377
drwxr-xr-x 2 root root 4096 Feb 21 16:00
fe2eac93-9a48-4e24-bc33-b2887cc561d9
drwxr-xr-x 2 root root 4096 Feb 21 16:01
2fb7e6c0-821f-46a3-825c-7e7dbc13434c
drwxr-xr-x 2 root root 4096 Feb 21 16:01
d4dba2a3-7b0b-41a5-941a-9c61533ce237
drwxr-xr-x 2 root root 4096 Feb 21 16:02
ba37a851-4b30-4606-93b3-a12a8bb0c88a
drwxr-xr-x 2 root root 4096 Feb 21 16:02
ec96373c-2509-43a1-86c7-e5328bf82869
drwxr-xr-x 2 root root 4096 Feb 21 16:03
ebe3e023-5765-48bc-a45d-e3099042abff
drwxr-xr-x 2 root root 4096 Feb 21 16:03
20dcbea8-2b46-40a1-8d94-e80e22affe39
drwxr-xr-x 2 root root 4096 Feb 21 16:04
6147801b-1180-4a89-81c1-1621eebe3a5c
drwxr-xr-x 2 root root 4096 Feb 21 16:04
be69b6d1-2e1f-44d9-a387-29a32f8e8bdb
drwxr-xr-x 2 root root 4096 Feb 21 16:05
ecebb1f7-0b09-4381-ab45-db46336f05df
drwxr-xr-x 2 root root 4096 Feb 21 16:05
70de58a0-2bbd-46d3-b1e3-b7a859f583ec
drwxr-xr-x 2 root root 4096 Feb 21 16:06
18ddeb94-a369-4077-99b4-8d0292e3f91c
drwxr-xr-x 2 root root 4096 Feb 21 16:06
0c08ea69-4ffb-4ea5-9dba-e2a8bbe68b9c
drwxr-xr-x 2 root root 4096 Feb 21 16:07
facfc0c0-ab23-45b3-b4db-059890d74217
drwxr-xr-x 2 root root 4096 Feb 21 16:07
ac4c16b8-8c28-4bb4-94ed-d44ae62e8121
drwxr-xr-x 2 root root 4096 Feb 21 16:08
432974df-d2b2-4e6d-bbfd-474af1e8ce28
drwxr-xr-x 2 root root 4096 Feb 21 16:08
3fbfdabf-43b5-4bb6-a8ae-d0ec213c563a
drwxr-xr-x 2 root root 4096 Feb 21 16:09
cfb18f56-964c-4bcb-afa6-044b7024d59f
drwxr-xr-x 2 root root 4096 Feb 21 16:09
4e28bd83-d7d2-4adf-bbeb-75bf6dbb9246
drwxr-xr-x 2 root root 4096 Feb 21 16:10
fe89a8b7-e7fb-4004-85bc-7e25d5ef91d8
drwxr-xr-x 2 root root 4096 Feb 21 16:10
3605b504-efc9-4662-97c1-f933efb1e5de
drwxr-xr-x 2 root root 4096 Feb 21 16:11
7a6678ce-3100-4486-8334-e3738e17fd58
drwxr-xr-x 2 root root 4096 Feb 21 16:11
d9becc8b-6722-4b13-86e8-c13497c4c655
drwxr-xr-x 2 root root 4096 Feb 21 16:12
6a972409-8e8e-4896-8ad7-8bc0bfed3234
drwxr-xr-x 2 root root 4096 Feb 21 16:12
5e1de47c-ce80-4794-818c-b05d987a3a96
drwxr-xr-x 2 root root 4096 Feb 21 16:13
de927ee9-73ae-4095-bfac-c090435c73b1
drwxr-xr-x 2 root root 4096 Feb 21 16:13
fb66aa6b-b8bd-46fe-b6e3-fcfd0f932edf
drwxr-xr-x 2 root root 4096 Feb 21 16:14
673a6471-f0e7-426b-9e0d-8718fa7132a8
drwxr-xr-x 2 root root 4096 Feb 21 16:14
4dc2dba5-c0f0-486f-a40b-8f35e7dffda1
drwxr-xr-x 2 root root 4096 Feb 21 16:15
eaec8fc1-1183-4dd1-8030-925192d04661
drwxr-xr-x 2 root root 4096 Feb 21 16:15
9cb11aea-3177-4275-9479-aef6c6d28482
drwxr-xr-x 2 root root 4096 Feb 21 16:16
beeaf135-f815-4198-8307-43f0394f3489
drwxr-xr-x 2 root root 4096 Feb 21 16:16
4f14d7d7-b5ed-42e3-920c-9ba962b978b9
drwxr-xr-x 2 root root 4096 Feb 21 16:17
d0ad9dcd-babb-4a4b-b695-2e25425c917e
drwxr-xr-x 2 root root 4096 Feb 24 13:31
e75de78a-9615-41e1-ae18-89ffa436b081
drwxr-xr-x 2 root root 4096 Feb 24 13:31
1ccb9c51-62a2-454a-9c5c-5f7607e64764
drwxr-xr-x 2 root root 4096 Feb 24 13:32
9dd92ce0-95f5-4445-aa98-dd9bff01e764
drwxr-xr-x 2 root root 4096 Feb 24 13:32
f5467831-6bcf-453f-8fac-50c70d9c784b
drwxr-xr-x 2 root root 4096 Feb 24 13:33
165a3dd0-0cfd-47d6-bc73-6edba3f6d43a
drwxr-xr-x 2 root root 4096 Feb 24 13:33
d18f280a-b8fb-43c6-9a8f-f29688c1045f
drwxr-xr-x 2 root root 4096 Feb 24 13:34
d714c711-aa9c-44a1-8113-0619fc69d787
drwxr-xr-x 2 root root 4096 Feb 24 13:34
6286b1b9-e070-4620-ada3-f6f4ebf4bcf2
drwxr-xr-x 2 root root 4096 Feb 24 13:35
fdd94acd-a89a-470a-bbb5-3beb291446cd
drwxr-xr-x 2 root root 4096 Feb 24 15:24
4d5ea4da-abb6-473e-b0aa-52e2d01eb112
drwxr-xr-x 2 root root 4096 Feb 24 15:24
dd8ae530-c3e2-44f9-8043-5e2813ed8619
drwxr-xr-x 2 root root 4096 Feb 24 15:25
74cbac47-2ddf-4151-b025-f2d1fa67eaaa
drwxr-xr-x 2 root root 4096 Feb 24 15:25
518f292c-ea62-4d5f-b9d4-2c1becf743d4
drwxr-xr-x 2 root root 4096 Feb 24 15:26
4fd17c34-7bd1-42cf-943e-9c8589b053f8
drwxr-xr-x 2 root root 4096 Feb 24 15:26
d916dbee-fb14-441a-b885-e2c236e011b0
[root@ovs-4-test cloud_mount]#
Thanks,
Siddharth
