RE: updatecloudtouseobjectstore options

[Somesh Naidu]

Hi Christian,

The output shared is expected and validates that I am looking at the right 
code. Note, "zoneId" is not a valid parameter and has no impact. The API call 
defaults to "NULL" for datacenter ID and "Region" for scope.

For what I understood from the code, the following API call should work:

update cloudtouseobjectstore
name=Secondary 
url=https://my.s3.storage 
details[0].key=accesskey details[0].value=X 
details[1].key=secretkey details[1].value=X 
details[2].key=bucket details[2].value=secondary 
details[3].key=endpoint details[3].value=my.s3.storage 
details[4].key=usehttps details[4].value=true 
provider=S3

You may validfate if the key,values provided in the details parameter are being 
processed correctly by looking up the entries for the image store in the table 
image_store_details (select * from image_store_details where 
store_id=;)

Regards,
Somesh


-Original Message-
From: christian.kir...@zv.fraunhofer.de 
[mailto:christian.kir...@zv.fraunhofer.de] 
Sent: Monday, August 17, 2015 8:24 AM
To: users@cloudstack.apache.org
Subject: Re: updatecloudtouseobjectstore options

Hi Somesh,

here is the log file message:

INFO  [o.a.c.s.d.l.S3ImageStoreLifeCycleImpl] (catalina-exec-13:ctx-ffeee088 
ctx-4f217213 ctx-3cc33cae) (logid:053d3
c2a) Trying to add a S3 store in data center null


And here the db output:

image_provider_name: S3
data_center_id: NULL
scope: REGION
role: Image

The data_center_id is also set to NULL in the database.

Kind regards
Christian

> On 14 Aug 2015, at 19:36, Somesh Naidu  wrote:
> 
> Christian, can you try to find the following log message and paste it here,
> "Trying to add a S3 store in data center"
> 
> In addition, can you tell me what values are being set in the DB for "scope", 
> "role" and "image_provider_name"?
> 
> Regards,
> Somesh
> 
> 
> -Original Message-
> From: Somesh Naidu [mailto:somesh.na...@citrix.com] 
> Sent: Friday, August 14, 2015 12:22 PM
> To: users@cloudstack.apache.org
> Subject: RE: updatecloudtouseobjectstore options
> 
> Hi Christian,
> 
>> details[4].key=usehttps details[4].value=true
> 
> I would have thought the above should have worked. Let me have a second look 
> at this and get back to you.
> 
> Regards,
> Somesh
> 
> 
> -Original Message-
> From: christian.kir...@zv.fraunhofer.de 
> [mailto:christian.kir...@zv.fraunhofer.de] 
> Sent: Friday, August 14, 2015 10:45 AM
> To: users@cloudstack.apache.org
> Subject: Re: updatecloudtouseobjectstore options
> 
> Hi Somesh,
> 
> thanks for diving through the code.
> 
> I gave it some new tries but unfortunately the protocol is still set to http.
> Here are the combinations I already used:
> 
> details[4].key=S3_HTTPS_FLAG details[4].value=usehttps
> details[4].key=S3_HTTPS_FLAG details[4].value=true
> details[4].key=usehttps details[4].value=true
> details[4].key=useHttps details[4].value=true
> details[4].key=useHttps details[4].value=usehttps
> 
> Did I miss the right one?
> 
> Kind Regards
> Christian
> 
>> On 11 Aug 2015, at 22:43, Somesh Naidu  wrote:
>> 
>> I did some digging and think you need to add another key,value - 
>> usehttps,useHttps in the details param to make it work.
>> 
>> My reference has been following code snippets:
>> ---
>> String useHttps = details.get(ApiConstants.S3_HTTPS_FLAG);
>>   if (useHttps != null && Boolean.parseBoolean(useHttps)) {
>>   protocol = "https";
>>   }
>> ---
>> public static final String S3_HTTPS_FLAG = "usehttps";
>> ---
>> 
>> Regards,
>> Somesh
>> 
>> 
>> -Original Message-
>> From: christian.kir...@zv.fraunhofer.de 
>> [mailto:christian.kir...@zv.fraunhofer.de] 
>> Sent: Tuesday, August 11, 2015 3:31 PM
>> To: users@cloudstack.apache.org
>> Subject: Re: updatecloudtouseobjectstore options
>> 
>> Hi Somesh,
>> 
>> thanks for your quick response. 
>> 
>> That was also my hope but the protocol in the url seems to be ignored. 
>> In the database is a attribute called protocol which was set to http in all 
>> my tries. 
>> It seems to be the default if you not explicitly set the protocol. 
>> 
>> I tried to set the protocol via a key value pair in the details part of the 
>> api call and via a separate option which I named protocol. 
>> There was never an error but it hasn't worked either. 
>> 
>> Here is the last call I tried:
>> update cloudtouseobjectstore name=Secondary 
>> zoneId=01b01ed7-ed98-4908-93a3-8729ef0db427 url=https://my.s3.storage 
>&g

RE: CS Manager down: all hypervisors reboot

[Somesh Naidu]

Management server down would not result in host being rebooted. Primary storage 
down will.

As you mentioned, you have hosted your primary storage (NFS) on the management 
server node. So yes, taking it down will cause all host connected to it to 
reboot. It doesn’t matter how many VMs use that particular storage.

I am sure if there is a better way of doing this but you could modify 
"kvmheartbeat.sh" to disable reboot on loosing primary storage connection.

Regards,
Somesh

-Original Message-
From: Frank Louwers [mailto:fr...@openminds.be] 
Sent: Wednesday, August 19, 2015 12:19 PM
To: users@cloudstack.apache.org
Subject: CS Manager down: all hypervisors reboot

Hi all,

We had an interesting outage this morning. We took the Cloudstack Manager node 
down for hardware upgrades and kernel updates, and it seems all “non-dedicated” 
hosts rebooted.

We run KVM on CS 4.4.latest.

Is this “normal behaviour”, why does it do that, and how do I disable that?

The Manager is also a primary storage provider (NFS export), but all VMs use 
local storage (except 1).


Regards,

Frank

RE: CS Manager down: all hypervisors reboot

[Somesh Naidu]

> this will happen even if no VMs on the host set to “HA”?
Yes. To verify if the hosts that were rebooted were indeed due to missing 
heartbeat from primary, look for " heartbeat" in /var/log/messages.

> What would then be the procedure to perform maintenance on the (first?) 
> primary NFS storage server
In order to perform maintenance on a primary storage, you should enable 
maintenance on it (can be done from GUI/API).

> That sill would not explain why the “dedicated” hosts didn’t reboot
Were these hosts connected to that NFS primary storage hosted on mgmt server?

> how would this work if primary storage were eg iSCSI?
I believe we perform the heartbeat check and host fencing for NFS storage only.

> Is there no way to disable that, except for modifying kvmheartbeat.sh?
AFAIK, there isn't.

Regards,
Somesh


-Original Message-
From: Frank Louwers [mailto:fr...@openminds.be] 
Sent: Wednesday, August 19, 2015 2:48 PM
To: users@cloudstack.apache.org
Subject: RE: CS Manager down: all hypervisors reboot

On 19 Aug 2015 at 20:44:47, Somesh Naidu (somesh.na...@citrix.com) wrote:
Management server down would not result in host being rebooted. Primary storage 
down will. 

As you mentioned, you have hosted your primary storage (NFS) on the management 
server node. So yes, taking it down will cause all host connected to it to 
reboot. It doesn’t matter how many VMs use that particular storage. 

I am sure if there is a better way of doing this but you could modify 
"kvmheartbeat.sh" to disable reboot on loosing primary storage connection. 
HI Somesh,

Thanks for the explanation!

Am I right that (after reading your mail and 
http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201508.mbox/%3ccalfpzo5cotx0qz+d_oxezjgytau+fa+mzxg_yqeuzswi_9g...@mail.gmail.com%3e
 by Marcus) that this will happen even if no VMs on the host set to “HA”?

What would then be the procedure to perform maintenance on the (first?) primary 
NFS storage server and how would this work if primary storage were eg iSCSI?

That sill would not explain why the “dedicated” hosts didn’t reboot, but I 
assume I should take a look at kvmheartbeat.sh then. Is there no way to disable 
that, except for modifying kvmheartbeat.sh?



Regards,



Frank



Regards, 
Somesh 

-Original Message- 
From: Frank Louwers [mailto:fr...@openminds.be] 
Sent: Wednesday, August 19, 2015 12:19 PM 
To: users@cloudstack.apache.org 
Subject: CS Manager down: all hypervisors reboot 

Hi all, 

We had an interesting outage this morning. We took the Cloudstack Manager node 
down for hardware upgrades and kernel updates, and it seems all “non-dedicated” 
hosts rebooted. 

We run KVM on CS 4.4.latest. 

Is this “normal behaviour”, why does it do that, and how do I disable that? 

The Manager is also a primary storage provider (NFS export), but all VMs use 
local storage (except 1). 


Regards, 

Frank 

RE: CS Manager down: all hypervisors reboot

[Somesh Naidu]

> So migrating my primary storage to iSCSI would (as a side effect) disable the 
> fencing/rebooting?

I can't be 100% sure about that but that's what I got from running through the 
code. I don't have a setup ATM where I could test this to confirm.

Regards,
Somesh


-Original Message-
From: Frank Louwers [mailto:fr...@openminds.be] 
Sent: Wednesday, August 19, 2015 3:55 PM
To: users@cloudstack.apache.org
Subject: RE: CS Manager down: all hypervisors reboot

So migrating my primary storage to iSCSI would (as a side effect) disable the 
fencing/rebooting? 


On 19 Aug 2015 at 21:46:35, Somesh Naidu (somesh.na...@citrix.com) wrote:

> how would this work if primary storage were eg iSCSI? 
I believe we perform the heartbeat check and host fencing for NFS storage only. 

> Is there no way to disable that, except for modifying kvmheartbeat.sh? 
AFAIK, there isn't. 

RE: The agent doesn't reconnect if there are stopped VMs

[Somesh Naidu]

> 2015-08-18 06:24:46,542 DEBUG [c.c.c.CapacityManagerImpl] 
> (AgentConnectTaskPool-213:ctx-76903ef6) Found 1 VM, not running on host 27
> 2015-08-18 06:24:46,544 ERROR [c.c.a.m.AgentManagerImpl] 
> (AgentConnectTaskPool-213:ctx-76903ef6) Monitor ComputeCapacityListener says 
> there is an error in the connect process for 27 due to null
> java.lang.NullPointerException

It will help if you send the complete exception stack for the above NPE.

Regards,
Somesh

-Original Message-
From: Simon Weller [mailto:swel...@ena.com] 
Sent: Thursday, August 20, 2015 11:21 AM
To: users@cloudstack.apache.org
Subject: Re: The agent doesn't reconnect if there are stopped VMs

Do you have any dynamic service offerings?


From: Vladimir Melnik 
Sent: Thursday, August 20, 2015 8:20 AM
To: users@cloudstack.apache.org
Subject: Re: The agent doesn't reconnect if there are stopped VMs

Oh, I'm sorry, I should have initially send the DEBUG-log!

Here is an example:

--- 8< ---
2015-07-29 00:53:42,988 INFO  [utils.nio.NioClient] (Agent-Selector:null) 
Connecting to ***.***.***.***:8250
2015-07-29 00:53:44,254 INFO  [utils.nio.NioClient] (Agent-Selector:null) SSL: 
Handshake done
2015-07-29 00:53:44,255 INFO  [utils.nio.NioClient] (Agent-Selector:null) 
Connected to ***.***.***.***:8250
2015-07-29 00:53:44,258 WARN  [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) Could not read cpuinfo_max_freq
2015-07-29 00:53:44,266 DEBUG [kvm.resource.LibvirtCapXMLParser] 
(Agent-Handler-1:null) Found /usr/libexec/qemu-kvm as a suiteable emulat
or
2015-07-29 00:53:44,266 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) Executing: /bin/bash -c qemu-img --help|grep
 convert
2015-07-29 00:53:44,270 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) Execution is successful.
2015-07-29 00:53:44,271 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null)   convert [-c] [-p] [-f fmt] [-t cache] [-T
src_cache] [-O output_fmt] [-o options] [-S sparse_size] filename [filename2 
[...]] output_filename

2015-07-29 00:53:44,271 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) cpus=8, speed=2660, ram=30153224192, dom0ram
=805306368, cpu sockets=1
2015-07-29 00:53:44,272 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) Parameters for private nic: 172.26.65.1 - 84:2b:
2b:56:d3:d9-255.255.255.0
2015-07-29 00:53:44,272 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) Parameters for storage nic: 172.26.65.1 - 84:2b:
2b:56:d3:d9-255.255.255.0
2015-07-29 00:53:44,272 DEBUG [cloud.resource.ServerResourceBase] 
(Agent-Handler-1:null) Parameters for pubic nic: 172.26.65.1 - 84:2b:2b
:56:d3:d9-255.255.255.0
2015-07-29 00:53:44,272 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) Executing: /usr/share/cloudstack-common/scri
pts/vm/hypervisor/versions.sh
2015-07-29 00:53:44,281 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) Execution is successful.
2015-07-29 00:53:44,282 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) Executing: sudo grep InitiatorName= /etc/isc
si/initiatorname.iscsi
2015-07-29 00:53:44,290 DEBUG [kvm.resource.LibvirtComputingResource] 
(Agent-Handler-1:null) Execution is successful.
2015-07-29 00:53:44,290 INFO  [kvm.storage.LibvirtStorageAdaptor] 
(Agent-Handler-1:null) Attempting to create storage pool 42bed7d9-88ae-
403d-9b53-0b44f31b2312 (Filesystem) in libvirt
2015-07-29 00:53:44,292 DEBUG [kvm.storage.LibvirtStorageAdaptor] 
(Agent-Handler-1:null) Found existing defined storage pool 42bed7d9-88a
e-403d-9b53-0b44f31b2312, using it.
2015-07-29 00:53:44,292 DEBUG [kvm.storage.LibvirtStorageAdaptor] 
(Agent-Handler-1:null) Trying to fetch storage pool 
42bed7d9-88ae-403d-9b53-0b44f31b2312 from libvirt
2015-07-29 00:53:44,811 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) 
Executing: hostname
2015-07-29 00:53:44,813 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) 
Execution is successful.
2015-07-29 00:53:44,834 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) 
Executing: hostname
2015-07-29 00:53:44,836 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) 
Execution is successful.
2015-07-29 00:53:44,838 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) 
Sending Startup: Seq 0-64:  { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 1, 
[{"com.cloud.agent.api.StartupRoutingCommand":{"cpuSockets":1,"cpus":8,"speed":2660,"memory":30153224192,"dom0MinMemory":805306368,"poolSync":false,"caps":"hvm,snapshot","pool":"/root","hypervisorType":"KVM","hostDetails":{"com.cloud.network.Networks.RouterPrivateIpStrategy":"HostLocal","Host.OS":"CentOS","Host.OS.Kernel.Version":"2.6.32-504.16.2.el6.x86_64","Host.OS.Version":"6.6"},"hostTags":[],"groupDetails":{},"type":"Routing","dataCenter":"4","pod":"5","cluster":"5","guid":"26e2bf7d-2fcf-3a67-a23d-ce9c09ef2ca5-LibvirtComputingResource","name":"***.***.***","id":0,"version":"4.5.1","iqn":"

RE: VM stuck in a failing Host

[Somesh Naidu]

Quick question, what is the state/status of the failed host in CS? Also, look 
up the particular VM on XS pool (xe vm-list name-label= i-574-14584-VM), what 
does it say?

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
Sent: Thursday, August 20, 2015 11:37 AM
To: users@cloudstack.apache.org
Subject: RE: VM stuck in a failing Host

Following the logs when I click 'run' in ACS after did the following in the DB


-  Change the state to 'stopped'

-  Change host ID to a working host

-  Change last host ID to a working host

-  Check VR is up and running on a working host


-bash-4.1# tail -f management-server.log | grep 14584
2015-08-20 05:45:27,513 DEBUG [cloud.async.AsyncJobManagerImpl] 
(catalina-exec-21:null) submit async job-45973 = [ 
d3ed77b7-534e-4a3b-9038-a66359162087 ], details: AsyncJobVO {id:45973, userId: 
2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, instanceId: 
14584, cmd: org.apache.cloudstack.api.command.user.vm.StopVMCmd, cmdOriginator: 
null, cmdInfo: 
{"response":"json","id":"98227dc9-682e-4f42-87e1-bd4b8045c7c9","sessionkey":"hwnxmM0He9EXs2craugKg3XyWL4\u003d","cmdEventType":"VM.STOP","ctxUserId":"2","httpmethod":"GET","_":"1440067422009","ctxAccountId":"2","ctxStartEventId":"38650949","forced":"true"},
 cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, 
processStatus: 0, resultCode: 0, result: null, initMsid: 139549854171544, 
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2015-08-20 05:46:33,404 DEBUG [agent.transport.Request] 
(Job-Executor-31:job-45974 = [ 9996fc72-fb83-4e5d-94c5-886396dac536 ]) Seq 
792-1073807425: Sending  { Cmd , MgmtId: 139549854171544, via: 792, Ver: v1, 
Flags: 100111, 
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/574/57764/28586b35-cb45-4565-bd9b-7aa46a2898da","volume":{"uuid":"a15d0923-0a25-408f-9d10-fd5d47b3fef9","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"3PAR_3000GB_ADV_SATA1","id":211,"poolType":"PreSetup","host":"localhost","path":"/3PAR_3000GB_ADV_SATA1","port":0}},"name":"ROOT-14584","size":107374182400,"path":"c7a8eebc-7750-455c-804f-64c0d66cb4f4","volumeId":57764,"vmName":"i-574-14584-VM","accountId":574,"format":"VHD","id":57764,"hypervisorType":"XenServer"},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172.16.4.65/vol/secondary_clpr","_role":"Image"}},"vmName":"i-574-14584-VM","name":"srvrasautos2_ROOT-14584_20141007233517","hypervisorType":"XenServer","id":11831}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/574/599","uuid":"70d21214-33d0-49e0-8b45-c7702b0fe579","id":599,"format":"RAW","accountId":574,"hvm":true,"displayText":"templateras","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172.16.4.65/vol/secondary_clpr","_role":"Image"}},"name":"248e2097b-4af7-38f7-a851-029ef11f52cc","hypervisorType":"XenServer"}},"executeInSequence":true,"wait":10800}}]
 }
2015-08-20 05:49:03,212 DEBUG [cloud.async.AsyncJobManagerImpl] 
(catalina-exec-1:null) submit async job-45975 = [ 
8ac23585-989d-4e3d-bcb9-3d3602842b8f ], details: AsyncJobVO {id:45975, userId: 
2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, instanceId: 
14584, cmd: org.apache.cloudstack.api.command.user.vm.StartVMCmd, 
cmdOriginator: null, cmdInfo: 
{"response":"json","id":"98227dc9-682e-4f42-87e1-bd4b8045c7c9","sessionkey":"hwnxmM0He9EXs2craugKg3XyWL4\u003d","cmdEventType":"VM.START","ctxUserId":"2","httpmethod":"GET","_":"1440067641673","ctxAccountId":"2","ctxStartEventId":"38651246"},
 cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, 
processStatus: 0, resultCode: 0, result: null, initMsid: 139549854171544, 
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2015-08-20 05:49:05,821 DEBUG [cloud.network.NetworkManagerImpl] 
(Job-Executor-32:job-45975 = [ 8ac23585-989d-4e3d-bcb9-3d3602842b8f ]) Asking 
VirtualRouter to prepare for 
Nic[194602-14584-5d82a92d-b828-45bc-882a-b5ce17401812-172.16.100.244]
2015-08-20 05:49:08,947 DEBUG [cloud.network.NetworkManagerImpl] 
(Job-Executor-32:job-45975 = [ 8ac23585-989d-4e3d-bcb9-3d3602842b8f ]) Asking 
VirtualRouter to prepare for Nic[194621-14584-null-172.16.180.35]
2015-08-20 05:49:10,181 DEBUG [cloud.storage.VolumeManagerImpl] 
(Job-Executor-32:job-45975 = [ 8ac23585-989d-4e3d-bcb9-3d3602842b8f ]) No need 
to recreate the volume: Vol[13270|vm=14584|DATADISK], since it already has a 
pool assigned: 208, adding disk to VM
2015-08-20 05:49:10,184 DEBUG [cloud.storage.VolumeManagerImpl] 
(Job-Executor-32:job-45975 = [ 8ac23585-989d-4e3d-bcb9-3d3602842b8f ]) No need 
to recreate the volume: Vol[57764|vm=14584|ROOT], since it already has a pool 
assigned: 211, adding disk to VM
2015-08-20 05:49:10,271 DEBUG [agent.transport.Request] 
(Job-

RE: VM stuck in a failing Host

[Somesh Naidu]

Can you not remove the failed host from CCP and XS cluster?

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
Sent: Thursday, August 20, 2015 12:38 PM
To: users@cloudstack.apache.org
Subject: RE: VM stuck in a failing Host

Hello,

state/status of the failed host in CS? = Disconnected

We run the command in the 2 remaining host with no results.

[root@dc1fdtptgcx04 /]# xe vm-list name-label= i-574-14584-VM
[root@dc1fdtptgcx04 /]#

[root@dc1fdtptgcx02 /]# xe vm-list name-label= i-574-14584-VM
[root@dc1fdtptgcx02 /]#



Regards / Cordialmente,

Jaime O. Rojas S.
Technology Manager
jaime.ro...@kumo.com.co
Mobile: +57 301-3382382
Office: +57-1-8766767 x215

-Mensaje original-
De: Somesh Naidu [mailto:somesh.na...@citrix.com] 
Enviado el: jueves, 20 de agosto de 2015 11:00 a. m.
Para: users@cloudstack.apache.org
Asunto: RE: VM stuck in a failing Host

Quick question, what is the state/status of the failed host in CS? Also, look 
up the particular VM on XS pool (xe vm-list name-label= i-574-14584-VM), what 
does it say?

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
Sent: Thursday, August 20, 2015 11:37 AM
To: users@cloudstack.apache.org
Subject: RE: VM stuck in a failing Host

Following the logs when I click 'run' in ACS after did the following in the DB


-  Change the state to 'stopped'

-  Change host ID to a working host

-  Change last host ID to a working host

-  Check VR is up and running on a working host


-bash-4.1# tail -f management-server.log | grep 14584
2015-08-20 05:45:27,513 DEBUG [cloud.async.AsyncJobManagerImpl] 
(catalina-exec-21:null) submit async job-45973 = [ 
d3ed77b7-534e-4a3b-9038-a66359162087 ], details: AsyncJobVO {id:45973, userId: 
2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, instanceId: 
14584, cmd: org.apache.cloudstack.api.command.user.vm.StopVMCmd, cmdOriginator: 
null, cmdInfo: 
{"response":"json","id":"98227dc9-682e-4f42-87e1-bd4b8045c7c9","sessionkey":"hwnxmM0He9EXs2craugKg3XyWL4\u003d","cmdEventType":"VM.STOP","ctxUserId":"2","httpmethod":"GET","_":"1440067422009","ctxAccountId":"2","ctxStartEventId":"38650949","forced":"true"},
 cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, 
processStatus: 0, resultCode: 0, result: null, initMsid: 139549854171544, 
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2015-08-20 05:46:33,404 DEBUG [agent.transport.Request] 
(Job-Executor-31:job-45974 = [ 9996fc72-fb83-4e5d-94c5-886396dac536 ]) Seq 
792-1073807425: Sending  { Cmd , MgmtId: 139549854171544, via: 792, Ver: v1, 
Flags: 100111, 
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/574/57764/28586b35-cb45-4565-bd9b-7aa46a2898da","volume":{"uuid":"a15d0923-0a25-408f-9d10-fd5d47b3fef9","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"3PAR_3000GB_ADV_SATA1","id":211,"poolType":"PreSetup","host":"localhost","path":"/3PAR_3000GB_ADV_SATA1","port":0}},"name":"ROOT-14584","size":107374182400,"path":"c7a8eebc-7750-455c-804f-64c0d66cb4f4","volumeId":57764,"vmName":"i-574-14584-VM","accountId":574,"format":"VHD","id":57764,"hypervisorType":"XenServer"},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172.16.4.65/vol/secondary_clpr","_role":"Image"}},"vmName":"i-574-14584-VM","name":"srvrasautos2_ROOT-14584_20141007233517","hypervisorType":"XenServer","id":11831}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/574/599","uuid":"70d21214-33d0-49e0-8b45-c7702b0fe579","id":599,"format":"RAW","accountId":574,"hvm":true,"displayText":"templateras","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172.16.4.65/vol/secondary_clpr","_role":"Image"}},"name":"248e2097b-4af7-38f7-a851-029ef11f52cc","hypervisorType":"XenServer"}},"executeInSequence&qu

RE: VM stuck in a failing Host

[Somesh Naidu]

I do not believe that should happen as the VM is primarily tied to the storage. 
But just to avoid taking any chances, we could do this:
1. Put the failed host in to maintenance.
2. Set host_id and last_host_id to NULL in vm_instance table for that VM.
3. Make sure the XS pool doesn't have any stale data for this VM. Look for the 
VM and associated VDI in the pool one more time. I noticed there is a space 
"name-label= i-574-14584-VM" after the equal operator, remove that space and 
try again or use XenCenter.

If #3 doesn't raise any flags, go ahead and try starting the VM again.

There is also another alternative, you could register the root disk of the VM 
as a template and launch a new VM from that template.

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
Sent: Thursday, August 20, 2015 1:00 PM
To: 
Subject: Re: VM stuck in a failing Host

Yes we could , but I'm not sure if maybe I lost the VM because it is tied to 
that host. 

Cordialmente,

Jaime Rojas



> On 20/08/2015, at 11:47 a.m., Somesh Naidu  wrote:
> 
> Can you not remove the failed host from CCP and XS cluster?
> 
> Regards,
> Somesh
> 
> 
> -Original Message-
> From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
> Sent: Thursday, August 20, 2015 12:38 PM
> To: users@cloudstack.apache.org
> Subject: RE: VM stuck in a failing Host
> 
> Hello,
> 
> state/status of the failed host in CS? = Disconnected
> 
> We run the command in the 2 remaining host with no results.
> 
> [root@dc1fdtptgcx04 /]# xe vm-list name-label= i-574-14584-VM
> [root@dc1fdtptgcx04 /]#
> 
> [root@dc1fdtptgcx02 /]# xe vm-list name-label= i-574-14584-VM
> [root@dc1fdtptgcx02 /]#
> 
> 
> 
> Regards / Cordialmente,
> 
> Jaime O. Rojas S.
> Technology Manager
> jaime.ro...@kumo.com.co
> Mobile: +57 301-3382382
> Office: +57-1-8766767 x215
> 
> -Mensaje original-
> De: Somesh Naidu [mailto:somesh.na...@citrix.com] 
> Enviado el: jueves, 20 de agosto de 2015 11:00 a. m.
> Para: users@cloudstack.apache.org
> Asunto: RE: VM stuck in a failing Host
> 
> Quick question, what is the state/status of the failed host in CS? Also, look 
> up the particular VM on XS pool (xe vm-list name-label= i-574-14584-VM), what 
> does it say?
> 
> Regards,
> Somesh
> 
> 
> -Original Message-
> From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
> Sent: Thursday, August 20, 2015 11:37 AM
> To: users@cloudstack.apache.org
> Subject: RE: VM stuck in a failing Host
> 
> Following the logs when I click 'run' in ACS after did the following in the DB
> 
> 
> -  Change the state to 'stopped'
> 
> -  Change host ID to a working host
> 
> -  Change last host ID to a working host
> 
> -  Check VR is up and running on a working host
> 
> 
> -bash-4.1# tail -f management-server.log | grep 14584
> 2015-08-20 05:45:27,513 DEBUG [cloud.async.AsyncJobManagerImpl] 
> (catalina-exec-21:null) submit async job-45973 = [ 
> d3ed77b7-534e-4a3b-9038-a66359162087 ], details: AsyncJobVO {id:45973, 
> userId: 2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, 
> instanceId: 14584, cmd: org.apache.cloudstack.api.command.user.vm.StopVMCmd, 
> cmdOriginator: null, cmdInfo: 
> {"response":"json","id":"98227dc9-682e-4f42-87e1-bd4b8045c7c9","sessionkey":"hwnxmM0He9EXs2craugKg3XyWL4\u003d","cmdEventType":"VM.STOP","ctxUserId":"2","httpmethod":"GET","_":"1440067422009","ctxAccountId":"2","ctxStartEventId":"38650949","forced":"true"},
>  cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, 
> processStatus: 0, resultCode: 0, result: null, initMsid: 139549854171544, 
> completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
> 2015-08-20 05:46:33,404 DEBUG [agent.transport.Request] 
> (Job-Executor-31:job-45974 = [ 9996fc72-fb83-4e5d-94c5-886396dac536 ]) Seq 
> 792-1073807425: Sending  { Cmd , MgmtId: 139549854171544, via: 792, Ver: v1, 
> Flags: 100111, 
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/574/57764/28586b35-cb45-4565-bd9b-7aa46a2898da","volume":{"uuid":"a15d0923-0a25-408f-9d10-fd5d47b3fef9","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"3PAR_3000GB_ADV_SATA1","i

RE: VM stuck in a failing Host

[Somesh Naidu]

We do not need to take a snapshot. Just extract the VHD from storage (you could 
use vdi-copy if it is on block storage) and then register it in CS as a 
template from UI.

> xe vm-list name-label= i-574-14584-VM

The command you tried above has space after "=". Did you try without the space?

Also, can you share the management server logs that capture the VM start job so 
we can take a look?

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
Sent: Thursday, August 20, 2015 1:59 PM
To: 
Subject: Re: VM stuck in a failing Host

We already did all of that and VM keeps trying to start on failed host. 
Template is not possible we tried to take a snapshot but it return an error. 

Cordialmente,

Jaime Rojas



> On 20/08/2015, at 12:19 p.m., Somesh Naidu  wrote:
> 
> I do not believe that should happen as the VM is primarily tied to the 
> storage. But just to avoid taking any chances, we could do this:
> 1. Put the failed host in to maintenance.
> 2. Set host_id and last_host_id to NULL in vm_instance table for that VM.
> 3. Make sure the XS pool doesn't have any stale data for this VM. Look for 
> the VM and associated VDI in the pool one more time. I noticed there is a 
> space "name-label= i-574-14584-VM" after the equal operator, remove that 
> space and try again or use XenCenter.
> 
> If #3 doesn't raise any flags, go ahead and try starting the VM again.
> 
> There is also another alternative, you could register the root disk of the VM 
> as a template and launch a new VM from that template.
> 
> Regards,
> Somesh
> 
> 
> -Original Message-
> From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
> Sent: Thursday, August 20, 2015 1:00 PM
> To: 
> Subject: Re: VM stuck in a failing Host
> 
> Yes we could , but I'm not sure if maybe I lost the VM because it is tied to 
> that host. 
> 
> Cordialmente,
> 
> Jaime Rojas
> 
> 
> 
>> On 20/08/2015, at 11:47 a.m., Somesh Naidu  wrote:
>> 
>> Can you not remove the failed host from CCP and XS cluster?
>> 
>> Regards,
>> Somesh
>> 
>> 
>> -Original Message-
>> From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
>> Sent: Thursday, August 20, 2015 12:38 PM
>> To: users@cloudstack.apache.org
>> Subject: RE: VM stuck in a failing Host
>> 
>> Hello,
>> 
>> state/status of the failed host in CS? = Disconnected
>> 
>> We run the command in the 2 remaining host with no results.
>> 
>> [root@dc1fdtptgcx04 /]# xe vm-list name-label= i-574-14584-VM
>> [root@dc1fdtptgcx04 /]#
>> 
>> [root@dc1fdtptgcx02 /]# xe vm-list name-label= i-574-14584-VM
>> [root@dc1fdtptgcx02 /]#
>> 
>> 
>> 
>> Regards / Cordialmente,
>> 
>> Jaime O. Rojas S.
>> Technology Manager
>> jaime.ro...@kumo.com.co
>> Mobile: +57 301-3382382
>> Office: +57-1-8766767 x215
>> 
>> -Mensaje original-
>> De: Somesh Naidu [mailto:somesh.na...@citrix.com] 
>> Enviado el: jueves, 20 de agosto de 2015 11:00 a. m.
>> Para: users@cloudstack.apache.org
>> Asunto: RE: VM stuck in a failing Host
>> 
>> Quick question, what is the state/status of the failed host in CS? Also, 
>> look up the particular VM on XS pool (xe vm-list name-label= 
>> i-574-14584-VM), what does it say?
>> 
>> Regards,
>> Somesh
>> 
>> 
>> -Original Message-
>> From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
>> Sent: Thursday, August 20, 2015 11:37 AM
>> To: users@cloudstack.apache.org
>> Subject: RE: VM stuck in a failing Host
>> 
>> Following the logs when I click 'run' in ACS after did the following in the 
>> DB
>> 
>> 
>> -  Change the state to 'stopped'
>> 
>> -  Change host ID to a working host
>> 
>> -  Change last host ID to a working host
>> 
>> -  Check VR is up and running on a working host
>> 
>> 
>> -bash-4.1# tail -f management-server.log | grep 14584
>> 2015-08-20 05:45:27,513 DEBUG [cloud.async.AsyncJobManagerImpl] 
>> (catalina-exec-21:null) submit async job-45973 = [ 
>> d3ed77b7-534e-4a3b-9038-a66359162087 ], details: AsyncJobVO {id:45973, 
>> userId: 2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, 
>> instanceId: 14584, cmd: org.apache.cloudstack.api.command.user.vm.StopVMCmd, 
>> cmdOriginator: null, cmdInfo: 
>> {"response":"json","id":"98227dc9-682e-4f42-87e1-bd4b8045c

RE: VM stuck in a failing Host

[Somesh Naidu]

Jaime,

Those are not complete logs I need. I need complete logs (no grep) between 
"2015-08-20 05:45:27,513" and when the job (job-45973) finished (I can't tell 
from the logs you shared earlier).

Also, do you have more than 1 management server?

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
Sent: Thursday, August 20, 2015 2:41 PM
To: 
Subject: Re: VM stuck in a failing Host

We ran the command without the space with no results.

In the second message I sent, I pasted the logs. You can find it in this mail 
chain at the beginning.

Cordialmente,

Jaime Rojas

Sent from my iPhone

On 20/08/2015, at 1:37 p.m., Somesh Naidu 
mailto:somesh.na...@citrix.com>> wrote:

We do not need to take a snapshot. Just extract the VHD from storage (you could 
use vdi-copy if it is on block storage) and then register it in CS as a 
template from UI.

xe vm-list name-label= i-574-14584-VM

The command you tried above has space after "=". Did you try without the space?

Also, can you share the management server logs that capture the VM start job so 
we can take a look?

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co]
Sent: Thursday, August 20, 2015 1:59 PM
To: mailto:users@cloudstack.apache.org>>
Subject: Re: VM stuck in a failing Host

We already did all of that and VM keeps trying to start on failed host. 
Template is not possible we tried to take a snapshot but it return an error.

Cordialmente,

Jaime Rojas



On 20/08/2015, at 12:19 p.m., Somesh Naidu 
mailto:somesh.na...@citrix.com>> wrote:

I do not believe that should happen as the VM is primarily tied to the storage. 
But just to avoid taking any chances, we could do this:
1. Put the failed host in to maintenance.
2. Set host_id and last_host_id to NULL in vm_instance table for that VM.
3. Make sure the XS pool doesn't have any stale data for this VM. Look for the 
VM and associated VDI in the pool one more time. I noticed there is a space 
"name-label= i-574-14584-VM" after the equal operator, remove that space and 
try again or use XenCenter.

If #3 doesn't raise any flags, go ahead and try starting the VM again.

There is also another alternative, you could register the root disk of the VM 
as a template and launch a new VM from that template.

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co]
Sent: Thursday, August 20, 2015 1:00 PM
To: mailto:users@cloudstack.apache.org>>
Subject: Re: VM stuck in a failing Host

Yes we could , but I'm not sure if maybe I lost the VM because it is tied to 
that host.

Cordialmente,

Jaime Rojas



On 20/08/2015, at 11:47 a.m., Somesh Naidu 
mailto:somesh.na...@citrix.com>> wrote:

Can you not remove the failed host from CCP and XS cluster?

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co]
Sent: Thursday, August 20, 2015 12:38 PM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: RE: VM stuck in a failing Host

Hello,

state/status of the failed host in CS? = Disconnected

We run the command in the 2 remaining host with no results.

[root@dc1fdtptgcx04 /]# xe vm-list name-label= i-574-14584-VM
[root@dc1fdtptgcx04 /]#

[root@dc1fdtptgcx02 /]# xe vm-list name-label= i-574-14584-VM
[root@dc1fdtptgcx02 /]#



Regards / Cordialmente,

Jaime O. Rojas S.
Technology Manager
jaime.ro...@kumo.com.co<mailto:jaime.ro...@kumo.com.co>
Mobile: +57 301-3382382
Office: +57-1-8766767 x215

-Mensaje original-
De: Somesh Naidu [mailto:somesh.na...@citrix.com]
Enviado el: jueves, 20 de agosto de 2015 11:00 a. m.
Para: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Asunto: RE: VM stuck in a failing Host

Quick question, what is the state/status of the failed host in CS? Also, look 
up the particular VM on XS pool (xe vm-list name-label= i-574-14584-VM), what 
does it say?

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co]
Sent: Thursday, August 20, 2015 11:37 AM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: RE: VM stuck in a failing Host

Following the logs when I click 'run' in ACS after did the following in the DB


-  Change the state to 'stopped'

-  Change host ID to a working host

-  Change last host ID to a working host

-  Check VR is up and running on a working host


-bash-4.1# tail -f management-server.log | grep 14584
2015-08-20 05:45:27,513 DEBUG [cloud.async.AsyncJobManagerImpl] 
(catalina-exec-21:null) submit async job-45973 = [ 
d3ed77b7-534e-4a3b-9038-a66359162087 ], details: AsyncJobVO {id:45973, userId: 
2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, instance

RE: VM stuck in a failing Host

[Somesh Naidu]

Thanks I just realized that the job was a stop command and not start command 
that I was looking for.

The stop command failed to stop the VM leaving the VM in Running state:
2015-08-20 05:45:27,513 DEBUG [cloud.async.AsyncJobManagerImpl] 
(catalina-exec-21:null) submit async job-45973 = [ 
d3ed77b7-534e-4a3b-9038-a66359162087 ], details: AsyncJobVO {id:45973, userId: 
2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, instanceId: 
14584, cmd: org.apache.cloudstack.api.command.user.vm.StopVMCmd, cmdOriginator: 
null, cmdInfo: 
{"response":"json","id":"98227dc9-682e-4f42-87e1-bd4b8045c7c9","sessionkey":"hwnxmM0He9EXs2craugKg3XyWL4\u003d","cmdEventType":"VM.STOP","ctxUserId":"2","httpmethod":"GET","_":"1440067422009","ctxAccountId":"2","ctxStartEventId":"38650949","forced":"true"},
 cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, 
processStatus: 0, resultCode: 0, result: null, initMsid: 139549854171544, 
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2015-08-20 05:45:27,605 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-30:job-45973 = [ d3ed77b7-534e-4a3b-9038-a66359162087 ]) VM state 
transitted from :Running to Stopping with event: StopRequestedvm's original 
host id: 599 new host id: 599 host id before state transition: 599
2015-08-20 05:45:27,617 WARN  [cloud.vm.VirtualMachineManagerImpl] 
(Job-Executor-30:job-45973 = [ d3ed77b7-534e-4a3b-9038-a66359162087 ]) Unable 
to stop vm, agent unavailable: com.cloud.exception.AgentUnavailableException: 
Resource [Host:599] is unreachable: Host 599: Host with specified id is not in 
the right state: Disconnected
2015-08-20 05:45:32,654 DEBUG [cloud.capacity.CapacityManagerImpl] 
(Job-Executor-30:job-45973 = [ d3ed77b7-534e-4a3b-9038-a66359162087 ]) VM state 
transitted from :Stopping to Running with event: OperationFailedvm's original 
host id: 599 new host id: 599 host id before state transition: 599
2015-08-20 05:45:33,683 DEBUG [cloud.async.AsyncJobManagerImpl] 
(Job-Executor-30:job-45973 = [ d3ed77b7-534e-4a3b-9038-a66359162087 ]) Complete 
async job-45973 = [ d3ed77b7-534e-4a3b-9038-a66359162087 ], jobStatus: 2, 
resultCode: 530, result: Error Code: 530 Error text: Failed to stop vm

I can't tell why the VM keeps starting on the failed host unless I have a look 
at the logs from a start command. 

But I think there is a good chance that if you check the "Force Stop" check box 
when stopping that VM and then try to start it again.

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co] 
Sent: Thursday, August 20, 2015 4:40 PM
To: users@cloudstack.apache.org
Subject: RE: VM stuck in a failing Host

Hello,

I am attaching the logs

http://jrojas-test.s3.kumo.com.co/management-server.log?AWSAccessKeyId=0099c1623d6704f9f5d5&Expires=1440711480&Signature=CFYwowzsJ3x%2B7XXfpAHDLM%2F022A%3D&x-amz-pt=N2ZiYjcyOTk4MTQ0MDEwMzEwNTQ5MA

We have a second manage server but it doesn't execute any task. 

Regards / Cordialmente,

Jaime O. Rojas S.
Technology Manager
jaime.ro...@kumo.com.co
Mobile: +57 301-3382382
Office: +57-1-8766767 x215

-Mensaje original-
De: Somesh Naidu [mailto:somesh.na...@citrix.com] 
Enviado el: jueves, 20 de agosto de 2015 2:17 p. m.
Para: users@cloudstack.apache.org
Asunto: RE: VM stuck in a failing Host

Jaime,

Those are not complete logs I need. I need complete logs (no grep) between 
"2015-08-20 05:45:27,513" and when the job (job-45973) finished (I can't tell 
from the logs you shared earlier).

Also, do you have more than 1 management server?

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co]
Sent: Thursday, August 20, 2015 2:41 PM
To: 
Subject: Re: VM stuck in a failing Host

We ran the command without the space with no results.

In the second message I sent, I pasted the logs. You can find it in this mail 
chain at the beginning.

Cordialmente,

Jaime Rojas

Sent from my iPhone

On 20/08/2015, at 1:37 p.m., Somesh Naidu 
mailto:somesh.na...@citrix.com>> wrote:

We do not need to take a snapshot. Just extract the VHD from storage (you could 
use vdi-copy if it is on block storage) and then register it in CS as a 
template from UI.

xe vm-list name-label= i-574-14584-VM

The command you tried above has space after "=". Did you try without the space?

Also, can you share the management server logs that capture the VM start job so 
we can take a look?

Regards,
Somesh


-Original Message-
From: Jaime Orlando Rojas Sanchez [mailto:jaime.ro...@kumo.com.co]
Sent: Thursday, August 20, 2015 1:59 PM
To: mailto:users@cloudstack.apache.org>>
Subject: Re: VM stuck in a failing H

RE: The agent doesn't reconnect if there are stopped VMs

[Somesh Naidu]

> If you mean offerings with "custom" parameters - yes, I use them

There is a possibility that this might be affecting this.

> I don't have more information in the log-file

Can you open the mgmt server log from "2015-08-18", search for "2015-08-18 
06:24:46,544", the next few lines should contain the java exception stack which 
should point us to the method-file-line_number that will help us understand 
what is causing the NPE.

Regards,
Somesh

-Original Message-
From: Vladimir Melnik [mailto:v.mel...@uplink.ua] 
Sent: Friday, August 21, 2015 2:42 AM
To: users@cloudstack.apache.org
Subject: Re: The agent doesn't reconnect if there are stopped VMs

I'll gladly send it, but where to find it? I don't have more information in the 
log-file :(

On Thu, Aug 20, 2015 at 03:49:25PM +, Somesh Naidu wrote:
> > 2015-08-18 06:24:46,542 DEBUG [c.c.c.CapacityManagerImpl] 
> > (AgentConnectTaskPool-213:ctx-76903ef6) Found 1 VM, not running on host 27
> > 2015-08-18 06:24:46,544 ERROR [c.c.a.m.AgentManagerImpl] 
> > (AgentConnectTaskPool-213:ctx-76903ef6) Monitor ComputeCapacityListener 
> > says there is an error in the connect process for 27 due to null
> > java.lang.NullPointerException
> 
> It will help if you send the complete exception stack for the above NPE.
> 
> Regards,
> Somesh
> 
> -Original Message-
> From: Simon Weller [mailto:swel...@ena.com] 
> Sent: Thursday, August 20, 2015 11:21 AM
> To: users@cloudstack.apache.org
> Subject: Re: The agent doesn't reconnect if there are stopped VMs
> 
> Do you have any dynamic service offerings?
> 
> 
> From: Vladimir Melnik 
> Sent: Thursday, August 20, 2015 8:20 AM
> To: users@cloudstack.apache.org
> Subject: Re: The agent doesn't reconnect if there are stopped VMs
> 
> Oh, I'm sorry, I should have initially send the DEBUG-log!
> 
> Here is an example:
> 
> --- 8< ---
> 2015-07-29 00:53:42,988 INFO  [utils.nio.NioClient] (Agent-Selector:null) 
> Connecting to ***.***.***.***:8250
> 2015-07-29 00:53:44,254 INFO  [utils.nio.NioClient] (Agent-Selector:null) 
> SSL: Handshake done
> 2015-07-29 00:53:44,255 INFO  [utils.nio.NioClient] (Agent-Selector:null) 
> Connected to ***.***.***.***:8250
> 2015-07-29 00:53:44,258 WARN  [kvm.resource.LibvirtComputingResource] 
> (Agent-Handler-1:null) Could not read cpuinfo_max_freq
> 2015-07-29 00:53:44,266 DEBUG [kvm.resource.LibvirtCapXMLParser] 
> (Agent-Handler-1:null) Found /usr/libexec/qemu-kvm as a suiteable emulat
> or
> 2015-07-29 00:53:44,266 DEBUG [kvm.resource.LibvirtComputingResource] 
> (Agent-Handler-1:null) Executing: /bin/bash -c qemu-img --help|grep
>  convert
> 2015-07-29 00:53:44,270 DEBUG [kvm.resource.LibvirtComputingResource] 
> (Agent-Handler-1:null) Execution is successful.
> 2015-07-29 00:53:44,271 DEBUG [kvm.resource.LibvirtComputingResource] 
> (Agent-Handler-1:null)   convert [-c] [-p] [-f fmt] [-t cache] [-T
> src_cache] [-O output_fmt] [-o options] [-S sparse_size] filename [filename2 
> [...]] output_filename
> 
> 2015-07-29 00:53:44,271 DEBUG [kvm.resource.LibvirtComputingResource] 
> (Agent-Handler-1:null) cpus=8, speed=2660, ram=30153224192, dom0ram
> =805306368, cpu sockets=1
> 2015-07-29 00:53:44,272 DEBUG [cloud.resource.ServerResourceBase] 
> (Agent-Handler-1:null) Parameters for private nic: 172.26.65.1 - 84:2b:
> 2b:56:d3:d9-255.255.255.0
> 2015-07-29 00:53:44,272 DEBUG [cloud.resource.ServerResourceBase] 
> (Agent-Handler-1:null) Parameters for storage nic: 172.26.65.1 - 84:2b:
> 2b:56:d3:d9-255.255.255.0
> 2015-07-29 00:53:44,272 DEBUG [cloud.resource.ServerResourceBase] 
> (Agent-Handler-1:null) Parameters for pubic nic: 172.26.65.1 - 84:2b:2b
> :56:d3:d9-255.255.255.0
> 2015-07-29 00:53:44,272 DEBUG [kvm.resource.LibvirtComputingResource] 
> (Agent-Handler-1:null) Executing: /usr/share/cloudstack-common/scri
> pts/vm/hypervisor/versions.sh
> 2015-07-29 00:53:44,281 DEBUG [kvm.resource.LibvirtComputingResource] 
> (Agent-Handler-1:null) Execution is successful.
> 2015-07-29 00:53:44,282 DEBUG [kvm.resource.LibvirtComputingResource] 
> (Agent-Handler-1:null) Executing: sudo grep InitiatorName= /etc/isc
> si/initiatorname.iscsi
> 2015-07-29 00:53:44,290 DEBUG [kvm.resource.LibvirtComputingResource] 
> (Agent-Handler-1:null) Execution is successful.
> 2015-07-29 00:53:44,290 INFO  [kvm.storage.LibvirtStorageAdaptor] 
> (Agent-Handler-1:null) Attempting to create storage pool 42bed7d9-88ae-
> 403d-9b53-0b44f31b2312 (Filesystem) in libvirt
> 2015-07-29 00:53:44,292 DEBUG [kvm.storage.LibvirtStorageAdaptor] 
> (Agent-Handler-1:null) Found existing defined storage pool 42bed7d9-88a
> e-403d-9b

RE: duplicate use of tips?

[Somesh Naidu]

Frank,

> That’s not really true: This is from the “nics” table in the Database:
What about the removed column?

Also, did you check the table user_ip_address table for the IPs? Are there 
multiple entries for those? If not then it should not be possible for mgmt 
server to assign one IP to two VMs at the same time unless the record is 
incorrectly not being marked as "Allocated" while assignment.


Regards,
Somesh


-Original Message-
From: Frank Louwers [mailto:fr...@openminds.be] 
Sent: Friday, August 21, 2015 3:30 AM
To: users@cloudstack.apache.org
Subject: Re: duplicate use of tips?

On 21 Aug 2015 at 04:44:13, Abhinandan Prateek 
(abhinandan.prat...@shapeblue.com) wrote:
If you are manually assigning the ips better use the ips that are outside the 
cidr that cloudstack manages. 
The ips assigned by cloudstack dhcp are as per cloudstack assignments anything 
that happen outside VR’s dhcp is unknown to cloudstack. 


That’s not really true: This is from the “nics” table in the Database:



+---+-+--+--++--+

| id    | instance_id | state    | ip4_address  | network_id | secondary_ip |

+---+-+--+--++--+

|    72 |          58 | Reserved | x.y.x.92     |        204 |            1 |

| 19092 |        4929 | Reserved | x.y.z.92     |        204 |            0 |

+---+-+--+--++———+







> On 20-Aug-2015, at 11:29 pm, Frank Louwers  wrote: 
> 
> Hi, 
> 
> In a zone with Basic Networking, I’ve assigned a certain netblock x.y.z.0/24 
> to the Guest network in CloudStack. 
> 
> I have a VM-A that has primary ip address x.y.z.92 and secondary address on 
> the same nic x.y.z.52. 
> 
> For various reasons, *both* ips were configured manually, so not using the 
> VR’s dhcp. 
> 
> A while back, the x.y.z.92 was (manually) deconfigured on VM-A (so VM-A only 
> used x.y.x.52, but both ips are still configured to belong to VM-A in 
> Cloudstack). 
> 
> A few days ago, a new instance (VM-B) was spun up, and CS assigned ip 
> x.y.z.92 to that VM. Why would it do that? 
> Today, a new instance was spun up (VM-C), but CS assigned x.y.z.52 to VM-C… 
> 
> How and why does this happen?! Is this because VM-A does not use dhcp? That 
> might explain the .92 re-assignement, but certainly not the .52 reassignment, 
> as secondary ips don’t use dhcp anyhow… 
> 
> Can anyone tell me what’s going on, and what can be done to prevent his? 
> Running CS 4.4.2 at the moment, considering upgrading to 4.5.1 (or 4.5.2) 
> 
> Regards, 
> Frank 
> 

Find out more about ShapeBlue and our range of CloudStack related services 

IaaS Cloud Design & Build 
CSForge – rapid IaaS deployment framework 
CloudStack Consulting 
CloudStack Software 
Engineering 
CloudStack Infrastructure 
Support 
CloudStack Bootcamp Training Courses 

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark. 

RE: duplicate use of tips?

[Somesh Naidu]

Frank,

> there was an entry for the “old” instances that got overridden
I haven't come across such an issue before.

Can you share the output of the following SQL:
1. select * from nics where ip4_address='37.72.162.58'
2. select * from user_ip_address where public_ip_address='37.72.162.58'

Also, can you check if either of "removeIpFromNic" or "addIpToNic" was called 
on either of these VMs (55 and 5014).

Regards,
Somesh

-Original Message-
From: Frank Louwers [mailto:fr...@openminds.be] 
Sent: Monday, August 24, 2015 5:10 AM
To: users@cloudstack.apache.org
Subject: RE: duplicate use of tips?

Somesh, it just happened again:

mysql> select * from nic_secondary_ips where ip4_address = '37.72.162.58';
++--+--+---+--+-++-++---+
| id | uuid                                 | vmId | nicId | ip4_address  | 
ip6_address | network_id | created             | account_id | domain_id |
++--+--+---+--+-++-++---+
| 14 | becda4a0-b912-4015-b69f-c9b889f74762 |   55 |    69 | 37.72.162.58 | 
NULL        |        204 | 2015-03-19 20:35:09 |         14 |         2 |
| 22 | b4b30ca2-f06c-4c1c-a048-f92678611eb2 | 5014 | 19177 | 37.72.162.58 | 
NULL        |        204 | 2015-08-24 09:03:45 |          2 |         1 |
++--+--+---+--+-++-++---+

mysql> select * from nics where id = 69\G
*** 1. row ***
            id: 69
          uuid: 23670e25-377a-40d1-ad29-0517127709b5
   instance_id: 55
   mac_address: 06:ba:92:00:00:46
   ip4_address: 37.72.162.105
       netmask: 255.255.254.0
       gateway: 37.72.162.1
       ip_type: Ip4
 broadcast_uri: vlan://untagged
    network_id: 204
          mode: Dhcp
         state: Reserved
      strategy: Start
 reserver_name: DirectPodBasedNetworkGuru
reservation_id: e9f76078-6d8f-4e46-bf4c-35e2814bb8e1
     device_id: 0
   update_time: 2015-04-01 13:02:35
 isolation_uri: NULL
   ip6_address: NULL
   default_nic: 1
       vm_type: User
       created: 2015-03-18 14:09:53
       removed: NULL
   ip6_gateway: NULL
      ip6_cidr: NULL
  secondary_ip: 1
   display_nic: 1

There is only one entry in user_ip_address, the entry for the “new” instance, 
but I am sure there was an entry for the “old” instances that got overriden.
-- 
Frank Louwers
Openminds bvba
T: 09/225 82 91
www.openminds.be

On 21 Aug 2015 at 19:08:59, Somesh Naidu (somesh.na...@citrix.com) wrote:

Frank,  

> That’s not really true: This is from the “nics” table in the Database:  
What about the removed column?  

Also, did you check the table user_ip_address table for the IPs? Are there 
multiple entries for those? If not then it should not be possible for mgmt 
server to assign one IP to two VMs at the same time unless the record is 
incorrectly not being marked as "Allocated" while assignment.  


Regards,  
Somesh  


-Original Message-  
From: Frank Louwers [mailto:fr...@openminds.be]  
Sent: Friday, August 21, 2015 3:30 AM  
To: users@cloudstack.apache.org  
Subject: Re: duplicate use of tips?  

On 21 Aug 2015 at 04:44:13, Abhinandan Prateek 
(abhinandan.prat...@shapeblue.com) wrote:  
If you are manually assigning the ips better use the ips that are outside the 
cidr that cloudstack manages.   
The ips assigned by cloudstack dhcp are as per cloudstack assignments anything 
that happen outside VR’s dhcp is unknown to cloudstack.   


That’s not really true: This is from the “nics” table in the Database:  



+---+-+--+--++--+  

| id    | instance_id | state    | ip4_address  | network_id | secondary_ip |  

+---+-+--+--++--+  

|    72 |          58 | Reserved | x.y.x.92     |        204 |            1 |  

| 19092 |        4929 | Reserved | x.y.z.92     |        204 |            0 |  

+---+-+--+--++———+  







> On 20-Aug-2015, at 11:29 pm, Frank Louwers  wrote:   
>   
> Hi,   
>   
> In a zone with Basic Networking, I’ve assigned a certain netblock x.y.z.0/24 
> to the Guest network in CloudStack.   
>   
> I have a VM-A that has primary ip address x.y.z.92 and secondary address on 
> the same nic x.y.z.52.   
>   
> For various reasons, *both* ips were configured manually, so not using the 
> VR’s dhcp.   
>   
> A while back, the x.y.z.92 was (manually) deconfigured on VM-A (so VM-A only 
> used x.y.x.52, but both ips are still configured to belong to VM-A in 
> Cloudstack).   
>   
>

RE: The agent doesn't reconnect if there are stopped VMs

[Somesh Naidu]

> I had posted the full log in the initial message. There is no exception 
> stack. 
My bad, I thought that was a grep for job/thread ID, I now realize it wasn't.

> If there was an exception stack I probably wouldn't ask stupid questions 
> here. :)
So you do realize why I was so keen on the exception stack as it would have 
lead us straight to the culprit.

> Thank you! So, should I change all offerings to "static" ones?
Without the exception stack it would be more of a calculated guess / 
hit-n-trial. I would may be just test this scenario by temporarily update the 
RAM/CPU of the offering (I know custom offerings should have them as NULL).

Since you mentioned that you didn't have dynamic SOs, I strongly suspect the 
culprit would be one of so.getRamSize() or so.getCpu(), see below:
reservedMemory += ((so.getRamSize() * 1024L * 1024L) / 
ramOvercommitRatio) * clusterRamOvercommitRatio;
reservedCpu += (so.getCpu() * so.getSpeed() / cpuOvercommitRatio) * 
clusterCpuOvercommitRatio;

If the above is indeed true, then this would be similar to - 
https://issues.apache.org/jira/browse/CLOUDSTACK-8328.

Regards,
Somesh


-Original Message-
From: Vladimir Melnik [mailto:v.mel...@uplink.ua] 
Sent: Sunday, August 23, 2015 2:45 AM
To: users@cloudstack.apache.org
Subject: Re: The agent doesn't reconnect if there are stopped VMs

Hello,

On Fri, Aug 21, 2015 at 04:41:42PM +, Somesh Naidu wrote:
> > If you mean offerings with "custom" parameters - yes, I use them
> There is a possibility that this might be affecting this.

Thank you! So, should I change all offerings to "static" ones?

> > I don't have more information in the log-file
> Can you open the mgmt server log from "2015-08-18", search for "2015-08-18 
> 06:24:46,544", the next few lines should contain the java exception stack 
> which should point us to the method-file-line_number that will help us 
> understand what is causing the NPE.

I had posted the full log in the initial message. There is no exception stack. 
There are 3 lines:
1: 2015-08-18 06:24:46,544 ERROR [c.c.a.m.AgentManagerImpl] 
(AgentConnectTaskPool-213:ctx-76903ef6) Monitor ComputeCapacityListener says 
there is an error in the connect process for 27 due to null
2: java.lang.NullPointerException
3: 2015-08-18 06:24:46,544 INFO  [c.c.a.m.AgentManagerImpl] 
(AgentConnectTaskPool-213:ctx-76903ef6) Host 27 is disconnecting with event 
AgentDisconnected

The 2nd line doesn't contain an exception stack, all it contains is 
"java.lang.NullPointerException".

If there was an exception stack I probably wouldn't ask stupid questions here. 
:)


-- 
V.Melnik

P.S. I've opened an issue: https://issues.apache.org/jira/browse/CLOUDSTACK-8747

RE: How do I stop Status popup message box?

[Somesh Naidu]

That is a defect, please file one here - 
https://issues.apache.org/jira/browse/CLOUDSTACK/

Regards,
Somesh

-Original Message-
From: Yichi Lu [mailto:y...@zenoss.com] 
Sent: Thursday, August 27, 2015 2:43 PM
To: users@cloudstack.apache.org
Subject: Re: How do I stop Status popup message box?

This happened when I set default.page.size to 40. Even if later on I used
pagesize 40, or set default.page.size > pagesize, but still default.page.size
< 500, I still got the popup message box each time I logged in to
cloudstack.
The message box no longer popped up only after I set default.page.size =
500.
Is this a bug? Or designed behavior?
Yichi

On Thu, Aug 27, 2015 at 11:48 AM, Yichi Lu  wrote:

> Hi:
> If I make a list type API call, and specify a pagesize >
> default.page.size, I'll get a popup status message box saying: "Page size
> can't exceed max allowed page size value: x", every time I login to
> my account, no matter how many time I clicked 'Close'. Is there a way to
> stop this popup message box?
> Yichi
>

RE: HAProxy Max Sessions

[Somesh Naidu]

Looks like the fullconn parameter you reference. It is supposed to be 10% of 
maxconn. The maxconn looks like set to default 2000 in your case so what you 
are seeing seems correct. Check out this link for more details - 
http://comments.gmane.org/gmane.comp.web.haproxy/9715

There is a global config "network.loadbalancer.haproxy.max.conn" that was 
introduced for this (and is set to 4096 by default) but I haven't recently 
verified if it still works.

Regards,
Somesh


-Original Message-
From: Steve Searles [mailto:ssear...@zimcom.net] 
Sent: Monday, August 31, 2015 12:10 PM
To: 
Subject: HAProxy Max Sessions

Does anyone know how to change the max backend sessions on the HA proxy load 
balancer? Currently with 2 servers I am seeing a backend session limit of 200. 
Is this something that needs to be changed on the VR by hand? If so how can the 
change be made persistent?   This is what I am seeing from the HAProxy status 
page.

XXX-443

Queue   Session rateSessionsBytes   Denied  Errors  
WarningsServer
Cur Max Limit   Cur Max Limit   Cur Max Limit   Total   
LbTot   LastIn  Out Req RespReq ConnRespRetr
Redis   Status  LastChk WghtAct Bck Chk Dwn Dwntme  Thrtle
Frontend  
1


33


-   161 223 20009554


116492541   403138671
0   0   0   OPEN
XXX-443_0
0   0   -   1   26  33  110 -   3382





209 1s  5289161282984   0   
0   183
68  34  8m13s UPL4OK in 0ms
1   Y   -   3
1   1m4s-
XXX-443_1
0   0   -   1   28  128 158 -   6274





333 1s  64159152241855687   0   
0   261
0   0   22m14s UP   L4OK in 0ms
1   Y   -   0
0   0s  -
Backend
0   0   1   33  161 223 200 9554




542 1s  116492541   403138671
0   0   0   444



- Steve

RE: Usage Job failed

[Somesh Naidu]

I wrote that article, it was for DB cleanup for 3.x version. I have updated it 
here for latest versions and added more tables - 
http://support.citrix.com/article/CTX200918.

I believe the error suggests that duplicate entries found when parsing records 
in table user_statistics for network usage. '2-1-228-144117719' - this 
translates to account_id 2, zone 1, network_id 228 and date Sep 03 2015 
19:59:59 GMT-0400.

Look at the usage logs for log messages "creating networkHelperEntry..." for 
account id 2 having multiple entries matching the above.

Regards,
Somesh

-Original Message-
From: mvs babu [mailto:mvsbabu0...@outlook.com] 
Sent: Friday, September 04, 2015 12:35 AM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org
Subject: Re: Usage Job failed

Thank you Abhinandan, I will try this.






Thank you,
Suneel Mallela





From: Abhinandan Prateek
Sent: ‎Thursday‎, ‎September‎ ‎3‎, ‎2015 ‎9‎:‎42‎ ‎PM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org





This support article may help:

http://support.citrix.com/article/CTX139043

> On 03-Sep-2015, at 5:16 pm, mvs babu  wrote:
>
> Hi All,
>
>
>
>
> We are getting usage job failed alert in CloudStack UI and found below error 
> message in usage.log,
>
>
>
>
> "ERROR [usage.dao.UsageVMInstanceDaoImpl] (Usage-Job-1:null) error saving 
> usage_network to cloud_usage db
> java.sql.BatchUpdateException: Duplicate entry '2-1-228-144117719' for 
> key 'PRIMARY'"
>
>
>
>
>
> We are using ACS4.3.1. on top of CentOS6.2.
>
>
>
>
> Please help to solve this issue.
>
>
>
>
> Thank you,
> Suneel Mallela

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

RE: CCP-4.5.0: Adding additional interfaces are not accepting on VMs if the VM has vm snapshots

[Somesh Naidu]

Agree with Erik, open a support ticket with Citrix. 

Regards,
Somesh

-Original Message-
From: Erik Weber [mailto:terbol...@gmail.com] 
Sent: Tuesday, September 08, 2015 6:15 AM
To: users@cloudstack.apache.org
Subject: Re: CCP-4.5.0: Adding additional interfaces are not accepting on VMs 
if the VM has vm snapshots

Hi Anil,

The links just explain what was done, and to some degree why.
I don't know much more than that, except that we've learned to live with it.

The rationale behind it seems to be that, due to the way CloudStack handles
snapshots, there is a risk of data loss if you do changes to the VM, and to
prevent that you are not allowed to do certain changes.

As for modifying the code, I can't really help you, that's out of my league.
But seeing that you are using CCP, I guess you could contact Citrix Support
and ask for their help, either in lifting the limitations, or fixing the
reasons behind them.

-- 
Erik

On Tue, Sep 8, 2015 at 11:50 AM, anil lakineni <
anilkumar459.lakin...@gmail.com> wrote:

> Dear Erik,
>
> Thanks for your replay.
>
> I am really not able to understand the information in the links which you
> provided
>
> I seen that some restrictions was there with VM snapshots in the links and
> fixes for the restrictions.
>
> What should I have to modify in the code to fix the issues with VM
> snapshots? can you please provide me step by step procedure to do
> modifications at code.
>
> Waiting for your valuable reply.
>
> Regards,
> Anil.
>
> On Tue, Sep 8, 2015 at 12:33 PM, Erik Weber  wrote:
>
> > See
> >
> >
> http://mail-archives.us.apache.org/mod_mbox/cloudstack-dev/201504.mbox/%3ccad6sckbtgz2skluctz9y8nrjzki4sd-73_swp4gl-d-krgs...@mail.gmail.com%3E
> >
> > and https://issues.apache.org/jira/browse/CLOUDSTACK-7688
> >
> > --
> > Erik
> >
> > On Tue, Sep 8, 2015 at 8:59 AM, anil lakineni <
> > anilkumar459.lakin...@gmail.com> wrote:
> >
> > > Hi All,
> > >
> > > We are facing issues when adding additional interfaces on VMs if VM has
> > vm
> > > snapshots. Issue is VM not accepting to add additional interface due to
> > VM
> > > snapshots.
> > >
> > > Error is: *Add netowrk to VM Action failed - Service Exception : NIC
> > cannot
> > > be added to VM with VM Snapshots*
> > >
> > > I believe that this is not a correct behaviour of CloudPlatform,
> because
> > we
> > > are able to add additional interfaces on VMs with VM snapshots in
> > remaining
> > > versions of Cloud Stack.
> > >
> > > Is it a bug on CCP 4.5.0?? Please let me know if I have to
> change/modify
> > > any values at CCP
> > > I will be Waiting for your valuable inputs. Thanks in advance.
> > >
> > > Using CitrixCloudPlatform 4.5.0 and XenServer 6.2 hosts
> > >
> > > Regards,
> > > Anil.
> > >
> >
>

RE: Usage Job failed

[Somesh Naidu]

The time is reported in milliseconds "144117719" - look up on the internet 
for an online converter.

Regards,
Somesh


-Original Message-
From: mvs babu [mailto:mvsbabu0...@outlook.com] 
Sent: Monday, September 07, 2015 3:57 AM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org
Subject: Re: Usage Job failed

Hi Somesh,

Thank you for your valuable information. 



The problem was solved without any actions made on database after some idle 
time.


Can you please share that how can we get timestamp from '2-1-228-144117719'.


Thank you,
Suneel Mallela





From: Somesh Naidu
Sent: ‎Saturday‎, ‎September‎ ‎5‎, ‎2015 ‎12‎:‎45‎ ‎AM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org





I wrote that article, it was for DB cleanup for 3.x version. I have updated it 
here for latest versions and added more tables - 
http://support.citrix.com/article/CTX200918.

I believe the error suggests that duplicate entries found when parsing records 
in table user_statistics for network usage. '2-1-228-144117719' - this 
translates to account_id 2, zone 1, network_id 228 and date Sep 03 2015 
19:59:59 GMT-0400.

Look at the usage logs for log messages "creating networkHelperEntry..." for 
account id 2 having multiple entries matching the above.

Regards,
Somesh

-Original Message-
From: mvs babu [mailto:mvsbabu0...@outlook.com] 
Sent: Friday, September 04, 2015 12:35 AM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org
Subject: Re: Usage Job failed

Thank you Abhinandan, I will try this.






Thank you,
Suneel Mallela





From: Abhinandan Prateek
Sent: ‎Thursday‎, ‎September‎ ‎3‎, ‎2015 ‎9‎:‎42‎ ‎PM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org





This support article may help:

http://support.citrix.com/article/CTX139043

> On 03-Sep-2015, at 5:16 pm, mvs babu  wrote:
>
> Hi All,
>
>
>
>
> We are getting usage job failed alert in CloudStack UI and found below error 
> message in usage.log,
>
>
>
>
> "ERROR [usage.dao.UsageVMInstanceDaoImpl] (Usage-Job-1:null) error saving 
> usage_network to cloud_usage db
> java.sql.BatchUpdateException: Duplicate entry '2-1-228-144117719' for 
> key 'PRIMARY'"
>
>
>
>
>
> We are using ACS4.3.1. on top of CentOS6.2.
>
>
>
>
> Please help to solve this issue.
>
>
>
>
> Thank you,
> Suneel Mallela

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software 
Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure 
Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

RE: Unable to create a deployment for VM (Additional DATADISK - API-job)

[Somesh Naidu]

Cristian,

First off, I would recommend masking information such as apikey, signature, 
public IPs, etc. when posting on the list for security reasons.

The reason for failure as per logs is "InsufficientServerCapacityException" 
however, from the logs snippets it is not possible to find the root cause. 
Also, I suspect the "InsufficientServerCapacityException" is a consequential 
error, that is, result of all the compute/storage resources ending up in the 
avoid set. What caused the compute/storage resource to end up in that list is 
the root cause. You should trace "job-754" and look for the initial failure.

Alternately, you could compare API call you're using vs the one generated via 
CS GUI to see for any differences. It will also help to know version of CS 
(looks like pre 4.5) and hypervisor. 

Regards,
Somesh

-Original Message-
From: Cristian Ciobanu [mailto:cristian.c@istream.today] 
Sent: Thursday, September 10, 2015 1:18 PM
To: users@cloudstack.apache.org
Subject: Unable to create a deployment for VM (Additional DATADISK - API-job)


Hello,

    I have a problem when i try to deploy a VM with DATADISK via API, i don't 
have any issue when i deploy from the CS interface.

I found some logs on CS MGMT:

==> management-server.log <==
2015-09-10 19:07:19,584 DEBUG [c.c.a.ApiServlet] (catalina-exec-21:ctx-60c7d3d4 
ctx-a0298b0c ctx-9750e753) ===END===  5.135.217.237 -- GET  
account=client_3_1&apikey=nZ72olHQnj4Ap25Wyfmlp2nU0S2kib-gg1JBN6_nWy-h8rYg2o2p6LBRmidFJTkxKxYT_Eao6GquFIF62sdpRQ&command=deployVirtualMachine&diskofferingid=0bc04371-2d2d-4a52-8094-7f25abb1e32b&displayname=cadaver&domainid=6aef553f-aa33-4db2-815a-1b0f0b575645&name=cadaver&response=json&serviceofferingid=59bdf4c6-9cca-4f35-a050-ac6b64c74cda&templateid=e873ac1f-b95b-48be-863e-0d81c5307995&zoneid=a85f1632-0718-4e67-b7c6-00d566121bf4&signature=qJHb2yDblfKlbAYWXXVTB9oc%2BHY%3D
2015-09-10 19:07:19,585 DEBUG [o.a.c.a.BaseCmd] 
(API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) Ignoring paremeter 
displayvm as the caller is not authorized to pass it in
2015-09-10 19:07:19,585 DEBUG [o.a.c.a.BaseCmd] 
(API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) Ignoring paremeter 
deploymentplanner as the caller is not authorized to pass it in
===

2015-09-10 19:07:19,846 WARN  [o.a.c.alerts] (API-Job-Executor-91:ctx-71d92d17 
job-754 ctx-38551c18)  alertType:: 8 // dataCenterId:: 1 // podId:: null // 
clusterId:: null // message:: Failed to deploy Vm with Id: 72, on Host with Id: 
null
2015-09-10 19:07:19,929 INFO  [o.a.c.a.c.u.v.DeployVMCmd] 
(API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) 
com.cloud.exception.InsufficientServerCapacityException: Unable to create a 
deployment for VM[User|i-6-72-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2015-09-10 19:07:19,929 INFO  [o.a.c.a.c.u.v.DeployVMCmd] 
(API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) Unable to create a 
deployment for VM[User|i-6-72-VM]
==

Can i get some help ? Thanks !


Regards,
Cristian

 

RE: Unable to create a deployment for VM (Additional DATADISK - API-job)

[Somesh Naidu]

xecutor-91:ctx-71d92d17 job-754 ctx-38551c18) Unable to create a 
deployment for VM[User|i-6-72-VM]
2015-09-10 19:07:19,930 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-91:ctx-71d92d17 job-754) Complete async job-754, jobStatus: 
FAILED, resultCode: 530, result: 
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":533,"errortext":"Unable
 to create a deployment for VM[User|i-6-72-VM]"}
2015-09-10 19:07:19,930 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-91:ctx-71d92d17 job-754) Publish async job-754 complete on 
message bus
2015-09-10 19:07:19,930 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-91:ctx-71d92d17 job-754) Wake up jobs related to job-754
2015-09-10 19:07:19,930 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-91:ctx-71d92d17 job-754) Update db status for job-754
2015-09-10 19:07:19,931 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-91:ctx-71d92d17 job-754) Wake up jobs joined with job-754 and 
disjoin all subjobs created from job- 754
2015-09-10 19:07:19,946 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-91:ctx-71d92d17 job-754) Done executing 
org.apache.cloudstack.api.command.user.vm.DeployVMCmd for job-754
2015-09-10 19:07:19,946 INFO  [o.a.c.f.j.i.AsyncJobMonitor] 
(API-Job-Executor-91:ctx-71d92d17 job-754) Remove job-754 from job monitoring




Thanks!

Regards,
Cristian

 
On 9/10/2015 9:03:48 PM, Somesh Naidu  wrote:
Cristian,

First off, I would recommend masking information such as apikey, signature, 
public IPs, etc. when posting on the list for security reasons.

The reason for failure as per logs is "InsufficientServerCapacityException" 
however, from the logs snippets it is not possible to find the root cause. 
Also, I suspect the "InsufficientServerCapacityException" is a consequential 
error, that is, result of all the compute/storage resources ending up in the 
avoid set. What caused the compute/storage resource to end up in that list is 
the root cause. You should trace "job-754" and look for the initial failure.

Alternately, you could compare API call you're using vs the one generated via 
CS GUI to see for any differences. It will also help to know version of CS 
(looks like pre 4.5) and hypervisor.

Regards,
Somesh

-Original Message-
From: Cristian Ciobanu [mailto:cristian.c@istream.today]
Sent: Thursday, September 10, 2015 1:18 PM
To: users@cloudstack.apache.org
Subject: Unable to create a deployment for VM (Additional DATADISK - API-job)


Hello,

    I have a problem when i try to deploy a VM with DATADISK via API, i don't 
have any issue when i deploy from the CS interface.

I found some logs on CS MGMT:

==> management-server.log <==>
2015-09-10 19:07:19,584 DEBUG [c.c.a.ApiServlet] (catalina-exec-21:ctx-60c7d3d4 
ctx-a0298b0c ctx-9750e753) ===END===  5.172.233.323 -- GET  
account=client_3_1&apikey=nZsd2olHQnj4ApdsWyfmlp2nU0S2kib-gg1JBN6_nWy-h8rYg2o2p6LBRmidFJTkxKxYT_Eao6GquFIF62sdpRQ&command=deployVirtualMachine&diskofferingid=0bc04371-2d2d-4a52-8094-7f25abb1e32b&displayname=cadaver&domainid=6aef553f-aa33-4db2-815a-1b0f0b575645&name=cadaver&response=json&serviceofferingid=59bdsd4c6-9cca-4f35-a050-ac6b64c74cda&templateid=e873ac1f-b95b-48be-863e-0d81c5307995&zoneid=a85f1632-0718-4e67-b7c6-00d566121bf4&signature=qJHb2yDblfKlbAYWXXVTB9oc%2BHY%3D
2015-09-10 19:07:19,585 DEBUG [o.a.c.a.BaseCmd] 
(API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) Ignoring paremeter 
displayvm as the caller is not authorized to pass it in
2015-09-10 19:07:19,585 DEBUG [o.a.c.a.BaseCmd] 
(API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) Ignoring paremeter 
deploymentplanner as the caller is not authorized to pass it in
===

2015-09-10 19:07:19,846 WARN  [o.a.c.alerts] (API-Job-Executor-91:ctx-71d92d17 
job-754 ctx-38551c18)  alertType:: 8 // dataCenterId:: 1 // podId:: null // 
clusterId:: null // message:: Failed to deploy Vm with Id: 72, on Host with Id: 
null
2015-09-10 19:07:19,929 INFO  [o.a.c.a.c.u.v.DeployVMCmd] 
(API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) 
com.cloud.exception.InsufficientServerCapacityException: Unable to create a 
deployment for VM[User|i-6-72-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2015-09-10 19:07:19,929 INFO  [o.a.c.a.c.u.v.DeployVMCmd] 
(API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) Unable to create a 
deployment for VM[User|i-6-72-VM]
==

Can i get some help ? Thanks !


Regards,
Cristian

 

RE: listStoragePools does not exist or it is not available for user with id

[Somesh Naidu]

I hope you realize that this API is only available to ROOT Admin users.

Regards,
Somesh


-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net] 
Sent: Thursday, September 10, 2015 2:00 AM
To: users@cloudstack.apache.org
Cc: Cristian Ciobanu
Subject: Re: listStoragePools does not exist or it is not available for user 
with id

Cristian,

I see "4.5.2" in api call in log. Haven't noticed it before. I 
may only suggest to call the same function from UI with the same user ID 
and check log for correct API request parameters. I haven't been using 
API so much, but signature calculation was always problematic for me, so 
I copied it from the log.

Vadim.


> Cristian,
> 
> It would be nice to know which CS version do you use? :)
> 
> Vadim
> 
> On 2015-⁠09-⁠10 00:01, Cristian Ciobanu wrote:
> 
>> Hello,
>> 
>> I have the following issue when i call the API, can someone tell me 
>> what is wrong on my configuration ?
>> 
>> 2015-09-09 22:56:35,071 INFO [a.c.c.a.ApiServer] 
>> (catalina-exec-2:ctx-9f0b0be5 ctx-88500807 ctx-da66b9f0) (userId=4 
>> accountId=4 sessionId=null) 172.20.217.237 -- GET 
>> apikey=YldqK50HK18FPp4bGvUvO-0l4OFG67Bsa_BbpSWXH3sUPw7h7dbQVEzjil5yyYv41r9cReUr2cPXUi2bUHUx1g&command=listCapabilities&response=json&signature=5b9PvDifkSK2JB1WJ1ssaVq1v%2BM%3D
>>  
>> 200 
>> {"listcapabilitiesresponse":{"capability":{"securitygroupsenabled":false,"cloudstackversion":"4.5.2","userpublictemplateenabled":true,"supportELB":"false","projectinviterequired":false,"allowusercreateprojects":true,"customdiskofferingminsize":1,"customdiskofferingmaxsize":1024,"regionsecondaryenabled":false,"kvmsnapshotenabled":false}}}
>> 2015-09-09 22:56:35,089 INFO [a.c.c.a.ApiServer] 
>> (catalina-exec-4:ctx-eee702f9 ctx-da90e1a6) 172.20.217.237 -- GET 
>> apikey=YldqK50HK18FPp4bGvUvO-0l4OFG67Bsa_BbpSWXH3sUPw7h7dbQVEzjil5yyYv41r9cReUr2cPXUi2bUHUx1g&command=listStoragePools&response=json&signature=u9bX0SoqNm7wmO9uAln5YzAnTak%3D
>>  
>> 432 The given command:listStoragePools does not exist or it is not 
>> available for user with id:null
>> 
>> Thanks
>> 
>> Regards,
>> Cristian

RE: Unable to create a deployment for VM (Additional DATADISK - API-job)

[Somesh Naidu]

t;response":"json","ctxDetails":"{\"com.cloud.template.VirtualMachineTemplate\":\"e873ac1f-b95b-48be-863e-0d81c5307995\",\"com.cloud.vm.VirtualMachine\":\"8a736ca7-b5e6-423c-bb2c-2814d2b87925\",\"com.cloud.offering.DiskOffering\":\"db258461-8b03-4666-b6a8-d3459b0097ff\",\"com.cloud.domain.Domain\":\"c468ebec-2479-4897-a347-4bb96d63804d\",\"com.cloud.dc.DataCenter\":\"a85f1632-0718-4e67-b7c6-00d566121bf4\",\"com.cloud.offering.ServiceOffering\":\"526fe949-68cd-463f-b3ca-f042cbdd79f4\"}","name":"srv212","account":"client_3_1","uuid":"8a736ca7-b5e6-423c-bb2c-2814d2b87925","ctxAccountId":"8","diskofferingid":"db258461-8b03-4666-b6a8-d3459b0097ff","ctxStartEventId":"1809","signature":"U1xUQdOsJEstqVxFgzI5IYDItfI\u003d","displayname":"SRV212"},
 cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: 
null, initMsid: 14038006851726, completeMsid: null, lastUpdated: null, 
lastPolled: null, created: null}
2015-09-11 13:15:45,820 DEBUG [c.c.a.ApiServlet] (catalina-exec-3:ctx-cd5ff82c 
ctx-9c7257a8 ctx-06e84516) ===END===  172.10.10.221 -- GET  
account=client_3_1&apikey=oSiamYtTnncCNh8iJRiM-K5IpHqqJkryJiRSKKYCDkRoq9l_U0mzBGDQhGkYQ_pHBrrkNY0dM8B8t5gceov6MA&command=deployVirtualMachine&diskofferingid=db258461-8b03-4666-b6a8-d3459b0097ff&displayname=SRV212&domainid=c468ebec-2479-4897-a347-4bb96d63804d&name=srv212&response=json&serviceofferingid=526fe949-68cd-463f-b3ca-f042cbdd79f4&templateid=e873ac1f-b95b-48be-863e-0d81c5307995&zoneid=a85f1632-0718-4e67-b7c6-00d566121bf4&signature=U1xUQdOsJEstqVxFgzI5IYDItfI%3D


 

    Can you please let me know how can i solve this ?

  

Thanks!

Regards,
Cristian


 
On 9/10/2015 9:53:02 PM, Cristian Ciobanu  wrote:
Hello,

    Thanks for the help!

Regards,
Cristian



 
On 9/10/2015 9:34:18 PM, Somesh Naidu  wrote:
> 2015-09-10 19:07:19,638 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] 
> (API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) No storage pools 
> available for shared volume allocation, returning
> 2015-09-10 19:07:19,638 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] 
> (API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) 
> ZoneWideStoragePoolAllocator to find storage pool
> 2015-09-10 19:07:19,638 DEBUG [c.c.d.DeploymentPlanningManagerImpl] 
> (API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) No suitable pools 
> found for volume: Vol[99|vm=72|DATADISK] under cluster: 1
> 2015-09-10 19:07:19,638 DEBUG [c.c.d.DeploymentPlanningManagerImpl] 
> (API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) No suitable pools 
> found
> 2015-09-10 19:07:19,638 DEBUG [c.c.d.DeploymentPlanningManagerImpl] 
> (API-Job-Executor-91:ctx-71d92d17 job-754 ctx-38551c18) No suitable 
> storagePools found under this Cluster: 1

Looks like the service offering you are using has storage type set to shared 
while none exists.

Regards,
Somesh


-Original Message-
From: Cristian Ciobanu [mailto:cristian.c@istream.today]
Sent: Thursday, September 10, 2015 2:25 PM
To: users@cloudstack.apache.org
Subject: RE: Unable to create a deployment for VM (Additional DATADISK - 
API-job)

Hello,

   Thanks for answer and suggestion ( is a testing environment )

   Also i did a grep for the job-754, and i found more events about this 
problem ( I use CS 4.5.2 with KVM on CentOS-6.6, Local Storage enabled,basic 
network )

[root@mgcs management]# cat  *.log | grep job-754
2015-09-10 19:07:19,581 INFO  [o.a.c.f.j.i.AsyncJobMonitor] 
(API-Job-Executor-91:ctx-71d92d17 job-754) Add job-754 into job monitoring
2015-09-10 19:07:19,583 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(catalina-exec-21:ctx-60c7d3d4 ctx-a0298b0c ctx-9750e753) submit async job-754, 
details: AsyncJobVO {id:754, userId: 6, accountId: 6, instanceType: 
VirtualMachine, instanceId: 72, cmd: 
org.apache.cloudstack.api.command.user.vm.DeployVMCmd, cmdInfo: 
{"serviceofferingid":"59bdf4c6-9cca-4f35-a050-ac6b64c74cda","cmdEventType":"VM.CREATE","ctxUserId":"6","zoneid":"a85f1632-0718-4e67-b7c6-00d566121bf4","httpmethod":"GET","templateid":"e873ac1f-b95b-48be-863e-0d81c5307995","domainid":"6aef553f-aa33-4db2-815a-1b0f0b575645","apikey":"notherealapiyfmlp2nU0S2kib-gg1JBN6_nWy-h8rYg2o2p6LBRmidFJTkxKxYT_Eao6GquFIF62sdpRQ","id":"72","response":"json","ctxDetails":"{\"com.cloud.template.VirtualMachineTemplate\":\"e873ac1f-b95b-48be-863e-0d81c5307995\",\"com.cloud.vm.VirtualMachin

RE: Dynamic Scalable Template issue

[Somesh Naidu]

A similar issue is listed in CCP 4.5 release notes – look for 
“CS-27425/CS-21217”.

Somesh
CloudPlatform Escalations
Citrix Systems, Inc.

From: Todd Pigram [mailto:t...@toddpigram.com]
Sent: Wednesday, September 09, 2015 11:22 AM
To: CloudStack Users
Subject: Re: Dynamic Scalable Template issue

Well its seems to be a XS Tools issue. I am waiting to here back from support 
on the ‘Official’ word, but with the new tools installed and the Dynamic 
Scalable option set, I am currently running like I was before the upgrade to 
CCP 4.3.0.2.

At this point it is closed.

Thanks for the help.

Todd Pigram
http://about.me/ToddPigram
www.linkedin.com/in/toddpigram/
@pigram86 on twitter
https://plus.google.com/+ToddPigram86
Mobile - 216-224-5769

PGP Public Key

On Sep 9, 2015, at 10:53 AM, Vadim Kimlaychuk 
mailto:va...@kickcloud.net>> wrote:

Todd,

   Is VM guest shows the correct amount of RAM? Is this issue resolved?

Vadim.

On 2015-09-09 15:34, Todd Pigram wrote:


Vadium,
Yes to both with the new tools from XS62ESP1028. Both Windows and CentOS have 
'Dynamic Scalable' Option selected and in XenCenter they show the correct RAM.
Todd Pigram
http://about.me/ToddPigram [1]
www.linkedin.com/in/toddpigram/ [2] 
@pigram86 on twitter
https://plus.google.com/+ToddPigram86 [3] Mobile - 216-224-5769
PGP Public Key [4]
On Sep 9, 2015, at 2:49 AM, Vadim Kimlaychuk 
mailto:va...@kickcloud.net>> wrote:
Todd,
Have you tried to do the following manual tests on the cluster where you have 
problem:
1. Dynamically scalable with CentOS ?
2. Dynamically scalable with Windows ?
What do they show as available RAM?
Regards,
On 2015-09-08 19:44, Todd Pigram wrote:
Vadium,
After installing XS62ESP1028 via CLI (no reboot on hosts yet) and building an 
Centos65 instance w/o 'Dynamic Scalable' option checked, it showed right in 
XenCenter. I installed the new tools from (XS62ESP1028) and still good. I 
created a template from this instance. Deployed said template, and the memory 
is still good in XenCenter.
I tested on a Windows VM and it is the same with the new tools, however, as 
this particular tenant bypasses the virtual router, I have to reboot twice and 
reset networking as the new XenTools reset the networking stack.
Todd Pigram
http://about.me/ToddPigram [1] [1]
www.linkedin.com/in/toddpigram/ [2] [2] 
@pigram86 on twitter
https://plus.google.com/+ToddPigram86 [3] [3] Mobile - 216-224-5769
PGP Public Key [4]
On Sep 6, 2015, at 4:57 AM, Vadim Kimlaychuk 
mailto:va...@kickcloud.net>> wrote:
Todd,
Can you try Linux template with same dynamic scale option on the same pool? I 
wonder if there is a problem with Windows or any guest OS.
Regards,
Vadim.
On 2015-09-05 21:04, Todd Pigram wrote:
Vadium
That makes sense. I will see if I can replicate the issue in a lab. But given 
the holiday weekend, might not be until next week
On Saturday, September 5, 2015, Vadim Kimlaychuk 
mailto:va...@kickcloud.net>> wrote:
Todd,
I have seeing similar problem with Xen 4.1 (not XenServer). Linux guests were 
able to see (and use) entire host resources on any guest VM. That was a bug of 
configuration. If you think about what could be different after CS update - it 
could be VM registration procedure. Still guest VM should not be able to see 
static max. Your XenCenter shows that effective dynamic VM memory size is 8Gb 
while maximium is 32Gb. So CS configured VM guest correctly. This is problem of 
hypervisor <-> guest VM communitcation. That is why I asked you to try to 
register VM manually. I believe you will have the same result. Than means your 
server pool of XS62ESP1027 is broken. 3 other pools are not. I see no reason to 
update to 4.5.1, because I think this is not the problem of CS, but 
particularly this XenServer pool + this type of Windows guest (if other 
templates with dynamic offer are good).
Vadim.
On 2015-09-05 14:45, Todd Pigram wrote:
Vadim
I have 3 other pools (1 XS6.2sp1 and 2x xs65sp1) I have no issue with these.
Based on the Design doc, what i was experiencing is by design. Ok I will turn 
it off.
But now my question is, why on 4.3 I didn't have this issue but after 
installing 4.3.0.2 it changed.
Was 4.3 broken or is 4.3.0.2? Will upgrading to CCP 4.5.1 will be better?
If this is truely by design, I will not be able to use dynamic scalable for my 
windows instances
On Saturday, September 5, 2015, Vadim Kimlaychuk 
mailto:va...@kickcloud.net>> wrote:
Todd,
You may try to create VM at XenServer without CloudStack just using XE tool (or 
XenCenter). If your manually created VM with static max <> dynamic max will be 
OK, then there is a problem with Cloudstack.
Vadim.
On 2015-09-04 21:51, Todd Pigram wrote:
Latest as of XS62ESP1027. I know XS62ESP1028 comes with new XenTools.
On Friday, September 4, 2015, Vadim Kimlaychuk 
mailto:va...@kickcloud

RE: Dynamic Scalable Template issue

[Somesh Naidu]

Well, that defect is considered a doc defect from CCP/CS perspective so there 
are no code changes involved. After listing the limitation in the CCP 4.5 
release notes the defect is marked as fixed.

The behavior is controlled/affected by how XS DMC works and how Windows guests 
view available memory. Windows guests always see static-max whereas the usable 
memory (allowed by Xen) for the guest can never exceed dynamic-max. In case of 
dynamic scaling, CCP/CS sets static-max higher (4 times dynamic-min) than 
dynamic-max. The memory represented by static-max – dynamic-max is occupied by 
XS balloon driver (contained in the XS tools) which inflates/deflates based on 
dynamic memory scaling requests.

Essentially, what Windows guests reports as available memory is incorrect. The 
functionality itself isn’t affected, that is, the actual memory available to 
the Windows guest is correct.

Somesh
CloudPlatform Escalations
Citrix Systems, Inc.

From: Todd Pigram [mailto:t...@toddpigram.com]
Sent: Tuesday, September 15, 2015 11:33 AM
To: Somesh Naidu
Cc: CloudStack Users
Subject: Re: Dynamic Scalable Template issue

Is this fixed in 4.5.1 as the issue is not listed in the release notes under 
CS-27425/CS-21217?

As a FYI, on the one VM the new tools worked but not on any others. I had to 
set ‘enable.dynamic.scale.vm’ to false, restart management service. Then I have 
to shutdown the instance. then start, to get the right memory. A reboot doesn’t 
fix it.



Todd Pigram
http://about.me/ToddPigram
www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/>
@pigram86 on twitter
https://plus.google.com/+ToddPigram86
Mobile - 216-224-5769

PGP Public Key<http://pgp.mit.edu/pks/lookup?op=get&search=0x96B7B0F0C55933BB>

On Sep 15, 2015, at 11:11 AM, Somesh Naidu 
mailto:somesh.na...@citrix.com>> wrote:

A similar issue is listed in CCP 4.5 release notes – look for 
“CS-27425/CS-21217”.

Somesh
CloudPlatform Escalations
Citrix Systems, Inc.

From: Todd Pigram [mailto:t...@toddpigram.com]
Sent: Wednesday, September 09, 2015 11:22 AM
To: CloudStack Users
Subject: Re: Dynamic Scalable Template issue

Well its seems to be a XS Tools issue. I am waiting to here back from support 
on the ‘Official’ word, but with the new tools installed and the Dynamic 
Scalable option set, I am currently running like I was before the upgrade to 
CCP 4.3.0.2.

At this point it is closed.

Thanks for the help.

Todd Pigram
http://about.me/ToddPigram
www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/%3chttp:/www.linkedin.com/in/toddpigram/>>
@pigram86 on twitter
https://plus.google.com/+ToddPigram86
Mobile - 216-224-5769

PGP Public Key<http://pgp.mit.edu/pks/lookup?op=get&search=0x96B7B0F0C55933BB>

On Sep 9, 2015, at 10:53 AM, Vadim Kimlaychuk 
mailto:va...@kickcloud.net<mailto:va...@kickcloud.net%3cmailto:va...@kickcloud.net>>>
 wrote:

Todd,

  Is VM guest shows the correct amount of RAM? Is this issue resolved?

Vadim.

On 2015-09-09 15:34, Todd Pigram wrote:


Vadium,
Yes to both with the new tools from XS62ESP1028. Both Windows and CentOS have 
'Dynamic Scalable' Option selected and in XenCenter they show the correct RAM.
Todd Pigram
http://about.me/ToddPigram [1]
www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/%3chttp:/www.linkedin.com/in/toddpigram/>>
 [2] @pigram86 on twitter
https://plus.google.com/+ToddPigram86 [3] Mobile - 216-224-5769
PGP Public Key [4]
On Sep 9, 2015, at 2:49 AM, Vadim Kimlaychuk 
mailto:va...@kickcloud.net<mailto:va...@kickcloud.net%3cmailto:va...@kickcloud.net>>>
 wrote:
Todd,
Have you tried to do the following manual tests on the cluster where you have 
problem:
1. Dynamically scalable with CentOS ?
2. Dynamically scalable with Windows ?
What do they show as available RAM?
Regards,
On 2015-09-08 19:44, Todd Pigram wrote:
Vadium,
After installing XS62ESP1028 via CLI (no reboot on hosts yet) and building an 
Centos65 instance w/o 'Dynamic Scalable' option checked, it showed right in 
XenCenter. I installed the new tools from (XS62ESP1028) and still good. I 
created a template from this instance. Deployed said template, and the memory 
is still good in XenCenter.
I tested on a Windows VM and it is the same with the new tools, however, as 
this particular tenant bypasses the virtual router, I have to reboot twice and 
reset networking as the new XenTools reset the networking stack.
Todd Pigram
http://about.me/ToddPigram [1] [1]
www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/%3chttp:/www.linkedin.com/in/toddpigram/>>
 [2] [2] @pigram86 on twitter
https://plus.google.com/+ToddPigram86 [3] [3] Mobile - 216-224-5769
PGP Public Key [4]
On Sep 6, 2015, at 4:57 AM, Vadim Kimlaychuk 
mailto:va...@kickcloud.net<ma

RE: Dynamic Scalable Template issue

[Somesh Naidu]

I believe XS does not allocate more than the dynamic-max to the VM. That task 
manger, perfmon, etc. would report incorrect memory usage.

One way to find out how much memory is available to the Windows guest is 
running the following in a powershell (with admin privilege):
$a = gwmi -n root\wmi -cl CitrixXenStoreSession
$a[0].getvalue("memory/target").value

The value returned would represent “real” amount of memory (in KB) available to 
Windows guest.

Regards,
Somesh

From: Todd Pigram [mailto:t...@toddpigram.com]
Sent: Tuesday, September 15, 2015 4:26 PM
To: Somesh Naidu
Cc: CloudStack Users
Subject: Re: Dynamic Scalable Template issue

I understand this but in the case of MS SQL it will use all the memory that is 
available to Windows. As in my case a DDC with SQL was using 31.5gb of ram 
while looking in perfmon. But the system offering was limited to 8GB.

Basically Dynamic Scales works but is bad for SQL servers. I just turned it off.

On Tuesday, September 15, 2015, Somesh Naidu 
mailto:somesh.na...@citrix.com>> wrote:
Well, that defect is considered a doc defect from CCP/CS perspective so there 
are no code changes involved. After listing the limitation in the CCP 4.5 
release notes the defect is marked as fixed.

The behavior is controlled/affected by how XS DMC works and how Windows guests 
view available memory. Windows guests always see static-max whereas the usable 
memory (allowed by Xen) for the guest can never exceed dynamic-max. In case of 
dynamic scaling, CCP/CS sets static-max higher (4 times dynamic-min) than 
dynamic-max. The memory represented by static-max – dynamic-max is occupied by 
XS balloon driver (contained in the XS tools) which inflates/deflates based on 
dynamic memory scaling requests.

Essentially, what Windows guests reports as available memory is incorrect. The 
functionality itself isn’t affected, that is, the actual memory available to 
the Windows guest is correct.

Somesh
CloudPlatform Escalations
Citrix Systems, Inc.

From: Todd Pigram 
[mailto:t...@toddpigram.com]
Sent: Tuesday, September 15, 2015 11:33 AM
To: Somesh Naidu
Cc: CloudStack Users
Subject: Re: Dynamic Scalable Template issue

Is this fixed in 4.5.1 as the issue is not listed in the release notes under 
CS-27425/CS-21217?

As a FYI, on the one VM the new tools worked but not on any others. I had to 
set ‘enable.dynamic.scale.vm’ to false, restart management service. Then I have 
to shutdown the instance. then start, to get the right memory. A reboot doesn’t 
fix it.



Todd Pigram
http://about.me/ToddPigram
www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/>
@pigram86 on twitter
https://plus.google.com/+ToddPigram86
Mobile - 216-224-5769

PGP Public Key<http://pgp.mit.edu/pks/lookup?op=get&search=0x96B7B0F0C55933BB>

On Sep 15, 2015, at 11:11 AM, Somesh Naidu 
>
 wrote:

A similar issue is listed in CCP 4.5 release notes – look for 
“CS-27425/CS-21217”.

Somesh
CloudPlatform Escalations
Citrix Systems, Inc.

From: Todd Pigram 
[mailto:t...@toddpigram.com]
Sent: Wednesday, September 09, 2015 11:22 AM
To: CloudStack Users
Subject: Re: Dynamic Scalable Template issue

Well its seems to be a XS Tools issue. I am waiting to here back from support 
on the ‘Official’ word, but with the new tools installed and the Dynamic 
Scalable option set, I am currently running like I was before the upgrade to 
CCP 4.3.0.2.

At this point it is closed.

Thanks for the help.

Todd Pigram
http://about.me/ToddPigram
www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/%3chttp:/www.linkedin.com/in/toddpigram/>>
@pigram86 on twitter
https://plus.google.com/+ToddPigram86
Mobile - 216-224-5769

PGP Public Key<http://pgp.mit.edu/pks/lookup?op=get&search=0x96B7B0F0C55933BB>

On Sep 9, 2015, at 10:53 AM, Vadim Kimlaychuk 
mailto:va...@kickcloud.netmailto:va...@kickcloud.net');>>>
 wrote:

Todd,

  Is VM guest shows the correct amount of RAM? Is this issue resolved?

Vadim.

On 2015-09-09 15:34, Todd Pigram wrote:


Vadium,
Yes to both with the new tools from XS62ESP1028. Both Windows and CentOS have 
'Dynamic Scalable' Option selected and in XenCenter they show the correct RAM.
Todd Pigram
http://about.me/ToddPigram [1]
www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/<http://www.linkedin.com/in/toddpigram/%3chttp:/www.linkedin.com/in/toddpigram/>>
 [2] @pigram86 on twitter
https://plus.google.com/+ToddPigram86 [3] Mobile - 216-224-5769
PGP Public Key [4]
On Sep 9, 2015, at 2:49 AM, Vadim Kimlaychuk 
mailto:va...@kickcloud.netmailto:va...@kickcloud.net');>>>
 wrote:
Todd,
Have you tried to do the following manual tests on the cluster where you have 
problem:
1. Dynamically scalable with CentOS ?
2. Dynamically scalable with Windows ?
What do they show as available RAM?
Regards,
On 2015-09-08 19:44, Todd Pigram wrote:
V

RE: unable to copy template to primary storage

[Somesh Naidu]

Yesid, please paste the complete exception stack. Alternately, you could always 
raise a support ticket with Citrix.

Regards,
Somesh

From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Wednesday, September 30, 2015 6:12 PM
To: users@cloudstack.apache.org
Subject: unable to copy template to primary storage

Hello guys, I have a problem with CloudPlatform 4.3.2, not possible copy the 
template and the system vm not have operation system, we have Vcenter  5.5 and 
ESXi 5.5, please help me with this error

ERROR [c.c.s.r.VmwareStorageProcessor] Unable to copy template to primary 
storage due to exception:Exception: java.lang.NullPointerException

thanks



Cordialmente / Best regards,





Yesid Mora | Orchestration Engineer | O4IT


PBX:+57 (1) 423-5460  Ext  251  | Cel: 3124509565


Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia


www.o4it.com | ym...@o4it.com




[http://www.o4it.com][http://www.linkedin.com/company/1207504][https://twitter.com/o4it][https://www.facebook.com/o4itofficial][https://www.youtube.com/user/o4itofficial]





CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for 
the sole use of the intended recipient(s) and may contain confidential or 
proprietary information. Any unauthorized review, use, disclosure or 
distribution is prohibited. If you are not the intended recipient, immediately 
contact the sender by reply e-mail and destroy all copies of the original 
message.

RE: unable to copy template to primary storage

[Somesh Naidu]

> additionally the product is CloudStack
Ok.

> System vm template is not ready at data center 1, wait until it is ready to 
> launch secondary storage vm
The logs suggests the template is not yet ready on the secondary storage. Can 
you check if the template is downloaded on the secondary storage, look at the 
table template_store_ref.

Regards,
Somesh

-Original Message-
From: Yesid Mora [mailto:ym...@o4it.com] 
Sent: Wednesday, September 30, 2015 6:27 PM
To: users@cloudstack.apache.org
Subject: RE: unable to copy template to primary storage

Hello in this moment we delete the secondary storage and add again but the 
error is different, whe check the table template_spool_ref and inform that the 
template is downloaded but the template not have in the UI templates, how can 
launch again the downladed template, additionally the product is CloudStack, 
thanks

2015-09-30 18:24:23,651 DEBUG [c.c.c.ConsoleProxyManagerImpl] 
(consoleproxy-1:ctx-83f9f66f) Zone 1 is not ready to launch console proxy yet
2015-09-30 18:24:23,914 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] 
(secstorage-1:ctx-4ee93080) System vm template is not ready at data center 1, 
wait until it is ready to launch secondary storage vm
2015-09-30 18:24:23,914 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] 
(secstorage-1:ctx-4ee93080) Zone 1 is not ready to launch secondary storage VM 
yet
2015-09-30 18:24:31,293 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:ctx-55143ea1) Found 0 routers to update status.
2015-09-30 18:24:31,294 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] 
(RouterStatusMonitor-1:ctx-55143ea1) Found 0 networks to update RvR status.
2015-09-30 18:24:31,354 DEBUG [c.c.a.AlertManagerImpl] 
(CapacityChecker:ctx-947ab22f) Running Capacity Checker ...
2015-09-30 18:24:31,354 DEBUG [c.c.a.AlertManagerImpl] 
(CapacityChecker:ctx-947ab22f) recalculating system capacity
2015-09-30 18:24:31,354 DEBUG [c.c.a.AlertManagerImpl] 
(CapacityChecker:ctx-947ab22f) Executing cpu/ram capacity update
2015-09-30 18:24:31,358 DEBUG [c.c.c.CapacityManagerImpl] 
(CapacityChecker:ctx-947ab22f) Found 0 VMs on host 1
2015-09-30 18:24:31,360 DEBUG [c.c.c.CapacityManagerImpl] 
(CapacityChecker:ctx-947ab22f) Found 0 VM, not running on host 1
2015-09-30 18:24:31,361 DEBUG [c.c.c.CapacityManagerImpl] 
(CapacityChecker:ctx-947ab22f) No need to calibrate cpu capacity, host:1 
usedCpu: 0 reservedCpu: 0
2015-09-30 18:24:31,361 DEBUG [c.c.c.CapacityManagerImpl] 
(CapacityChecker:ctx-947ab22f) No need to calibrate memory capacity, host:1 
usedMem: 0 reservedMem: 0
2015-09-30 18:24:31,363 DEBUG [c.c.d.DeploymentPlanningManagerImpl] 
(HostReservationReleaseChecker:ctx-d2f93112) Checking if any host reservation 
can be released ...
2015-09-30 18:24:31,364 DEBUG [c.c.d.DeploymentPlanningManagerImpl] 
(HostReservationReleaseChecker:ctx-d2f93112) Done running 
HostReservationReleaseChecker ...
2015-09-30 18:24:31,365 DEBUG [c.c.c.CapacityManagerImpl] 
(CapacityChecker:ctx-947ab22f) Found 0 VMs on host 2
2015-09-30 18:24:31,370 DEBUG [c.c.c.CapacityManagerImpl] 
(CapacityChecker:ctx-947ab22f) Found 0 VM, not running on host 2
2015-09-30 18:24:31,372 DEBUG [c.c.c.CapacityManagerImpl] 
(CapacityChecker:ctx-947ab22f) No need to calibrate cpu capacity, host:2 
usedCpu: 0 reservedCpu: 0
2015-09-30 18:24:31,372 DEBUG [c.c.c.CapacityManagerImpl] 
(CapacityChecker:ctx-947ab22f) No need to calibrate memory capacity, host:2 
usedMem: 0 reservedMem: 0
2015-09-30 18:24:31,372 DEBUG [c.c.a.AlertManagerImpl] 
(CapacityChecker:ctx-947ab22f) Done executing cpu/ram capacity update
2015-09-30 18:24:31,373 DEBUG [c.c.a.AlertManagerImpl] 
(CapacityChecker:ctx-947ab22f) Executing storage capacity update



Cordialmente,

Yesid Mora | Orchestration Engineer | O4IT
PBX: 251 Ext +57 (1) 423-5460 | Cel: 3124509565
Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia
http://www.o4it.com | mailto:ym...@o4it.com



-Original Message-----
From: Somesh Naidu [mailto:somesh.na...@citrix.com]
Sent: Wednesday, September 30, 2015 5:17 PM
To: users@cloudstack.apache.org
Subject: RE: unable to copy template to primary storage

Yesid, please paste the complete exception stack. Alternately, you could always 
raise a support ticket with Citrix.

Regards,
Somesh

From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Wednesday, September 30, 2015 6:12 PM
To: users@cloudstack.apache.org
Subject: unable to copy template to primary storage

Hello guys, I have a problem with CloudPlatform 4.3.2, not possible copy the 
template and the system vm not have operation system, we have Vcenter  5.5 and 
ESXi 5.5, please help me with this error

ERROR [c.c.s.r.VmwareStorageProcessor] Unable to copy template to primary 
storage due to exception:Exception: java.lang.NullPointerException

thanks



Cordialmente / Best regards,





Yesid Mora | Orchestration Engineer | O4IT


PBX:+57 (1) 423-5460  Ext  251  | Cel: 3124509565


Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia


www.o4it

RE: unable to copy template to primary storage

[Somesh Naidu]

Yesid, the pictures can’t be attached to the emails to this DL so you’d have to 
upload it and share the link.

Looking at the error, copy command is failing meaning copy from secondary to 
primary. There are multiple reasons including command is timing out. I can’t be 
sure without looking at the complete logs.

Also, you mention that a CPVM and SSVM show up in vCenter. I would assume that 
these VMs are leftovers from previous install or attempts. Try matching the VM 
name/ID with that in CS DB. If they are not the same then go ahead and remove 
these VMs from vCenter.

Regards,
Somesh

From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Wednesday, September 30, 2015 6:56 PM
To: users@cloudstack.apache.org
Subject: RE: unable to copy template to primary storage

Hello, additionally I check the task in vcenter and exist this error
[cid:image001.png@01D0FBA9.46894370]




Cordialmente / Best regards,





Yesid Mora | Orchestration Engineer | O4IT


PBX:+57 (1) 423-5460  Ext  251  | Cel: 3124509565


Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia


www.o4it.com<http://www.o4it.com> | ym...@o4it.com<mailto:ym...@o4it.com>




[http://www.o4it.com]<http://www.o4it.com>[http://www.linkedin.com/company/1207504]<http://www.linkedin.com/company/1207504>[https://twitter.com/o4it]<https://twitter.com/o4it>[https://www.facebook.com/o4itofficial]<https://www.facebook.com/o4itofficial>[https://www.youtube.com/user/o4itofficial]<https://www.youtube.com/user/o4itofficial>





CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for 
the sole use of the intended recipient(s) and may contain confidential or 
proprietary information. Any unauthorized review, use, disclosure or 
distribution is prohibited. If you are not the intended recipient, immediately 
contact the sender by reply e-mail and destroy all copies of the original 
message.







From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Wednesday, September 30, 2015 5:53 PM
To: users@cloudstack.apache.org
Subject: unable to copy template to primary storage


Hello Somesh, thanks for your comments, I check the table and the template is 
downloaded and again have error with the unable copy template but I check the 
vcenter exist two vm create for CPVM and SSVM but I check vm not have operation 
system and error is :



2015-09-30 18:49:33,234 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-170:ctx-794548c7) Seq 2-620101715: Executing request

2015-09-30 18:49:33,235 INFO  [c.c.h.v.u.VmwareContextPool] 
(DirectAgent-170:ctx-794548c7 10.112.3.2) Return a VmwareContext from the idle 
pool: corp\icf@10.112.3.250. current pool size: 1, outstanding count: 3

2015-09-30 18:49:33,266 ERROR [c.c.s.r.VmwareStorageProcessor] 
(DirectAgent-170:ctx-794548c7 10.112.3.2) Unable to copy template to primary 
storage due to exception:Exception: java.lang.NullPointerException

2015-09-30 18:49:33,266 INFO  [c.c.h.v.u.VmwareContextPool] 
(DirectAgent-170:ctx-794548c7 10.112.3.2) Recycle VmwareContext into idle pool: 
corp\icf@10.112.3.250, current idle pool size: 2, outstanding count: 3

2015-09-30 18:49:33,266 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-170:ctx-794548c7) Seq 2-620101715: Response Received:

2015-09-30 18:49:33,267 DEBUG [c.c.a.t.Request] (DirectAgent-170:ctx-794548c7) 
Seq 2-620101715: Processing:  { Ans: , MgmtId: 345050522867, via: 2, Ver: v1, 
Flags: 10, 
[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Unable
 to copy template to primary storage due to exception:Exception: 
java.lang.NullPointerException\nMessage: null\n","wait":0}}] }



[cid:image001.png@01D0FBA8.D4EF1460]





Cordialmente / Best regards,





Yesid Mora | Orchestration Engineer | O4IT


PBX:+57 (1) 423-5460  Ext  251  | Cel: 3124509565


Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia


www.o4it.com<http://www.o4it.com> | ym...@o4it.com<mailto:ym...@o4it.com>




[http://www.o4it.com]<http://www.o4it.com>[http://www.linkedin.com/company/1207504]<http://www.linkedin.com/company/1207504>[https://twitter.com/o4it]<https://twitter.com/o4it>[https://www.facebook.com/o4itofficial]<https://www.facebook.com/o4itofficial>[https://www.youtube.com/user/o4itofficial]<https://www.youtube.com/user/o4itofficial>





CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for 
the sole use of the intended recipient(s) and may contain confidential or 
proprietary information. Any unauthorized review, use, disclosure or 
distribution is prohibited. If you are not the intended recipient, immediately 
contact the sender by reply e-mail and destroy all copies of the original 
message.








-Original Message-
From: Somesh Naidu [mailto:somesh.na...@citrix.com]
Sent: Wednesday, September 30, 2015 5:42 PM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: RE: unable to c

RE: unable to copy template to primary storage

[Somesh Naidu]

Also, if you google "Unable to copy template to primary storage due to 
exception:Exception: java.lang.NullPointerException" you will find a lot of 
known issues that you can take a hint from and verify if you are hitting any of 
those known issues.

Regards,
Somesh

-Original Message-----
From: Somesh Naidu [mailto:somesh.na...@citrix.com] 
Sent: Wednesday, September 30, 2015 7:03 PM
To: users@cloudstack.apache.org
Subject: RE: unable to copy template to primary storage

Yesid, the pictures can’t be attached to the emails to this DL so you’d have to 
upload it and share the link.

Looking at the error, copy command is failing meaning copy from secondary to 
primary. There are multiple reasons including command is timing out. I can’t be 
sure without looking at the complete logs.

Also, you mention that a CPVM and SSVM show up in vCenter. I would assume that 
these VMs are leftovers from previous install or attempts. Try matching the VM 
name/ID with that in CS DB. If they are not the same then go ahead and remove 
these VMs from vCenter.

Regards,
Somesh

From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Wednesday, September 30, 2015 6:56 PM
To: users@cloudstack.apache.org
Subject: RE: unable to copy template to primary storage

Hello, additionally I check the task in vcenter and exist this error
[cid:image001.png@01D0FBA9.46894370]




Cordialmente / Best regards,





Yesid Mora | Orchestration Engineer | O4IT


PBX:+57 (1) 423-5460  Ext  251  | Cel: 3124509565


Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia


www.o4it.com<http://www.o4it.com> | ym...@o4it.com<mailto:ym...@o4it.com>




[http://www.o4it.com]<http://www.o4it.com>[http://www.linkedin.com/company/1207504]<http://www.linkedin.com/company/1207504>[https://twitter.com/o4it]<https://twitter.com/o4it>[https://www.facebook.com/o4itofficial]<https://www.facebook.com/o4itofficial>[https://www.youtube.com/user/o4itofficial]<https://www.youtube.com/user/o4itofficial>





CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for 
the sole use of the intended recipient(s) and may contain confidential or 
proprietary information. Any unauthorized review, use, disclosure or 
distribution is prohibited. If you are not the intended recipient, immediately 
contact the sender by reply e-mail and destroy all copies of the original 
message.







From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Wednesday, September 30, 2015 5:53 PM
To: users@cloudstack.apache.org
Subject: unable to copy template to primary storage


Hello Somesh, thanks for your comments, I check the table and the template is 
downloaded and again have error with the unable copy template but I check the 
vcenter exist two vm create for CPVM and SSVM but I check vm not have operation 
system and error is :



2015-09-30 18:49:33,234 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-170:ctx-794548c7) Seq 2-620101715: Executing request

2015-09-30 18:49:33,235 INFO  [c.c.h.v.u.VmwareContextPool] 
(DirectAgent-170:ctx-794548c7 10.112.3.2) Return a VmwareContext from the idle 
pool: corp\icf@10.112.3.250. current pool size: 1, outstanding count: 3

2015-09-30 18:49:33,266 ERROR [c.c.s.r.VmwareStorageProcessor] 
(DirectAgent-170:ctx-794548c7 10.112.3.2) Unable to copy template to primary 
storage due to exception:Exception: java.lang.NullPointerException

2015-09-30 18:49:33,266 INFO  [c.c.h.v.u.VmwareContextPool] 
(DirectAgent-170:ctx-794548c7 10.112.3.2) Recycle VmwareContext into idle pool: 
corp\icf@10.112.3.250, current idle pool size: 2, outstanding count: 3

2015-09-30 18:49:33,266 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-170:ctx-794548c7) Seq 2-620101715: Response Received:

2015-09-30 18:49:33,267 DEBUG [c.c.a.t.Request] (DirectAgent-170:ctx-794548c7) 
Seq 2-620101715: Processing:  { Ans: , MgmtId: 345050522867, via: 2, Ver: v1, 
Flags: 10, 
[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Unable
 to copy template to primary storage due to exception:Exception: 
java.lang.NullPointerException\nMessage: null\n","wait":0}}] }



[cid:image001.png@01D0FBA8.D4EF1460]





Cordialmente / Best regards,





Yesid Mora | Orchestration Engineer | O4IT


PBX:+57 (1) 423-5460  Ext  251  | Cel: 3124509565


Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia


www.o4it.com<http://www.o4it.com> | ym...@o4it.com<mailto:ym...@o4it.com>




[http://www.o4it.com]<http://www.o4it.com>[http://www.linkedin.com/company/1207504]<http://www.linkedin.com/company/1207504>[https://twitter.com/o4it]<https://twitter.com/o4it>[https://www.facebook.com/o4itofficial]<https://www.facebook.com/o4itofficial>[https://www.youtube.com/user/o4itofficial]<https://www.youtube.com/user/o4itofficial>





CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for 
the sole use of the intended recipient(s) and m

RE: unable to copy template to primary storage

[Somesh Naidu]

So the operation did timeout on VMware as I suspected and the managed object no 
longer exists hence the NPE. What version of Cloudstack (preferably send the 
output of cloudstack-sccs) and VMware are you using?

Regards,
Somesh

-Original Message-
From: Yesid Mora [mailto:ym...@o4it.com] 
Sent: Wednesday, September 30, 2015 7:14 PM
To: users@cloudstack.apache.org
Subject: unable to copy template to primary storage

Hello Somesh, thanks I upload the picture and logs to this link if possible 
your check I would be very grateful, thanks

https://www.dropbox.com/sh/ia28zpsjptx4wrq/AADxPeI3Yh7VBFmzZp5mev57a?dl=0



Cordialmente,

Yesid Mora | Orchestration Engineer | O4IT
PBX: 251 Ext +57 (1) 423-5460 | Cel: 3124509565
Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia
http://www.o4it.com | mailto:ym...@o4it.com



-Original Message-
From: Somesh Naidu [mailto:somesh.na...@citrix.com]
Sent: Wednesday, September 30, 2015 6:07 PM
To: users@cloudstack.apache.org
Subject: RE: unable to copy template to primary storage

Also, if you google "Unable to copy template to primary storage due to 
exception:Exception: java.lang.NullPointerException" you will find a lot of 
known issues that you can take a hint from and verify if you are hitting any of 
those known issues.

Regards,
Somesh

-Original Message-----
From: Somesh Naidu [mailto:somesh.na...@citrix.com]
Sent: Wednesday, September 30, 2015 7:03 PM
To: users@cloudstack.apache.org
Subject: RE: unable to copy template to primary storage

Yesid, the pictures can’t be attached to the emails to this DL so you’d have to 
upload it and share the link.

Looking at the error, copy command is failing meaning copy from secondary to 
primary. There are multiple reasons including command is timing out. I can’t be 
sure without looking at the complete logs.

Also, you mention that a CPVM and SSVM show up in vCenter. I would assume that 
these VMs are leftovers from previous install or attempts. Try matching the VM 
name/ID with that in CS DB. If they are not the same then go ahead and remove 
these VMs from vCenter.

Regards,
Somesh

From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Wednesday, September 30, 2015 6:56 PM
To: users@cloudstack.apache.org
Subject: RE: unable to copy template to primary storage

Hello, additionally I check the task in vcenter and exist this error 
[cid:image001.png@01D0FBA9.46894370]




Cordialmente / Best regards,





Yesid Mora | Orchestration Engineer | O4IT


PBX:+57 (1) 423-5460  Ext  251  | Cel: 3124509565


Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia


www.o4it.com<http://www.o4it.com> | ym...@o4it.com<mailto:ym...@o4it.com>




[http://www.o4it.com]<http://www.o4it.com>[http://www.linkedin.com/company/1207504]<http://www.linkedin.com/company/1207504>[https://twitter.com/o4it]<https://twitter.com/o4it>[https://www.facebook.com/o4itofficial]<https://www.facebook.com/o4itofficial>[https://www.youtube.com/user/o4itofficial]<https://www.youtube.com/user/o4itofficial>





CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for 
the sole use of the intended recipient(s) and may contain confidential or 
proprietary information. Any unauthorized review, use, disclosure or 
distribution is prohibited. If you are not the intended recipient, immediately 
contact the sender by reply e-mail and destroy all copies of the original 
message.







From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Wednesday, September 30, 2015 5:53 PM
To: users@cloudstack.apache.org
Subject: unable to copy template to primary storage


Hello Somesh, thanks for your comments, I check the table and the template is 
downloaded and again have error with the unable copy template but I check the 
vcenter exist two vm create for CPVM and SSVM but I check vm not have operation 
system and error is :



2015-09-30 18:49:33,234 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-170:ctx-794548c7) Seq 2-620101715: Executing request

2015-09-30 18:49:33,235 INFO  [c.c.h.v.u.VmwareContextPool] 
(DirectAgent-170:ctx-794548c7 10.112.3.2) Return a VmwareContext from the idle 
pool: corp\icf@10.112.3.250. current pool size: 1, outstanding count: 3

2015-09-30 18:49:33,266 ERROR [c.c.s.r.VmwareStorageProcessor] 
(DirectAgent-170:ctx-794548c7 10.112.3.2) Unable to copy template to primary 
storage due to exception:Exception: java.lang.NullPointerException

2015-09-30 18:49:33,266 INFO  [c.c.h.v.u.VmwareContextPool] 
(DirectAgent-170:ctx-794548c7 10.112.3.2) Recycle VmwareContext into idle pool: 
corp\icf@10.112.3.250, current idle pool size: 2, outstanding count: 3

2015-09-30 18:49:33,266 DEBUG [c.c.a.m.DirectAgentAttache] 
(DirectAgent-170:ctx-794548c7) Seq 2-620101715: Response Received:

2015-09-30 18:49:33,267 DEBUG [c.c.a.t.Request] (DirectAgent-170:ctx-794548c7) 
Seq 2-620101715: Processing:  { Ans: , MgmtId: 345050522867, via: 2, Ver: v1, 
Flags: 10, 
[{"org.apache.cloudstack.storage.command.

RE: table cloud.template_store_ref

[Somesh Naidu]

Does not look like vSphere/vCenter 5.5 is supported with 4.3 
(http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.3/hypervisor_installation.html#vmware-vsphere-installation-and-configuration).

Did you correctly prepare the system VM template on the secondary storage? 
Also, have you ensured that mgmt server has no trouble with connecting/mounting 
the secondary storage?

Regards,
Somesh


-Original Message-
From: Yesid Mora [mailto:ym...@o4it.com] 
Sent: Thursday, October 01, 2015 3:52 AM
To: users@cloudstack.apache.org
Subject: table cloud.template_store_ref

Hello, Vadim, sorry the version is 4.3.2 CS, additionally please confirm if 
compatibility this version with vcenter 5.5 and ESXi 5.5, thanks



Cordialmente,

Yesid Mora | Orchestration Engineer | O4IT
PBX: 251 Ext +57 (1) 423-5460 | Cel: 3124509565
Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia
http://www.o4it.com | mailto:ym...@o4it.com



-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: Thursday, October 01, 2015 2:43 AM
To: users@cloudstack.apache.org
Cc: Yesid Mora
Subject: Re: table cloud.template_store_ref

Dear Yesid,

   Are you sure that CS version is 3.4.2 ?  I wasn't able to find such number 
in the history
   Anyway, everyone else will ask for management server log. Can you drop it 
here?

Regards,

Vadim.

On 2015-10-01 09:37, Yesid Mora wrote:

> Hello, I have a problem with template system vm, I check table
> cloud.template_store_ref and inform that the template is downloaded
> but the size is 0 and the install path inform that is
> template/tmpl/1/8 and no more, the version is cloudstacl 3.4.2 esxi
> 5.5, please collaboration guys, thanks
>
> CORDIALMENTE / BEST REGARDS,
>
> Yesid Mora | Orchestration Engineer | O4IT
>
> PBX:+57 (1) 423-5460 Ext 251 | Cel: 3124509565
>
> Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia
>
> www.o4it.com [1] | ym...@o4it.com
>
> [1] [2] [3] [4] [5]
>
> CONFIDENTIALITY NOTICE: This e-mail message, including any
> attachments, is for the sole use of the intended recipient(s) and may
> contain confidential or proprietary information. Any unauthorized
> review, use, disclosure or distribution is prohibited. If you are not
> the intended recipient, immediately contact the sender by reply e-mail
> and destroy all copies of the original message.

RE: table cloud.template_store_ref

[Somesh Naidu]

If you are referring to pre-seeding the template to primary storage (from 
secondary) then you may use the prepareTemplate API 
(https://cloudstack.apache.org/api/apidocs-4.5/root_admin/prepareTemplate.html).
 Note, the template must already be downloaded on the secondary storage.

Regards,
Somesh

-Original Message-
From: Yesid Mora [mailto:ym...@o4it.com] 
Sent: Wednesday, October 07, 2015 3:19 PM
To: users@cloudstack.apache.org
Subject: RE: table cloud.template_store_ref

Thanks, Timothy, I download the template and public in local server but 
generate the same error, you can confirm the command for copy the template to 
primary storage


Thanks



Cordialmente,

Yesid Mora | Orchestration Engineer | O4IT
PBX: 251 Ext +57 (1) 423-5460 | Cel: 3124509565
Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia
http://www.o4it.com | mailto:ym...@o4it.com



-Original Message-
From: Timothy Lothering [mailto:tlother...@datacentrix.co.za]
Sent: Thursday, October 01, 2015 7:04 PM
To: users@cloudstack.apache.org
Subject: RE: table cloud.template_store_ref

Hi Yesid,

We have Citrix CP 4.3.0.2 running on vCenter/ESXi 5.5. No issues yet (10 months 
and going)

Try to re-download the SystemVM template. Worst case, manually download the 
SystemVM template for VMware to a local Web Server, publish the .ISO, 
re-download from local Web Server to the Secondary Storage.

Kind Regards,

Timothy Lothering
Timothy Lothering
Solutions Architect
Managed Services

T: +27877415535
F: +27877415100
C: +27824904099
E: tlother...@datacentrix.co.za


DISCLAIMER NOTICE:

Everything in this e-mail and any attachments relating to the official business 
of Datacentrix Holdings Ltd. and its subsidiaries
('Datacentrix') is proprietary to Datacentrix. It is confidential, legally 
privileged and protected by law. Datacentrix does not own and endorse any other 
content. Views and opinions are those of the sender unless clearly stated as 
being that of Datacentrix.
The person addressed in the e-mail is the sole authorised recipient. Please 
notify the sender immediately if it has unintentionally reached you and do not 
read, disclose or use the content in any way. Datacentrix cannot assure that 
the integrity of this communication has been maintained nor that it is free of 
errors, virus, interception or interference.
-Original Message-
From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Thursday, 01 October 2015 7:14 PM
To: users@cloudstack.apache.org
Subject: RE: table cloud.template_store_ref

Hello, if I am coming to the conclusion that vcenter 5.5 is not supported for 
CS 4.3, additionally we check the secondary storage in the vm mgmt and the 
mount is good, and deploy the template with command

/usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt 
-m /mnt/secondary -u

Execute good and I check the secondary storage and exist the .ova and others 
files, thanks



Cordialmente,

Yesid Mora | Orchestration Engineer | O4IT
PBX: 251 Ext +57 (1) 423-5460 | Cel: 3124509565 Cr. 7 #74-56 | Oficina 202 | 
Bogotá, Colombia http://www.o4it.com | mailto:ym...@o4it.com



-Original Message-----
From: Somesh Naidu [mailto:somesh.na...@citrix.com]
Sent: Thursday, October 01, 2015 11:23 AM
To: users@cloudstack.apache.org
Subject: RE: table cloud.template_store_ref

Does not look like vSphere/vCenter 5.5 is supported with 4.3 
(http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.3/hypervisor_installation.html#vmware-vsphere-installation-and-configuration).

Did you correctly prepare the system VM template on the secondary storage? 
Also, have you ensured that mgmt server has no trouble with connecting/mounting 
the secondary storage?

Regards,
Somesh


-Original Message-
From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Thursday, October 01, 2015 3:52 AM
To: users@cloudstack.apache.org
Subject: table cloud.template_store_ref

Hello, Vadim, sorry the version is 4.3.2 CS, additionally please confirm if 
compatibility this version with vcenter 5.5 and ESXi 5.5, thanks



Cordialmente,

Yesid Mora | Orchestration Engineer | O4IT
PBX: 251 Ext +57 (1) 423-5460 | Cel: 3124509565 Cr. 7 #74-56 | Oficina 202 | 
Bogotá, Colombia http://www.o4it.com | mailto:ym...@o4it.com



-Original Message-
From: Vadim Kimlaychuk [mailto:va...@kickcloud.net]
Sent: Thursday, October 01, 2015 2:43 AM
To: users@cloudstack.apache.org
Cc: Yesid Mora
Subject: Re: table cloud.template_store_ref

Dear Yesid,

   Are you sure that CS version is 3.4.2 ?  I wasn't able to find such number 
in the history
   Anyway, everyone else will ask for management server log. Can you drop it 
here?

Regards,

Vadim.

On 2015-10-01 09:37, Yesid Mora wrote:

> Hello, I have a problem with template system vm, I check table
> cloud.template_store_ref and inform that the template is downloaded
> but the size is 0 and the install path inform that is
> template/tmpl/1/8 and no more, the version is cloudsta

RE: Volume migration not working in asynchronous way | Urgent help !

[Somesh Naidu]

Can you check what value is set for global configuration parameter 
"vmware.create.full.clone"? If false, try setting it to true and see if that 
works.

Regards,
Somesh

-Original Message-
From: Emil [mailto:emi...@gmail.com] 
Sent: Tuesday, October 13, 2015 3:08 PM
To: users@cloudstack.apache.org
Subject: Volume migration not working in asynchronous way | Urgent help !

Hello,

We have a big problem in our environment which not letting us keep working.
We are trying to use the command migrateVolume which is written as
asynchronous in cloudstack API.

But in some way every time we try to run the command (through the API or
Web)
only 1x migration running at a time (At very very rare situations 2x
migrations running simultaneously).

I tried to check every configuration settings especially those:

   - execute.in.sequence.hypervisor.commands
   - execute.in.sequence.network.element.commands

They were defaulted as false, I tried them with true as value also didnt
worked.

Also if we are trying to run storage vMotion through the vSphere client, it
working great (3,4,5 simultaneously)

Some details about our environment:

vSphere 5.5
CS 4.5.2

Some logs conclusions:

When preforming the first volumeMigration it seems like each task has a
sequence id, which registerd some where,
then the task "Executing" it self and every thing fine. Got unique job id
 for the task (to trace the status).

When the second volumeMigration executed there is a line in the log which
very suspicious and it says:
"Waiting for Seq 244522346426 Scheduling: .."
That sequence id is the id of the first migration ! Why the hell he waiting
for the first task ?!

I hope some one will see ot and can help. Very urgent case.

RE: Problem with VolumeMigration, stuck after first migration‏

[Somesh Naidu]

Ilya, the operation SEQ is based on the host (also referred to as agent). So, 
this concurrency isn't at the object level but at the host/agent level.

In this case, I believe it is SSVM. Have Emil verify this from host table 
querying for the ID in the SEQ.

Regards,
Somesh


-Original Message-
From: ilya [mailto:ilya.mailing.li...@gmail.com] 
Sent: Tuesday, October 13, 2015 4:59 PM
To: users@cloudstack.apache.org
Subject: Re: Problem with VolumeMigration, stuck after first migration‏

Hi Emil,

I believe there are some restrictions on how migration is handled with
vmware.

Please explain from resource standpoint what you are running and how
test is made..

i.e. how many hosts and datastores in your cluster and how tests are made..

Example:
Test 1 Source: vm1, host 1, datastore1
Test 1 Dest: vm1, host 1, datastore2

Test 2 Source: vm1, host 2, datastore3
Test 2 Dest: vm1, host 2, datastore4



When you try to migrate, see of you can migrate vms that are on
different host and datastore - but in the same cluster...

I vaguely recall there was a limit of concurrent operations on single
object...

Regards
ilya


On 10/11/15 1:17 PM, Emil wrote:
> Hello dear users,
> we implemented cloudstack (4.5.2) in a private network, as hypervisor we
> used VmWare (ESXi 5.5).
> 
> The enviornment running perfectly except for one strange and annoying
> problem.
> When we are trying the migrate a volume it migrates very fine and we can
> see it the vSphere Client,
> 
> but !! when we are trying to make another migration it just enter the queue
> (can see it with listAsyncJobs)
> and it waits for the first migration to end, when the first migration ends
> the second migration starting
> Not only the second migration not running parallel or any third, fourth ...
> ,
> Any task we are trying to run enters the queue (deploy, snapshot, anything)
> !
> 
> We are tried to run every thing from the api, same results,
> searched the logs for warning, but every thing seems to be OK,
> it even wrote "job-165 entered for monitoring" (Sorry if it ain't accurate)
> for the second migration or
> any other task we are trying to execute
> 
> I must admit that when we are trying to run anything else then migration,
> it runs parallel (Taking Snapshots, Deployments)
> 
> When I looked at the list of AsyncJobs (through the api), the jobstatus of
> the new tasks (When first migration deployed) it valued as 0.
> 
> Why it is stuck ? and not running parallel ? Can someone help here ?
> 

RE: What is Size of a typical ACS production environment?

[Somesh Naidu]

I have had experience with users (more than 1) having 1000+ hosts and of 
course, I am talking 1 ACS deployment.

Regards,
Somesh

-Original Message-
From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] 
Sent: Wednesday, October 14, 2015 9:42 AM
To: users@cloudstack.apache.org
Subject: Re: What is Size of a typical ACS production environment?

Thanks Sebastian and Giles,

That will help; we just wanted to feel how big an ACS environment can be.

On Wed, Oct 14, 2015 at 8:08 AM, Sebastien Goasguen 
wrote:

> If I had to guess I would say 80/20 applies.
>
> 80% of cloudstack deployments < 100 nodes
> 20% > 100 nodes
>
> There is a long tail..
>
> there is actually research/stats on size of HPC clusters out there, and
> 80/20 roughly applies on size of cluster.
>
> > On Oct 14, 2015, at 10:42 AM, Giles Sirett 
> wrote:
> >
> > Hi Rafael
> >
> > There is a HUGE range out there, any mean-based average would be useless
> >
> > Theres lots of small hosting providers with 8-16 hosts
> > Theres quite a few in the 100-500 category
> >
> > And then a smaller number in the 1000+
> >
> >
> >
> > Regards
> >
> > Giles
> >
> > -Original Message-
> > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com]
> > Sent: 08 October 2015 21:41
> > To: users@cloudstack.apache.org
> > Subject: What is Size of a typical ACS production environment?
> >
> > Hi folks,
> >
> > I was looking at the ACS users’ lists (
> > https://cloudstack.apache.org/users.html), and I got me wondering. What
> is the average size of the cloud environment that those companies have?
> > Does anyone have some ideas on how many hosts might be in an ACS
> production deployment?
> >
> > I know that there is a new feature coming (ACS 4.6.0?!) that is meant to
> generate such report.
> > Until that feature is ready to be used we will not know that; so, is
> there someone with an educated guess about the average size of those
> environments?
> >
> > --
> > Rafael Weingärtner
> > Find out more about ShapeBlue and our range of CloudStack related
> services
> >
> > IaaS Cloud Design & Build<
> http://shapeblue.com/iaas-cloud-design-and-build//>
> > CSForge – rapid IaaS deployment framework
> > CloudStack Consulting
> > CloudStack Software Engineering<
> http://shapeblue.com/cloudstack-software-engineering/>
> > CloudStack Infrastructure Support<
> http://shapeblue.com/cloudstack-infrastructure-support/>
> > CloudStack Bootcamp Training Courses<
> http://shapeblue.com/cloudstack-training/>
> >
> > This email and any attachments to it may be confidential and are
> intended solely for the use of the individual to whom it is addressed. Any
> views or opinions expressed are solely those of the author and do not
> necessarily represent those of Shape Blue Ltd or related companies. If you
> are not the intended recipient of this email, you must neither take any
> action based upon its contents, nor copy or show it to anyone. Please
> contact the sender if you believe you have received this email in error.
> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
> Services India LLP is a company incorporated in India and is operated under
> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
> company incorporated in Brasil and is operated under license from Shape
> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of
> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is
> a registered trademark.
>
>


-- 
Rafael Weingärtner

RE: Volume migration not working in asynchronous way | Urgent help !

[Somesh Naidu]

Emil,

> If false, try setting it to true and see if that works.

I may have mistakenly said it the other way round, if set to true, VM 
operations will execute in sequence meaning multiple VMs cannot be launched at 
the same time on 1 host. The default for this parameter is false. I don't know 
for sure if this parameter affects volume operations so wanted you to try out.

Regards,
Somesh


-Original Message-
From: Emil [mailto:emi...@gmail.com] 
Sent: Thursday, October 15, 2015 12:07 AM
To: users@cloudstack.apache.org
Subject: Re: Volume migration not working in asynchronous way | Urgent help !

Update:

the parameter "vmware.create.full.clone" was set to "true", didn't help
either.
But noticed something else, now when "full.clone" is enabled,
I couldn't deploy two instances simultaneously !!

It seems like there is some kind of limitation or restriction with
"time"/"heavy tasks"/"waiting", dont know what !

And you can see also a message from this guy in 9 Oct:
Timothy Lothering Re: Running Multiple Jobs in parallel

Is there any kind of limitation/restriction with vMware with tasks that
takes time ?

2015-10-14 0:04 GMT+03:00 ilya :

> Somesh,
>
> Not certain how that is going to help the problem with concurrent
> tasks.. Please explain..
>
> Thanks,
> ilya
>
> On 10/13/15 1:58 PM, Somesh Naidu wrote:
> > Can you check what value is set for global configuration parameter
> "vmware.create.full.clone"? If false, try setting it to true and see if
> that works.
> >
> > Regards,
> > Somesh
> >
> > -Original Message-
> > From: Emil [mailto:emi...@gmail.com]
> > Sent: Tuesday, October 13, 2015 3:08 PM
> > To: users@cloudstack.apache.org
> > Subject: Volume migration not working in asynchronous way | Urgent help !
> >
> > Hello,
> >
> > We have a big problem in our environment which not letting us keep
> working.
> > We are trying to use the command migrateVolume which is written as
> > asynchronous in cloudstack API.
> >
> > But in some way every time we try to run the command (through the API or
> > Web)
> > only 1x migration running at a time (At very very rare situations 2x
> > migrations running simultaneously).
> >
> > I tried to check every configuration settings especially those:
> >
> >- execute.in.sequence.hypervisor.commands
> >- execute.in.sequence.network.element.commands
> >
> > They were defaulted as false, I tried them with true as value also didnt
> > worked.
> >
> > Also if we are trying to run storage vMotion through the vSphere client,
> it
> > working great (3,4,5 simultaneously)
> >
> > Some details about our environment:
> >
> > vSphere 5.5
> > CS 4.5.2
> >
> > Some logs conclusions:
> >
> > When preforming the first volumeMigration it seems like each task has a
> > sequence id, which registerd some where,
> > then the task "Executing" it self and every thing fine. Got unique job id
> >  for the task (to trace the status).
> >
> > When the second volumeMigration executed there is a line in the log which
> > very suspicious and it says:
> > "Waiting for Seq 244522346426 Scheduling: .."
> > That sequence id is the id of the first migration ! Why the hell he
> waiting
> > for the first task ?!
> >
> > I hope some one will see ot and can help. Very urgent case.
> >
>

RE: how to assign an instance to a different project ?

[Somesh Naidu]

I believe this functionality does not exist yet. The only to achieve is to 
perform manual DB updates but this has not been tested. If you decide to go 
with the manual DB update approach, you should take care of network association 
for that VM.

Regards,
Somesh

-Original Message-
From: Yiping Zhang [mailto:yzh...@marketo.com] 
Sent: Tuesday, November 03, 2015 2:43 PM
To: users@cloudstack.apache.org
Subject: how to assign an instance to a different project ?

Hi,

I need to move some instances from project-1 in domain-1 to project-2 in 
domain-2. But I can’t find any API to do so.

The API  “assignVirtualMachine” can move instances between accounts (in the 
same or different domains), but it does not work with projects. If there is an 
API to move an instance from an account to a project, that would work for me as 
well.

How would I do this ?

Thanks

Yiping

RE: CPBM

[Somesh Naidu]

Venkatesh,

As others have pointed out, while CPBM supports integration with Apache 
Cloudstack (ACS), this may not be the right forum for questions on CPBM. You 
should try posting your questions on CPBM here, 
http://discussions.citrix.com/forum/1182-cloudportal-business-manager-2x/

Also, the CPBM docs do provide detailed instruction on integration with ACS.

In addition, note that CPBM is sold under commercial license which almost 
always includes technical support. So if you have or are using CPBM then the 
chances are that you have a valid support contract with Citrix and you should 
leverage the same for any technical support requirements related to CPBM.

Regards,
Somesh


-Original Message-
From: Timothy Lothering [mailto:tlother...@datacentrix.co.za] 
Sent: Monday, November 02, 2015 9:41 AM
To: users@cloudstack.apache.org
Subject: RE: CPBM

Hi Venkatesh,

You can also use the CPBM Cookbook: 
https://www.google.co.za/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=0CBsQFjAAahUKEwi0za_s-_HIAhUChxoKHWN8BK0&url=http%3A%2F%2Fsupport.citrix.com%2Fservlet%2FKbServlet%2Fdownload%2F36125-102-708539%2FCPBM_2.2_Cookbook.pdf&usg=AFQjCNGR4lb3cTiCMOgVH-JaBiF4S-OMww&sig2=ohGNB_jrAUh7EMHJ7GWSNA&bvm=bv.106379543,d.ZWU
 

Kind Regards,

Timothy Lothering
Timothy Lothering
Solutions Architect
Managed Services

T: +27877415535
F: +27877415100
C: +27824904099
E: tlother...@datacentrix.co.za


DISCLAIMER NOTICE: 

Everything in this e-mail and any attachments relating to the official business 
of Datacentrix Holdings Ltd. and its subsidiaries 
('Datacentrix') is proprietary to Datacentrix. It is confidential, legally 
privileged and protected by law. Datacentrix does not 
own and endorse any other content. Views and opinions are those of the sender 
unless clearly stated as being that of Datacentrix. 
The person addressed in the e-mail is the sole authorised recipient. Please 
notify the sender immediately if it has unintentionally 
reached you and do not read, disclose or use the content in any way. 
Datacentrix cannot assure that the integrity of this communication 
has been maintained nor that it is free of errors, virus, interception or 
interference.
-Original Message-
From: prapul cool [mailto:prapul_cool2...@yahoo.com.INVALID] 
Sent: Monday, 02 November 2015 4:32 PM
To: users@cloudstack.apache.org
Subject: Re: CPBM

Hi venkatesh,  Give a try with this
CTX137909 - Integrating CloudPortal Business Manager 2.0 with CloudPlatform - 
Citrix Knowledge Center
|   |
|   |  |   |   |   |   |   |
| CTX137909 - Integrating CloudPortal Business Manager 2...Name - name 
| to identify this infrastructure component Protocol (http or https) - 
| Protocol to use while connecting to CloudPlatform / CloudStack  |  | 
| View on support.citrix.com | Preview by Yahoo |  |
|   |


 Regards,
Prapul sriram,

 


 On Monday, 2 November 2015 7:42 PM, kotipalli venkatesh 
 wrote:
   

 Hi All,

How to integrate CPBM (Cloud portal business management ) in our cloudstack.

please share the links.

Thanks,
Venkatesh.k


  

RE: Restoring Cloudstack DB with Missing /etc/cloudstack/management/key

[Somesh Naidu]

That should be possible. It is not perfectly clear which key is out of sync, 
but if you are looking to replace the mgmt secret key located in 
/etc/cloudstack/management/key then you only need to replace the new value for 
property " db.cloud.encrypt.secret" in /etc/cloudstack/management/db.properties.

Regards,
Somesh


-Original Message-
From: James Smith [mailto:ciscovillan1...@gmail.com] 
Sent: Sunday, November 01, 2015 12:03 PM
To: users@cloudstack.apache.org
Subject: Restoring Cloudstack DB with Missing /etc/cloudstack/management/key

I have a cloudstack management instance I'm trying to restore but didn't
back up the /etc/cloudstack/management/key which encrypts given fields in
the db.  Having restored it I'm getting jaspyr exceptions due to the key
being different, I'd like to override those with newly necrypted values.
Is this possible? Which fields should I look to replace in particular?

Thanks

James

RE: CloudStack fails to deploy SSVM

[Somesh Naidu]

The reason for SSVM and CPVM not being deployed would quite likely be the same.

Here are the errors relevant to SSVM start failure:
2015-12-02 18:19:27,314 INFO  [c.c.s.s.SecondaryStorageManagerImpl] 
(secstorage-1:ctx-f86ee694) Found a stopped secondary storage vm, bring it up 
to running pool. secStorageVm vm id : 3099
2015-12-02 18:19:27,417 WARN  [c.c.s.s.SecondaryStorageManagerImpl] 
(secstorage-1:ctx-f86ee694) Exception while trying to start secondary storage vm
com.cloud.exception.InsufficientServerCapacityException: Unable to create a 
deployment for VM[SecondaryStorageVm|s-3099-VM]Scope=interface 
com.cloud.dc.DataCenter; id=4

There are similar for CPVM.

I see that the logging level is set to INFO. Changing to DEBUG will provide 
more pointers on the cause of the failures. I’d suspect storage. I believe mgmt 
server may be trying to deploy the System VMs on local storage but there isn’t 
one available in the new Zone.

Somesh
CloudPlatform Escalations
Citrix Systems, Inc.

From: Bernhard Dübi [mailto:1linuxengin...@gmail.com]
Sent: Wednesday, December 02, 2015 3:12 PM
To: users@cloudstack.apache.org
Subject: CloudStack fails to deploy SSVM

Hi,

we have a CloudStack 4.3.2 installation with 152 XenServer 6.2.0 hosts 
organized in 2 zones. We use local disks as primary storage and NFS shares as 
secondary storage. So good so far.
Now I created a new zone and added a VMware cluster with 2 ESX 5.5 hosts. I 
configured 2 NFS shares as primary and secondary storage. I copied the vSphere 
systemvm to the new secondary storage as described in the installation guide.
If I understand right, this template will be used to deploy the SSVM.
Unfortunately something is missing and CloudStack fails to deploy the SSVM and 
- probably as a consequence - the Console Proxy
Please find attached a small part of the management-server.log

Any idea what's wrong? Thanks for your help

Regards
Bernhard

RE: CloudStack fails to deploy SSVM

[Somesh Naidu]

> So, I assume the missing pool is the secondary storage pool.

No, that's the primary storage the allocator is complaining about.

Can you verify if there is a enabled storage pool (primary storage) in that 
Zone/Clusters with the matching "storage type" as that of the service offering 
of the System VMs (SSVM/CPVM)? The tables you'd want to be looking at is 
disk_offering (id=9) and storage_pool (data_center_id=4).

Regards,
Somesh

-Original Message-
From: Bernhard Dübi [mailto:1linuxengin...@gmail.com] 
Sent: Thursday, December 03, 2015 2:33 PM
To: users@cloudstack.apache.org
Subject: Re: CloudStack fails to deploy SSVM

Hi,

you can get an excerpt from my management-server.log at level DEBUG at
http://www.due.bi/pub/management-server-debug.zip
the log sais "no pool found" but I can see the primary storage mounted in
the VMware Virtual Center. So, I assume the missing pool is the secondary
storage pool.
do we have a chicken & egg problem: to deploy the SSVM I need the secondary
storage and to access the secondary storage I need the SSVM

Regards
Bernhard

2015-12-02 23:28 GMT+01:00 Somesh Naidu :

> The reason for SSVM and CPVM not being deployed would quite likely be the
> same.
>
> Here are the errors relevant to SSVM start failure:
> 2015-12-02 18:19:27,314 INFO  [c.c.s.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-f86ee694) Found a stopped secondary storage vm, bring it
> up to running pool. secStorageVm vm id : 3099
> 2015-12-02 18:19:27,417 WARN  [c.c.s.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-f86ee694) Exception while trying to start secondary
> storage vm
> com.cloud.exception.InsufficientServerCapacityException: Unable to create
> a deployment for VM[SecondaryStorageVm|s-3099-VM]Scope=interface
> com.cloud.dc.DataCenter; id=4
>
> There are similar for CPVM.
>
> I see that the logging level is set to INFO. Changing to DEBUG will
> provide more pointers on the cause of the failures. I’d suspect storage. I
> believe mgmt server may be trying to deploy the System VMs on local storage
> but there isn’t one available in the new Zone.
>
> Somesh
> CloudPlatform Escalations
> Citrix Systems, Inc.
>
> From: Bernhard Dübi [mailto:1linuxengin...@gmail.com]
> Sent: Wednesday, December 02, 2015 3:12 PM
> To: users@cloudstack.apache.org
> Subject: CloudStack fails to deploy SSVM
>
> Hi,
>
> we have a CloudStack 4.3.2 installation with 152 XenServer 6.2.0 hosts
> organized in 2 zones. We use local disks as primary storage and NFS shares
> as secondary storage. So good so far.
> Now I created a new zone and added a VMware cluster with 2 ESX 5.5 hosts.
> I configured 2 NFS shares as primary and secondary storage. I copied the
> vSphere systemvm to the new secondary storage as described in the
> installation guide.
> If I understand right, this template will be used to deploy the SSVM.
> Unfortunately something is missing and CloudStack fails to deploy the SSVM
> and - probably as a consequence - the Console Proxy
> Please find attached a small part of the management-server.log
>
> Any idea what's wrong? Thanks for your help
>
> Regards
> Bernhard
>

RE: Failed CloudStack 4.6 Upgrade

[Somesh Naidu]

Justin, to add to what Daan suggested, before you re-run the upgrade, ensure 
that you have reverted the DB (using the DB dump collected just prior to the 
upgrade) to avoid errors due to duplicate entries/columns.

Somesh
CloudPlatform Escalations
Citrix Systems, Inc.

-Original Message-
From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] 
Sent: Tuesday, December 01, 2015 5:54 AM
To: users@cloudstack.apache.org
Subject: Re: Failed CloudStack 4.6 Upgrade

Dustin, do the columns  `cloud`.`snapshots`.`min_iops` and
`cloud`.`snapshots`.`max_iops` contain any significant data for you? If not
you can delete them and rerun the upgrade. It seems like the upgrade has
been started before this error and was aborted. Have a look at the file
.../cloudstack/setup/db/db/schema-452to460.sql and see if any of the other
changes in there are in your db. Also have a look at the version table to
see whether it is at the version you expect.

hope this helps,

On Mon, Nov 30, 2015 at 5:54 PM, Dustin Wright <
dwri...@untangledtechnology.com> wrote:

> I confirmed I have no additional plugins in use for storage or networking.
> I’m using advanced /w basic VLAN networking (I went into the switches and
> pre-assigned a few hundred VLAN’s). All of the servers (Storage,
> Controller, Hypervisor) are all CentOS 6.7.
>
> Any suggestions on how I should proceed to upgrade this cloud?
>
> I built a new ACS 4.6 controller which is 100% vanilla just to ensure
> everything worked on CentOS 6 new. I’m just not sure how to proceed with my
> existing 4.5.2 deployment.
>
> Dustin W
>
> > On Nov 27, 2015, at 6:04 PM, Simon Weller  wrote:
> >
> > There are not meant to be scheme changes on minor releases, but we'll
> have to go and look back at the sql files in git to confirm that.
> >
> > Do you have any additional plugins in use (i.e. storage, or networking)?
> >
> >
> > 
> > From: Dustin Wright 
> > Sent: Wednesday, November 25, 2015 11:55 AM
> > To: users@cloudstack.apache.org
> > Subject: Re: Failed CloudStack 4.6 Upgrade
> >
> > Simon,
> >
> > I did as suggested and got a new SQL error further down the script (line
> 154, user_id) see below...
> >
> > I also found it strange the file schema-452to460.sql has the following
> copy at the top..
> >
> > --
> > -- Schema upgrade from 4.5.1 to 4.6.0
> > —
> >
> > Shouldn’t it read 4.5.2 to 4.6.0?
> >
> > [root@controller ~]# mysql cloud <
> /usr/share/cloudstack-management/setup/db/schema-452to460.sql
> > ERROR 1060 (42S21) at line 22: Duplicate column name 'min_iops'
> > [root@controller ~]# vi
> /usr/share/cloudstack-management/setup/db/schema-452to460.sql
> > [root@controller ~]# mysql cloud <
> /usr/share/cloudstack-management/setup/db/schema-452to460.sql
> > ERROR 1060 (42S21) at line 154: Duplicate column name ‘user_id’
> >
> > Dustin W
> >
> >> On Nov 25, 2015, at 10:29 AM, Simon Weller  wrote:
> >>
> >> Try commenting out both the min_iops and max_iops lines.
> >>
> >>
> >>
> >> 
> >> From: Dustin Wright 
> >> Sent: Wednesday, November 25, 2015 8:58 AM
> >> To: users@cloudstack.apache.org
> >> Subject: Re: Failed CloudStack 4.6 Upgrade
> >>
> >> This was a fresh 4.5.2 install. No previous upgrades.
> >>
> >> I tried commenting out the offending SQL and it errors on the next line.
> >>
> >> I will try to gather more info later today after I put out some other
> fires.
> >>
> >> Dustin
> >>
> >>
> >>
> >> Sent from my iPhone
> >>
> >>> On Nov 25, 2015, at 7:51 AM, Simon Weller  wrote:
> >>>
> >>> Dustin,
> >>>
> >>> Was 4.5.2 a fresh install, or did you upgrade from a previous version
> to it? If so, can you tell us the upgrade order?
> >>>
> >>> - Si
> >>>
> >>>
> >>> 
> >>> From: Dustin Wright 
> >>> Sent: Wednesday, November 25, 2015 6:21 AM
> >>> To: users@cloudstack.apache.org
> >>> Subject: Re: Failed CloudStack 4.6 Upgrade
> >>>
> >>> This was a fairly vanilla ACS 4.5.2. It has maybe 1 cluster, 6 HV's
> and 10 HVM VM's with advanced networking (single port, vlan)
> >>>
> >>> Never touched DB or UI.
> >>>
> >>> All I did to upgrade was removed AWS APi as directed and loaded up the
> 4.6 repo.
> >>>
> >>> I was going to troubleshoot more today might restore back.
> >>>
> >>> Dustin
> >>>
> >>> Sent from my iPhone
> >>>
>  On Nov 25, 2015, at 5:56 AM, Rajani Karuturi 
> wrote:
> 
>  from which version are you trying to upgrade? Were there any custom
> changes
>  on top of ACS?
> 
>  ~Rajani
> 
>  On Tue, Nov 24, 2015 at 3:39 AM, Dustin Wright <
>  dwri...@untangledtechnology.com> wrote:
> 
> > I’ve facing an SQL error while trying to upgrade a CloudStack
> environment.
> > Any suggestions?
> >
> > [root@controller management]# tail management-server.log -f
> > Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to
> > execute upgrade script:
> > /usr/share/cloudstack-management/s

RE: CloudStack fails to deploy SSVM

[Somesh Naidu]

Look at the column "use_local_storage" being set to 1 meaning the system 
service offering requires local storage. That should be because the global 
config "system.vm.use.local.storage" in your environment is set to true.

I am not sure if 4.3.x has the capability to set the above config per Zone so 
you may have to use local storage for system VMs in the new Zone (ID 4) as well.

Somesh
CloudPlatform Escalations
Citrix Systems, Inc.

-Original Message-
From: Bernhard Dübi [mailto:1linuxengin...@gmail.com] 
Sent: Friday, December 04, 2015 1:25 AM
To: users@cloudstack.apache.org
Subject: Re: CloudStack fails to deploy SSVM

Hi Somesh,

thank you for looking into this


mysql> select * from disk_offering where id=9;
++---+--+--+--+---+-+--+-+---++++-+-+--+--+-+--+--+-+--++-++---+
| id | domain_id | name |
uuid | display_text | disk_size | type|
tags | recreatable | use_local_storage | unique_name|
system_use | customized | removed | created | sort_key |
display_offering | customized_iops | min_iops | max_iops | bytes_read_rate
| bytes_write_rate | iops_read_rate | iops_write_rate | state  |
hv_ss_reserve |
++---+--+--+--+---+-+--+-+---++++-+-+--+--+-+--+--+-+--++-++---+
|  9 |  NULL | System Offering For Secondary Storage VM |
e216d1da-f106-4db5-b9ea-72c6942d5d66 | NULL | 0 | Service |
NULL |   1 | 1 | Cloud.com-SecondaryStorage
|  1 |  1 | NULL| 2013-12-20 15:25:16 |0
|1 |NULL | NULL | NULL |
NULL | NULL |   NULL |NULL | Active
|  NULL |
++---+--+--+--+---+-+--+-+---++++-+-+--+--+-+--+--+-+--++-++---+
1 row in set (0.00 sec)

mysql> select * from storage_pool where data_center_id = 4;
+-+--+--+---+--++++---++--+---+--+-+-+-++---+-++-+---+
| id  | name | uuid |
pool_type | port | data_center_id | pod_id | cluster_id |
used_bytes| capacity_bytes | host_address | user_info |
path | created | removed | update_time | status |
storage_provider_name | scope   | hypervisor | managed | capacity_iops |
+-+--+--+---+--++++---++--+---+--+-+-+-++---+-++-+---+
| 173 | VMware_Primary01 | 8ed580cb-bed8-3de4-b2d6-ffd60d30b6a3 |
NetworkFilesystem | 2049 |  4 |  6 | 16 |
1525553401856 |  2198886936576 | zcgnfsesx001.fpprod.corp | NULL  |
/cloud01 | 2015-12-02 11:25:25 | NULL| NULL| Up |
DefaultPrimary| CLUSTER | NULL   |   0 |  NULL |
+-+--+--+---+--++++---++--+---+--+-+-+-++---+-++-+---+
1 row in set (0.00 sec)


2015-12-04 0:45 GMT+01:00 Somesh Naidu :

> > So, I assume the missing pool is the secondary storage pool.
>
> No, that's the primary storage the allocator is complaining about.
>
> Can you verify if there is a enabled storage pool (

RE: Unable to add hosts

[Somesh Naidu]

See if updating nss package on your management server helps resolve this.

(http://mail-archives.apache.org/mod_mbox/cloudstack-users/201511.mbox/%3c5a4fe8efa8c8584cbefeeacd9aa077ee61228...@sinpex01cl02.citrite.net%3E)

Somesh
CloudPlatform Escalations
Citrix Systems, Inc.

-Original Message-
From: sayed jahed hussini [mailto:sjahed_hussini...@yahoo.com.INVALID] 
Sent: Friday, December 11, 2015 11:18 AM
To: users@cloudstack.apache.org
Subject: Unable to add hosts

I installed cloudstack using this guide:
Quick Installation Guide for CentOS 6 — Apache CloudStack Installation 
Documentation 4.6.0 documentation
Everything went without any errors. But I am unable to add hosts. In 
/var/log/cloudstack/agent/agent.log I got the following error:
INFO [utils.nio.NioClient] (main:null) Connecting to 10.1.1.2:8250ERROR 
[utils.nio.NioConnection] (main:null) Unable to initalize the 
threads.java.io.IOException: Connection closed with -1 on reading size..
Also in /var/log/cloudstack/management/setupManagement.log i got the following 
errors:
DEBUG:root:execute:iptables-save|grep INPUT| grep -w 8080DEBUG:root:Failed to 
execute:
DEBUG:root:execute:iptables -I INPUT -p tcp -m tcp --dport 8080 -j 
ACCEPTDEBUG:root:execute:iptables-save|grep INPUT| grep -w 8250
DEBUG:root:Failed to execute:DEBUG:root:execute:iptables -I INPUT -p tcp -m tcp 
--dport 8250 -j ACCEPT

best,Jay

|   |
|   |   |   |   |   |
| Quick Installation Guide for CentOS 6 — Apache CloudStack Installation 
Documentation 4.6.0 documenta...NFS Our configuration is going to use NFS for 
both primary and secondary storage. We are going to go ahead and setup two NFS 
shares for those purposes. We’llstart out by installing nfs-utils.  |
|  |
| View on cloudstack-installation.readthedocs.org | Preview by Yahoo |
|  |
|   |

RE: Unable to add hosts

[Somesh Naidu]

Jay, I missed asking earlier, what host are you working with, KVM?

Regards,
Somesh

From: sayed jahed hussini [mailto:sjahed_hussini...@yahoo.com.INVALID]
Sent: Tuesday, December 15, 2015 8:59 AM
To: Paul Angus; users@cloudstack.apache.org; Somesh Naidu
Subject: Re: Unable to add hosts

I tried deactivating firewall and adding host, didn't work. Then downgraded 
java (yum downgrade java), still no luck.I had setup this server using the same 
guide about a month ago and it worked last time(same OS version).  Any other 
parts that I need to change?

best,
jay


On Saturday, December 12, 2015 12:47 PM, Paul Angus 
mailto:paul.an...@shapeblue.com>> wrote:

Hi Jay,

As you've pointed out in your mgmt. server log, it looks like your firewall 
rules haven't been set. Assuming you're using CentOS/RHEL I guess SELinux 
wasn't set to permissive when your ran cloudstack-setup-management

You could try a quick n' dirty; service iptables stop to see if the 
communications from your host can get through, then fix the rules and re-enable 
the firewall.

[ShapeBlue]<http://www.shapeblue.com/>

Paul Angus

VP Technology

,

ShapeBlue



d:

+44 203 603 0540 | s: +44 203 617 0528

 |

m:

+44 7711 418784


e:

paul.an...@shapeblue.com | t: 
@cloudyangus<mailto:paul.an...@shapeblue.com%20|%20t:%20@cloudyangus>

 |

w:

www.shapeblue.com<http://www.shapeblue.com/>


a:

53 Chandos Place, Covent Garden London WC2N 4HS UK



[cid:image07e1ce.png@904e29c0.45b9cae6]



Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services 
India LLP is a company incorporated in India and is operated under license from 
Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd 
is a company registered by The Republic of South Africa and is traded under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error.



-Original Message-
From: sayed jahed hussini [mailto:sjahed_hussini...@yahoo.com.INVALID]
Sent: Saturday, December 12, 2015 4:23 PM
To: Somesh Naidu mailto:somesh.na...@citrix.com>>; 
users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: Re: Unable to add hosts

I did update nss package, but that didn't resolve the problem either.


On Friday, December 11, 2015 2:03 PM, Somesh Naidu 
mailto:somesh.na...@citrix.com>> wrote:


See if updating nss package on your management server helps resolve this.

(http://mail-archives.apache.org/mod_mbox/cloudstack-users/201511.mbox/%3c5a4fe8efa8c8584cbefeeacd9aa077ee61228...@sinpex01cl02.citrite.net%3E)

Somesh
CloudPlatform Escalations
Citrix Systems, Inc.

-Original Message-
From: sayed jahed hussini [mailto:sjahed_hussini...@yahoo.com.INVALID]
Sent: Friday, December 11, 2015 11:18 AM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
Subject: Unable to add hosts

I installed cloudstack using this guide:
Quick Installation Guide for CentOS 6 — Apache CloudStack Installation 
Documentation 4.6.0 documentation Everything went without any errors. But I am 
unable to add hosts. In /var/log/cloudstack/agent/agent.log I got the following 
error:
INFO [utils.nio.NioClient] (main:null) Connecting to 10.1.1.2:8250ERROR 
[utils.nio.NioConnection] (main:null) Unable to initalize the 
threads.java.io.IOException: Connection closed with -1 on reading size..
Also in /var/log/cloudstack/management/setupManagement.log i got the following 
errors:
DEBUG:root:execute:iptables-save|grep INPUT| grep -w 8080DEBUG:root:Failed to 
execute:
DEBUG:root:execute:iptables -I INPUT -p tcp -m tcp --dport 8080 -j 
ACCEPTDEBUG:root:execute:iptables-save|grep INPUT| grep -w 8250 
DEBUG:root:Failed to execute:DEBUG:root:execute:iptables -I INPUT -p tcp -m tcp 
--dport 8250 -j ACCEPT

best,Jay

|   |
|   |   |   |   |   |
| Quick Installation Guide for CentOS 6 — Apache CloudStack Installation
|Documentation 4.6.0 documenta...NFS Our configuration is going to use
|NFS for both primary and secondary storage. We are going to go ahead
|and setup two NFS shares for those purposes. We’llstart out by
|installing nfs-utils.  |
|  |
| View on cloudstack-installation.readthedocs.org | Preview by Yahoo |

|  |
|   |




Find out more about ShapeBlue and our range of CloudStack related services:
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-

RE: Quick note about $dayjob

[Somesh Naidu]

Good luck and I hope the best for your new venture!

Regards,
Somesh

-Original Message-
From: Sebastien Goasguen [mailto:run...@gmail.com] 
Sent: Tuesday, January 26, 2016 9:31 AM
To: d...@cloudstack.apache.org
Cc: market...@cloudstack.apache.org; users@cloudstack.apache.org
Subject: Quick note about $dayjob

Hi folks,

As some of you might have guessed I am changing $dayjob.

This is an exciting time for me, but it also means that I will become less 
involved with CloudStack. ( I said *less* involved, did not say I was going to 
disappear). I have informed the PMC and offered to stop my VP role ahead of the 
March deadline. As you know we have a one-year rotation for the VP role. 
However if the PMC does not see a problem with it I will gladly continue until 
March.

I will keep this brief but I wanted to let you know so that you don’t wonder 
why my involvement in recent releases and votes has decreased.

It is an exciting time for CloudStack as well, with ever greater releases ( in 
large part to Remi, Wilder and a few others), a strong proposal to offer LTS 
and the commitment from Accelerite.

Change is good, challenges are opportunities says Sensei Wu from Ninjago :)

PS:
If you wonder, I am launching my own container startup called Skippbox. I will 
grant myself a shameless plug, and if you know anyone interested in containers 
and kubernetes I sure could use some help ( https://github.com/skippbox , 
http://www.skippbox.com/blog/), github stars and PRs :)

Cheers,

-Sebastien

RE: CloudStack and VMware VM deploy issue

[Somesh Naidu]

The problem seems to be pointed out by the below lines in the log:

2016-01-26 06:29:33,821 DEBUG [o.a.c.e.o.VolumeOrchestrator] 
(Work-Job-Executor-25:ctx-7bfca42f job-78/job-79 ctx-67168166) Unable to create 
Vol[15|vm=12|ROOT]:Failed to create a Vmware context, check the management 
server logs or the ssvm log for details
2016-01-26 06:29:33,821 INFO  [c.c.v.VirtualMachineManagerImpl] 
(Work-Job-Executor-25:ctx-7bfca42f job-78/job-79 ctx-67168166) Unable to 
contact resource.

There may be some inconsistency regarding download status of template ID 7, 
CentOS 5.3(64-bit) no GUI (vSphere), on primary storage, ID 1 - datastore-159. 
For some reason the copy command has failed. You'll need to look at the SSVM 
logs (search for 3-5184769071010284298) to find out more details on why it 
failed.

Regards,
Somesh


-Original Message-
From: Cristian Ciobanu [mailto:cristian.c@istream.today] 
Sent: Tuesday, January 26, 2016 4:34 PM
To: users@cloudstack.apache.org
Subject: Re: CloudStack and VMware VM deploy issue

Hi ilya

 
Yes, before deploy i set local storage in "Global Settings" also i set on zone 
level settings and i removed all disk offering with shared option and added 
with local storage. ( CS 4.5.2 ShapeBlue)

I did this in CS  4.5.2 i also used this version for KVM with local storage and 
works. but on VMware i have this issue.


  

 B. I have this error when i try the following task ( CS 4.5.2 ShapeBlue - 
VMware 5.5 - Local Storage enabled with Basic networking  ):

      I installed an Windows 2008 from ISO file, after this i tried to create 
template from ROOT volume, but i get this error : Failed to create 
templatecreate template from volume exception: Exception: 
java.lang.NullPointerException
Message: null

  


  A. I see this error when i try to deploy a vm from default template ( CS 
4.5.2 ShapeBlue - VMware 5.5 - Local Storage enabled with Basic networking  ):

root@ns52 management]# grep -r job-79 --color
management-server.log:2016-01-26 06:28:27,608 DEBUG 
[o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-14:ctx-107b2062 job-78 
ctx-9e2c938d) Sync job-79 execution on object VmWorkJobQueue.12
management-server.log:2016-01-26 06:28:29,292 DEBUG 
[o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-336c2f61) 
Schedule queued job-79
management-server.log:2016-01-26 06:28:29,307 INFO  
[o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-25:ctx-7bfca42f job-78/job-79) 
Add job-79 into job monitoring
management-server.log:2016-01-26 06:28:29,320 DEBUG 
[o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-7bfca42f 
job-78/job-79) Executing AsyncJobVO {id:79, userId: 2, accountId: 2, 
instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: 
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAACAAIADHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAXBzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAFxAH4ACnBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0x3CBABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
 cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: 
null, initMsid: 37591044139110, completeMsid: null, lastUpdated: null, 
lastPolled: null, created: Tue Jan 26 06:28:27 EST 2016}
management-server.log:2016-01-26 06:28:29,321 DEBUG [c.c.v.VmWorkJobDispatcher] 
(Work-Job-Executor-25:ctx-7bfca42f job-78/job-79) Run VM work job: 
com.cloud.vm.VmWorkStart for VM 12, job origin: 78
management-server.log:2016-01-26 06:28:29,323 DEBUG 
[c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-25:ctx-7bfca42f job-78/job-79 
ctx-67168166) Execute VM work job: 
com.cloud.vm.VmWorkStart{"dcId":1,"podId":1,"clusterId":1,"hostId":1,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":12,"handlerName":"VirtualMachineManagerImpl"}
management-server.log:2016-01-26 06:28:29,334 DEBUG [c.c.c.CapacityManagerImpl] 
(Work-Job-Executor-25:ctx-7bfca42f job-78/job-79 ctx-67168166) VM state 
transitted from :Stopped to Starting with event: StartRequestedvm's original 
host id: null new host id: null host id before state transition: null
management-server.log:2016-01-26 06:28:29,334 DEBUG 
[c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-25:ctx-7bfca42f 
job-78/job-79 ctx-67168166) Successfully transitioned to start state for 
VM[User|i-2-12-VM] reservation id = ae2f6b6d-693a-4dc6-8e80-28f1ca7e9777
ma

RE: Failed to create templatecreate ( CloudStack 4.5.2 VMware 5.5 )

[Somesh Naidu]

Is there a defect filed for this?

We will need more logs (at least the entire stack trace) to be able to 
understand what is happening.

Regards,
Somesh


-Original Message-
From: Cristian Ciobanu [mailto:cristian.c@istream.today] 
Sent: Tuesday, January 26, 2016 9:58 AM
To: users@cloudstack.apache.org
Subject: Failed to create templatecreate ( CloudStack 4.5.2 VMware 5.5 )

Hello,

      I found another issue, also i don't find solution for first one ( with 
this subject : CloudStack and VMware VM deploy issue )

      I installed an Windows 2008 from ISO file, after this i tried to create 
template from ROOT volume, but i get this error : Failed to create 
templatecreate template from volume exception: Exception: 
java.lang.NullPointerException
Message: null

     Is there a solution to fix this ? is this fixed in CS 4.6 ?


  Thank you!

Regards,
Cristian

RE: unable to create VPN connection for Site-To-Site VPN

[Somesh Naidu]

Sonali,

Try looking up logs for Seq 4-3491697086095716136 in the other management 
server log.

Regards,
Somesh


-Original Message-
From: Sonali Jadhav [mailto:son...@servercentralen.se] 
Sent: Monday, January 25, 2016 5:42 AM
To: users@cloudstack.apache.org
Subject: RE: unable to create VPN connection for Site-To-Site VPN

Anyone? 

/Sonali

-Original Message-
From: Sonali Jadhav [mailto:son...@servercentralen.se] 
Sent: Thursday, January 21, 2016 3:50 PM
To: users@cloudstack.apache.org
Subject: unable to create VPN connection for Site-To-Site VPN

Hi,

I am running ACS 4.5.2. I am trying to add VPC connection for making 
site-To-Site VPN in vpc. But I running into an error,

2016-01-21 08:44:25,308 DEBUG [c.c.a.ApiServlet] 
(http-6443-exec-23:ctx-5134ed7d) ===START===  1.4.134.114 -- GET  
command=createVpnConnection&response=json&sessionkey=ASWYR9%2Bi4dq92HizW8V8s%3D&s2svpngatewayid=bb0ffb92-6ed1-444e-a3ab-0aaad4655625&s2scustomergatewayid=c19b2093-df5b-41a5-b58b-9f36a2a8154d&passive=false&_=1453362266654
2016-01-21 08:44:25,316 DEBUG [o.a.c.a.BaseCmd] (http-6443-exec-23:ctx-5134ed7d 
ctx-92ecd917) Ignoring paremeter fordisplay as the caller is not authorized to 
pass it in
2016-01-21 08:44:25,333 DEBUG [c.c.u.AccountManagerImpl] 
(http-6443-exec-23:ctx-5134ed7d ctx-92ecd917) Access to 
Acct[04f51dd2-2fa6-4e1d-aa1c-625da0155494-mboss] granted to 
Acct[04f51dd2-2fa6-4e1d-aa1c-625da0155494-mboss] by DomainChecker
2016-01-21 08:44:25,341 DEBUG [o.a.c.a.BaseCmd] (http-6443-exec-23:ctx-5134ed7d 
ctx-92ecd917) Ignoring paremeter fordisplay as the caller is not authorized to 
pass it in
2016-01-21 08:44:25,353 DEBUG [c.c.u.AccountManagerImpl] 
(http-6443-exec-23:ctx-5134ed7d ctx-92ecd917) Access to 
Acct[04f51dd2-2fa6-4e1d-aa1c-625da0155494-mboss] granted to 
Acct[04f51dd2-2fa6-4e1d-aa1c-625da0155494-mboss] by DomainChecker
2016-01-21 08:44:25,368 DEBUG [c.c.u.AccountManagerImpl] 
(http-6443-exec-23:ctx-5134ed7d ctx-92ecd917) Access to 
com.cloud.network.dao.Site2SiteCustomerGatewayVO$$EnhancerByCGLIB$$dfda331d@3a81e18c
 granted to Acct[04f51dd2-2fa6-4e1d-aa1c-625da0155494-mboss] by DomainChecker
2016-01-21 08:44:25,381 DEBUG [c.c.u.AccountManagerImpl] 
(http-6443-exec-23:ctx-5134ed7d ctx-92ecd917) Access to 
com.cloud.network.dao.Site2SiteVpnGatewayVO$$EnhancerByCGLIB$$42578b7@5690e4b1 
granted to Acct[04f51dd2-2fa6-4e1d-aa1c-625da0155494-mboss] by DomainChecker
2016-01-21 08:44:25,586 INFO  [o.a.c.f.j.i.AsyncJobMonitor] 
(API-Job-Executor-2:ctx-c8efccc8 job-14425) Add job-14425 into job monitoring
2016-01-21 08:44:25,594 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-2:ctx-c8efccc8 job-14425) Executing AsyncJobVO {id:14425, 
userId: 12, accountId: 14, instanceType: None, instanceId: 5, cmd: 
org.apache.cloudstack.api.command.user.vpn.CreateVpnConnectionCmd, cmdInfo: 
{"id":"5","response":"json","sessionkey":"ASWYR9+i4dq92HizW8V8s\u003d","s2scustomergatewayid":"c19b2093-df5b-41a5-b58b-9f36a2a8154d","ctxDetails":"{\"com.cloud.network.Site2SiteVpnConnection\":\"b0f5546b-1877-4b2a-8eb2-2433ca3baab6\",\"com.cloud.network.Site2SiteVpnGateway\":\"bb0ffb92-6ed1-444e-a3ab-0aaad4655625\",\"com.cloud.network.Site2SiteCustomerGateway\":\"c19b2093-df5b-41a5-b58b-9f36a2a8154d\"}","cmdEventType":"VPN.S2S.CONNECTION.CREATE","ctxUserId":"12","s2svpngatewayid":"bb0ffb92-6ed1-444e-a3ab-0aaad4655625","passive":"false","httpmethod":"GET","_":"1453362266654","uuid":"b0f5546b-1877-4b2a-8eb2-2433ca3baab6","ctxAccountId":"14","ctxStartEventId":"112421"},
 cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: 
null, initMsid: 59778234354585, completeMsid: null, lastUpdated: null, 
lastPolled: null, created: null}
2016-01-21 08:44:25,597 DEBUG [o.a.c.a.BaseCmd] 
(API-Job-Executor-2:ctx-c8efccc8 job-14425 ctx-c8db121f) Ignoring paremeter 
fordisplay as the caller is not authorized to pass it in
2016-01-21 08:44:25,599 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(http-6443-exec-23:ctx-5134ed7d ctx-92ecd917) submit async job-14425, details: 
AsyncJobVO {id:14425, userId: 12, accountId: 14, instanceType: None, 
instanceId: 5, cmd: 
org.apache.cloudstack.api.command.user.vpn.CreateVpnConnectionCmd, cmdInfo: 
{"id":"5","response":"json","sessionkey":"ASWYR9+i4dq92HizW8V8s\u003d","s2scustomergatewayid":"c19b2093-df5b-41a5-b58b-9f36a2a8154d","ctxDetails":"{\"com.cloud.network.Site2SiteVpnConnection\":\"b0f5546b-1877-4b2a-8eb2-2433ca3baab6\",\"com.cloud.network.Site2SiteVpnGateway\":\"bb0ffb92-6ed1-444e-a3ab-0aaad4655625\",\"com.cloud.network.Site2SiteCustomerGateway\":\"c19b2093-df5b-41a5-b58b-9f36a2a8154d\"}","cmdEventType":"VPN.S2S.CONNECTION.CREATE","ctxUserId":"12","s2svpngatewayid":"bb0ffb92-6ed1-444e-a3ab-0aaad4655625","passive":"false","httpmethod":"GET","_":"1453362266654","uuid":"b0f5546b-1877-4b2a-8eb2-2433ca3baab6","ctxAccountId":"14","ctxStartEventId":"112421"},
 cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: 
null, initMsid: 59778234354585, completeMs

RE: Failed to create templatecreate ( CloudStack 4.5.2 VMware 5.5 )

[Somesh Naidu]

> Please see the full log

But these logs are output of grep. I'd be better off with the logs.

It does appear that there is a possibility that the stack trace for this NPE 
may not be available as I see "Message: null" meaning the exception stack 
wasn't propagated to the layer where the exception is being logged in which 
case it will be very difficult to identify the cause of the NPE.

The first thing I would do is to look at SSVM for logs related to job-50 / seq 
2-6133058267548483884 (assuming host id 2 is SSVM) to see if I can find out 
more details. The second thing I would do is look at the relevant DB entries in 
the tables volumes and image_store to see if there is any field missing any 
data.

FYI the NPE is logged within this method - 
com.cloud.storage.resource.VmwareStorageProcessor.createTemplateFromVolume(CopyCommand).
 Someone more familiar with that piece of code may be able to provide more 
insight.

Regards,
Somesh


-Original Message-
From: Cristian Ciobanu [mailto:cristian.c@istream.today] 
Sent: Wednesday, January 27, 2016 2:17 PM
To: users@cloudstack.apache.org
Subject: RE: Failed to create templatecreate ( CloudStack 4.5.2 VMware 5.5 )

Hi Somesh,

   Please see the full log, i reproduced the error again.

    1. Install Windows 2008 from iso
    2. Create template from Windows 2008 ROOT VOLUME

Please see the logs: http://pastebin.com/XfmqNeRa
Thank you !

Regards,
Cristian
On 27.01.2016 01:02:15, Somesh Naidu  wrote:
Is there a defect filed for this?

We will need more logs (at least the entire stack trace) to be able to 
understand what is happening.

Regards,
Somesh


-Original Message-
From: Cristian Ciobanu [mailto:cristian.c@istream.today]
Sent: Tuesday, January 26, 2016 9:58 AM
To: users@cloudstack.apache.org
Subject: Failed to create templatecreate ( CloudStack 4.5.2 VMware 5.5 )

Hello,

      I found another issue, also i don't find solution for first one ( with 
this subject : CloudStack and VMware VM deploy issue )

      I installed an Windows 2008 from ISO file, after this i tried to create 
template from ROOT volume, but i get this error : Failed to create 
templatecreate template from volume exception: Exception: 
java.lang.NullPointerException
Message: null

     Is there a solution to fix this ? is this fixed in CS 4.6 ?


  Thank you!

Regards,
Cristian

RE: CloudStack and VMware VM deploy issue

[Somesh Naidu]

Can you check if SSVM is able to talk to the vCenter on port 80?

Regards,
Somesh


-Original Message-
From: Cristian Ciobanu [mailto:cristian.c@istream.today] 
Sent: Wednesday, January 27, 2016 4:32 PM
To: users@cloudstack.apache.org
Subject: Re: CloudStack and VMware VM deploy issue

Hello again,

   Just want to add additional logs from SSVM : http://pastebin.com/1J5ejc6D

   Please help to solve this issue.

Thanks All


Regards,
Cristian
On 27.01.2016 17:52:32, Cristian Ciobanu  wrote:
Hello to All,

       I did rebuild of this configuration and i have the same issue, first VM 
deploy issue, please see the full log : http://pastebin.com/ybEybCQJ   (maybe 
you will see another error on first part of log, this was related to HOST IP 
configuration, i forgot to change it, but right now is fixed )

 Thank you!     


Regards,
Cristian
On 27.01.2016 03:42:35, ilya  wrote:
err..

Looks like my message was trimmed, do

cat /dev/null > /var/log/cloudstack/management/management-server.log

or similar to start with minimal log.

On 1/26/16 1:53 PM, Cristian Ciobanu wrote:
> I will come back in few hours with more details, I will start again from 
> scratch.
>
> Thank you!
>
>
> Regards,
> Cristian
> On 26.01.2016 23:43:54, ilya wrote:
> Can you post full log to pastebin like site?
>
> Ideally, if you can trim the log before you simulate the error - it
> would be great.
>
> do
>
>> /var/log/cloudstack/management/management-server.log
>
> Then similate the issue and upload to http://pastebin.com
>
> Thanks
> ilya
>
>
>
> On 1/26/16 1:33 PM, Cristian Ciobanu wrote:
>> Hi ilya
>>
>>
>> Yes, before deploy i set local storage in "Global Settings" also i set on 
>> zone level settings and i removed all disk offering with shared option and 
>> added with local storage. ( CS 4.5.2 ShapeBlue)
>>
>> I did this in CS 4.5.2 i also used this version for KVM with local storage 
>> and works. but on VMware i have this issue.
>>
>>
>>
>>
>> B. I have this error when i try the following task ( CS 4.5.2 ShapeBlue - 
>> VMware 5.5 - Local Storage enabled with Basic networking ):
>>
>> I installed an Windows 2008 from ISO file, after this i tried to create 
>> template from ROOT volume, but i get this error : Failed to create 
>> templatecreate template from volume exception: Exception: 
>> java.lang.NullPointerException
>> Message: null
>>
>>
>>
>>
>> A. I see this error when i try to deploy a vm from default template ( CS 
>> 4.5.2 ShapeBlue - VMware 5.5 - Local Storage enabled with Basic networking ):
>>
>> root@ns52 management]# grep -r job-79 --color
>> management-server.log:2016-01-26 06:28:27,608 DEBUG 
>> [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-14:ctx-107b2062 job-78 
>> ctx-9e2c938d) Sync job-79 execution on object VmWorkJobQueue.12
>> management-server.log:2016-01-26 06:28:29,292 DEBUG 
>> [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-336c2f61) 
>> Schedule queued job-79
>> management-server.log:2016-01-26 06:28:29,307 INFO 
>> [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-25:ctx-7bfca42f 
>> job-78/job-79) Add job-79 into job monitoring
>> management-server.log:2016-01-26 06:28:29,320 DEBUG 
>> [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-7bfca42f 
>> job-78/job-79) Executing AsyncJobVO {id:79, userId: 2, accountId: 2, 
>> instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, 
>> cmdInfo: 
>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAACAAIADHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAXBzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAFxAH4ACnBwcHEAfgAKcHN
y

> A
> BFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0x3CBABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
>  cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: 
> null, initMsid: 37591044139110, completeMsid: null, lastUpdated: null, 
> lastPolled: null, created: Tue Jan 26 06:28:27 EST 2016}
>> management-server.log:2016-01-26 06:28:29,321 DEBUG 
>> [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-25:ctx-7bfca42f 
>> job-78/job-79) Run VM work job: com.cloud.vm.VmWorkStart for VM 12, job 
>> origin: 78
>> management-server.log:2016-01-26 06:28:29,323 DEBUG 
>> [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-25:ctx-7bfca42f 
>> job-78/job-79 ctx-67168166) Execute VM work job: 
>> com.cloud.vm.VmWorkStart{"dcId":1,"podId":1,"clusterId":1,"hostId":1,"rawPara

RE: overprovisioning of local storage

[Somesh Naidu]

As per 4.6 docs, storage overprovisioning is only supported with NFS when using 
XenServer, refer 
http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.6/choosing_deployment_architecture.html.

I have not come across a feature request for implementing this feature for 
local storage. In case you wish to raise one then please do so here, 
https://issues.apache.org/jira/browse/CLOUDSTACK/. Note, please double check if 
one already exists.

Regards,
Somesh


-Original Message-
From: ilya [mailto:ilya.mailing.li...@gmail.com] 
Sent: Monday, February 01, 2016 2:50 PM
To: users@cloudstack.apache.org
Subject: Re: overprovisioning of local storage

Its a bug that was fixed in latest 4.5

On 2/1/16 2:22 AM, S. Brüseke - proIO GmbH wrote:
> Hi,
> 
> we are using CS 4.4.0 and it looks like we are unable to overprovisioning 
> local storage. We configured storage.overprovisioning.factor with 4 and using 
> ext local storage on XenServer pools. Is this a known limitation/bug? And if 
> so does anybody know if this has been fixed in newer versions?
> 
> Thanks for any help and clarification on this!
> 
> Mit freundlichen Grüßen / With kind regards,
> 
> Swen
> 
> 
> 
> 
> - proIO GmbH -
> Geschäftsführer: Swen Brüseke
> Sitz der Gesellschaft: Frankfurt am Main
> 
> USt-IdNr. DE 267 075 918
> Registergericht: Frankfurt am Main - HRB 86239
> 
> Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte 
> Informationen. 
> Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich 
> erhalten haben, 
> informieren Sie bitte sofort den Absender und vernichten Sie diese Mail. 
> Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail sind nicht 
> gestattet. 
> 
> This e-mail may contain confidential and/or privileged information. 
> If you are not the intended recipient (or have received this e-mail in error) 
> please notify 
> the sender immediately and destroy this e-mail.  
> Any unauthorized copying, disclosure or distribution of the material in this 
> e-mail is strictly forbidden. 
> 
> 

RE: overprovisioning of local storage

[Somesh Naidu]

Interesting though that there is a defect 
(https://issues.apache.org/jira/browse/CLOUDSTACK-8313), that seems to address 
this, that's fixed in 4.6 as per the Jira ticket and comments suggest that the 
changes were merged in master and 4.5 
(9836ccdcf3b339718676847c1cfaee80cbffc1ca/ 
940622c32fb0326dd2b081304edb809b66d4c751).

So the documentation needs an update.

Regards,
Somesh


-Original Message-
From: Somesh Naidu [mailto:somesh.na...@citrix.com]
Sent: Monday, February 01, 2016 3:03 PM
To: users@cloudstack.apache.org
Subject: RE: overprovisioning of local storage

As per 4.6 docs, storage overprovisioning is only supported with NFS when using 
XenServer, refer 
http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.6/choosing_deployment_architecture.html.

I have not come across a feature request for implementing this feature for 
local storage. In case you wish to raise one then please do so here, 
https://issues.apache.org/jira/browse/CLOUDSTACK/. Note, please double check if 
one already exists.

Regards,
Somesh


-Original Message-
From: ilya [mailto:ilya.mailing.li...@gmail.com]
Sent: Monday, February 01, 2016 2:50 PM
To: users@cloudstack.apache.org
Subject: Re: overprovisioning of local storage

Its a bug that was fixed in latest 4.5

On 2/1/16 2:22 AM, S. Brüseke - proIO GmbH wrote:
> Hi,
>
> we are using CS 4.4.0 and it looks like we are unable to overprovisioning 
> local storage. We configured storage.overprovisioning.factor with 4 and using 
> ext local storage on XenServer pools. Is this a known limitation/bug? And if 
> so does anybody know if this has been fixed in newer versions?
>
> Thanks for any help and clarification on this!
>
> Mit freundlichen Grüßen / With kind regards,
>
> Swen
>
>
>
>
> - proIO GmbH -
> Geschäftsführer: Swen Brüseke
> Sitz der Gesellschaft: Frankfurt am Main
>
> USt-IdNr. DE 267 075 918
> Registergericht: Frankfurt am Main - HRB 86239
>
> Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte Informationen.
> Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich 
> erhalten haben,
> informieren Sie bitte sofort den Absender und vernichten Sie diese Mail.
> Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail sind nicht 
> gestattet.
>
> This e-mail may contain confidential and/or privileged information.
> If you are not the intended recipient (or have received this e-mail in error) 
> please notify
> the sender immediately and destroy this e-mail.
> Any unauthorized copying, disclosure or distribution of the material in this 
> e-mail is strictly forbidden.
>
>

RE: Network Rate

[Somesh Naidu]

One way to accomplish this would be to set rate limit on Network offering (in 
UI, the label for that parameter is “Network Rate (Mb/s)”) that would be used 
specifically to create network/s specific to that particular account.

Regards,
Somesh

From: Yesid Mora [mailto:ym...@o4it.com]
Sent: Friday, February 19, 2016 1:51 PM
To: users@cloudstack.apache.org
Subject: Network Rate

Hello guys, we have a problem, we need to limit the Network-rate for the all 
VM’s on a specific account  the bandwidth require for the client its 2Mb, which 
parameters in offering (Compute, system, disk, network) do I need to change in 
order to apply the limit?.

Thanks




Cordialmente / Best regards,





Yesid Mora | Orchestration Engineer | O4IT


PBX:+57 (1) 423-5460  Ext  251  | Cel: 3124509565


Cr. 7 #74-56 | Oficina 202 | Bogotá, Colombia


www.o4it.com | ym...@o4it.com




[http://www.o4it.com][http://www.linkedin.com/company/1207504][https://twitter.com/o4it][https://www.facebook.com/o4itofficial][https://www.youtube.com/user/o4itofficial]





CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is for 
the sole use of the intended recipient(s) and may contain confidential or 
proprietary information. Any unauthorized review, use, disclosure or 
distribution is prohibited. If you are not the intended recipient, immediately 
contact the sender by reply e-mail and destroy all copies of the original 
message.

RE: Virtual router starting

[Somesh Naidu]

Mohd,

Did you get this fixed? If not, could you share entire logs relevant to this 
incident via pastebin or similar so we can ascertain the cause. In addition, 
please specify the version you are using (best is to share output of 
cloudstack-sccs).

Regards,
Somesh

-Original Message-
From: Mohd Zainal Abidin Rabani [mailto:zai...@nocser.net] 
Sent: Monday, February 22, 2016 10:45 PM
To: users@cloudstack.apache.org
Subject: Virtual router starting

Hi,

I saw virtual router on starting state. About a few it show error:

Unable to get answer that is of class com.cloud.agent.api.StartAnswer

This is from server logs:

2016-02-23 11:42:08,033 ERROR [c.c.a.ApiAsyncJobDispatcher] 
(API-Job-Executor-1:ctx-05d8d07d job-1054) Unexpected exception while 
executing org.apache.cloudstack.api.command.admin.router.StartRouterCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to get answer 
that is of class com.cloud.agent.api.StartAnswer
 at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80)
 at 
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1032)
 at 
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:497)
 at 
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
 at 
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
 at 
com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
 at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
 at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
 at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
 at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
 at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
 at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
 at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
 at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
 at java.lang.Thread.run(Thread.java:745)
2016-02-23 11:42:08,035 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(API-Job-Executor-1:ctx-05d8d07d job-1054) Complete async job-1054, 
jobStatus: FAILED, resultCode: 530, result: 
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
 
to get answer that is of class com.cloud.agent.api.StartAnswer"}

-
Regards,
Mohd Zainal Abidin Rabani
Technical Support

ModernOne Data Solutions Sdn. Bhd.(1119382-D)
No. 83-2, Jalan TKS 1,
Kajang Sentral, 43000 Kajang, Selangor.
T : 03-8737 0030 | F : 03-8737 0070
E : zai...@nocser.net
W : www.modern.com.my | www.nocser.net

RE: Cannot take snapshot ok KVM in 4.8

[Somesh Naidu]

Rui,

That global config is for volume snapshots not virtual machine snapshots.

Verify and update the following in the DB:
select vm_snapshot_enabled from hypervisor_capabilities where 
hypervisor_type='KVM';

Regards,
Somesh


-Original Message-
From: Rui Mao [mailto:maoru...@163.com] 
Sent: Wednesday, February 24, 2016 4:31 AM
To: users@cloudstack.apache.org
Subject: Cannot take snapshot ok KVM in 4.8

Hi all,

 

CloudStack 4.8 & Ubuntu 14.04-3

 

I've set kvm.snapshot.enabled=true and rebooted the management server. But I
still could not take snapshot of KVM VMs. Why?

 

2016-02-24 15:19:48,565 DEBUG [c.c.a.ApiServlet]
(catalina-exec-24:ctx-c807e476) (logid:e61e9a4e) ===START===  10.3.0.230 --
GET
command=createVMSnapshot&virtualmachineid=1ea88b02-a560-4651-ba70-7131b0ce2c
08&snapshotmemory=false&quiescevm=false&name=vm1&response=json&_=14562983878
66

2016-02-24 15:19:48,583 INFO  [c.c.a.ApiServer]
(catalina-exec-24:ctx-c807e476 ctx-e13a9b41) (logid:e61e9a4e) VM snapshot is
not enabled for hypervisor type: KVM

2016-02-24 15:19:48,584 DEBUG [c.c.a.ApiServlet]
(catalina-exec-24:ctx-c807e476 ctx-e13a9b41) (logid:e61e9a4e) ===END===
10.3.0.230 -- GET
command=createVMSnapshot&virtualmachineid=1ea88b02-a560-4651-ba70-7131b0ce2c
08&snapshotmemory=false&quiescevm=false&name=vm1&response=json&_=14562983878
66

 

Best regards,

Rui Mao

 

RE: URGENT - CloudStack agent not able to connect to management server

[Somesh Naidu]

> Eventually, we could only connect back the host after we rebooted it, which 
> means sacrificing all the VMs which were still up and running during the 
> disconnection.

Instead of rebooting the KVM hosts, you may want try stopping the agent on all 
the hosts and then starting the agent service one by one.

> Will adding new management server be able to resolve the problem?

That really depends on whether your existing management servers are optimally 
tuned and still the resources are getting maxed out, if not, adding another 
server will be more of an overhead than benefit. 

Regards,
Somesh

-Original Message-
From: Indra Pramana [mailto:in...@sg.or.id] 
Sent: Sunday, April 03, 2016 7:44 AM
To: users@cloudstack.apache.org
Subject: Re: URGENT - CloudStack agent not able to connect to management server

Hi Lucian,

Good day to you, and thank you for your reply. Apologise for the delay in
my reply.

Yes, I can confirm that we can access the host and port specified. Based on
the logs, the host can connect to the management server but there's no
follow-up logs which usually come after it's connected. Eventually, we
could only connect back the host after we rebooted it, which means
sacrificing all the VMs which were still up and running during the
disconnection.

At the time when the first hypervisor was disconnected, the CloudStack
management servers were very busy handling the disconnections, trying to
fence the hosts and initiate HA for all the affected VMs, based on the
logs. Could this have put a strain on the management server, causing it to
disconnect all the remaining hosts? Will adding new management server be
able to resolve the problem?

Any advice is appreciated.

Looking forward to your reply, thank you.

Cheers.

On Thu, Mar 31, 2016 at 5:28 PM, Nux!  wrote:

> Hello,
>
> Are you sure you can connect from the hypervisors to the
> cloudstack-management on the host and port specified in the
> agent.properties?
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>
> - Original Message -
> > From: "Indra Pramana" 
> > To: users@cloudstack.apache.org
> > Sent: Thursday, 31 March, 2016 03:14:59
> > Subject: URGENT - CloudStack agent not able to connect to management
> server
>
> > Dear all,
> >
> > We are using CloudStack 4.2.0, KVM hypervisor and Ceph RBD storage. All
> our
> > agents got disconnected from the management server and unable to connect
> > again, despite rebooting the management server and stopping and
> restarting
> > the cloudstack-agent many times.
> >
> > We even tried to physically reboot a hypervisor host (sacrificing all the
> > running VMs inside) to see if it can reconnect after boot-up, and it's
> not
> > able to reconnect (keep on "Connecting" state). Here's the excerpts from
> > the logs:
> >
> > 
> > 2016-03-31 10:07:49,346 DEBUG [cloud.agent.Agent] (UgentTask-5:null)
> > Sending ping: Seq 0-11:  { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 11,
> >
> [{"com.cloud.agent.api.PingRoutingWithNwGroupsCommand":{"newGroupStates":{},"newStates":{},"_gatewayAccessible":true,"_vnetAccessible":true,"hostType":"Routing","hostId":0,"wait":0}}]
> > }
> > 2016-03-31 10:07:49,395 DEBUG [cloud.agent.Agent] (Agent-Handler-2:null)
> > Received response: Seq 0-11:  { Ans: , MgmtId: 161342671900, via: 75,
> Ver:
> > v1, Flags: 100010,
> >
> [{"com.cloud.agent.api.PingAnswer":{"_command":{"hostType":"Routing","hostId":0,"wait":0},"result":true,"wait":0}}]
> > }
> > 2016-03-31 10:08:49,271 DEBUG [kvm.resource.LibvirtComputingResource]
> > (UgentTask-5:null) Executing:
> > /usr/share/cloudstack-common/scripts/vm/network/security_group.py
> > get_rule_logs_for_vms
> > 2016-03-31 10:08:49,350 DEBUG [kvm.resource.LibvirtComputingResource]
> > (UgentTask-5:null) Execution is successful.
> > 2016-03-31 10:08:49,353 DEBUG [cloud.agent.Agent] (UgentTask-5:null)
> > Sending ping: Seq 0-12:  { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 11,
> >
> [{"com.cloud.agent.api.PingRoutingWithNwGroupsCommand":{"newGroupStates":{},"newStates":{},"_gatewayAccessible":true,"_vnetAccessible":true,"hostType":"Routing","hostId":0,"wait":0}}]
> > }
> > 2016-03-31 10:08:49,406 DEBUG [cloud.agent.Agent] (Agent-Handler-3:null)
> > Received response: Seq 0-12:  { Ans: , MgmtId: 161342671900, via: 75,
> Ver:
> > v1, Flags: 100010,
> >
> [{"com.cloud.agent.api.PingAnswer":{"_command":{"hostType":"Routing","hostId":0,"wait":0},"result":true,"wait":0}}]
> > }
> > 2016-03-31 10:09:49,272 DEBUG [kvm.resource.LibvirtComputingResource]
> > (UgentTask-5:null) Executing:
> > /usr/share/cloudstack-common/scripts/vm/network/security_group.py
> > get_rule_logs_for_vms
> > 2016-03-31 10:09:49,345 DEBUG [kvm.resource.LibvirtComputingResource]
> > (UgentTask-5:null) Execution is successful.
> > 2016-03-31 10:09:49,347 DEBUG [cloud.agent.Agent] (UgentTask-5:null)
> > Sending ping: Seq 0-13:  { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 11,
> >
> [{"com.cloud.agent.api.PingRoutingWithNwGroupsCo

RE: (Re-)introduction

[Somesh Naidu]

Good to see you back Kirk!

Regards,
Somesh


-Original Message-
From: Kirk Kosinski [mailto:kirk.kosin...@shapeblue.com] 
Sent: Tuesday, April 05, 2016 10:43 PM
To: users@cloudstack.apache.org
Subject: (Re-)introduction
Importance: Low

Hi, Apache CloudStack users.  If you don't know me, I'm Kirk, an ACS committer 
and former employee of Cloud.com and Citrix.  I haven't been very active on the 
lists lately, but I recently joined ShapeBlue and I will be helping out more 
here and other areas in the community.  If you happen to be attending ApacheCon 
NA next month, I'll be presenting a CloudStack-related session, so please check 
it out and say hello.  Thanks!!

Kirk


Regards,

Kirk Kosinski

kirk.kosin...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HS
@shapeblue

RE: Calculating vm network usage

[Somesh Naidu]

VM statistics are different from usage. These are runtime information stored in 
objects and never persisted. So yes this is the intended behavior.

On the other hand, network usage/statistics are processed by ACS usage server 
and they are persisted in the DB (I forget the table names) so you should be 
able to work with those. 

Regards,
Somesh

-Original Message-
From: Özhan Rüzgar Karaman [mailto:oruzgarkara...@gmail.com] 
Sent: Thursday, April 28, 2016 9:11 AM
To: users@cloudstack.apache.org
Subject: Calculating vm network usage

Hi;
We plan to monthly calculate vm network usage on ACS 4.8, normally we plan
to use CloudStack vm statistics, via api(listvirtualmachines) but today we
realised that when you restart CloudStack management server, the current
values are reset, so you loose all the values before management server
restart.

So is this behaviour normal that when you restart management server you
loose all the values there. So i like to understand if this a bug or if
this is a normal behaviour of ACS. My ACS also has usage server working
over it.

Thanks for all replies

Özhan

RE: [ANNOUNCE] Will Stevens as new Apache CloudStack VP

[Somesh Naidu]

Congratulations Will!

Regards,
Somesh

-Original Message-
From: Tutkowski, Mike [mailto:mike.tutkow...@netapp.com] 
Sent: Monday, May 23, 2016 2:13 AM
To: d...@cloudstack.apache.org
Cc: users@cloudstack.apache.org; market...@cloudstack.apache.org
Subject: Re: [ANNOUNCE] Will Stevens as new Apache CloudStack VP

Congratulations, Will!

> On May 22, 2016, at 10:29 PM, Prashant Mishra 
>  wrote:
> 
> Congrats Will!
> 
> 
>> On 5/19/16, 2:02 PM, "Jayapal Uradi"  wrote:
>> 
>> Congrats Will.
>> 
>> Thanks,
>> Jayapal
>>> On 19-May-2016, at 1:54 pm, Rohit Yadav 
>>> wrote:
>>> 
>>> Congrats Will.
>>> 
>>> Regards,
>>> Rohit Yadav
>>> 
>>> 
>>> rohit.ya...@shapeblue.com
>>> www.shapeblue.com
>>> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>>> @shapeblue
>>> 
>>> 
>>> On May 19 2016, at 12:26 pm, Sebastien Goasguen 
>>> wrote:
>>> 
>>> Morning Everyone,
>>> 
>>> Yesterday at the ASF board meeting, the board passed the resolution
>>> making Will Stevens the new Vice President of the Apache CloudStack
>>> project.
>>> 
>>> Join me in congratulating Will on this appointment, wish him luck and
>>> bring your unwavering support !
>>> 
>>> You may have noticed that Will took on RM duties for the new releases
>>> going forward and has also taken a very active role to finish bringing
>>> us to github based workflow and CI. Will has some updates on that front
>>> that I am sure you will all like.
>>> 
>>> -Sebastien
>>> Former VP CloudStack
>> 
>> 
>> 
>> 
>> DISCLAIMER
>> ==
>> This e-mail may contain privileged and confidential information which is
>> the property of Accelerite, a Persistent Systems business. It is intended
>> only for the use of the individual or entity to which it is addressed. If
>> you are not the intended recipient, you are not authorized to read,
>> retain, copy, print, distribute or use this message. If you have received
>> this communication in error, please notify the sender and delete all
>> copies of this message. Accelerite, a Persistent Systems business does
>> not accept any liability for virus infected mails.
> 
> 
> 
> 
> DISCLAIMER
> ==
> This e-mail may contain privileged and confidential information which is the 
> property of Accelerite, a Persistent Systems business. It is intended only 
> for the use of the individual or entity to which it is addressed. If you are 
> not the intended recipient, you are not authorized to read, retain, copy, 
> print, distribute or use this message. If you have received this 
> communication in error, please notify the sender and delete all copies of 
> this message. Accelerite, a Persistent Systems business does not accept any 
> liability for virus infected mails.

RE: Question about migrating local storage datadisks

[Somesh Naidu]

First off, for datadisks, you may not explicitly need to move them around. If 
you detach it from the existing VM and attach it to another VM (essentially the 
host running that VM) that does not have access to the storage where the 
datadisk currently resides, then cloudstack will copy the datadisk to a storage 
accessible to that host.

> I’m confused why we can’t snapshot a datadisk, which, if I understand
> correctly, should then get copied to secondary storage, and then bring it
> up on another host. I hope I’m just missing something obvious.

You can snapshot a datadisk and the snapshot will reside on the secondary 
store, that bit is straight/correct.

I do not understand what you mean when you say "bring it up on another host".
The part that is not clear is what does "bring it up" mean? Also, what you mean 
by "host", hypervisor or storage? Do you mean the datadisks are bootable and 
you want to start them on a different host? If so, know that you can't launch a 
VM directly off of a snapshot, you’d have to convert it to a template and then 
launch a VM from it. The VM could be launched on any host - if this is the 
use-case/scenario you had in mind then yes, you will achieve what you need this 
way.

Regards,
Somesh


-Original Message-
From: technopathol...@gmail.com [mailto:technopathol...@gmail.com] On Behalf Of 
Douglas Land
Sent: Wednesday, July 06, 2016 3:03 PM
To: users@cloudstack.apache.org
Subject: Question about migrating local storage datadisks

We use local storage for everything, including datadisks. We need to
migrate these to another host, which docs all seem to say isn’t supported.
I’m confused why we can’t snapshot a datadisk, which, if I understand
correctly, should then get copied to secondary storage, and then bring it
up on another host. I hope I’m just missing something obvious.

RE: Question about migrating local storage datadisks

[Somesh Naidu]

Yes, as long as the hypervisor host where the VM is running in step #5 does not 
have access to the storage where the datadisk currently resides.

Regards,
Somesh

-Original Message-
From: technopathol...@gmail.com [mailto:technopathol...@gmail.com] On Behalf Of 
Douglas Land
Sent: Thursday, July 07, 2016 1:30 AM
To: users@cloudstack.apache.org
Subject: Re: Question about migrating local storage datadisks

So I'm not sure I understood you correctly but the steps as I tries them
were:
1) shut down a VM
2) detach datadisk
3) migrate VM
4) re-attach datadisk??
5) restart the VM

Is that the correct scenario where cloudstack should migrate the datadisk
for me?


On Wed, Jul 6, 2016 at 4:35 PM, Douglas Land  wrote:

> Thanks Somesh, I'll try just moving the VM and see if it triggers a
> datadisk migration.
>
> Sorry, by 'bring up' I just meant migrate to a new host.
>
>
> On Wednesday, July 6, 2016, Somesh Naidu  wrote:
>
>> First off, for datadisks, you may not explicitly need to move them
>> around. If you detach it from the existing VM and attach it to another VM
>> (essentially the host running that VM) that does not have access to the
>> storage where the datadisk currently resides, then cloudstack will copy the
>> datadisk to a storage accessible to that host.
>>
>> > I’m confused why we can’t snapshot a datadisk, which, if I understand
>> > correctly, should then get copied to secondary storage, and then bring
>> it
>> > up on another host. I hope I’m just missing something obvious.
>>
>> You can snapshot a datadisk and the snapshot will reside on the secondary
>> store, that bit is straight/correct.
>>
>> I do not understand what you mean when you say "bring it up on another
>> host".
>> The part that is not clear is what does "bring it up" mean? Also, what
>> you mean by "host", hypervisor or storage? Do you mean the datadisks are
>> bootable and you want to start them on a different host? If so, know that
>> you can't launch a VM directly off of a snapshot, you’d have to convert it
>> to a template and then launch a VM from it. The VM could be launched on any
>> host - if this is the use-case/scenario you had in mind then yes, you will
>> achieve what you need this way.
>>
>> Regards,
>> Somesh
>>
>>
>> -Original Message-
>> From: technopathol...@gmail.com [mailto:technopathol...@gmail.com] On
>> Behalf Of Douglas Land
>> Sent: Wednesday, July 06, 2016 3:03 PM
>> To: users@cloudstack.apache.org
>> Subject: Question about migrating local storage datadisks
>>
>> We use local storage for everything, including datadisks. We need to
>> migrate these to another host, which docs all seem to say isn’t supported.
>> I’m confused why we can’t snapshot a datadisk, which, if I understand
>> correctly, should then get copied to secondary storage, and then bring it
>> up on another host. I hope I’m just missing something obvious.
>>
>

RE: can't import VHD

[Somesh Naidu]

Could you check what global configuration parameter 
"secstorage.allowed.internal.sites" is set to?

-Original Message-
From: Andrew Kirch [mailto:trel...@trelane.net] 
Sent: Tuesday, 9 December 2014 4:30 PM
To: users@cloudstack.apache.org
Subject: can't import VHD

I'm attempting to import a VHD to a template.  I've set up a webserver on the 
local Cloudstack box, but am getting connection refused.  Apache is claiming 
it's sending a 200 and the file.
i
  CloudStack is saying:
Home

  * Templates
  * Zenoss425


Zones:

Zone name Connection refused no +

apache is saying:
192.168.100.20 - - [09/Dec/2014:16:04:26 -0500] "GET /Zenoss425.vhd HTTP/1.1" 
200 6301425664 "-" "Java/1.7.0_71"


Obviously this is something simple, but what am I missing?

Andrew

RE: ACS 4.4.1 XenServer 6.2 - VMs lost connection in "Isolated" network

[Somesh Naidu]

Check routes on the guests that are having trouble. You should verify if the 
public traffic from these guests is reaching the router.

-Original Message-
From: Motty Cruz [mailto:motty.c...@gmail.com] 
Sent: Tuesday, 9 December 2014 11:46 AM
To: users@cloudstack.apache.org
Subject: ACS 4.4.1 XenServer 6.2 - VMs lost connection in "Isolated" network

Hi All,

I have total of about 5 VMs on "Isolated" network, but they lost connection to 
outside world. I am able to ping the VR but can't ping to outside world. If I 
log in to VR, am able to ping anywhere outside or inside network.

out of the 5 VMs, 3 machines never loose connection, the two VMs that do loose 
connection are windows machines. To get the connection again, I have to restart 
VR. Any ideas?

I want to mentioned that, I have three other "Isolated" networks in the same 
zone. I do not have problems with other "Isolated" networks.

I do need help!

Thanks,
Motty

RE: Not able to upload templates: Connection timed out

[Somesh Naidu]

Vlad,

Two things, 
a. looking up the specific error message in ssvm logs 
(/var/log/cloud/cloud.out) should give a better insight on what's happening 
(not working).
b. running ssvm-check.sh will test this for you (if you can mount sec storage 
within the SSVM).

The below link will provide you with lot more troubleshooting tips:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM,+templates,+Secondary+storage+troubleshooting

-Original Message-
From: Vladislav Nazarenko [mailto:vladislav.nazare...@gmail.com] 
Sent: Wednesday, December 10, 2014 3:10 PM
To: users@cloudstack.apache.org
Subject: Re: Not able to upload templates: Connection timed out

Hi Guys,

thanx a lot for your prompt responses:

@Dave:
  The image(http://IP/CentOS-6-x86_64-vanilla-kvm.qcow2.bz2) is 
available and can be downloaded (tested with wget)

@Tejas: Hypervisor hosts  are able to mount the secondary storage
How can I debug this on the SSVM?

Kind regards
Vlad

On 10.12.2014 20:44, Tejas Sheth wrote:
> Hi Vlad,
>
>I was also getting the same error few days ago, for me the issue was my
> SSVM was not able to mount Secondary storage.
> Make sure that all your hypervisor hosts and system vms are able to access
> nfs secondary storage.
>
> Thanks,
> Tejas
>
>
> On Thu, Dec 11, 2014 at 1:07 AM, Dave Dunaway 
> wrote:
>
>> Hey Vlado,
>>
>> Check out your download URL 
>>
>> "http://IP/CentOS-6-x86_64-vanilla-kvm.qcow2.bz2
>> "
>>
>>
>>
>> On Wed, Dec 10, 2014 at 1:56 PM, Vladislav Nazarenko <
>> vladislav.nazare...@gmail.com> wrote:
>>
>>> Hi Everybody,
>>>
>>> need help with a fresh installed cloudstack with basic setup.
>>>
>>> System VMs are running. Trying to upload a template a see the following
>> in
>>> /var/log/cloudstack/management/management-server.log
>>>
>>> 2014-12-10 18:35:22,043 DEBUG [c.c.a.t.Request] (Timer-13:ctx-8ce1d6ae)
>>> Seq 3-8582734989861322876: Sending  { Cmd , MgmtId: 207379926576, via:
>>> 3(s-2-VM), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.
>>> storage.command.DownloadProgressCommand":{"jobId":"2683e976-bd26-450d-
>>> 8774-092665b1233e","request":"GET_STATUS","hvm":true,"
>>> description":"CENTOS","maxDownloadSizeInBytes":53687091200,"id":209,"
>>> resourceType":"TEMPLATE","installPath":"template/tmpl/2/
>>> 209","_store":{"com.cloud.agent.api.to.NfsTO":{"_url":"
>>> nfs://IP/secondary","_role":"Image"}},"url":"http://IP/
>>> CentOS-6-x86_64-vanilla-kvm.qcow2.bz2","format":"QCOW2","
>>> accountId":2,"name":"209-2-4a99674a-acce-36e0-b2f6-
>>> e12a7ad15e6b","secUrl":"nfs://IP/secondary","wait":0}}] }
>>>
>>> Please advice
>>> Vlad
>>>
>>>

RE: Not able to upload templates: Connection timed out

[Somesh Naidu]

> So... how can I change the password or install an ssh pub key?

You can do either,
1. create a VM from that template, customize it, like change passwd etc and 
then created a template out of it 
(https://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.2/html/Admin_Guide/create-template-from-existing-vm.html)
2. upload a ssh keypair and assign it to the VM 
(https://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.2/html/Installation_Guide/using-sshkeys.html)

In addition, you could also a template as password enabled so cloudstack can be 
used to manage/reset the password 
(https://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.0.2/html/Admin_Guide/add-password-management-to-templates.html)

Hope that helps.

-Original Message-
From: Vladislav Nazarenko [mailto:vladislav.nazare...@gmail.com] 
Sent: Thursday, December 11, 2014 1:29 PM
To: users@cloudstack.apache.org
Subject: Re: Not able to upload templates: Connection timed out

Guys ...

Tejas, Tilak, Somesh,

thanx a lot! With your workarounds I was able to login to SSVM, find the 
reason and upload an image!!!

So I can now create instances now ...

May be one more question ... I downloaded a template (centos) from hier 
http://dl.openvm.eu/cloudstack/centos/vanilla/6/x86_64/CentOS-6-x86_64-vanilla-kvm.qcow2.bz2

It looks like the rootpw is password (according to the kickstart 
http://dl.openvm.eu/cloudstack/centos/ks/vanilla/6/security.ks)

So... how can I change the password or install an ssh pub key?

Thank you in advance
Vlad


On 10.12.2014 20:44, Tejas Sheth wrote:
> Hi Vlad,
>
>I was also getting the same error few days ago, for me the issue was my
> SSVM was not able to mount Secondary storage.
> Make sure that all your hypervisor hosts and system vms are able to access
> nfs secondary storage.
>
> Thanks,
> Tejas
>
>
> On Thu, Dec 11, 2014 at 1:07 AM, Dave Dunaway 
> wrote:
>
>> Hey Vlado,
>>
>> Check out your download URL 
>>
>> "http://IP/CentOS-6-x86_64-vanilla-kvm.qcow2.bz2
>> "
>>
>>
>>
>> On Wed, Dec 10, 2014 at 1:56 PM, Vladislav Nazarenko <
>> vladislav.nazare...@gmail.com> wrote:
>>
>>> Hi Everybody,
>>>
>>> need help with a fresh installed cloudstack with basic setup.
>>>
>>> System VMs are running. Trying to upload a template a see the following
>> in
>>> /var/log/cloudstack/management/management-server.log
>>>
>>> 2014-12-10 18:35:22,043 DEBUG [c.c.a.t.Request] (Timer-13:ctx-8ce1d6ae)
>>> Seq 3-8582734989861322876: Sending  { Cmd , MgmtId: 207379926576, via:
>>> 3(s-2-VM), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.
>>> storage.command.DownloadProgressCommand":{"jobId":"2683e976-bd26-450d-
>>> 8774-092665b1233e","request":"GET_STATUS","hvm":true,"
>>> description":"CENTOS","maxDownloadSizeInBytes":53687091200,"id":209,"
>>> resourceType":"TEMPLATE","installPath":"template/tmpl/2/
>>> 209","_store":{"com.cloud.agent.api.to.NfsTO":{"_url":"
>>> nfs://IP/secondary","_role":"Image"}},"url":"http://IP/
>>> CentOS-6-x86_64-vanilla-kvm.qcow2.bz2","format":"QCOW2","
>>> accountId":2,"name":"209-2-4a99674a-acce-36e0-b2f6-
>>> e12a7ad15e6b","secUrl":"nfs://IP/secondary","wait":0}}] }
>>>
>>> Please advice
>>> Vlad
>>>
>>>

RE: Network Traffic Statistics

[Somesh Naidu]

Network Stats (listVirtualMachines ) and Network Usage (listUsageRecords) are 
two different entities. 

The former is run time stats received from the hypervisor and isn't stored or 
used by cloudstack.

The latter is raw CCP usage and as you mentioned, gathered via iptables on VR 
and only captures traffic on public interface.

-Original Message-
From: Logan Barfield [mailto:lbarfi...@tqhosting.com] 
Sent: Friday, December 12, 2014 3:20 PM
To: users@cloudstack.apache.org
Subject: Network Traffic Statistics

Just a quick question about traffic statistics.

Currently there appear to be two ways to pull network statistics in an
advanced zone:

- listVirtualMachines
-> Returns networkkbsread & networkkbswrite

- listUsageRecords
-> Type 4: Bytes sent
-> Type 5: Bytes received

I assume both of these list the aggregate network traffic for each VM (both
public and between VMs on the same network).

My question is: Is there currently a way via CloudStack to pull only the
public network traffic for a given network (incoming and outgoing)?

The statistics gathering seems to use the NETWORK_STATS IPtables entries on
the VR, so I would think it could pull the traffic for just the public
interface.  Even better would be to pull the traffic for each public IP,
but that would be a bit more difficult I assume.



Thank You,

Logan Barfield
Tranquil Hosting

RE: SSVM weird behavior

[Somesh Naidu]

VM state is reflected in "vm_instance" table. You could update the state using 
the following SQL:
update vm_instance set state='Up', host_id= where id=; 
//host_id is where the VM is running

Agent status is reflected in "host table". Make sure the entries in the two 
tables correctly correspond to each other.

I would recommend to check all network interfaces (specially the 
private/link-local IP) are sending/receiving traffic. It would also benefit to 
run the ssvm diagnostic tool to check for any discrepancy.

-Original Message-
From: Tejas Sheth [mailto:tshet...@gmail.com] 
Sent: Sunday, December 14, 2014 4:16 AM
To: users@cloudstack.apache.org
Subject: SSVM weird behavior

Hello guyz,

  we were doing HA testing for xenservers. when SSVM restarted to another
host in cloudstack VM State stuck to "STARTING" but agent state is "UP" . I
tried to upload and ISO to secondary storage which is working fine.

  is it because cloudstakc was not able to update the record in VM_instance
table?

 Which table i have to modify to change the VM status from "Starting" to
"UP"?

Thanks,
Tejas

RE: Virtual Router - Make default gateway

[Somesh Naidu]

You need to choose the correct provider for all the services being offered. In 
your case, make sure you have selected VR as the provider.

Also, when provisioning the VM mark the particular network as default network 
so the correct routes are added.

-Original Message-
From: Matthew Midgett [mailto:clouds...@trick-solutions.com.INVALID] 
Sent: Tuesday, December 16, 2014 9:37 AM
To: users@cloudstack.apache.org
Subject: Virtual Router - Make default gateway

How do I make the ACS Virtual router for a guest network the default router
for that network. It should do this by default right?

 

Example

 

Vlan600 tagged on router with trunk interface no IP

CloudStack VR 10.0.1.1 as gateway with a Vlan 600

Public 0.0.0.0/24

 

I want the VR to offer all of the services. I tried this and with HA the
VR's took random addresses. I must be doing something incorrect. Some light
please.

 

 

Matthew Midgett

Trick Solutions

143 Jenny Marie Rd

Mooresville NC,28115

336-618-7425 Office

704-728-5644 Cell

www.trick-solutions.com

 

RE: NFS Staging Store

[Somesh Naidu]

You should be able to replace the secondary storage. The procedure should be in 
the administration guide.

You should be able to either provision additional storage to a zone or replace 
the existing storage with a larger one.

-Original Message-
From: Logan Barfield [mailto:lbarfi...@tqhosting.com] 
Sent: Tuesday, December 16, 2014 4:06 PM
To: d...@cloudstack.apache.org; users@cloudstack.apache.org
Subject: NFS Staging Store

I am attempting to increase the size of our NFS staging store because we
have several customers that want to create snapshots of 1TB+ disks.

Is it possible to simply add a second staging store to a zone to increase
the capacity?  Or would I need to add a larger staging store, then remove
the old one in order for it to work?

If I have to replace it completely, is there a way to convert the data in
the current staging store to a new one?  If I remove the old one, will it
automatically clean up any data there?

RE: ACS 4.4.1 network.throttling.rate - Advance Zone- XenServer 6.2

[Somesh Naidu]

Did you check the network service offering? What's the network rate set there?

-Original Message-
From: Motty Cruz [mailto:motty.c...@gmail.com] 
Sent: Thursday, December 18, 2014 3:16 PM
To: users@cloudstack.apache.org
Subject: Re: ACS 4.4.1 network.throttling.rate - Advance Zone- XenServer 6.2

hi ilya,

I configured "Global Setting"  set "0" to network.throttling.rate, 
rebuild the VR reboot the machines but network rate still under 20MB. I 
did restarted the management server as well.

I don't know what else to try!

Thanks,
Motty

On 12/18/2014 11:18 AM, ilya musayev wrote:
> What i mentioned, confirmed to work on 4.3.1 with VmWare, i havent 
> tried on Xen, if that does not help, its probably a bug in 4.4.1 and 
> should be filled in JIRA.
>
> On 12/18/14, 11:15 AM, ilya musayev wrote:
>> There is a global setting in cloudstack named 
>> "network.throttling.rate" which is set to default 200mb.
>>
>> We should file RFE to alter this value to "0" or no throttling at all 
>> instead of default 200.
>>
>>
>> To address your issues:
>>
>> You can change the value and restart. In order for this setting to 
>> take effect, you may have to either
>> migrate VMs to this vswitch/portgroup
>> stop and start VM which will recreate and bind vms to new portgroup 
>> with no throttling
>> update the portgroup with 200 limit to 0, whenever the VM on this 
>> portgroup stops and start it will migrate to new portgroup with no 
>> throttle.
>>
>> Regards
>> ilya
>>
>> On 12/18/14, 7:38 AM, Motty Cruz wrote:
>>> Hi Peter,
>>> We do not set QoS limitation on the interface, I made sure there are 
>>> not setup by default. it's dragging me crazy this issue.
>>>
>>> -Motty
>>> On 12/16/2014 03:48 PM, Erdősi Péter wrote:
 2014.12.17. 0:38 keltezéssel, Motty Cruz írta:
> I'm still having issues with network throughput, it does not go 
> over 200MB. am I doing something wrong? I rebuilt VR, reboot VMs 
> but does not seem to change throughput. I remember having this 
> issue in KVM cluster but was able to fix it. current cluster is 
> XenServer 6.2 all updates installed. 
 If you open the XenCenter, and check the interface, do you see QoS 
 limitation on it?
 What happend, if you switch it off on a running vm (and restart 
 networking on a VM itself, cause may be loose the nic for a moment)

 Regards:
  Peter
>>>
>>
>

RE: how to add back xen hypervisor host?

[Somesh Naidu]

You could try this, (I believe you mentioned there are not VMs/Volumes pointing 
to this storage anymore)
1. put the primary storage in maintenance
2. remove primary storage
3. add it back to the pool

Hope that helps.

-Original Message-
From: Yiping Zhang [mailto:yzh...@marketo.com] 
Sent: Thursday, December 18, 2014 6:49 PM
To: users@cloudstack.apache.org
Subject: how to add back xen hypervisor host?

Hi, All:

I have a lab CS instance running 4.3.1 and today my only xen hypervisor crashed 
 so I have to rebuild it.  I have already deleted all user VM instances, so 
only SSVM, CPVM and VR are running at this time.

Here is what I did:

 1.  Put zone in maintenance
 2.  Put xen host in maintenance
 3.  Delete xen host from CS
 4.  Rebuild xen hypervisor, set network label (I am using basic networking in 
this lab)
 5.  Add xen hypervisor back into CS

After these steps,  host shows up in CS as up and in enabled state.  I can see 
a cloud_link_local_network interface is created on host by CS with IP address 
169.254.0.1/16.
However,  the primary storage (an nfs volume) is NOT mounted on the host, and 
there is no SR for the primary storage on the host either.

What's the proper way to get my NFS primary storage mounted on this xen host ?  
 Did I miss any steps?

Any help are much appreciated, thanks!

Yiping

RE: Cannot create instance due to java.lang.RuntimeException

[Somesh Naidu]

Here's the error:
---
2014-12-23 15:43:32,545 DEBUG [o.a.c.e.o.NetworkOrchestrator] 
(Work-Job-Executor-82:ctx-32b20d5c job-214/job-215 ctx-d35f12fd) Asking 
ExternalGuestNetworkGuru to implement 
Ntwk[b39d161a-5fd7-4bbc-aed2-092ff486a173|Guest|8]
2014-12-23 15:43:32,546 ERROR [o.a.c.e.o.NetworkOrchestrator] 
(Work-Job-Executor-82:ctx-32b20d5c job-214/job-215 ctx-d35f12fd) Unable to 
transition to a new state from Shutdown via ImplementNetwork
2014-12-23 15:43:32,546 DEBUG [o.a.c.e.o.NetworkOrchestrator] 
(Work-Job-Executor-82:ctx-32b20d5c job-214/job-215 ctx-d35f12fd) Cleaning up 
because we're unable to implement the network 
Ntwk[b39d161a-5fd7-4bbc-aed2-092ff486a173|Guest|8]
---
2014-12-23 15:43:32,661 ERROR [c.c.v.VirtualMachineManagerImpl] 
(Work-Job-Executor-82:ctx-32b20d5c job-214/job-215 ctx-d35f12fd) Failed to 
start instance VM[User|i-2-34-VM]
java.lang.NullPointerException
at 
com.cloud.network.Networks$BroadcastDomainType.getSchemeValue(Networks.java:159)
at 
com.cloud.network.Networks$BroadcastDomainType.getValue(Networks.java:213)
at 
com.cloud.network.guru.GuestNetworkGuru.shutdown(GuestNetworkGuru.java:422)
---

Looks like the broadcast domain isn't set correctly or isn't set at all. Check 
the entry for the particular network in the networks table and look up the 
column "broadcast_domain_type" and " broadcast_uri". What values do these have?

-Original Message-
From: Niki Sfika [mailto:sf...@ceid.upatras.gr] 
Sent: Tuesday, December 23, 2014 9:25 AM
To: users@cloudstack.apache.org
Subject: Cannot create instance due to java.lang.RuntimeException

Hi,

I have a problem during instance creation. I have for host nic0 with an ip
192.168.x.x and nic1 has an ip with internet access.For cloudstack server I
have nic0 with an ip in the same subnet 192.168.x.x and nic1 has an ip with
internet access too. All agents for system VMs are up and I try to create an
instance but I get this error in the cloudstack UI:

"Job failed due to exception Resource [Host:1] is unreachable: Host 1:
Unable to start instance due to null"

Can anyone help me please?

here you can find the logs.

https://www.dropbox.com/s/fphd5cjx42njlzc/cloudstack_logs?dl=0

RE: Can't download ISO's can't setup Templates

[Somesh Naidu]

> But i am unable to connect to the vm it says no route to host

I am guessing you mean SSVM here. Where are you trying to access the VM from 
and using what IP?

-Original Message-
From: Mohamed Infaz [mailto:infaz...@cse.mrt.ac.lk] 
Sent: Friday, December 19, 2014 10:40 PM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org
Subject: Re: Can't download ISO's can't setup Templates

Hi Prashanth,

Yes they are up now. I was trying to use the health check script by trying
to log on to the system vm. But i am unable to connect to the vm it says no
route to host.

Thank you.

On 19 December 2014 at 14:35, Prashant Kumar Mishra <
prashantkumar.mis...@citrix.com> wrote:

> System vms are must for download/upload and deploy vm , make sure they are
> up . You can check cwiki for troubleshooting .
>
> Thanks
> prashant
>
> On 12/19/14, 9:11 AM, "Mohamed Infaz"  wrote:
>
> >Hi All,
> >
> >Finally i have successfully added a host in to the management server. Now
> >to create and instance i am unable to download an ISO image. When i click
> >on the sample iso images which is CentOS 5.5(64-bit) no GUI (KVM). It
> >shows
> >that it is not ready and i also don't see the download status what could
> >be
> >the issue. I did correctly setup my primary and secondary storages. But i
> >dont have a system vm! is it must to run a system vm? And why can't i
> >download and iSO image and set up an instance.
> >
> >Thank you.
>
>

RE: Resource mismatch on CS

[Somesh Naidu]

> I have configured my CS guest on DELL M620 blade server

Here you refer to "CS guest" - not sure what that means. Are you referring to a 
hypervisor host or the CS installation?

> when I check on the infrastructure --> hostes-->node001

What hypervisor?

-Original Message-
From: Abdul Rasool [mailto:rasool...@gmail.com] 
Sent: Wednesday, December 24, 2014 4:07 AM
To: users@cloudstack.apache.org; cloudstack-us...@incubator.apache.org
Subject: Re: Resource mismatch on CS

Hi,

can some one help me on this please ...?

Hi,

I have configured my CS guest on DELL M620 blade server which has 2
physical sockets but when I check on the infrastructure --> hostes-->
node001 it shows The Number of CPU Sockets -1.

could you please assist me why CS is showing only 1 sockets instead of 2.

Thanks
AR

On 24 December 2014 at 12:28, Abdul Rasool  wrote:

> Hi,
>
> I have configured my CS guest on M620 blade server which has 2 physical
> sockets but when I check on the infrastructure --> hostes--> node001 it
> shows The Number of CPU Sockets -1.
>
> could you please assist me why CS is showing only 1 sockets instead of 2.
>
> Thanks
> AR
>

RE: VR is not able to ping from node002

[Somesh Naidu]

> my VR is running on node001 which is not reachable from node002 via  
> 169.254.0.0 network.

That's not supposed to work, link local networks are local context (host wide) 
only.

> also when I do brctl show in node001 I could see there are so many
> interfaces are created but the same interfaces are not available in node002.

Don't think this is relevant.

What you need to check is if the guests that are not accessible are able to 
ping their default gateway, the VR that is. If not, did you trunk the zone vlan 
ids on the corresponding ports on the switch connecting the two hosts?

-Original Message-
From: Abdul Rasool [mailto:rasool...@gmail.com] 
Sent: Wednesday, December 24, 2014 8:58 AM
To: cloudstack-us...@incubator.apache.org; users@cloudstack.apache.org
Subject: VR is not able to ping from node002

Hi,

In my setup I have 2 computing nodes both are same HW platform, in that I
have created multiple guest VMs which is working fine in first node. when I
migrate any guest VM to second node I am loosing connection to the guest
VM. when I start debugging the issue I found my VR is running on node001
which is not reachable from node002 via  169.254.0.0 network.

also when I do brctl show in node001 I could see there are so many
interfaces are created but the same interfaces are not available in
node002.

could some one help me why the virtual bridge interfaces are not created in
my node002 machine ?

Thanks
AR

RE: Physical network design options - which crime to comit

[Somesh Naidu]

I generally prefer to keep the storage traffic separate. Reason is that storage 
performance (provision templates to primary, snapshots, copy templates, etc) 
significantly impact end user experience. In addition, it also helps isolate 
network issues when troubleshooting.

So I'd go for one of the following in that order:
Case I
1G = mgmt network (only mgmt)
10G = Primary and Secondary storage traffic
10G = Guest and Public traffic

Case II
10G = Primary and Secondary storage traffic
10G = mgmt network, Guest and Public traffic

Case III
10G = mgmt network, Primary and Secondary storage traffic
10G = Guest and Public traffic

-Original Message-
From: Andrija Panic [mailto:andrija.pa...@gmail.com] 
Sent: Friday, December 26, 2014 10:06 AM
To: users@cloudstack.apache.org; d...@cloudstack.apache.org
Subject: Physical network design options - which crime to comit

Hi folks,

I'm designing some stuff - and wondering which crime to commit - I have 2
posible scenarios in my head
I have folowing NICs available on compute nodes:
1 x 1G NIC
2 x 10G NIC

I was wondering which approach would be better, as I', thinking about 2
possible sollutions at the moment, maybe 3.

*First scenario:*

1G = mgmt network (only mgmt)
10G = Primary and Secondary storage traffic
10G = Guest and Public traffic


*Second scenario*

1G = not used at all
10G = mgmt,primary,secondary storage
10G = Guest and Public


And possibly a 3rd scenario:

1G = not used at all
10G = mgmt+primary storage
10G = secondary storage, guest,public network


I could continue here with different scenarios - but I'm wondering if 1G
dedicated for mgmt would make sense - I know it is "better" to have it
dedicated if possible, but folowing "KISS" and knowing it's extremely light
weight traffic - I was thinkin puting everything on 2 x 10G interfaces.

Any opinions are most welcome.
Thanks,


-- 

Andrija Panić

RE: Physical network design options - which crime to comit

[Somesh Naidu]

Actually, I would highly consider nic bonding for storage network if possible.

-Original Message-
From: Andrija Panic [mailto:andrija.pa...@gmail.com] 
Sent: Friday, December 26, 2014 4:42 PM
To: d...@cloudstack.apache.org
Cc: users@cloudstack.apache.org
Subject: RE: Physical network design options - which crime to comit

Thanks Somesh, first option also seems most logical to me.

I guess you wouldn't consider doing nic bonding and then vlans with some
QoS based on vlans on switch level?

Thx again

Sent from Google Nexus 4
On Dec 26, 2014 9:48 PM, "Somesh Naidu"  wrote:

> I generally prefer to keep the storage traffic separate. Reason is that
> storage performance (provision templates to primary, snapshots, copy
> templates, etc) significantly impact end user experience. In addition, it
> also helps isolate network issues when troubleshooting.
>
> So I'd go for one of the following in that order:
> Case I
> 1G = mgmt network (only mgmt)
> 10G = Primary and Secondary storage traffic
> 10G = Guest and Public traffic
>
> Case II
> 10G = Primary and Secondary storage traffic
> 10G = mgmt network, Guest and Public traffic
>
> Case III
> 10G = mgmt network, Primary and Secondary storage traffic
> 10G = Guest and Public traffic
>
> -Original Message-
> From: Andrija Panic [mailto:andrija.pa...@gmail.com]
> Sent: Friday, December 26, 2014 10:06 AM
> To: users@cloudstack.apache.org; d...@cloudstack.apache.org
> Subject: Physical network design options - which crime to comit
>
> Hi folks,
>
> I'm designing some stuff - and wondering which crime to commit - I have 2
> posible scenarios in my head
> I have folowing NICs available on compute nodes:
> 1 x 1G NIC
> 2 x 10G NIC
>
> I was wondering which approach would be better, as I', thinking about 2
> possible sollutions at the moment, maybe 3.
>
> *First scenario:*
>
> 1G = mgmt network (only mgmt)
> 10G = Primary and Secondary storage traffic
> 10G = Guest and Public traffic
>
>
> *Second scenario*
>
> 1G = not used at all
> 10G = mgmt,primary,secondary storage
> 10G = Guest and Public
>
>
> And possibly a 3rd scenario:
>
> 1G = not used at all
> 10G = mgmt+primary storage
> 10G = secondary storage, guest,public network
>
>
> I could continue here with different scenarios - but I'm wondering if 1G
> dedicated for mgmt would make sense - I know it is "better" to have it
> dedicated if possible, but folowing "KISS" and knowing it's extremely light
> weight traffic - I was thinkin puting everything on 2 x 10G interfaces.
>
> Any opinions are most welcome.
> Thanks,
>
>
> --
>
> Andrija Panić
>

RE: Physical network design options - which crime to comit

[Somesh Naidu]

Sorry, I was out on holidays :)

I guess that should work. Just know that Primary traffic is hypervisor to 
storage and Secondary traffic is SSVM/Mgmt to storage. Cloudstack generally 
doesn't consider primary storage in its architecture design as it mostly relies 
on recommendation from the hypervisor vendors.

-Original Message-
From: Andrija Panic [mailto:andrija.pa...@gmail.com] 
Sent: Friday, December 26, 2014 5:59 PM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org
Subject: RE: Physical network design options - which crime to comit

On storage nodes - yes definitively will do it.

One finall advice/opinion please...?

On compute nodes, since one 10G will be shared by both primary and
secondary traffic - would you separate that on 2 different VLANs and then
implement some QoS i.e. guarantie 8Gb/s for primary traffic vlan, or i.e.
limit sec.storage vlan to i.e. 2Gb/s. Or just simply let them compete for
the traffic? In afraid secondary traffic my influence or completely
overweight primary traffic if no QoS implemented...

Sorry for borring you with details.

Thanks

Sent from Google Nexus 4
On Dec 26, 2014 11:51 PM, "Somesh Naidu"  wrote:

> Actually, I would highly consider nic bonding for storage network if
> possible.
>
> -Original Message-
> From: Andrija Panic [mailto:andrija.pa...@gmail.com]
> Sent: Friday, December 26, 2014 4:42 PM
> To: d...@cloudstack.apache.org
> Cc: users@cloudstack.apache.org
> Subject: RE: Physical network design options - which crime to comit
>
> Thanks Somesh, first option also seems most logical to me.
>
> I guess you wouldn't consider doing nic bonding and then vlans with some
> QoS based on vlans on switch level?
>
> Thx again
>
> Sent from Google Nexus 4
> On Dec 26, 2014 9:48 PM, "Somesh Naidu"  wrote:
>
> > I generally prefer to keep the storage traffic separate. Reason is that
> > storage performance (provision templates to primary, snapshots, copy
> > templates, etc) significantly impact end user experience. In addition, it
> > also helps isolate network issues when troubleshooting.
> >
> > So I'd go for one of the following in that order:
> > Case I
> > 1G = mgmt network (only mgmt)
> > 10G = Primary and Secondary storage traffic
> > 10G = Guest and Public traffic
> >
> > Case II
> > 10G = Primary and Secondary storage traffic
> > 10G = mgmt network, Guest and Public traffic
> >
> > Case III
> > 10G = mgmt network, Primary and Secondary storage traffic
> > 10G = Guest and Public traffic
> >
> > -Original Message-
> > From: Andrija Panic [mailto:andrija.pa...@gmail.com]
> > Sent: Friday, December 26, 2014 10:06 AM
> > To: users@cloudstack.apache.org; d...@cloudstack.apache.org
> > Subject: Physical network design options - which crime to comit
> >
> > Hi folks,
> >
> > I'm designing some stuff - and wondering which crime to commit - I have 2
> > posible scenarios in my head
> > I have folowing NICs available on compute nodes:
> > 1 x 1G NIC
> > 2 x 10G NIC
> >
> > I was wondering which approach would be better, as I', thinking about 2
> > possible sollutions at the moment, maybe 3.
> >
> > *First scenario:*
> >
> > 1G = mgmt network (only mgmt)
> > 10G = Primary and Secondary storage traffic
> > 10G = Guest and Public traffic
> >
> >
> > *Second scenario*
> >
> > 1G = not used at all
> > 10G = mgmt,primary,secondary storage
> > 10G = Guest and Public
> >
> >
> > And possibly a 3rd scenario:
> >
> > 1G = not used at all
> > 10G = mgmt+primary storage
> > 10G = secondary storage, guest,public network
> >
> >
> > I could continue here with different scenarios - but I'm wondering if 1G
> > dedicated for mgmt would make sense - I know it is "better" to have it
> > dedicated if possible, but folowing "KISS" and knowing it's extremely
> light
> > weight traffic - I was thinkin puting everything on 2 x 10G interfaces.
> >
> > Any opinions are most welcome.
> > Thanks,
> >
> >
> > --
> >
> > Andrija Panić
> >
>

RE: Unable to start VM due to concurrent operation

[Somesh Naidu]

Mohamed,

The log snippet you have shared doesn't seem to be relevant to the concurrent 
operation exception (can't see that exception stack).

The message that did catch my attention though is,
-
2014-12-31 05:25:07,972 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] 
(secstorage-1:ctx-463d2f57) System vm template is not ready at data center 1, 
wait until it is ready to launch secondary storage vm
2014-12-31 05:25:07,972 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] 
(secstorage-1:ctx-463d2f57) Zone 1 is not ready to launch secondary storage VM 
yet
-

That's pointing to missing system VM template. Please verify that you have 
correctly provisioned the secondary storage with the correct system VM template 
(as per the docs).

-Somesh

-Original Message-
From: Mohamed Infaz [mailto:infaz...@cse.mrt.ac.lk] 
Sent: Tuesday, December 30, 2014 11:03 AM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org
Subject: Unable to start VM due to concurrent operation

Hi All,

I have successfully deployed cloudstack 4.3 with two hosts and the setup
runs the management server on another physical host. I had issues with
downloading an ISO but finally i was able to download an ISO image. When i
want to create an instance i get the following error message saying "Unable
to start VM due to concurrent operation" i did some searching on the topic
and it said version 4.3 system template solved the issue. These are some of
the MS logs that i collected what could be the issue?

2014-12-31 05:25:07,972 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-463d2f57) System vm template is not ready at data center
1, wait until it is ready to launch secondary storage vm
2014-12-31 05:25:07,972 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-463d2f57) Zone 1 is not ready to launch secondary storage
VM yet
2014-12-31 05:25:12,425 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-9:null) Ping from 4
2014-12-31 05:25:12,834 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-5:null) SeqA 3-91695: Processing Seq 3-91695:  { Cmd
, MgmtId: -1, via: 3, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2014-12-31 05:25:12,920 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-5:null) SeqA 3-91695: Sending Seq 3-91695:  { Ans: ,
MgmtId: 248795600505608, via: 3, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2014-12-31 05:25:15,239 DEBUG [c.c.n.ExternalDeviceUsageManagerImpl]
(ExternalNetworkMonitor-1:ctx-998a86df) External devices stats collector is
running...
2014-12-31 05:25:15,362 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterMonitor-1:ctx-dfdc73ce) Found 0 running routers.
2014-12-31 05:25:15,366 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-79d58896) Found 0 routers to update status.
2014-12-31 05:25:15,367 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-79d58896) Found 0 networks to update RvR status.
2014-12-31 05:25:15,393 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
(SnapshotPollTask:ctx-ae761f6b) Snapshot scheduler.poll is being called at
2014-12-30 23:55:15 GMT
2014-12-31 05:25:15,393 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
(SnapshotPollTask:ctx-ae761f6b) Got 0 snapshots to be executed at
2014-12-30 23:55:15 GMT
2014-12-31 05:25:18,535 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-14:null) Ping from 3
2014-12-31 05:25:18,698 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-10:null) Ping from 2
2014-12-31 05:25:19,834 INFO  [c.c.a.m.AgentManagerImpl]
(AgentMonitor-1:ctx-f10d32f0) Found the following agents behind on ping: [1]
2014-12-31 05:25:19,835 DEBUG [c.c.h.Status] (AgentMonitor-1:ctx-f10d32f0)
Ping timeout for host 1, do invstigation
2014-12-31 05:25:19,837 INFO  [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-14:ctx-43a85937) Investigating why host 1 has disconnected
with event PingTimeout
2014-12-31 05:25:19,837 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-14:ctx-43a85937) checking if agent (1) is alive
2014-12-31 05:25:19,839 DEBUG [c.c.a.t.Request]
(AgentTaskPool-14:ctx-43a85937) Seq 1-449186863: Sending  { Cmd , MgmtId:
248795600505608, via: 1(virtualops-h4), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.CheckHealthCommand":{"wait":50}}] }
2014-12-31 05:25:19,844 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-7:null) Seq 1-449186863: Processing:  { Ans: ,
MgmtId: 248795600505608, via: 1, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.CheckHealthAnswer":{"result":true,"details":"resource
is alive","wait":0}}] }
2014-12-31 05:25:19,844 DEBUG [c.c.a.t.Request]
(AgentTaskPool-14:ctx-43a85937) Seq 1-449186863: Received:  { Ans: ,
MgmtId: 248795600505608, via: 1, Ver: v1, Flags: 10, { CheckHealthAnswer } }
2014-12-31 05:25:19,844 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentTaskPool-14:ctx-43a85937) Details from executing class
com.cloud.agent.api.CheckHealthCommand: resourc

RE: No templates showing up in 'instances' tab

[Somesh Naidu]

I suspect the templates are not getting downloaded. Did you check if the 
templates property "Ready", is that showing as "Yes"?

You could also check directly in the DB by looking up the table 
template_store_ref.

-Original Message-
From: Thomas Munn [mailto:symgr...@gmail.com] 
Sent: Saturday, December 27, 2014 3:01 AM
To: users@cloudstack.apache.org
Subject: No templates showing up in 'instances' tab

I can upload them to my heart's content, but not items. I CAN see the
templates, but they never show up in my zone.

I tried the gobblygook docs in the ssvm storage thing, but I can't even
begin to find the id_rsa binary, or any of the tools it mentions.

I have permission to see things on the nfs server, templates show up in the
'templates' file, but they don't register for instances.

I have the nfs server set to map all files to 'root', and cannot change
permissions on the server. I can 'write' directories as 'root', but am not
sure what uid I need final files to be stored as.or just turn off
'nosquash'?

Here is the log:

:2014-12-27 07:59:36,050 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-6:null) Seq 5-5773614722288975885: Processing:  {
Ans: , MgmtId: 52228748028, via: 5, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.Answer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException:
GetRootDir for nfs://192.168.0.6/volume1/cloudstack/secondary failed due to
com.cloud.utils.exception.CloudRuntimeException: Unable to mount
192.168.0.6:/volume1/cloudstack/secondary at
/mnt/SecStorage/449b7d09-1835-3387-92ad-4720fa465137 due to mount.nfs:
access denied by server while mounting
192.168.0.6:/volume1/cloudstack/secondary\n\tat
org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.getRootDir(NfsSecondaryStorageResource.java:1839)\n\tat
org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.execute(NfsSecondaryStorageResource.java:1588)\n\tat
org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.executeRequest(NfsSecondaryStorageResource.java:212)\n\tat
com.cloud.agent.Agent.processRequest(Agent.java:501)\n\tat
com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)\n\tat
com.cloud.utils.nio.Task.run(Task.java:84)\n\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\n\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat
java.lang.Thread.run(Thread.java:745)\n","wait":0}}] }
But when I mount manually it works fine. So I have no idea on how to fix.
-- 
---
Two Wheels Good, Four Wheels Bad

RE: Physical network design options - which crime to comit

[Somesh Naidu]

Interaction with primary storage would be via the hypervisor. SSVM doesn't 
access the primary storage directly.

-Original Message-
From: Andrija Panic [mailto:andrija.pa...@gmail.com] 
Sent: Tuesday, December 30, 2014 1:52 PM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org
Subject: Re: Physical network design options - which crime to comit

Somesh, thx - I understand that - one more question, since you guys are
arround :)

The primary storage network - I unnderstand how to separate that from
management networks on the host (having separate NIC/vlan/IP inside each
hypervisor host, etc) - but as far as I know, the SSVM doesnt have a NIC
that goes directly into the Pimary storage network, just into management -
does this mean, that the Primary storage network needs to be
reachable/routable from Management network (so SSVM uses "Reserved System
Gateway" to actually reach Primary storage network, through Management
network) ?
SSVM needs to reach Primary storage somehow...

Thx

On 30 December 2014 at 19:29, Somesh Naidu  wrote:

> Sorry, I was out on holidays :)
>
> I guess that should work. Just know that Primary traffic is hypervisor to
> storage and Secondary traffic is SSVM/Mgmt to storage. Cloudstack generally
> doesn't consider primary storage in its architecture design as it mostly
> relies on recommendation from the hypervisor vendors.
>
> -Original Message-
> From: Andrija Panic [mailto:andrija.pa...@gmail.com]
> Sent: Friday, December 26, 2014 5:59 PM
> To: users@cloudstack.apache.org
> Cc: d...@cloudstack.apache.org
> Subject: RE: Physical network design options - which crime to comit
>
> On storage nodes - yes definitively will do it.
>
> One finall advice/opinion please...?
>
> On compute nodes, since one 10G will be shared by both primary and
> secondary traffic - would you separate that on 2 different VLANs and then
> implement some QoS i.e. guarantie 8Gb/s for primary traffic vlan, or i.e.
> limit sec.storage vlan to i.e. 2Gb/s. Or just simply let them compete for
> the traffic? In afraid secondary traffic my influence or completely
> overweight primary traffic if no QoS implemented...
>
> Sorry for borring you with details.
>
> Thanks
>
> Sent from Google Nexus 4
> On Dec 26, 2014 11:51 PM, "Somesh Naidu"  wrote:
>
> > Actually, I would highly consider nic bonding for storage network if
> > possible.
> >
> > -Original Message-
> > From: Andrija Panic [mailto:andrija.pa...@gmail.com]
> > Sent: Friday, December 26, 2014 4:42 PM
> > To: d...@cloudstack.apache.org
> > Cc: users@cloudstack.apache.org
> > Subject: RE: Physical network design options - which crime to comit
> >
> > Thanks Somesh, first option also seems most logical to me.
> >
> > I guess you wouldn't consider doing nic bonding and then vlans with some
> > QoS based on vlans on switch level?
> >
> > Thx again
> >
> > Sent from Google Nexus 4
> > On Dec 26, 2014 9:48 PM, "Somesh Naidu"  wrote:
> >
> > > I generally prefer to keep the storage traffic separate. Reason is that
> > > storage performance (provision templates to primary, snapshots, copy
> > > templates, etc) significantly impact end user experience. In addition,
> it
> > > also helps isolate network issues when troubleshooting.
> > >
> > > So I'd go for one of the following in that order:
> > > Case I
> > > 1G = mgmt network (only mgmt)
> > > 10G = Primary and Secondary storage traffic
> > > 10G = Guest and Public traffic
> > >
> > > Case II
> > > 10G = Primary and Secondary storage traffic
> > > 10G = mgmt network, Guest and Public traffic
> > >
> > > Case III
> > > 10G = mgmt network, Primary and Secondary storage traffic
> > > 10G = Guest and Public traffic
> > >
> > > -Original Message-
> > > From: Andrija Panic [mailto:andrija.pa...@gmail.com]
> > > Sent: Friday, December 26, 2014 10:06 AM
> > > To: users@cloudstack.apache.org; d...@cloudstack.apache.org
> > > Subject: Physical network design options - which crime to comit
> > >
> > > Hi folks,
> > >
> > > I'm designing some stuff - and wondering which crime to commit - I
> have 2
> > > posible scenarios in my head
> > > I have folowing NICs available on compute nodes:
> > > 1 x 1G NIC
> > > 2 x 10G NIC
> > >
> > > I was wondering which approach would be better, as I', thinking about 2
> > > possible sollutions at the moment, maybe 3.
> > >
> > > *First 

RE: Can't create or deploy VMs

[Somesh Naidu]

It would be helpful if you could share a larger chunk of mgmt. server logs via 
paste bin so we can see what's happening/failing.

-Original Message-
From: José Egas López [mailto:josee...@farmaenlace.com] 
Sent: Tuesday, December 30, 2014 5:41 PM
To: users@cloudstack.apache.org
Subject: Can't create or deploy VMs

Hi all, when I try to create or deploy a new VM, it shows the following 
error:

User VM

Failed to deploy Vm with Id: 42on Host with Id: null

Mon29 Dec 2014 19:22:27 GMT

So I can do nothing, I can't create VMs or deploy them from a template.
How can I fix it?

I was creating and deploying VMs normally.
I have ACS 4.3.1 with VMware 5.5
-- 
*


Regards,
José

*

RE: Can't create or deploy VMs

[Somesh Naidu]

.f.j.i.AsyncJobManagerImpl] 
(Job-Executor-22:ctx-f2bc1611) Complete async job-419, jobStatus: FAILED, 
resultCode: 530, result: 
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":533,"errortext":"Unable
 to create a deployment for VM[User|test]"}
2014-12-31 07:49:44,483 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
(Job-Executor-22:ctx-f2bc1611) Done executing 
org.apache.cloudstack.api.command.user.vm.DeployVMCmd for job-419
2014-12-31 07:49:44,487 INFO  [o.a.c.f.j.i.AsyncJobMonitor] 
(Job-Executor-22:ctx-f2bc1611) Remove job-419 from job monitoring
2014-12-31 07:49:45,692 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentManager-Handler-1:null) SeqA 2-981122: Processing Seq 2-981122:  { Cmd , 
MgmtId: -1, via: 2, Ver: v1, Flags: 11, 
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n
  \"connections\": []\n}","wait":0}}] }
2014-12-31 07:49:45,697 DEBUG [c.c.a.m.AgentManagerImpl] 
(AgentManager-Handler-1:null) SeqA 2-981122: Sending Seq 2-981122:  { Ans: , 
MgmtId: 345050676845, via: 2, Ver: v1, Flags: 100010, 
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2014-12-31 07:49:46,059 DEBUG [o.a.c.s.RemoteHostEndPoint] 
(Timer-12:ctx-89509527) Sending command 
org.apache.cloudstack.storage.command.DownloadProgressCommand to host: 3




***




- Original Message -
From: "Somesh Naidu" 
To: users@cloudstack.apache.org
Sent: Tuesday, December 30, 2014 5:53:55 PM
Subject: RE: Can't create or deploy VMs

It would be helpful if you could share a larger chunk of mgmt. server logs via 
paste bin so we can see what's happening/failing.

-Original Message-
From: José Egas López [mailto:josee...@farmaenlace.com] 
Sent: Tuesday, December 30, 2014 5:41 PM
To: users@cloudstack.apache.org
Subject: Can't create or deploy VMs

Hi all, when I try to create or deploy a new VM, it shows the following 
error:

User VM

Failed to deploy Vm with Id: 42on Host with Id: null

Mon29 Dec 2014 19:22:27 GMT

So I can do nothing, I can't create VMs or deploy them from a template.
How can I fix it?

I was creating and deploying VMs normally.
I have ACS 4.3.1 with VMware 5.5
-- 
*


Regards,
José

*

RE: Unable to start VM due to concurrent operation

[Somesh Naidu]

You mean the system VMs for Zone 1 are running? Are they showing as connected 
in the DB?

If they are, can you stop these VMs and see if they start okay.

From: Mohamed Infaz [infaz...@cse.mrt.ac.lk]
Sent: Tuesday, December 30, 2014 21:26
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org
Subject: Re: Unable to start VM due to concurrent operation

systemvm64template-2014-01-14-master-kvm.qcow2.bz2 This is the template i used.


On 31 December 2014 at 07:49, Mohamed Infaz  wrote:

> Hi Somesh,
>
> Thank you for the reply. Well both of my system vm's are running and it is
> downloading the iso image. And i was able to ping them. The system vm
> template i am using is for the version 4.3 cloudstack.
>
> Thank you.
>
> On 30 December 2014 at 23:59, Somesh Naidu 
> wrote:
>
>> Mohamed,
>>
>> The log snippet you have shared doesn't seem to be relevant to the
>> concurrent operation exception (can't see that exception stack).
>>
>> The message that did catch my attention though is,
>> -
>> 2014-12-31 05:25:07,972 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>> (secstorage-1:ctx-463d2f57) System vm template is not ready at data center
>> 1, wait until it is ready to launch secondary storage vm
>> 2014-12-31 05:25:07,972 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>> (secstorage-1:ctx-463d2f57) Zone 1 is not ready to launch secondary storage
>> VM yet
>> -
>>
>> That's pointing to missing system VM template. Please verify that you
>> have correctly provisioned the secondary storage with the correct system VM
>> template (as per the docs).
>>
>> -Somesh
>>
>> -Original Message-
>> From: Mohamed Infaz [mailto:infaz...@cse.mrt.ac.lk]
>> Sent: Tuesday, December 30, 2014 11:03 AM
>> To: users@cloudstack.apache.org
>> Cc: d...@cloudstack.apache.org
>> Subject: Unable to start VM due to concurrent operation
>>
>> Hi All,
>>
>> I have successfully deployed cloudstack 4.3 with two hosts and the setup
>> runs the management server on another physical host. I had issues with
>> downloading an ISO but finally i was able to download an ISO image. When i
>> want to create an instance i get the following error message saying
>> "Unable
>> to start VM due to concurrent operation" i did some searching on the topic
>> and it said version 4.3 system template solved the issue. These are some
>> of
>> the MS logs that i collected what could be the issue?
>>
>> 2014-12-31 05:25:07,972 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>> (secstorage-1:ctx-463d2f57) System vm template is not ready at data center
>> 1, wait until it is ready to launch secondary storage vm
>> 2014-12-31 05:25:07,972 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>> (secstorage-1:ctx-463d2f57) Zone 1 is not ready to launch secondary
>> storage
>> VM yet
>> 2014-12-31 05:25:12,425 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-9:null) Ping from 4
>> 2014-12-31 05:25:12,834 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-5:null) SeqA 3-91695: Processing Seq 3-91695:  { Cmd
>> , MgmtId: -1, via: 3, Ver: v1, Flags: 11,
>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>> \"connections\": []\n}","wait":0}}] }
>> 2014-12-31 05:25:12,920 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-5:null) SeqA 3-91695: Sending Seq 3-91695:  { Ans: ,
>> MgmtId: 248795600505608, via: 3, Ver: v1, Flags: 100010,
>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>> 2014-12-31 05:25:15,239 DEBUG [c.c.n.ExternalDeviceUsageManagerImpl]
>> (ExternalNetworkMonitor-1:ctx-998a86df) External devices stats collector
>> is
>> running...
>> 2014-12-31 05:25:15,362 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (RouterMonitor-1:ctx-dfdc73ce) Found 0 running routers.
>> 2014-12-31 05:25:15,366 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (RouterStatusMonitor-1:ctx-79d58896) Found 0 routers to update status.
>> 2014-12-31 05:25:15,367 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (RouterStatusMonitor-1:ctx-79d58896) Found 0 networks to update RvR
>> status.
>> 2014-12-31 05:25:15,393 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
>> (SnapshotPollTask:ctx-ae761f6b) Snapshot scheduler.poll is being called at
>> 2014-12-30 23:55:15 GMT
>> 2014-12-31 05:25:15,393 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
>> (SnapshotPollTask:ctx-ae7

RE: RE: cloudstack 4.3.2 + xenserver 6.2 with all patchs,couldn't start system vm

[Somesh Naidu]

Could you try restarting CS or unmange/mange the XS cluster to see if that 
fixes the issue.

As an aside, one bad thing about this error is that most times it doesn’t 
explicitly say why the zone is not ready so we have to deduce. Following are 
few of the reasons why this could happen:
1. Storage is not ready
2. System VM template/ISO is not ready
3. Run out of IP (generally public)

You might want to verify these. Try to look deeper in the logs to get a hint of 
what resource is causing the zone to be in this state.

-Original Message-
From: linux...@gmail.com [mailto:linux...@gmail.com] 
Sent: Tuesday, December 30, 2014 8:42 PM
To: users@cloudstack.apache.org
Subject: Re: RE: cloudstack 4.3.2 + xenserver 6.2 with all patchs,couldn't 
start system vm

1、we install xenserver 6.2 with no patch
2、we install cloudstack and the ssvm cpvm could running
3、we disable the zone,remove ssvm and cpvm
4、we install all the patchs of xenserver
5、after patched xenserver we enable the zone on cloudstack

at this time,the log told us

Zone 1 is not ready to launch console
proxy yet

2014-12-30 23:54 GMT+08:00 Matthew Midgett
:
> Did you patch before or after installing cloudstack? I think some of files 
> that acs puts on the hypervisors get overwritten. I saw someone talking about 
> this on the mailing list before. I'm mobile today so can't provide the files 
> and directories to be updated.
>
>  Original message From: linux...@gmail.com 
> Date:12/30/2014  4:43 AM  (GMT-05:00) To: 
> users@cloudstack.apache.org Subject: cloudstack 4.3.2 + xenserver 
> 6.2 with all patchs,couldn't start
>   system vm 
> Hey ALL:
>
>we are testing cloustack 4.3.2 .our hypervisior is xenserver
> 6.2 with all patchs
> the system vm template is
> http://download.cloud.com/templates/4.3/systemvm64template-2014-09-30-4.3-xen.vhd.bz2
>
> we have tryed basic network and advanced network
>
> when xenserver 6.2 is not patched ,it worked fine
>
> after we patched xenserver 6.2 with all patch,the systemvm couldn't running
>
> this is the log of management :
>
>
>
> 2014-12-30 17:17:47,512 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-28:ctx-52719350) Seq 4-417988800: Executing request
>
> 2014-12-30 17:17:47,722 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-28:ctx-52719350) Seq 4-417988800: Response Received:
>
> 2014-12-30 17:17:47,722 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> (DirectAgent-28:ctx-52719350) Seq 4-417988800: MgmtId 345051527296:
> Resp: Routing to peer
>
> 2014-12-30 17:17:58,813 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-b73976d7) Found 0 routers to update status.
>
> 2014-12-30 17:17:58,814 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-b73976d7) Found 0 networks to update RvR
> status.
>
> 2014-12-30 17:18:08,433 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-246:ctx-0222d7ab) Ping from 4(xenserver-101)
>
> 2014-12-30 17:18:08,820 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-143:ctx-3ae568b1) Seq 4-1243152388: Executing request
>
> 2014-12-30 17:18:09,008 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-143:ctx-3ae568b1) Seq 4-1243152388: Response Received:
>
> 2014-12-30 17:18:09,009 DEBUG [c.c.a.t.Request]
> (DirectAgent-143:ctx-3ae568b1) Seq 4-1243152388: Processing:  { Ans: ,
> MgmtId: 345051527295, via: 4, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}]
> }
>
> 2014-12-30 17:18:14,378 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> (consoleproxy-1:ctx-04c0e3de) Zone 1 is not ready to launch console
> proxy yet
>
> 2014-12-30 17:18:14,758 DEBUG [c.c.s.StatsCollector]
> (StatsCollector-2:ctx-5f9e7528) VmStatsCollector is running...
>
> 2014-12-30 17:18:28,813 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-2da8a4a0) Found 0 routers to update status.
>
> 2014-12-30 17:18:28,814 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-2da8a4a0) Found 0 networks to update RvR
> status.
>
> 2014-12-30 17:18:31,605 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-247:ctx-2929f84f) Seq 4-417988801: Executing request
>
> 2014-12-30 17:18:31,758 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-247:ctx-2929f84f) Seq 4-417988801: Response Received:
>
> 2014-12-30 17:18:31,759 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> (DirectAgent-247:ctx-2929f84f) Seq 4-417988801: MgmtId 345051527296:
> Resp: Routing to peer
>
> 2014-12-30 17:18:33,902 DEBUG [c.c.h.d.HostDaoImpl]
> (ClusteredAgentManager Timer:ctx-29831b59) Resetting hosts suitable
> for reconnect
>
> 2014-12-30 17:18:33,903 DEBUG [c.c.h.d.HostDaoImpl]
> (ClusteredAgentManager Timer:ctx-29831b59) Completed resetting hosts
> suitable for reconnect
>
> 2014-12-30 17:18:33,903 DEBUG [c.c.h.d.HostDaoImpl]
> (ClusteredAgentManager Timer:ctx-29831b59) Acquiring hosts for
> clusters already owned by this management server
>

RE: Unable to start VM due to concurrent operation

[Somesh Naidu]

What's the status of template are you trying to create a VM from? Please share 
either DB output or UI screenshot.

-Original Message-
From: Mohamed Infaz [mailto:infaz...@cse.mrt.ac.lk] 
Sent: Friday, January 02, 2015 7:03 AM
To: users@cloudstack.apache.org
Cc: d...@cloudstack.apache.org
Subject: Re: Unable to start VM due to concurrent operation

Hi all,

I did redeploy cloudstack and i used the

>>   1. /usr/share/cloudstack-common/
scripts/storage/secondary/cloud-install-sys-tmplt \
>>   2. -m /srv/images/secondary \
>>   3. -u
http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2
\
>>   4. -h kvm \
>>   5. -F

The following script to deploy system vm's. After some time they started
working! Now when i try to deploy and vm
i am getting the following error message.
"com.cloud.exception.AgentUnavailableException: Resource [Host:1] is
unreachable: Host 1: Unable to start instance due to Template 3 has not
been completely downloaded to zone 1"

I did reregister the latest system vm template and i was able to
successfully download it. But there are two inbuilt templates where it says
in the status that the connection was time out. And one of these in built
template is an in built old system vm template. How can i solve this issue
now there is a system vm running properly in the environment and i have the
latest template registered but it seems so cloudstack searches for those
two templates which it couldn't download. Because of this i still can't
create a virtual machine.

Thank you.

On 2 January 2015 at 08:08, Abhinandan Prateek <
abhinandan.prat...@shapeblue.com> wrote:

> The sec store has some issues, you can login into KVM host and check if
> the sec storage mount point is visible and the said folder is there. Check
> if ssvm is running fine.
> It is also possible that the sec store is fine but the template that is
> being used to create VM is in inconsistent state, then you need to remove
> and re-register the template.
>
> -abhi
>
> > On 01-Jan-2015, at 8:35 pm, Mohamed Infaz 
> wrote:
> >
> > Hi,
> > I updated my cloudstack deployment to 4.4.2 to 4.3.1. Now when we try to
> > deploy a VM i am getting following error
> >
> > message. com.cloud.exception.StorageUnavailableException: Resource
> > [StoragePool:2] is unreachable: Unable to create
> > Vol[30|vm=58|ROOT]:com.cloud.utils.exception.CloudRuntimeException:
> > org.libvirt.LibvirtException: internal error: Child process (/bin/mount
> > 10.8.100.201:/mnt/secondary/template/tmpl/2/205
> > /mnt/8c6fa424-cbc7-3421-8f05-d69a43ffa15c) unexpected exit status 32:
> > mount.nfs: mounting 10.8.100.201:/mnt/secondary/template/tmpl/2/205
> failed,
> > reason given by server: No such file or directory
> >
> >
> >
> > Thank you.
> >
> >
> > On 1 January 2015 at 14:03, Mohamed Infaz 
> wrote:
> >
> >> Hi Somesh,
> >>
> >> Yes i was successful in stopping both the system vm's and starting them
> >> back i also could access them through the console that cloudstack
> provides.
> >> May be the reason for that code snippet is that i didn't register the
> >> template but i ran this script to install the system vm's.
> >>
> >>
> >>   1.
> /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt
> \
> >>   2. -m /srv/images/secondary \
> >>   3. -u
> http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2
> \
> >>   4. -h kvm \
> >>   5. -F
> >>
> >> this was on the docs. How about upgrading my cloudstack version to 4.4.
> >> This whole thing happened in 4.3.
> >>
> >> Thank you.
> >>
> >> On 1 January 2015 at 01:39, Somesh Naidu 
> wrote:
> >>
> >>> You mean the system VMs for Zone 1 are running? Are they showing as
> >>> connected in the DB?
> >>>
> >>> If they are, can you stop these VMs and see if they start okay.
> >>> 
> >>> From: Mohamed Infaz [infaz...@cse.mrt.ac.lk]
> >>> Sent: Tuesday, December 30, 2014 21:26
> >>> To: users@cloudstack.apache.org
> >>> Cc: d...@cloudstack.apache.org
> >>> Subject: Re: Unable to start VM due to concurrent operation
> >>>
> >>> systemvm64template-2014-01-14-master-kvm.qcow2.bz2 This is the
> template i
> >>> used.
> >>>
> >>>
> >>> On 31 December 2014 at 07:49, Mohamed Infaz 
> >>> wrote:
> >>>
> >>>> Hi Som

RE: Unable to add primary storage (SR_BACKEND_FAILURE_73NFS mount error [opterr=mount failed with return code 32])

[Somesh Naidu]

XS is unable to create the SR failing with the following error:
---
Caused by: SR_BACKEND_FAILURE_73NFS mount error [opterr=mount failed with
return code 32]
---

May be a problem with the NFS. Can you try manually creating a SR on XS using 
this NFS or may be simply try to mount the NFS on XS and see if that works.

-Original Message-
From: Tejas Gadaria [mailto:refond.g...@gmail.com] 
Sent: Monday, January 05, 2015 9:26 AM
To: users@cloudstack.apache.org; d...@cloudstack.apache.org
Subject: Unable to add primary storage (SR_BACKEND_FAILURE_73NFS mount error 
[opterr=mount failed with return code 32])

Hi,

I am facing issue with xenserver 6.2 SP1, on ACS 4.3.1 and 4.4 both.


While creating Zone with NFS as primary & secondary storage

2015-01-05 19:29:45,715 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-2:ctx-23cfb66b) Seq 1-3875347479352311816: Executing request
2015-01-05 19:29:47,079 WARN  [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-2:ctx-23cfb66b) Catch Exception
com.cloud.utils.exception.CloudRuntimeException, create StoragePool failed
due to com.cloud.utils.exception.CloudRuntimeException: Unable to create
NFS SR Pool[1|192.168.161.110:2049|/mnt/data/VMS-TT/primary] on
host:ba237c07-71cb-48a8-8a6d-6e6c3aff65b2 pool:
192.168.161.110/mnt/data/VMS-TT/primary
com.cloud.utils.exception.CloudRuntimeException: Unable to create NFS SR
Pool[1|192.168.161.110:2049|/mnt/data/VMS-TT/primary]
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNfsSR(CitrixResourceBase.java:6133)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5074)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:475)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:61)
at
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:102)
at
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:307)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: SR_BACKEND_FAILURE_73NFS mount error [opterr=mount failed with
return code 32]
at com.xensource.xenapi.Types.checkResponse(Types.java:2006)
at com.xensource.xenapi.Connection.dispatch(Connection.java:350)
at
com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:456)
at com.xensource.xenapi.SR.create(SR.java:801)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNfsSR(CitrixResourceBase.java:6129)
... 17 more
2015-01-05 19:29:47,080 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-2:ctx-23cfb66b) Seq 1-3875347479352311816: Response Received:
2015-01-05 19:29:47,080 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-2:ctx-23cfb66b) Seq 1-3875347479352311816: Response Received:
2015-01-05 19:29:47,080 DEBUG [c.c.a.t.Request]
(DirectAgent-2:ctx-23cfb66b) Seq 1-3875347479352311816: Processing:  { Ans:
, MgmtId: 158445874166998, via: 1, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.Answer":{"result":false,"details":"Catch Exception
com.cloud.utils.exception.CloudRuntimeException, create StoragePool failed
due to com.cloud.utils.exception.CloudRuntimeException: Unable to create
NFS SR Pool[1|192.168.161.110:2049|/mnt/data/VMS-TT/primary] on
host:ba237c07-71cb-48a8-8a6d-6e6c3aff65b2 pool:
192.168.161.110/mnt/data/VMS-TT/primary","wait":0}}] }
2015-01-05 19:29:47,081 DEBUG [c.c.a.t.Request]
(catalina-exec-13:ctx-c00f6f19 ctx-37181993) Seq 1-3875347479352311816:
Received:  { Ans: , MgmtId: 158445874166998, via: 1, Ver: v1, Flags: 10, {
Answer } }
2015-01-05 19:29:47,081 DEBUG [c.c.a.m.AgentManagerImpl]
(catalina-exec-13:ctx-c00f6f19 ctx-37181993) Details from executing class
com.cloud.agent.api.CreateStoragePoolCommand: Catch Exception
com.cloud.utils.exception.CloudRuntimeException, create StoragePool failed
due to com.cloud.utils.exception.CloudRuntimeException: Unable to creat

RE: API error

[Somesh Naidu]

Can we get more details. As a start, what API call are we talking about here 
and what hypervisor?

-Original Message-
From: Mohammad Rastgoo [mailto:moham...@synapti.ca] 
Sent: Monday, January 05, 2015 12:48 PM
To: users@cloudstack.apache.org
Subject: API error

Hi,

I'm not sure if this is related to CS or not. Thanks in advance for all the
help and advice.

Setup: 4.4.2 on Centos 6.6 64bit
External Secondary Storage: NFS
Local Primary on identical hosts.

API error that we get:

Unable to use network with id= 626ee136-933c-4bca-9084-fc0691f2ff81,
permission denied.

We are using hostbill if it matters.

-- 
Mohammad Rastgoo

RE: API error

[Somesh Naidu]

I am sorry, I am not familiar with "hostbill" but a quick look up on the 
internet tells me that this is a billing software module that would, I guess, 
consume raw usage data from ACS (of course via ACS API).

So if I understand it correct, you say you are trying to create a VM via a 
hostbill API call? 

Irrespective of whether above is true or not, I believe the create VM is 
eventually being executed by ACS. If that's the case then it would help looking 
up the management-server.log (and/or apilog.log) to get more details of what is 
failing. Are you familiar with these logs?

-Original Message-
From: Mohammad Rastgoo [mailto:moham...@synapti.ca] 
Sent: Monday, January 05, 2015 1:04 PM
To: users@cloudstack.apache.org
Subject: Re: API error

Thanks for you reply.

Hypervisor is KVM.
I'm creating a VM. Unfortunately hostbill module is encoded so I cannot see
anything at hostbill end. is there any API log in hostbill that I can
see/paste the API calls here?

Thanks


On Mon, Jan 5, 2015 at 12:54 PM, Somesh Naidu 
wrote:

> Can we get more details. As a start, what API call are we talking about
> here and what hypervisor?
>
> -Original Message-
> From: Mohammad Rastgoo [mailto:moham...@synapti.ca]
> Sent: Monday, January 05, 2015 12:48 PM
> To: users@cloudstack.apache.org
> Subject: API error
>
> Hi,
>
> I'm not sure if this is related to CS or not. Thanks in advance for all the
> help and advice.
>
> Setup: 4.4.2 on Centos 6.6 64bit
> External Secondary Storage: NFS
> Local Primary on identical hosts.
>
> API error that we get:
>
> Unable to use network with id= 626ee136-933c-4bca-9084-fc0691f2ff81,
> permission denied.
>
> We are using hostbill if it matters.
>
> --
> Mohammad Rastgoo
>

RE: Can't create or deploy VMs

[Somesh Naidu]

Note quite.

> Insufficient space on pool: 1 since its usage percentage: 0.9072490225390984 
> has crossed the pool.storage.capacity.disablethreshold: 0.85

As Prashant pointed out, the used threshold for this storage has been reached. 
What you are seeing on the dashboard is allocated percentage. That is why he 
suggested workaround of manipulating "pool.storage.capacity.disablethreshold" 
and not "pool.storage.allocated.capacity.disablethreshold". This will buy you 
some time but eventually, you need to provision more storage.

Check the physical usage on the storage to understand what we mean.

-Original Message-
From: José Egas López [mailto:josee...@farmaenlace.com] 
Sent: Monday, January 05, 2015 1:43 PM
To: users@cloudstack.apache.org
Subject: Re: Can't create or deploy VMs

Hi Naidu, in the dashboard, it shows there is used only 38% of Primary 
Storage:

  *
Zone: ZonePharma
38%
Primary Storage
211.44 GB / 543.50 GB

So it seems there is more than enough of Primary Storage for creating VMs.

*Regards,
* *José

*

Teléf. (593-2)2993100 ext. 1639
Teléf. (593-99)8-824047
El 31/12/2014 a las 12:49, Somesh Naidu escribió:
>> 2014-12-31 07:49:44,405 DEBUG [c.c.d.DeploymentPlanningManagerImpl] 
>> (Job-Executor-22:ctx-f2bc1611 ctx-77cccfb5) No suitable pools found
>> 2014-12-31 07:49:44,405 DEBUG [c.c.d.DeploymentPlanningManagerImpl] 
>> (Job-Executor-22:ctx-f2bc1611 ctx-77cccfb5) No suitable storagePools found 
>> under this Cluster: 1
>> 2014-12-31 07:49:44,407 DEBUG [c.c.d.DeploymentPlanningManagerImpl] 
>> (Job-Executor-22:ctx-f2bc1611 ctx-77cccfb5) Could not find suitable 
>> Deployment Destination for this VM under any clusters, returning.
> Apparently, you only have 1 cluster in Zone 1 where the VM is being deployed 
> and the storage on that one is full. You need to provision more space.
>
> -Original Message-
> From: José Egas López [mailto:josee...@farmaenlace.com]
> Sent: Wednesday, December 31, 2014 8:18 AM
> To: users@cloudstack.apache.org
> Subject: Re: Can't create or deploy VMs
>
> The log on mgmt is:
>
> ***
> 2014-12-31 07:49:44,138 DEBUG [c.c.a.ApiServlet] 
> (catalina-exec-2:ctx-de733770) ===START===  172.30.1.107 -- GET  
> command=deployVirtualMachine&response=json&sessionkey=ExqHTfNe1JVXnQXRkEpgjMoDqu0%3D&zoneid=80b7c240-9204-43eb-85c8-762c7d7f6a15&templateid=449e3489-292e-4888-9682-d57d58a0ea1a&hypervisor=VMware&serviceofferingid=a6e438f6-afce-4388-9498-78cf2525cac2&diskofferingid=3df3bee2-bdee-4b80-9a0b-5ef039c5194c&displayname=test&name=test&_=1420030300055
> 2014-12-31 07:49:44,150 DEBUG [c.c.a.ApiDispatcher] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) InfrastructureEntity name 
> is:com.cloud.offering.ServiceOffering
> 2014-12-31 07:49:44,153 DEBUG [c.c.a.ApiDispatcher] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) ControlledEntity name 
> is:com.cloud.template.VirtualMachineTemplate
> 2014-12-31 07:49:44,158 DEBUG [c.c.a.ApiDispatcher] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) InfrastructureEntity name 
> is:com.cloud.offering.DiskOffering
> 2014-12-31 07:49:44,190 DEBUG [c.c.v.UserVmManagerImpl] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) Allocating in the DB for vm
> 2014-12-31 07:49:44,219 DEBUG [c.c.v.VirtualMachineManagerImpl] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) Allocating entries for VM: 
> VM[User|test]
> 2014-12-31 07:49:44,221 DEBUG [c.c.v.VirtualMachineManagerImpl] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) Allocating nics for VM[User|test]
> 2014-12-31 07:49:44,222 DEBUG [o.a.c.e.o.NetworkOrchestrator] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) Allocating nic for vm 
> VM[User|test] in network Ntwk[204|Guest|6] with requested profile 
> NicProfile[0-0-null-null-null
> 2014-12-31 07:49:44,233 DEBUG [c.c.v.VirtualMachineManagerImpl] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) Allocating disks for VM[User|test]
> 2014-12-31 07:49:44,244 DEBUG [c.c.v.VirtualMachineManagerImpl] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) Allocation completed for VM: 
> VM[User|test]
> 2014-12-31 07:49:44,244 DEBUG [c.c.v.UserVmManagerImpl] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) Successfully allocated DB entry 
> for VM[User|test]
> 2014-12-31 07:49:44,296 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] 
> (catalina-exec-2:ctx-de733770 ctx-77cccfb5) submit async job-419, details: 
> AsyncJobVO {id:419, userId: 2, accountId: 2, instanceType: VirtualMachine, 
> instanceId: 47, cmd: org.apache.cloudstack.api.command.user.vm.DeployVMCmd, 
> cmdInfo: 
> {"serviceofferingid":"a6e438f6-afce-4388-9498-78cf2525cac2","sessionkey":"ExqHTfNe1JVXnQXRkEpgjMoDqu0\u003d","cmdEventType":"VM.CREATE",

RE: API error

[Somesh Naidu]

Share the output of the following SQL query/s:

select * from account where account_name='client_1_1'\G
select * from networks where uuid='626ee136-933c-4bca-9084-fc0691f2ff81'\G

-Original Message-
From: Mohammad Rastgoo [mailto:moham...@synapti.ca] 
Sent: Monday, January 05, 2015 1:53 PM
To: users@cloudstack.apache.org
Subject: Re: API error

Hi,

Thanks again.

here is the API log:

http://pastebin.com/Fdx3mPK2

seems there is communication back and forth between HB and ACS.

I appreciate any help with the log please.

Thanks

On Mon, Jan 5, 2015 at 1:41 PM, Somesh Naidu 
wrote:

> I am sorry, I am not familiar with "hostbill" but a quick look up on the
> internet tells me that this is a billing software module that would, I
> guess, consume raw usage data from ACS (of course via ACS API).
>
> So if I understand it correct, you say you are trying to create a VM via a
> hostbill API call?
>
> Irrespective of whether above is true or not, I believe the create VM is
> eventually being executed by ACS. If that's the case then it would help
> looking up the management-server.log (and/or apilog.log) to get more
> details of what is failing. Are you familiar with these logs?
>
> -Original Message-
> From: Mohammad Rastgoo [mailto:moham...@synapti.ca]
> Sent: Monday, January 05, 2015 1:04 PM
> To: users@cloudstack.apache.org
> Subject: Re: API error
>
> Thanks for you reply.
>
> Hypervisor is KVM.
> I'm creating a VM. Unfortunately hostbill module is encoded so I cannot see
> anything at hostbill end. is there any API log in hostbill that I can
> see/paste the API calls here?
>
> Thanks
>
>
> On Mon, Jan 5, 2015 at 12:54 PM, Somesh Naidu 
> wrote:
>
> > Can we get more details. As a start, what API call are we talking about
> > here and what hypervisor?
> >
> > -Original Message-
> > From: Mohammad Rastgoo [mailto:moham...@synapti.ca]
> > Sent: Monday, January 05, 2015 12:48 PM
> > To: users@cloudstack.apache.org
> > Subject: API error
> >
> > Hi,
> >
> > I'm not sure if this is related to CS or not. Thanks in advance for all
> the
> > help and advice.
> >
> > Setup: 4.4.2 on Centos 6.6 64bit
> > External Secondary Storage: NFS
> > Local Primary on identical hosts.
> >
> > API error that we get:
> >
> > Unable to use network with id= 626ee136-933c-4bca-9084-fc0691f2ff81,
> > permission denied.
> >
> > We are using hostbill if it matters.
> >
> > --
> > Mohammad Rastgoo
> >
>



-- 
Mohammad Rastgoo
Founder & CEO

RE: API error

[Somesh Naidu]

Ok, all the accounts with account_name "client_1_1" seem to be removed.

So not sure using which account you are trying to launch the VM?

-Original Message-
From: Mohammad Rastgoo [mailto:moham...@synapti.ca] 
Sent: Monday, January 05, 2015 2:16 PM
To: users@cloudstack.apache.org
Subject: Re: API error

mysql> select * from account where account_name='client_1_1'\G
*** 1. row ***
 id: 4
   account_name: client_1_1
   uuid: 7124a5a9-eb18-42b8-818e-f64a248d7194
   type: 0
  domain_id: 3
  state: enabled
removed: 2015-01-02 21:00:46
 cleanup_needed: 0
 network_domain: NULL
default_zone_id: NULL
default: 0
*** 2. row ***
 id: 5
   account_name: client_1_1
   uuid: 16d39f9c-028e-4d7d-9821-8b95a2d39d2f
   type: 0
  domain_id: 4
  state: enabled
removed: 2015-01-02 21:14:46
 cleanup_needed: 0
 network_domain: NULL
default_zone_id: NULL
default: 0
*** 3. row ***
 id: 6
   account_name: client_1_1
   uuid: fbecb3ac-601b-4827-9797-ceacd7c10699
   type: 0
  domain_id: 5
  state: enabled
removed: 2015-01-02 21:18:25
 cleanup_needed: 0
 network_domain: NULL
default_zone_id: NULL
default: 0
*** 4. row ***
 id: 7
   account_name: client_1_1
   uuid: 2416c3df-1fe4-489b-8538-f9ed42c4801e
   type: 0
  domain_id: 6
  state: enabled
removed: 2015-01-02 21:24:19
 cleanup_needed: 0
 network_domain: NULL
default_zone_id: NULL
default: 0
*** 5. row ***
 id: 8
   account_name: client_1_1
   uuid: 95a84c01-2a51-4d8b-b35d-5e189f79bd2e
   type: 0
  domain_id: 7
  state: enabled
removed: 2015-01-02 21:29:38
 cleanup_needed: 0
 network_domain: NULL
default_zone_id: NULL
default: 0
*** 6. row ***
 id: 9
   account_name: client_1_1
   uuid: d569892c-c335-428f-889f-271ecfed12cb
   type: 0
  domain_id: 8
  state: enabled
removed: 2015-01-02 21:42:18
 cleanup_needed: 0
 network_domain: NULL
default_zone_id: NULL
default: 0
*** 7. row ***
 id: 10
   account_name: client_1_1
   uuid: 5d176acb-9d4c-413b-8441-0c1f548393f6
   type: 0
  domain_id: 9
  state: enabled
removed: 2015-01-02 21:43:40
 cleanup_needed: 0
 network_domain: NULL
default_zone_id: NULL
default: 0
*** 8. row ***
 id: 11
   account_name: client_1_1
   uuid: 89f60ee3-527f-4174-bff8-a59738d279b3
   type: 0
  domain_id: 10
  state: enabled
removed: 2015-01-02 21:44:29
 cleanup_needed: 0
 network_domain: NULL
default_zone_id: NULL
default: 0
*** 9. row ***
 id: 12
   account_name: client_1_1
   uuid: cdc04dd2-df08-49f8-ab75-e84f70fd2b0a
   type: 0
  domain_id: 11
  state: enabled
removed: 2015-01-05 17:45:34
 cleanup_needed: 0
 network_domain: NULL
default_zone_id: NULL
default: 0
9 rows in set (0.00 sec)


=
mysql> select * from networks where
uuid='626ee136-933c-4bca-9084-fc0691f2ff81'\G
*** 1. row ***
   id: 204
 name: Default
 uuid: 626ee136-933c-4bca-9084-fc0691f2ff81
 display_text: Default
 traffic_type: Guest
broadcast_domain_type: Vlan
broadcast_uri: vlan://624
  gateway: 10.1.0.1
 cidr: 10.1.0.0/20
 mode: Dhcp
  network_offering_id: 8
  physical_network_id: 200
   data_center_id: 1
guru_name: ExternalGuestNetworkGuru
state: Implemented
  related: 204
domain_id: 1
   account_id: 2
 dns1: NULL
 dns2: NULL
guru_data: NULL
   set_fields: 0
 acl_type: Account
   network_domain: cs2cloud.internal
   reservation_id: d028a548-0b79-4722-9751-29483dbbd12b
   guest_type: Isolated
 restart_required: 0
  created: 2015-01-02 06:03:01
  removed: NULL
specify_ip_ranges: 0
   vpc_id: NULL
  ip6_gateway: NULL
 ip6_cidr: NULL
 network_cidr: NULL
  display_network: 1
   network_acl_id: NULL
  streched_l2: 0
1 row in set (0.00 sec)


On Mon, Jan 5, 2015 at 2:09 PM, Somesh Naidu 
wrote:

>

RE: How to reduce the size of the cloud_usage database

[Somesh Naidu]

Dave,

Deleting records from cloud_usage is safe and permitted. These records are not 
used by any CS functionality. This data (raw usage data) is consumed by 
entities external to CS (billing software, etc). This data is exposed by CS via 
listUsage API. Deleting records from cloud_usage table will only cause this API 
to not return raw usage pertaining to those deleted records but not cause the 
API to break/crash.

I had written a KB article for Citrix Cloudplatform on this subject as well - 
http://support.citrix.com/article/CTX139043

You cloud replace "truncate table" with "delete from" with a where clause if 
you wanted to keep records until certain time and purge older, something like 
below:
delete from cloud_usage where start_date < date_sub(current_date(), interval 30 
day);

Hope that helps.

-Original Message-
From: David Williams [mailto:david.willi...@interoute.com] 
Sent: Tuesday, January 06, 2015 5:06 AM
To: users@cloudstack.apache.org
Subject: How to reduce the size of the cloud_usage database

Hi all,

Is there an "official" procedure on how to reduce the size of the cloud_usage 
database?

Thanks,

Dave

RE: How to reduce the size of the cloud_usage database

[Somesh Naidu]

Just saw this ...

> new (global) configuration option to limit size

+1 for the above.

It would be useful to have similar functionality developed for cloud_usage as 
we have for alerts and events, see below:

+--++
| name | description
|
+--++
| alert.purge.delay| Alerts older than specified number days will be 
purged. Set this value to 0 to never delete alerts |
| alert.purge.interval | The interval (in seconds) to wait before running the 
alert purge thread|
| event.purge.delay| Events older than specified number days will be 
purged. Set this value to 0 to never delete events |
| event.purge.interval | The interval (in seconds) to wait before running the 
event purge thread|
+--++

-Original Message-
From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] 
Sent: Tuesday, January 06, 2015 6:22 AM
To: users@cloudstack.apache.org
Subject: Re: How to reduce the size of the cloud_usage database

Hi David,

There is no official way to reduce the size of the cloud_usage database
as it gets populated from the cloud database.

Can you share why you want to reduce it? Are you're facing any MySQL
performance issues?

If your DB size is causing problems we could work with you to develop a
new (global) configuration option to limit size or an API to limit
past/historic data.

On Tuesday 06 January 2015 03:36 PM, David Williams wrote:
> Hi all,
>
> Is there an "official" procedure on how to reduce the size of the cloud_usage 
> database?
>
> Thanks,
>
> Dave

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 8826230892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab
PS. If you see any footer below, I did not add it :)
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge - rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

RE: Xenserver pool HA in Cloudstack

[Somesh Naidu]

Sonali, what version of XS are you using? 

-Original Message-
From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com] 
Sent: Tuesday, January 06, 2015 9:03 AM
To: users@cloudstack.apache.org
Subject: RE: Xenserver pool HA in Cloudstack

Sonali,

There have been some changes recently and as luck would have it today I am 
working on a blog article for www.shapeblue.com covering the correct way to 
configure HA in XenServer.  It's due to go live later today, I'll respond to 
this thread once it's live.

Regards

Geoff Higginbottom

D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581

geoff.higginbot...@shapeblue.com

-Original Message-
From: Sonali Jadhav [mailto:son...@servercentralen.se]
Sent: 06 January 2015 13:27
To: users@cloudstack.apache.org
Subject: Xenserver pool HA in Cloudstack

Hi,

I have Xenserver cluster setup with 4 Hosts in it. I was wondering  about HA 
configuration of xenserver pool. But at some places I saw that cloudstack HA 
and Xenserver HA both are different . And One shouldn't use Xenserver HA, since 
Cloudstack HA is by default active. Is it true?

Yours sincerely,

Sonali Jadhav | System Administrator
Nordiska Servercentralen
Direct: (Sweden) +46 7 52472074  | (India) +91 9892837889 Skype ID: 
sonali.jadhav.sj
E-mail: son...@servercentralen.se
Nordiska Servercentralen AB
Snövitsvägen 5
S-167 62 Bromma | Sweden
www.servercentralen.se
Incredible Servercentral Pvt. Ltd.
202, Siddhivinayak Aurum, Near Hyatt Regency Behind Eden Garden, Viman Nagar, 
411 014 | Pune, India www.servercentral.in

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

RE: How to reduce the size of the cloud_usage database

[Somesh Naidu]

Just saw this ...

> new (global) configuration option to limit size

+1 for the above.

It would be useful to have similar functionality developed for cloud_usage as 
we have for alerts and events, see below:

+--++
| name | description
|
+--++
| alert.purge.delay| Alerts older than specified number days will be 
purged. Set this value to 0 to never delete alerts |
| alert.purge.interval | The interval (in seconds) to wait before running the 
alert purge thread|
| event.purge.delay| Events older than specified number days will be 
purged. Set this value to 0 to never delete events |
| event.purge.interval | The interval (in seconds) to wait before running the 
event purge thread|
+--++

-Original Message-
From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com] 
Sent: Tuesday, January 06, 2015 6:22 AM
To: users@cloudstack.apache.org
Subject: Re: How to reduce the size of the cloud_usage database

Hi David,

There is no official way to reduce the size of the cloud_usage database
as it gets populated from the cloud database.

Can you share why you want to reduce it? Are you're facing any MySQL
performance issues?

If your DB size is causing problems we could work with you to develop a
new (global) configuration option to limit size or an API to limit
past/historic data.

On Tuesday 06 January 2015 03:36 PM, David Williams wrote:
> Hi all,
>
> Is there an "official" procedure on how to reduce the size of the cloud_usage 
> database?
>
> Thanks,
>
> Dave

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 8826230892 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab
PS. If you see any footer below, I did not add it :)
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge - rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.

RE: Unable to add primary storage (SR_BACKEND_FAILURE_73NFS mount error [opterr=mount failed with return code 32])

[Somesh Naidu]

Can you try with *async* instead?

If it still fails, check SMlog to see if there are more details why the mount 
is failing when creating the SR.

-Original Message-
From: Tejas Gadaria [mailto:refond.g...@gmail.com] 
Sent: Tuesday, January 06, 2015 7:44 AM
To: d...@cloudstack.apache.org
Cc: users@cloudstack.apache.org
Subject: Re: Unable to add primary storage (SR_BACKEND_FAILURE_73NFS mount 
error [opterr=mount failed with return code 32])

Hi Prashant,

/etc/export file content is given below
/mnt/data/VM-TT/primary *(rw,sync,no_root_squash,no_subtree_check)

Still problem persist.

I have Ubuntu 12.04 Server acting as NFS-Server.

Regards,
Tejas


On Tue, Jan 6, 2015 at 12:40 PM, Prashant Kumar Mishra <
prashantkumar.mis...@citrix.com> wrote:

> It seems issue with remote mounting ,similar issue seen
> http://lists.xenproject.org/archives/html/xen-api/2012-05/msg00191.html
> ,mentioned solution should work in your case also
>
> Thanks
> prashant
>
> On 1/6/15, 11:39 AM, "Tejas Gadaria"  wrote:
>
> >Hi Suresh,
> >
> >I was able to mount NFS on XS host through CLI mount.nfs4 successfully.
> >Also vhd-utils was present on Management server and XS host also. Still
> >facing same issue.
> >
> >Regards,
> >Tejas
> >
> >
> >
> >On Mon, Jan 5, 2015 at 11:16 PM, Suresh Sadhu 
> >wrote:
> >
> >> Hope you have already copied vhd-util  in to the host  and also as
> >>Somesh
> >> suggested try manually mounting the storage directly  from  the host.
> >>
> >>
> >> Regards
> >> Sadhu
> >>
> >>
> >> -Original Message-
> >> From: Somesh Naidu [mailto:somesh.na...@citrix.com]
> >> Sent: 05 January 2015 20:16
> >> To: users@cloudstack.apache.org; d...@cloudstack.apache.org
> >> Subject: RE: Unable to add primary storage (SR_BACKEND_FAILURE_73NFS
> >>mount
> >> error [opterr=mount failed with return code 32])
> >>
> >> XS is unable to create the SR failing with the following error:
> >> ---
> >> Caused by: SR_BACKEND_FAILURE_73NFS mount error [opterr=mount failed
> >>with
> >> return code 32]
> >> ---
> >>
> >> May be a problem with the NFS. Can you try manually creating a SR on XS
> >> using this NFS or may be simply try to mount the NFS on XS and see if
> >>that
> >> works.
> >>
> >> -Original Message-
> >> From: Tejas Gadaria [mailto:refond.g...@gmail.com]
> >> Sent: Monday, January 05, 2015 9:26 AM
> >> To: users@cloudstack.apache.org; d...@cloudstack.apache.org
> >> Subject: Unable to add primary storage (SR_BACKEND_FAILURE_73NFS mount
> >> error [opterr=mount failed with return code 32])
> >>
> >> Hi,
> >>
> >> I am facing issue with xenserver 6.2 SP1, on ACS 4.3.1 and 4.4 both.
> >>
> >>
> >> While creating Zone with NFS as primary & secondary storage
> >>
> >> 2015-01-05 19:29:45,715 DEBUG [c.c.a.m.DirectAgentAttache]
> >> (DirectAgent-2:ctx-23cfb66b) Seq 1-3875347479352311816: Executing
> >>request
> >> 2015-01-05 19:29:47,079 WARN  [c.c.h.x.r.CitrixResourceBase]
> >> (DirectAgent-2:ctx-23cfb66b) Catch Exception
> >> com.cloud.utils.exception.CloudRuntimeException, create StoragePool
> >>failed
> >> due to com.cloud.utils.exception.CloudRuntimeException: Unable to create
> >> NFS SR Pool[1|192.168.161.110:2049|/mnt/data/VMS-TT/primary] on
> >> host:ba237c07-71cb-48a8-8a6d-6e6c3aff65b2 pool:
> >> 192.168.161.110/mnt/data/VMS-TT/primary
> >> com.cloud.utils.exception.CloudRuntimeException: Unable to create NFS SR
> >> Pool[1|192.168.161.110:2049|/mnt/data/VMS-TT/primary]
> >> at
> >>
> >>
> >>com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNfsSR(CitrixResou
> >>rceBase.java:6133)
> >> at
> >>
> >>
> >>com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResour
> >>ceBase.java:5074)
> >> at
> >>
> >>
> >>com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citri
> >>xResourceBase.java:475)
> >> at
> >>
> >>
> >>com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenS
> >>erver56Resource.java:61)
> >> at
> >>
> >>
> >>com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(Xen
> >>Server610Resource.java:102)
> >> at
> >>
> >>
> >>com.cloud.age