Re: VMware 6.0 or 6.5

[Dag Sonstebo]

Shouldn’t be any issues with this Marty – you obviously need to create new 
templates – and maybe name your templates according to hypervisor. Apart from 
that as long as your networking is set up correctly – i.e. VLANs propagate 
between VMware and XenServer clusters this should work fine.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 28/10/2017, 00:33, "Marty Godsey"  wrote:

No, I am just now getting ready to add my VMware cluster to my zone and 
wanted to know if anyone had any bad experiences.

Regards,
Marty Godsey
Principal Engineer
nSource Solutions, LLC

-Original Message-
From: Rafael Weingärtner [mailto:raf...@autonomiccs.com.br] 
Sent: Friday, October 27, 2017 7:20 PM
To: users@cloudstack.apache.org
Subject: Re: VMware 6.0 or 6.5

I have not seen any. Have you experienced something out of the ordinary?


On 10/27/2017 9:19 PM, Marty Godsey wrote:
> Has anyone seen issues when using in the same zone as XenServer? 
Different clusters of course..
>
> Regards,
> Marty Godsey
> Principal Engineer
> nSource Solutions, LLC
>
> -Original Message-
> From: Dag Sonstebo [mailto:dag.sonst...@shapeblue.com]
> Sent: Friday, October 27, 2017 11:23 AM
> To: users@cloudstack.apache.org
> Subject: Re: VMware 6.0 or 6.5
>
> Hi Marty,
>
> We use vSphere 6.5 with ACS4.9.3, works a treat, no issues.
>
> Regards,
> Dag Sonstebo
> Cloud Architect
> ShapeBlue
>
> On 27/10/2017, 15:36, "Marty Godsey"  wrote:
>
>  Hello everyone,
>  
>  What has the experience been with ACS an VMware? I have used 
XenServer primarily with a spackling of KVM but never VMware. I am quite versed 
with VMware, just not with ACS.
>  
>  Thoughts, experiences, warnings?
>  
>  Regards,
>  Marty Godsey
>  Principal Engineer
>  nSource Solutions, LLC
>  
>  
>
>
> dag.sonst...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
>
>   
>

-- 
Rafael Weingärtner




dag.sonst...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: Problems with KVM HA & STONITH

[Dag Sonstebo]

Hi James,

I think  you possibly have over-configured your KVM hosts. If you use NFS (and 
no clustered file system like CLVM) then there should be no need to configure 
STONITH. CloudStack takes care of your HA, so this is not something you offload 
to the KVM host.

(As mentioned the only time I have played with STONITH and CloudStack was for 
CLVM – and I eventually found it not fit for purpose, too unstable and causing 
too many issues like you describe. Note this was for block storage though – not 
NFS).

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 28/10/2017, 03:40, "Ivan Kudryavtsev"  wrote:

Hi. If the node losts nfs host it reboots (acs agent behaviour). If you
really have 3 storages, you'll go clusterwide reboot everytime your host is
down.

28 окт. 2017 г. 3:02 пользователь "Simon Weller" 
написал:

> Hi James,
>
>
> Can you elaborate a bit further on the storage? You say you're running NFS
> on all 3 nodes, can you explain how it is setup?
>
> Also, what version of ACS are you running?
>
>
> - Si
>
>
>
>
> 
> From: McClune, James 
> Sent: Friday, October 27, 2017 2:21 PM
> To: users@cloudstack.apache.org
> Subject: Problems with KVM HA & STONITH
>
> Hello Apache CloudStack Community,
>
> My setup consists of the following:
>
> - Three nodes (NODE1, NODE2, and NODE3)
> NODE1 is running Ubuntu 16.04.3, NODE2 is running Ubuntu 16.04.3, and 
NODE3
> is running Ubuntu 14.04.5.
> - Management Server (running on separate VM, not in cluster)
>
> The three nodes use KVM as the hypervisor. I also configured primary and
> secondary storage on all three of the nodes. I'm using NFS for the primary
> & secondary storage. VM operations work great. Live migration works great.
>
> However, when a host goes down, the HA functionality does not work at all.
> Instead of spinning up the VM on another available host, the down host
> seems to trigger STONITH. When STONITH happens, all hosts in the cluster 
go
> down. This not only causes no HA, but also downs perfectly good VM's. I
> have read countless articles and documentation related to this issue. I
> still cannot find a viable solution for this issue. I really want to use
> Apache CloudStack, but cannot implement this in production when STONITH
> happens.
>
> I think I have something misconfigured. I thought I would reach out to the
> CloudStack community and ask for some friendly assistance.
>
> If there is anything (system-wise) you request in order to further
> troubleshoot this issue, please let me know and I'll send. I appreciate 
any
> help in this issue!
>
> --
>
> Thanks,
>
> James
>



dag.sonst...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: Oracle VM 3.4 with ACS

[Dag Sonstebo]

Hi David,

Oracle VM isn’t a supported hypervisor in ACS unfortunately, not aware of any 
work having been done on this – but someone else may know.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 29/10/2017, 16:30, "David Amorín"  wrote:


Hi all, our infraestructure is based on ACS 4.9.2 with XS 7. We need to 
deploy new host based on Oracle VM and we will have to set spinning CPU (1 
socket per host) 




1./ Do you know if this configuration is compatible with ACS?




2./ I didn't find to much information about the "real" issues of Oracle VM 
& ACS. Is there any user working in a production environment with Oracle VM & 
ACS?




Thanks for your help
-- 
David 






dag.sonst...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

File upload task failed to complete due to: Error writing request body to server

[Ciobanu Cristian]

Hello,

 

Any idea how to fix this issue?   I get this issue only when I try to
deploy a VM on this particular host ( logs ) :

 

 

Logs exported from SSVM:

 

2017-10-30 08:36:56,466 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null)
Received response: Seq 94-43:  { Ans: , MgmtId: 52230178461, via: 94, Ver:
v1, Flags: 100010,
[{"com.cloud.agent.api.PingAnswer":{"_command":{"hostType":"Storage",
"hostId":94,"wait":0},"result":true,"wait":0}}] }

2017-10-30 08:37:49,056 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-5:null) Processing command:
com.cloud.agent.api.GetStorageStatsCommand

2017-10-30 08:37:49,056 INFO  [storage.resource.NfsSecondaryStorageResource]
(agentRequest-Handler-5:null) Determined host 172.1.2.4 corresponds to IP
172.1.2.4

2017-10-30 08:37:55,139 ERROR [vmware.mo.HypervisorHostHelper]
(agentRequest-Handler-4:job-5229/job-5231, cmd: CopyCommand) File upload
task failed to complete due to: Error writing request body to server

2017-10-30 08:37:55,140 INFO  [vmware.mo.HttpNfcLeaseMO]
(agentRequest-Handler-4:job-5229/job-5231, cmd: CopyCommand) close
ProgressReporter, interrupt reporter runner to let it quit

2017-10-30 08:37:55,140 ERROR [vmware.mo.HypervisorHostHelper]
(agentRequest-Handler-4:job-5229/job-5231, cmd: CopyCommand) Aborting the
lease on b263251970913d2ab563ae8d61c4f67f after import operation failed.

2017-10-30 08:37:55,141 INFO  [vmware.mo.HttpNfcLeaseMO] (Thread-6:null)
ProgressReporter is interrupted, quiting

2017-10-30 08:37:55,142 INFO  [vmware.mo.HttpNfcLeaseMO] (Thread-6:null)
ProgressReporter stopped

2017-10-30 08:37:55,306 INFO  [vmware.util.VmwareHelper]
(agentRequest-Handler-4:job-5229/job-5231, cmd: CopyCommand) [ignored]failed
toi get message for exception: File upload task failed to complete due to:
Error writing request body  to server

2017-10-30 08:37:55,306 ERROR [storage.resource.VmwareStorageProcessor]
(agentRequest-Handler-4:job-5229/job-5231, cmd: CopyCommand) Unable to copy
template to primary storage due to exception:Exception: java.lang.Exception

Message: File upload task failed to complete due to: Error writing request
body to server

 

java.lang.Exception: File upload task failed to complete due to: Error
writing request body to server

at
com.cloud.hypervisor.vmware.mo.HypervisorHostHelper.importVmFromOVF(Hypervis
orHostHelper.java:1561)

at
com.cloud.hypervisor.vmware.mo.HostMO.importVmFromOVF(HostMO.java:749)

at
com.cloud.storage.resource.VmwareStorageProcessor.copyTemplateFromSecondaryT
oPrimary(VmwareStorageProcessor.java:207)

at
com.cloud.storage.resource.VmwareStorageProcessor.copyTemplateToPrimaryStora
ge(VmwareStorageProcessor.java:349)

at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Storag
eSubsystemCommandHandlerBase.java:85)

at
com.cloud.storage.resource.VmwareStorageSubsystemCommandHandler.execute(Vmwa
reStorageSubsystemCommandHandler.java:187)

at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageC
ommands(StorageSubsystemCommandHandlerBase.java:55)

at
com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.executeRequ
est(VmwareSecondaryStorageResourceHandler.java:115)

at
com.cloud.storage.resource.PremiumSecondaryStorageResource.executeRequest(Pr
emiumSecondaryStorageResource.java:57)

at com.cloud.agent.Agent.processRequest(Agent.java:525)

at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:833)

at com.cloud.utils.nio.Task.call(Task.java:83)

at com.cloud.utils.nio.Task.call(Task.java:29)

at java.util.concurrent.FutureTask.run(FutureTask.java:262)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
45)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
15)

at java.lang.Thread.run(Thread.java:745)

2017-10-30 08:37:55,307 DEBUG
[storage.resource.VmwareSecondaryStorageResourceHandler]
(agentRequest-Handler-4:job-5229/job-5231, cmd: CopyCommand) Command
execution answer: {"result":false,"details":"Unable to copy template to
primary  storage due to exception:Exception: java.lang.Exception\nMessage:
File upload task failed to complete due to: Error writing request body to
server\n","wait":0}

2017-10-30 08:37:55,308 DEBUG
[storage.resource.VmwareSecondaryStorageResourceHandler]
(agentRequest-Handler-4:job-5229/job-5231, cmd: CopyCommand) Done executing
{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"templ
ate/tmpl/2/260/9ac00ab4-4666-32e0-8656-6c3de1b1faa6.ova","origUrl":"http://1
49.202.xx.xx/userdata/963e8e86-941a-44b7-8605-ed80104cc8b4.ova","uuid":"a3e6
e56d-6466-4f99-b5db-b1045568c3b6","id":260,"format":"OVA","accountId":2,"che
cksum
":"d24d767ebe0a526e0edfbef726764a8a","hvm":true,"displayText":"CentOS-6.7-Mi
nimalv1","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://172
.1.2.4/secondaryE01","_role":"Image"}},"nam

Re: need help on Template and Storage issue

[William Alianto]

Looks like there is something wrong with the NFS storage, since the system 
cannot determine the capacity of the storage and failed to create system VM.

Here is part of the log


https://pastebin.com/Jrx1K1vn




On 27-Oct-17 18:45:02, Rafael Weingärtner  wrote:
If the zone is enabled, probably there is something wrong. You can take a
look at the log files in /var/log/cloudstack/management/

On Fri, Oct 27, 2017 at 1:25 AM, William Alianto wrote:

> Hi Rafael,
>
> Although the sytem vm template is ready, there is no system vm shown in
> the infrastructure. Is there anything wrong in the installation process or
> there is some other steps needed to enable the system vm in the
> infrastructure?
>
> --
> Regards,
>
> William
>
>
> On 26-Oct-17 22:52:14, Rafael Weingärtner
> wrote:
> Under infrastructure dashboard there is an option called system vm
>
> On Thu, Oct 26, 2017 at 1:48 PM, William Alianto wrote:
>
> > I’m not sure about that. How can I check about the status of system vms?
> >
> > --
> > Regards,
> >
> > William
> >
> > > On 26 Oct 2017, at 22.18, Rafael Weingärtner
> > rafaelweingart...@gmail.com> wrote:
> > >
> > > And are the system vms running?
> > >
> > >> On Thu, Oct 26, 2017 at 1:17 PM, William Alianto
> > wrote:
> > >>
> > >> The zone, pod and cluster has been configured, and host added. System
> VM
> > >> template is ready as well.
> > >>
> > >> --
> > >> Regards,
> > >>
> > >> William
> > >>
> > >>> On 26 Oct 2017, at 21.30, Rafael Weingärtner
> > >> rafaelweingart...@gmail.com> wrote:
> > >>>
> > >>> Did you configure the logical divisions Zone, Pode, Cluster and then
> > >> added
> > >>> the host?
> > >>> Are the system VMs running?
> > >>>
> >  On Thu, Oct 26, 2017 at 12:13 PM, William Alianto
> > >> wrote:
> > 
> >  I have installed the management server, and have one KVM hypervisor
> > and
> >  one Storage server with NFS capability. On the dashboard I can see
> > that
> > >> all
> >  of them have been added to the system properly, or it might seems to
> > be,
> >  including the networking. I guess that would be the least minimum
> >  requirement for the initial installation.
> > 
> >  --
> >  Regards,
> > 
> >  William
> > 
> > > On 26 Oct 2017, at 18.03, Rafael Weingärtner
> >  rafaelweingart...@gmail.com> wrote:
> > >
> > > You just installed the management server or did you configure
> > >> everything
> > > else? Apache CloudStack (ACS) is not "just" an application that you
> > > install; you need to check the requirements for the deployment
> design
> > >> you
> > > want, and then you need to configure them. By requirements I mean,
> >  storage,
> > > networking and virtualization systems that need to be set up for
> ACS
> > to
> > > manage and create the cloud abstraction.
> > >
> > >
> > >> On Thu, Oct 26, 2017 at 8:36 AM, William Alianto
> > >
> >  wrote:
> > >>
> > >> Hi,
> > >>
> > >> I'm currently trying to create a Cloudstack for POC purpose,
> before
> > >> heading to development and production. I've been using the
> > >> installation
> > >> guide provided at http://docs.cloudstack.apache.org/projects/
> > >> cloudstack-installation/en/4.9/ [http://docs.cloudstack.
> > >> apache.org/projects/cloudstack-installation/en/4.9/]. I'm using
> > >> CentOS
> > >> 6.9 for the base OS.
> > >>
> > >> After I completed the installation, and running the initial
> setup, I
> > >> encounter some problem. I can't create any instances because
> nothing
> >  shown
> > >> at my templates list. I also tried to add my own template, but I
> got
> > >> "unable to find zone or an image store with enough capacity"
> message
> > >> instead. Seems like the system cannot determine any space
> available
> >  from my
> > >> NFS server. Is there any way to solve this problems, so I can move
> >  further
> > >> in the POC progress?
> > >>
> > >> --
> > >> Regards,
> > >>
> > >> William
> > >
> > >
> > >
> > >
> > > --
> > > Rafael Weingärtner
> > 
> > >>>
> > >>>
> > >>>
> > >>> --
> > >>> Rafael Weingärtner
> > >>
> > >
> > >
> > >
> > > --
> > > Rafael Weingärtner
> >
>
>
>
> --
> Rafael Weingärtner
>



--
Rafael Weingärtner

Re: File upload task failed to complete due to: Error writing request body to server

[Boris Stoyanov]

Hi Cristian,
are you using local storage? Can you confirm template is properly downloaded 
and deployable on other hosts?
—Boris Stoyanov

boris.stoya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

On Oct 30, 2017, at 11:23 AM, Ciobanu Cristian 
mailto:cristian.c@istream.today>> wrote:

Error
writing request body to server

Issue with PVLAN , Vmware 6.5 ACS 4.10

[Info Manager]

Hello,



Any idea how to fix this issue?

Mark Rogov

Thank's

29 окт. 2017 г. 22:49 пользователь "Info Manager" 
написал:

> Hello,
>
> VR is shutting down after deploy and no network assigned when trying to
> create shared guest network with real white IP's
>
> L2 Switch Force10 s60 with PVLAN
>
> [image: Inline image 1]
>
> 2017-10-29 22:32:22,058 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (API-Job-Executor-37:ctx-9cc3690d job-348 ctx-20fa9ee9) (logid:2a620d26)
> Allocating entries for VM: VM[DomainRouter|r-65-VM]
> 2017-10-29 22:32:22,063 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (API-Job-Executor-37:ctx-9cc3690d job-348 ctx-20fa9ee9) (logid:2a620d26)
> Allocating nics for VM[DomainRouter|r-65-VM]
> 2017-10-29 22:32:22,066 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-37:ctx-9cc3690d job-348 ctx-20fa9ee9) (logid:2a620d26)
> Allocating nic for vm VM[DomainRouter|r-65-VM] in network Ntwk[220|Guest|7]
> with requested profile NicProfile[0-0-null-null-null
> 2017-10-29 22:32:22,092 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-37:ctx-9cc3690d job-348 ctx-20fa9ee9) (logid:2a620d26)
> Allocating nic for vm VM[DomainRouter|r-65-VM] in network
> Ntwk[202|Control|3] with requested profile null
> 2017-10-29 22:32:22,110 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (API-Job-Executor-37:ctx-9cc3690d job-348 ctx-20fa9ee9) (logid:2a620d26)
> Allocating disks for VM[DomainRouter|r-65-VM]
> 2017-10-29 22:32:22,120 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (API-Job-Executor-37:ctx-9cc3690d job-348 ctx-20fa9ee9) (logid:2a620d26)
> Allocation completed for VM: VM[DomainRouter|r-65-VM]
> 2017-10-29 22:32:22,145 DEBUG [c.c.n.r.NetworkHelperImpl]
> (API-Job-Executor-37:ctx-9cc3690d job-348 ctx-20fa9ee9) (logid:2a620d26)
> Starting router VM[DomainRouter|r-65-VM]
> 2017-10-29 22:32:23,755 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-63:ctx-001ec8b4 job-348/job-351 ctx-4a25af66)
> (logid:2a620d26) Successfully transitioned to start state for
> VM[DomainRouter|r-65-VM] reservation id = 5afbcfcf-d768-4c70-8af1-
> acf7c8238a3d
> 2017-10-29 22:32:23,947 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-63:ctx-001ec8b4 job-348/job-351 ctx-4a25af66)
> (logid:2a620d26) Deployment found  - P0=VM[DomainRouter|r-65-VM],
> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(66|
> ROOT-->Pool(2))]
> 2017-10-29 22:32:24,088 DEBUG [c.c.n.g.PodBasedNetworkGuru]
> (Work-Job-Executor-63:ctx-001ec8b4 job-348/job-351 ctx-4a25af66)
> (logid:2a620d26) Allocated a nic NicProfile[133-65-5afbcfcf-
> d768-4c70-8af1-acf7c8238a3d-172.23.35.247-null for
> VM[DomainRouter|r-65-VM]
> 2017-10-29 22:32:24,115 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> (Work-Job-Executor-63:ctx-001ec8b4 job-348/job-351 ctx-4a25af66)
> (logid:2a620d26) Checking if we need to prepare 1 volumes for
> VM[DomainRouter|r-65-VM]
> 2017-10-29 22:32:24,207 DEBUG [c.c.a.t.Request] 
> (Work-Job-Executor-63:ctx-001ec8b4
> job-348/job-351 ctx-4a25af66) (logid:2a620d26) Seq 1-1437774181038032715:
> Sending  { Cmd , MgmtId: 52240608294, via: 1(172.23.32.1), Ver: v1, Flags:
> 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{
> "srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"
> 055468adeeda31e283b0b01fc0631e93","origUrl":"http://
> packages.shapeblue.com.s3-eu-west-1.amazonaws.com/
> systemvmtemplate/4.10/dnsmasq/systemvm64template-4.10-vmware.ova
> ","uuid":"2c2b054b-8be2-4e1f-9537-83e852ba9b1c","id":8,"format":"OVA","
> accountId":1,"checksum":"970bfb070a80bd74820881d8149643
> c1","hvm":false,"displayText":"SystemVM Template
> (vSphere)","imageDataStore":{"org.apache.cloudstack.storage.
> to.PrimaryDataStoreTO":{"uuid":"9646e689ebf53959acd3001b2686a9
> 5b","id":2,"poolType":"VMFS","host":"VMFS datastore:
> datastore-183","path":"datastore-183","port":0,"url":"VMFS://VMFS
> datastore: datastore-183/datastore-183/?ROLE=Primary&STOREUUID=
> 9646e689ebf53959acd3001b2686a95b","isManaged":false}},"name"
> :"routing-8","hypervisorType":"VMware"}},"destTO":{"org.
> apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"
> 95b692c6-194e-4d92-a756-b5f7697e5418","volumeType":"
> ROOT","dataStore":{"org.apache.cloudstack.storage.to.
> PrimaryDataStoreTO":{"uuid":"9646e689ebf53959acd3001b2686a9
> 5b","id":2,"poolType":"VMFS","host":"VMFS datastore:
> datastore-183","path":"datastore-183","port":0,"url":"VMFS://VMFS
> datastore: datastore-183/datastore-183/?ROLE=Primary&STOREUUID=
> 9646e689ebf53959acd3001b2686a95b","fullCloneFlag":true,"
> isManaged":false}},"name":"ROOT-65","size":3355443200,"
> volumeId":66,"vmName":"r-65-VM","accountId":1,"format":"
> OVA","provisioningType":"THIN","id":66,"deviceId":0,"
> hypervisorType":"VMware"}},"executeInSequence":true,"
> options":{},"options2":{},"wait":0}}] }
> 2017-10-29 22:32:24,208 DEBUG [c.c.a.t.Request] 
> (Work-Job-Executor-63:ctx-001ec8b4
> job-348/job-351 ctx-4a25af66) (logid:2a620d

Re: [DISCUSS] Moving to embedded Jetty and fatjar CloudStack

[Rohit Yadav]

All,


The fatjar PR that aims at migrating to embedded Jetty is ready for review now:

https://github.com/apache/cloudstack/pull/2226


New configuration file updates/changes:
- /etc/cloudstack/management/server.properties - single file to configure 
ports, webapp directory, http/s configurations, webapp context path etc.
- Environment configuration set at /etc/default/cloudstack-management (CentOS 
accepts having env conf files at /etc/default, while Ubuntu uses this path most 
of the time)

High-level changelog:

- Changes packaging to a shaded (fat/uber) jar
- Updates jetty dependencies version 9.2 (java 7+)
- Removal of tomcat, config files and additional distro-provided java 
dependencies
- Does not shade and include mysql-connector (cat-x), still distro-provided and 
used from classpath
- Introduce ServerDaemon class with customizations
- Migrate to embedded Jetty server with a new ServerDaemon launcher
- Introduce a new server.properties file for easier configuration
- Have a single /etc/default/cloudstack-management to configure env
- Reduce shaded jar file, removing unnecessary dependencies, thereby reducing 
overall rpm/deb file size to less than 84MB
- Upgrade to Spring 5.x, upgrade several jar dependencies
- Upgrade and use bountcastle as a separate un-shaded jar dependency
- Have both embedded UI assets in uber jar and separate webapp directory
- Refactor systemd and init scripts, cleanup packaging
- Made cloudstack-setup-databases faster, using `urandom`
- Remove unmaintained distro packagings and config files


Regards.


From: Rohit Yadav 
Sent: Thursday, August 24, 2017 1:24:06 AM
To: Syed Ahmed; d...@cloudstack.apache.org
Cc: Cloudstack Users List
Subject: Re: [DISCUSS] Moving to embedded Jetty and fatjar CloudStack

All,


Based on last Trilian based test runs, no regressions are seen. We'll aim for 
following changes and afterwards works towards merging the PR;


- An option to provide explicit webapp directory, for custom UI etc. The 
default UI would be bundled in the fat jar, with the UI assets/files also 
copied/packaged at /usr/share/cloudstack-management/webapp (or ui folder) to 
allow for customizations

- Fix packaging, refactor systemd/initd script

- Completely move to java/systemd, instead of using jsvc+systemd for 
systemd-enabled distros, and use init.d scripts for centos6/older distros

- Logging and other improvements to ServerDaemon (the main class that run jetty 
in the fatjar)

- A xml/yml file to configure SSL certificates, options etc.


- Rohit


From: Syed Ahmed 
Sent: Thursday, August 17, 2017 3:00:48 PM
To: d...@cloudstack.apache.org
Cc: Rohit Yadav; Cloudstack Users List
Subject: Re: [DISCUSS] Moving to embedded Jetty and fatjar CloudStack

I have always been a big fan of fat, dependency-free binaries. Good work guys!


rohit.ya...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue




rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

On Thu, Aug 10, 2017 at 11:23 AM, Wido den Hollander 
mailto:w...@widodh.nl>> wrote:

> Op 10 augustus 2017 om 14:09 schreef Rohit Yadav 
> mailto:rohit.ya...@shapeblue.com>>:
>
>
> All,
>
>
> Distro provided tomcat6/7/* has caused production issues for few users in the 
> past. Due to this, the ACS deployments are inconsistent with the version/jars 
> of tomcat in use. By allowing exploded war to be shipped, can allow admins to 
> sometimes overwrite cloudstack jars causing production issues. I think moving 
> to a CloudStack uber/fat jar will make it easier to deploy CloudStack in 
> environments and write custom init/systemd scripts and fix cloudstack setup 
> databases/management scripts without assuming the distro we're on.
>

Yes, I agree. A flat jar makes things a lot easier.

>
> With this discussion thread, I would like to engage with the community if 
> they've any reservations from moving away from tomcat to embedded jetty + 
> fat/uber jar based packaging. Please share your thoughts and comments.
>
>
> On very high level the packaging will provide the following:
>
> - A ServerDaemon class that can accept custom location of UI (webapp 
> directory), logging, and other environment options, part of the fatjar.
>
> - A config file (xml/yml or otherwise) where you can configure 
> keystore/SSL-certificates, paths (/client), ports, logging etc.
>
> - Default libraries/plugin path at /usr/share/cloudstack-management/lib, UI 
> path at /usr/share/cloudstack-management/webapp
>
> - A default file (available at /etc/default/cloudstack-management or symlink 
> at /etc/sysconfig etc) where you can specific custom variables, java options, 
> classpath etc.
>
> - Refactored init.d/systemd scripts to be commonly used b/w rpm/deb build 
> scripts
>
> - A new/improve logrotate file
>
> - Logging will be handled by log4j (the same xml/config 

RE: File upload task failed to complete due to: Error writing request body to server

[Ciobanu Cristian]

Hi Boris,

  I use local storage and the template is successfully installed, I'm able to 
deploy to other host (same cluster ) using this template, the only issue is 
that it may take longer, the copy progress take longer, same issue for second 
host also ( not working one ) but there I end with this :
vSphere event:
=== 
Deploy OVF template
b263251970913d2ab563ae8d61c4f67f
The task was canceled by 
a user.
VSPHERE.LOCAL\Administrator
VCENTER001
===

for example, right now is stuck on 2% (vSphere ) will end with canceled by 
user...
===
Deploy OVF template
b263251970913d2ab563ae8d61c4f67f
2%
VSPHERE.LOCAL\Administrator
VCENTER001
10/30/2017 1:57:34 PM
===

I'm able to deploy VMs only from template which were used before this issue...

 Thank you,
Cristian

-Original Message-
From: Boris Stoyanov [mailto:boris.stoya...@shapeblue.com] 
Sent: Monday, October 30, 2017 11:31 AM
To: users@cloudstack.apache.org
Subject: Re: File upload task failed to complete due to: Error writing request 
body to server

Hi Cristian,
are you using local storage? Can you confirm template is properly downloaded 
and deployable on other hosts?
—Boris Stoyanov

boris.stoya...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
  
 

On Oct 30, 2017, at 11:23 AM, Ciobanu Cristian 
mailto:cristian.c@istream.today>> wrote:

Error
writing request body to server

RE: Strange size of template from snapshot on XenServer

[Lotic Lists]

Good morning

Guys, who could execute the test below?

1. Create a manual snapshot of a volume
2. Create a file (1GB) with dd on VM
3. Create second snapshot of a volume
4. Convert latest snapshot to a template
5. Verify the size of vhd of new template in secondary storage.

Here the template have 1GB, exactly the size of latest snapshot.

ACS 4.9.3, XenServer 6.5, Primary Stg ISCSI


-Original Message-
From: Lotic Lists [mailto:li...@lotic.com.br] 
Sent: quinta-feira, 26 de outubro de 2017 15:03
To: users@cloudstack.apache.org
Subject: RE: Strange size of template from snapshot on XenServer

I test the same case on other environment, create template from snapshot, acs 
4.9.2.0 and XenServer 6.5/iscsi

1. Was created two snapshots

# ls -lh 
/var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/snapshots/131/617/
total 3.0G
-rw-r--r-- 1 4294967294 root  13G Oct 26 13:46 
42c7c51d-4aa7-40d2-b5eb-cb56fc963974.vhd
-rw-r--r-- 1 4294967294 root 1.2G Oct 26 14:42 
53b33a5a-a7d9-4efa-b126-38eec5482b05.vhd

https://i.imgur.com/cSHZAJ3.png

2. create a template from latest snapshot

# ls -lh
total 37M
-rw-r--r-- 1 4294967294 root 1.2G Oct 26 14:43 
637604a6-3085-444e-ba09-b9aab11a2c16.vhd
-rw-r--r-- 1 4294967294 root  303 Oct 26 14:43 template.properties

# cat template.properties
#Thu Oct 26 16:43:54 UTC 2017
filename=637604a6-3085-444e-ba09-b9aab11a2c16.vhd
id=1
vhd=true
vhd.filename=637604a6-3085-444e-ba09-b9aab11a2c16.vhd
public=true
uniquename=637604a6-3085-444e-ba09-b9aab11a2c16
vhd.virtualsize=21474836480
virtualsize=21474836480
hvm=
vhd.size=1197752832
size=1197752832

# md5sum 
/var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/snapshots/131/617/53b33a5a-a7d9-4efa-b126-38eec5482b05.vhd
9d2078a6f41ca5e1eab824848c06df53  
/var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/snapshots/131/617/53b33a5a-a7d9-4efa-b126-38eec5482b05.vhd

# md5sum 
/var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/template/tmpl/2/294/637604a6-3085-444e-ba09-b9aab11a2c16.vhd
9d2078a6f41ca5e1eab824848c06df53  
/var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/template/tmpl/2/294/637604a6-3085-444e-ba09-b9aab11a2c16.vhd

ACS not merge files of snapshots in a single file for template, I think it's a 
bug.


-Original Message-
From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com]
Sent: quarta-feira, 25 de outubro de 2017 22:51
To: users@cloudstack.apache.org
Subject: Re: Strange size of template from snapshot on XenServer

It is easy to test, get one of these files and try to use them in Virtualbox. 
If they run, they do not require anything else.

On Wed, Oct 25, 2017 at 10:49 PM, Lotic Lists  wrote:

> Sure but files on secondary storage don't have parents, I don't know 
> if ACS can connect standalone files.
>
> vhd-util scan -f -m'*.vhd' -p
> vhd=14818597-55bb-49be-9ace-761e9e01c074.vhd capacity=311385128960
> size=304124744192 hidden=0 parent=none 
> vhd=bbd9e9b5-53fb-44a2-afbe-f262396a2d84.vhd capacity=311385128960
> size=17770869248 hidden=0 parent=none
> vhd=3b90bbb2-7ce5-41f6-9f7e-fd0ea061cb2d.vhd capacity=311385128960
> size=52199817728 hidden=0 parent=none
> vhd=4b450217-c9ad-45a2-946b-de3cb323469b.vhd capacity=311385128960
> size=51615670784 hidden=0 parent=none
>
>
> -Original Message-
> From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com]
> Sent: quarta-feira, 25 de outubro de 2017 22:35
> To: users@cloudstack.apache.org
> Subject: Re: Strange size of template from snapshot on XenServer
>
> If it was not executing coalesce you would see the parent reference 
> when you listed the hierarchy, right?
>
> On Wed, Oct 25, 2017 at 10:25 PM, Lotic Lists  wrote:
>
> > I think ACS preserve all VHDs for coalesce but coalesce not occur 
> > when create a template or before starting next snapshot scheduled.
> > If I create a template from any snapshots (2) showing in GUI, the 
> > template have 49GB. 49 GB is the size of the 2 latest files on 
> > secondary
> storage.
> >
> > What do you think? Bug?
> >
> >
> > -Original Message-
> > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com]
> > Sent: quarta-feira, 25 de outubro de 2017 22:07
> > To: users@cloudstack.apache.org
> > Subject: Re: Strange size of template from snapshot on XenServer
> >
> > Aha, The two destroyed entries are showing " removed: NULL".
> >
> > In ACS one thing is the "destroying" of a resource, another is the 
> > removal of this resource from the system. I believe there is 
> > something to do with the expunge interval, but I am not sure if the 
> > snapshots complete removal also happens within the expunge interval 
> > of user VMs or if it is configured by something else.
> >
> >
> > On Wed, Oct 25, 2017 at 10:03 PM, Lotic Lists 
> wrote:
> >
> > > I not start manual snapshot, just scheduled with keep=2
> > >
> > > GUI showing 2 snapshots, database showing 4 entries, 2 Destroyed 
> > > and
> > > 2 BackedUp
> > >
> > > *** 132. row ***
> > >   

Re: Strange size of template from snapshot on XenServer

[Rafael Weingärtner]

I just did, and the size of the template is the size of the root disk + the
1GB file I created in the test vm.

The system I tested this is an ACS 4.9.2, XenServer 6.5, Primary Stg ISCSI

On Mon, Oct 30, 2017 at 10:20 AM, Lotic Lists  wrote:

> Good morning
>
> Guys, who could execute the test below?
>
> 1. Create a manual snapshot of a volume
> 2. Create a file (1GB) with dd on VM
> 3. Create second snapshot of a volume
> 4. Convert latest snapshot to a template
> 5. Verify the size of vhd of new template in secondary storage.
>
> Here the template have 1GB, exactly the size of latest snapshot.
>
> ACS 4.9.3, XenServer 6.5, Primary Stg ISCSI
>
>
> -Original Message-
> From: Lotic Lists [mailto:li...@lotic.com.br]
> Sent: quinta-feira, 26 de outubro de 2017 15:03
> To: users@cloudstack.apache.org
> Subject: RE: Strange size of template from snapshot on XenServer
>
> I test the same case on other environment, create template from snapshot,
> acs 4.9.2.0 and XenServer 6.5/iscsi
>
> 1. Was created two snapshots
>
> # ls -lh /var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/
> snapshots/131/617/
> total 3.0G
> -rw-r--r-- 1 4294967294 root  13G Oct 26 13:46 42c7c51d-4aa7-40d2-b5eb-
> cb56fc963974.vhd
> -rw-r--r-- 1 4294967294 root 1.2G Oct 26 14:42 53b33a5a-a7d9-4efa-b126-
> 38eec5482b05.vhd
>
> https://i.imgur.com/cSHZAJ3.png
>
> 2. create a template from latest snapshot
>
> # ls -lh
> total 37M
> -rw-r--r-- 1 4294967294 root 1.2G Oct 26 14:43 637604a6-3085-444e-ba09-
> b9aab11a2c16.vhd
> -rw-r--r-- 1 4294967294 root  303 Oct 26 14:43 template.properties
>
> # cat template.properties
> #Thu Oct 26 16:43:54 UTC 2017
> filename=637604a6-3085-444e-ba09-b9aab11a2c16.vhd
> id=1
> vhd=true
> vhd.filename=637604a6-3085-444e-ba09-b9aab11a2c16.vhd
> public=true
> uniquename=637604a6-3085-444e-ba09-b9aab11a2c16
> vhd.virtualsize=21474836480
> virtualsize=21474836480
> hvm=
> vhd.size=1197752832
> size=1197752832
>
> # md5sum /var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/
> snapshots/131/617/53b33a5a-a7d9-4efa-b126-38eec5482b05.vhd
> 9d2078a6f41ca5e1eab824848c06df53  /var/cloud_mount/e5921d9a-
> 70b0-3501-9fda-6097e721fffb/snapshots/131/617/53b33a5a-
> a7d9-4efa-b126-38eec5482b05.vhd
>
> # md5sum /var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/
> template/tmpl/2/294/637604a6-3085-444e-ba09-b9aab11a2c16.vhd
> 9d2078a6f41ca5e1eab824848c06df53  /var/cloud_mount/e5921d9a-
> 70b0-3501-9fda-6097e721fffb/template/tmpl/2/294/637604a6-
> 3085-444e-ba09-b9aab11a2c16.vhd
>
> ACS not merge files of snapshots in a single file for template, I think
> it's a bug.
>
>
> -Original Message-
> From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com]
> Sent: quarta-feira, 25 de outubro de 2017 22:51
> To: users@cloudstack.apache.org
> Subject: Re: Strange size of template from snapshot on XenServer
>
> It is easy to test, get one of these files and try to use them in
> Virtualbox. If they run, they do not require anything else.
>
> On Wed, Oct 25, 2017 at 10:49 PM, Lotic Lists  wrote:
>
> > Sure but files on secondary storage don't have parents, I don't know
> > if ACS can connect standalone files.
> >
> > vhd-util scan -f -m'*.vhd' -p
> > vhd=14818597-55bb-49be-9ace-761e9e01c074.vhd capacity=311385128960
> > size=304124744192 hidden=0 parent=none
> > vhd=bbd9e9b5-53fb-44a2-afbe-f262396a2d84.vhd capacity=311385128960
> > size=17770869248 hidden=0 parent=none
> > vhd=3b90bbb2-7ce5-41f6-9f7e-fd0ea061cb2d.vhd capacity=311385128960
> > size=52199817728 hidden=0 parent=none
> > vhd=4b450217-c9ad-45a2-946b-de3cb323469b.vhd capacity=311385128960
> > size=51615670784 hidden=0 parent=none
> >
> >
> > -Original Message-
> > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com]
> > Sent: quarta-feira, 25 de outubro de 2017 22:35
> > To: users@cloudstack.apache.org
> > Subject: Re: Strange size of template from snapshot on XenServer
> >
> > If it was not executing coalesce you would see the parent reference
> > when you listed the hierarchy, right?
> >
> > On Wed, Oct 25, 2017 at 10:25 PM, Lotic Lists 
> wrote:
> >
> > > I think ACS preserve all VHDs for coalesce but coalesce not occur
> > > when create a template or before starting next snapshot scheduled.
> > > If I create a template from any snapshots (2) showing in GUI, the
> > > template have 49GB. 49 GB is the size of the 2 latest files on
> > > secondary
> > storage.
> > >
> > > What do you think? Bug?
> > >
> > >
> > > -Original Message-
> > > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com]
> > > Sent: quarta-feira, 25 de outubro de 2017 22:07
> > > To: users@cloudstack.apache.org
> > > Subject: Re: Strange size of template from snapshot on XenServer
> > >
> > > Aha, The two destroyed entries are showing " removed: NULL".
> > >
> > > In ACS one thing is the "destroying" of a resource, another is the
> > > removal of this resource from the system. I believe there is
> > > something to do with the expunge interval, but I

Re[2]: Oracle VM 3.4 with ACS

[David Amorín]

Thanks Dag for your quick response. Reading the official documention from 
https://cloudstack.apache.org, i found out ACS supports Oracle VM




CloudStack currently supports the most popular hypervisors: VMware, KVM, Citrix 
XenServer, Xen Cloud Platform (XCP), Oracle VM server and Microsoft Hyper-V.




Dag, why is not supported from your point of view? Did you try it? 




Thanks for your feedback







-- 
David Amorín
Director


david.amo...@adderglobal.com
T. 91 133 18 99 Ext. 151
M. 626 94 95 88
 
-Mensaje original- 
> De: "Dag Sonstebo"  
> A: users@cloudstack.apache.org 
> Fecha: 30/10/2017 09:25 
> Asunto: Re: Oracle VM 3.4 with ACS 
> 
> Hi David,
> 
> Oracle VM isn’t a supported hypervisor in ACS unfortunately, not aware of any 
> work having been done on this – but someone else may know.
> 
> Regards,
> Dag Sonstebo
> Cloud Architect
> ShapeBlue
> 
> On 29/10/2017, 16:30, "David Amorín"  wrote:
> 
>     
>     Hi all, our infraestructure is based on ACS 4.9.2 with XS 7. We need to 
> deploy new host based on Oracle VM and we will have to set pinning CPU (1 
> socket per host) 
>     
>     
>     
>     
>     1./ Do you know if this configuration is compatible with ACS?
>     
>     
>     
>     
>     2./ I didn't find to much information about the "real" issues of Oracle 
> VM & ACS. Is there any user working in a production environment with Oracle 
> VM & ACS?
>     
>     
>     
>     
>     Thanks for your help
>     -- 
>     David 
>     
>     
>     
>     
> 
> 
> dag.sonst...@shapeblue.com 
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue

Re: Re[2]: Oracle VM 3.4 with ACS

[Dag Sonstebo]

Hi David,

Apologies – wrong wording on my part – Oracle VM is supported, but this hasn’t 
been maintained in CloudStack for quite a few versions now. We did a brief test 
of it 6 months back and found it will need some development work to get it back 
on track.

Hope this clarifies things.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

From: David Amorín 
Reply-To: "users@cloudstack.apache.org" 
Date: Monday, 30 October 2017 at 14:38
To: "users@cloudstack.apache.org" 
Subject: Re[2]: Oracle VM 3.4 with ACS


Thanks Dag for your quick response. Reading the official documention from 
https://cloudstack.apache.org, i found out ACS supports Oracle VM



CloudStack currently supports the most popular hypervisors: VMware, KVM, Citrix 
XenServer, Xen Cloud Platform (XCP), Oracle VM server and Microsoft Hyper-V.



Dag, why is not supported from your point of view? Did you try it?



Thanks for your feedback



[cid:381759f73980503101z25871379]
--
[X][X]David Amorín
Director

david.amo...@adderglobal.com
T. 91 133 18 99 Ext. 151
M. 626 94 95 88


-Mensaje original-
> De: "Dag Sonstebo" 
> mailto:dag.sonst...@shapeblue.com>>
> A: users@cloudstack.apache.org
> Fecha: 30/10/2017 09:25
> Asunto: Re: Oracle VM 3.4 with ACS
>
> Hi David,
>
> Oracle VM isn't a supported hypervisor in ACS unfortunately, not aware of any 
> work having been done on this - but someone else may know.
>
> Regards,
> Dag Sonstebo
> Cloud Architect
> ShapeBlue
>
> On 29/10/2017, 16:30, "David Amorín" 
> mailto:david.amo...@adderglobal.com>> wrote:
>
>
>Hi all, our infraestructure is based on ACS 4.9.2 with XS 7. We need to 
> deploy new host based on Oracle VM and we will have to set pinning CPU (1 
> socket per host)
>
>
>
>
>1./ Do you know if this configuration is compatible with ACS?
>
>
>
>
>2./ I didn't find to much information about the "real" issues of Oracle VM 
> & ACS. Is there any user working in a production environment with Oracle VM & 
> ACS?
>
>
>
>
>Thanks for your help
>--
>David
>
>
>
>
>
>
> dag.sonst...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue

dag.sonst...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

[Cacti CloudStack]

[Gian Paolo Buono]

Hi guys,

I need to monitor vpc routers from all cloudstack zone with cacti, how can i 
enable snmp on these routers ? how can I monitor network traffic?

Thanks, bye
Gian Paolo

Bandwith limit on guests

[Imran Ahmed]

Hi All,

WE are facing a bandwidth problem on our cloudstack guests. (cloudstack 4.8
with KVM  on CentOS)

The network and vm throttling was set at 200mbs, and we're seeing a max on
the guests of 25MB/sec (just slightly over the throttle).  I set the values
to 0, restarted the management server and stopped/started the virtual
router.  However, the guests are still only seeing 25MB/sec to an NFS share.
I performed the same test to the same NFS share on a physical machine and it
reached the full gigabit network speed (just over 100MB/sec).


Any ideas please?

Kind regards,

Imran

Re: Bandwith limit on guests

[Mārtiņš Paurs]

Megabytes vs Megabits?



Nosūtīts no mana Samsung Galaxy viedtālruņa.


 Sākotnējā ziņa 
No: Imran Ahmed 
Datums: 30.10.17 19:56 (GMT+02:00)
Kam: users@cloudstack.apache.org
Tēma: Bandwith limit on guests

Hi All,

WE are facing a bandwidth problem on our cloudstack guests. (cloudstack 4.8
with KVM  on CentOS)

The network and vm throttling was set at 200mbs, and we're seeing a max on
the guests of 25MB/sec (just slightly over the throttle).  I set the values
to 0, restarted the management server and stopped/started the virtual
router.  However, the guests are still only seeing 25MB/sec to an NFS share.
I performed the same test to the same NFS share on a physical machine and it
reached the full gigabit network speed (just over 100MB/sec).


Any ideas please?

Kind regards,

Imran

Re: Problems with KVM HA & STONITH

[McClune, James]

Hi Simon,

Thank you for responding back. I am currently running ACS 4.9 on an Ubuntu
14.04 VM. I have the three nodes, each having about 1TB of primary storage
(NFS) and 1TB of secondary storage (NFS). I added each NFS share into ACS.
All nodes are in a cluster.

Maybe I'm not understanding the setup or misconfigured something. I'm
trying to setup an HA environment where if one node goes down, running an
HA marked VM, the VM will start on another host. When I simulate a network
disconnect or reboot of a host, all of the nodes go down.

If you request more information, please let me know. Again, any help is
greatly appreciated!

Thanks,
James

On Fri, Oct 27, 2017 at 4:02 PM, Simon Weller 
wrote:

> Hi James,
>
>
> Can you elaborate a bit further on the storage? You say you're running NFS
> on all 3 nodes, can you explain how it is setup?
>
> Also, what version of ACS are you running?
>
>
> - Si
>
>
>
>
> 
> From: McClune, James 
> Sent: Friday, October 27, 2017 2:21 PM
> To: users@cloudstack.apache.org
> Subject: Problems with KVM HA & STONITH
>
> Hello Apache CloudStack Community,
>
> My setup consists of the following:
>
> - Three nodes (NODE1, NODE2, and NODE3)
> NODE1 is running Ubuntu 16.04.3, NODE2 is running Ubuntu 16.04.3, and NODE3
> is running Ubuntu 14.04.5.
> - Management Server (running on separate VM, not in cluster)
>
> The three nodes use KVM as the hypervisor. I also configured primary and
> secondary storage on all three of the nodes. I'm using NFS for the primary
> & secondary storage. VM operations work great. Live migration works great.
>
> However, when a host goes down, the HA functionality does not work at all.
> Instead of spinning up the VM on another available host, the down host
> seems to trigger STONITH. When STONITH happens, all hosts in the cluster go
> down. This not only causes no HA, but also downs perfectly good VM's. I
> have read countless articles and documentation related to this issue. I
> still cannot find a viable solution for this issue. I really want to use
> Apache CloudStack, but cannot implement this in production when STONITH
> happens.
>
> I think I have something misconfigured. I thought I would reach out to the
> CloudStack community and ask for some friendly assistance.
>
> If there is anything (system-wise) you request in order to further
> troubleshoot this issue, please let me know and I'll send. I appreciate any
> help in this issue!
>
> --
>
> Thanks,
>
> James
>



-- 



James McClune

Technical Support Specialist

Norwalk City Schools

Phone: 419-660-6590

mcclu...@norwalktruckers.net

Re: Bandwith limit on guests

[Eric Green]

Did you try the same test from the exact same physical host that one of the 
guests are running on? There may be congestion between the Cloudstack network 
and the NFS network.

I just tested this by creating a compute offering that had the 200Mbit limit 
and assigning it to an instance. I mounted a NFS directory, and dding' a large 
file in that directory. I got the 23 mbyte/sec throughput I expected. I then 
shut the instance down, reassigned it to another compute offering without the 
limit, started it back up, and dd'ed that large file. I got the 200mbyte/sec 
throughput that I expected from this specific NFS server. 

How exactly are you setting network and VM throttling? Are you talking about in 
the Global Settings? If so, note that any limit set here (even infinite -- 
i.e., zero) is overridden by the values in the service offering if the service 
offering's values are smaller. Please check your service offerings to make sure 
they don't have throttling values in them. Also make sure that you put both 
network.throttling.rate and vm.network.throttling.rate back down to zero. 

Note -- I am running Cloudstack 4.9.2. But it should work same as 4.8 here.


> On Oct 30, 2017, at 10:56, Imran Ahmed  wrote:
> 
> Hi All,
> 
> WE are facing a bandwidth problem on our cloudstack guests. (cloudstack 4.8
> with KVM  on CentOS)
> 
> The network and vm throttling was set at 200mbs, and we're seeing a max on
> the guests of 25MB/sec (just slightly over the throttle).  I set the values
> to 0, restarted the management server and stopped/started the virtual
> router.  However, the guests are still only seeing 25MB/sec to an NFS share.
> I performed the same test to the same NFS share on a physical machine and it
> reached the full gigabit network speed (just over 100MB/sec).
> 
> 
> Any ideas please?
> 
> Kind regards,
> 
> Imran
> 

Re: Problems with KVM HA & STONITH

[McClune, James]

Hi Dag,

Thank you for responding back. I am currently running ACS 4.9 on an Ubuntu
14.04 VM. I have the three nodes, each having about 1TB of primary storage
(NFS) and 1TB of secondary storage (NFS). I added each NFS share into ACS.
All nodes are in a cluster.

Maybe I'm not understanding the setup or misconfigured something. I'm
trying to setup an HA environment where if one node goes down, running an
HA marked VM, the VM will start on another host. When I simulate a network
disconnect or reboot of a host, all of the nodes go down (STONITH?).

I am unsure on how to setup an HA environment, if all the nodes in the
cluster go down. Any help is much appreciated!

Thanks,
James

On Mon, Oct 30, 2017 at 3:49 AM, Dag Sonstebo 
wrote:

> Hi James,
>
> I think  you possibly have over-configured your KVM hosts. If you use NFS
> (and no clustered file system like CLVM) then there should be no need to
> configure STONITH. CloudStack takes care of your HA, so this is not
> something you offload to the KVM host.
>
> (As mentioned the only time I have played with STONITH and CloudStack was
> for CLVM – and I eventually found it not fit for purpose, too unstable and
> causing too many issues like you describe. Note this was for block storage
> though – not NFS).
>
> Regards,
> Dag Sonstebo
> Cloud Architect
> ShapeBlue
>
> On 28/10/2017, 03:40, "Ivan Kudryavtsev"  wrote:
>
> Hi. If the node losts nfs host it reboots (acs agent behaviour). If you
> really have 3 storages, you'll go clusterwide reboot everytime your
> host is
> down.
>
> 28 окт. 2017 г. 3:02 пользователь "Simon Weller"
> 
> написал:
>
> > Hi James,
> >
> >
> > Can you elaborate a bit further on the storage? You say you're
> running NFS
> > on all 3 nodes, can you explain how it is setup?
> >
> > Also, what version of ACS are you running?
> >
> >
> > - Si
> >
> >
> >
> >
> > 
> > From: McClune, James 
> > Sent: Friday, October 27, 2017 2:21 PM
> > To: users@cloudstack.apache.org
> > Subject: Problems with KVM HA & STONITH
> >
> > Hello Apache CloudStack Community,
> >
> > My setup consists of the following:
> >
> > - Three nodes (NODE1, NODE2, and NODE3)
> > NODE1 is running Ubuntu 16.04.3, NODE2 is running Ubuntu 16.04.3,
> and NODE3
> > is running Ubuntu 14.04.5.
> > - Management Server (running on separate VM, not in cluster)
> >
> > The three nodes use KVM as the hypervisor. I also configured primary
> and
> > secondary storage on all three of the nodes. I'm using NFS for the
> primary
> > & secondary storage. VM operations work great. Live migration works
> great.
> >
> > However, when a host goes down, the HA functionality does not work
> at all.
> > Instead of spinning up the VM on another available host, the down
> host
> > seems to trigger STONITH. When STONITH happens, all hosts in the
> cluster go
> > down. This not only causes no HA, but also downs perfectly good
> VM's. I
> > have read countless articles and documentation related to this
> issue. I
> > still cannot find a viable solution for this issue. I really want to
> use
> > Apache CloudStack, but cannot implement this in production when
> STONITH
> > happens.
> >
> > I think I have something misconfigured. I thought I would reach out
> to the
> > CloudStack community and ask for some friendly assistance.
> >
> > If there is anything (system-wise) you request in order to further
> > troubleshoot this issue, please let me know and I'll send. I
> appreciate any
> > help in this issue!
> >
> > --
> >
> > Thanks,
> >
> > James
> >
>
>
>
> dag.sonst...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>


-- 



James McClune

Technical Support Specialist

Norwalk City Schools

Phone: 419-660-6590

mcclu...@norwalktruckers.net

Re: [Cacti CloudStack]

[Rafael Weingärtner]

You can update the VRs template with Cacti's agent. Then, for every VR that
is started, you are going to have cactis monitoring them. You can also
enable SNMP on the templates if you need them. I did something similar
already with remote logging and graylog.

On Mon, Oct 30, 2017 at 4:34 PM, Gian Paolo Buono 
wrote:

>
> Hi guys,
>
> I need to monitor vpc routers from all cloudstack zone with cacti, how can
> i enable snmp on these routers ? how can I monitor network traffic?
>
> Thanks, bye
> Gian Paolo
>



-- 
Rafael Weingärtner

Below error pups up while creating a Zone

[Asanka Gunasekara]

Hi All, I am trying to setup a CloudStack with VMware, while creating the
Zone I am getting below error. Please let me know what any additional
information you would require

My environment is
CloudStack 4.10
VCenter - 6.5
ESXi - 5.5

I have created below on vCenter before trying Zone creation

Data center - WeDatacenter
Cluster - Wecluster
DVS - DSwitch


Number of nodes - 2

I can ping one another with out any issue, and I am trying our Advance
networking :(

2017-10-31 12:02:52,840 DEBUG [c.c.a.ApiServlet]
(catalina-exec-9:ctx-2475938c) (logid:8cdc7888) ===START===  172.17.101.246
-- GET  command=listHypervisors&response=json&_=1509431574317
2017-10-31 12:02:52,852 DEBUG [c.c.a.ApiServlet]
(catalina-exec-9:ctx-2475938c ctx-575daa35) (logid:8cdc7888) ===END===
172.17.101.246 -- GET  command=listHypervisors&response=json&_=1509431574317
2017-10-31 12:02:52,888 DEBUG [c.c.a.ApiServlet]
(catalina-exec-12:ctx-3113ae51) (logid:9c29cc4d) ===START===
172.17.101.246 -- GET
command=listConfigurations&response=json&name=vmware.use.nexus.vswitch&_=1509431574363
2017-10-31 12:02:52,911 DEBUG [c.c.a.ApiServlet]
(catalina-exec-12:ctx-3113ae51 ctx-3a4c5f78) (logid:9c29cc4d) ===END===
172.17.101.246 -- GET
command=listConfigurations&response=json&name=vmware.use.nexus.vswitch&_=1509431574363
2017-10-31 12:02:52,932 DEBUG [c.c.a.ApiServlet]
(catalina-exec-17:ctx-12feb65a) (logid:c701763c) ===START===
172.17.101.246 -- GET
command=listConfigurations&response=json&name=vmware.use.dvswitch&_=1509431574397
2017-10-31 12:02:52,953 DEBUG [c.c.a.ApiServlet]
(catalina-exec-17:ctx-12feb65a ctx-aa9170be) (logid:c701763c) ===END===
172.17.101.246 -- GET
command=listConfigurations&response=json&name=vmware.use.dvswitch&_=1509431574397
2017-10-31 12:02:53,723 DEBUG [c.c.s.StatsCollector]
(StatsCollector-5:ctx-255e604b) (logid:590926bf)
HostOutOfBandManagementStatsCollector is running...
2017-10-31 12:02:53,806 DEBUG [c.c.s.StatsCollector]
(StatsCollector-2:ctx-0646fc49) (logid:d6d56098) AutoScaling Monitor is
running...
2017-10-31 12:02:53,832 DEBUG [c.c.s.StatsCollector]
(StatsCollector-4:ctx-b358f8b2) (logid:f5b38c2f) VmStatsCollector is
running...
2017-10-31 12:02:53,843 DEBUG [c.c.s.StatsCollector]
(StatsCollector-6:ctx-1d586223) (logid:c85d21b3) StorageCollector is
running...
2017-10-31 12:02:53,845 DEBUG [c.c.s.StatsCollector]
(StatsCollector-3:ctx-cad416b9) (logid:7cb76d06) HostStatsCollector is
running...
2017-10-31 12:02:55,669 DEBUG [c.c.a.ApiServlet]
(catalina-exec-15:ctx-4de5d9db) (logid:dd0d4871) ===START===
172.17.101.246 -- POST  command=addVmwareDc&response=json
2017-10-31 12:02:55,685 INFO  [c.c.h.v.m.VmwareManagerImpl]
(catalina-exec-15:ctx-4de5d9db ctx-57acc52b) (logid:dd0d4871) Ignoring API
call addVmwareDc, because VMware DC 172.17.101.246/WeDatacenter is already
associated with specified zone with id 1
2017-10-31 12:02:55,685 DEBUG [c.c.a.ApiServlet]
(catalina-exec-15:ctx-4de5d9db ctx-57acc52b) (logid:dd0d4871) ===END===
172.17.101.246 -- POST  command=addVmwareDc&response=json
2017-10-31 12:02:55,695 DEBUG [c.c.a.ApiServlet]
(catalina-exec-16:ctx-f52cc28e) (logid:027e266d) ===START===
172.17.101.246 -- GET
command=addCluster&zoneId=f538e730-7431-4c65-bf7d-eccc154e8b48&hypervisor=VMware&clustertype=ExternalManaged&podId=6262dca1-59df-4a32-b80a-52435f2ec4f7&username=administrator&url=http%3A%2F%2F172.17.101.246%2FWeDatacenter%2FWeCluster&clustername=172.17.101.246%2FWeDatacenter%2FWeCluster&response=json&_=1509431577174
2017-10-31 12:02:55,766 INFO  [c.c.h.v.VmwareServerDiscoverer]
(catalina-exec-16:ctx-f52cc28e ctx-fdc1bb18) (logid:027e266d) Discover
host. dc: 1, pod: 1, cluster: 6, uri host: 172.17.101.246
2017-10-31 12:02:55,872 INFO  [c.c.h.v.VmwareServerDiscoverer]
(catalina-exec-16:ctx-f52cc28e ctx-fdc1bb18) (logid:027e266d) Detected
private network label : DSwitch,,vmwaresvs
2017-10-31 12:02:55,872 DEBUG [c.c.h.v.r.VmwareContextFactory]
(catalina-exec-16:ctx-f52cc28e ctx-fdc1bb18) (logid:027e266d) initialize
VmwareContext. url: https://172.17.101.246/sdk/vimService, username:
administrator, password: W*
2017-10-31 12:02:58,338 INFO  [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-d6249ab4) (logid:30c4e7ea) Begin cleanup
expired async-jobs
2017-10-31 12:02:58,345 INFO  [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-d6249ab4) (logid:30c4e7ea) End cleanup expired
async-jobs
2017-10-31 12:03:00,019 WARN  [c.c.h.v.VmwareServerDiscoverer]
(catalina-exec-16:ctx-f52cc28e ctx-fdc1bb18) (logid:027e266d) Unable to
connect to Vmware vSphere server. service address: 172.17.101.246.
com.vmware.vim25.InvalidLoginFaultMsg: Cannot complete login due to an
incorrect user name or password.
2017-10-31 12:03:00,019 WARN  [c.c.r.ResourceManagerImpl]
(catalina-exec-16:ctx-f52cc28e ctx-fdc1bb18) (logid:027e266d) Unable to
find the server resources at http://172.17.101.246/WeDatacenter/WeCluster
2017-10-31 12:03:00,019 INFO  [c.c.u.e.CSExceptionErrorCode]
(catalina-exec-16:ctx-f52cc28e ctx-fd

Re: Below error pups up while creating a Zone

[Asanka Gunasekara]

Please ignor the above error, this was taken when I though it would have
been some thing to do with user/password. correntct one as below

2017-10-31 12:17:37,116 DEBUG [c.c.a.ApiServlet]
(catalina-exec-22:ctx-f2dc50b2) (logid:799ac7c1) ===START===
172.17.101.246 -- POST  command=addVmwareDc&response=json
2017-10-31 12:17:37,132 INFO  [c.c.h.v.m.VmwareManagerImpl]
(catalina-exec-22:ctx-f2dc50b2 ctx-a324e697) (logid:799ac7c1) Ignoring API
call addVmwareDc, because VMware DC 172.17.101.246/WeDatacenter is already
associated with specified zone with id 1
2017-10-31 12:17:37,133 DEBUG [c.c.a.ApiServlet]
(catalina-exec-22:ctx-f2dc50b2 ctx-a324e697) (logid:799ac7c1) ===END===
172.17.101.246 -- POST  command=addVmwareDc&response=json
2017-10-31 12:17:37,155 DEBUG [c.c.a.ApiServlet]
(catalina-exec-20:ctx-a26bd8ef) (logid:272077ae) ===START===
172.17.101.246 -- GET
command=addCluster&zoneId=f538e730-7431-4c65-bf7d-eccc154e8b48&hypervisor=VMware&clustertype=ExternalManaged&podId=6262dca1-59df-4a32-b80a-52435f2ec4f7&username=administrator%40vsphere.local&url=http%3A%2F%2F172.17.101.246%2FWeDatacenter%2FWeCluster&clustername=172.17.101.246%2FWeDatacenter%2FWeCluster&response=json&_=1509432458636
2017-10-31 12:17:37,225 INFO  [c.c.h.v.VmwareServerDiscoverer]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) Discover
host. dc: 1, pod: 1, cluster: 7, uri host: 172.17.101.246
2017-10-31 12:17:37,313 INFO  [c.c.h.v.VmwareServerDiscoverer]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) Detected
private network label : DSwitch,,vmwaresvs
2017-10-31 12:17:37,313 DEBUG [c.c.h.v.r.VmwareContextFactory]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) initialize
VmwareContext. url: https://172.17.101.246/sdk/vimService, username:
administrator@vsphere.local, password: W*
2017-10-31 12:17:37,535 INFO  [c.c.h.v.u.VmwareContext]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) New
VmwareContext object, current outstanding count: 1
2017-10-31 12:17:37,662 INFO  [c.c.h.v.m.VmwareManagerImpl]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) Preparing
network on host com.cloud.hypervisor.vmware.util.VmwareContext@53bf4bc2 for
DSwitch,,vmwaresvs
2017-10-31 12:17:37,695 ERROR [c.c.h.v.m.HypervisorHostHelper]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) Unable to
find vSwitchDSwitch
2017-10-31 12:17:37,696 WARN  [c.c.h.v.VmwareServerDiscoverer]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) Unable to
connect to Vmware vSphere server. service address: 172.17.101.246.
java.lang.Exception: Unable to find vSwitchDSwitch
2017-10-31 12:17:37,696 INFO  [c.c.h.v.u.VmwareContext]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) Disconnecting
VMware session
2017-10-31 12:17:37,715 WARN  [c.c.r.ResourceManagerImpl]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) Unable to
find the server resources at http://172.17.101.246/WeDatacenter/WeCluster
2017-10-31 12:17:37,716 INFO  [c.c.u.e.CSExceptionErrorCode]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) Could not
find exception: com.cloud.exception.DiscoveryException in error code list
for exceptions
2017-10-31 12:17:37,980 WARN  [o.a.c.a.c.a.c.AddClusterCmd]
(catalina-exec-20:ctx-a26bd8ef ctx-06a2c997) (logid:272077ae) Exception:
com.cloud.exception.DiscoveryException: Unable to add the external cluster
at
com.cloud.resource.ResourceManagerImpl.discoverCluster(ResourceManagerImpl.java:542)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:333)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)
at com.sun.proxy.$Proxy169.discoverCluster(Unknown Source)
at
org.apache.cloudstack.api.command.admin.cluster.AddClusterCmd.execute(AddClusterCmd.java:212)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:729)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:553)
at
com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:297)
at com.cloud.api.Api