Re: [ANNOUNCE] New VP of Apache CloudStack - Rohit Yadav

[David Jumani]

Congrats Rohit, and thank you Simon!

From: Simon Weller 
Sent: Thursday, March 30, 2023 9:05 AM
To: d...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Cc: priv...@cloudstack.apache.org 
Subject: [ANNOUNCE] New VP of Apache CloudStack - Rohit Yadav

All,

I'm very pleased to announce that the ASF board has accepted the nomination
of Rohit Yadav to be the new VP of the Apache CloudStack project.

It has been my pleasure to serve as the VP over the past year, and I'd like
to thank the community for all of the support.

Rohit, congratulations and I wish you the best as you take on this new role.

-Simon

 

Re: Daan Hoogland - New ASF Member

[David Jumani]

Congrats Daan!

From: Paul Angus 
Sent: Friday, March 24, 2023 2:58 PM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Daan Hoogland - New ASF Member



It is my pleasure to announce that Daan Hoogland as been elected to become a
member of the ASF.

The ASF would like to recognize both his practical involvement and the way
in which he has interacted with others in and around the ASF.



Congratulations  Daan.









Kind regards



Paul Angus




 

Re: [ANNOUNCE] Ivet Petrova has joined the PMC

[David Jumani]

Congratulations Ivet!


From: Vishesh Jindal 
Sent: Wednesday, February 15, 2023 10:24 AM
To: users@cloudstack.apache.org 
Cc: d...@cloudstack.apache.org ; 
priv...@cloudstack.apache.org 
Subject: Re: [ANNOUNCE] Ivet Petrova has joined the PMC

Congratulations Ivet!

From: Rohit Yadav 
Sent: Wednesday, February 15, 2023 7:14 AM
To: users@cloudstack.apache.org 
Cc: d...@cloudstack.apache.org ; 
priv...@cloudstack.apache.org 
Subject: Re: [ANNOUNCE] Ivet Petrova has joined the PMC

Congratulations Ivet, well deserved!

Regards.

From: Martijn Struijk 
Sent: Wednesday, February 15, 2023 3:06:18 AM
To: users@cloudstack.apache.org 
Cc: d...@cloudstack.apache.org ; 
priv...@cloudstack.apache.org 
Subject: Re: [ANNOUNCE] Ivet Petrova has joined the PMC

Congratulations Ivet!

On Tue, Feb 14, 2023 at 7:24 PM Nicolas Vazquez <
nicolas.vazq...@shapeblue.com> wrote:

> Congratulations Ivet!
>
> Regards,
> Nicolas Vazquez
> 
> From: Simon Weller 
> Sent: Tuesday, February 14, 2023 1:01 PM
> To: priv...@cloudstack.apache.org ;
> d...@cloudstack.apache.org ;
> users@cloudstack.apache.org 
> Subject: [ANNOUNCE] Ivet Petrova has joined the PMC
>
> Hi everyone,
>
> It gives me great pleasure to announce that Ivet has been invited to join
> the
> CloudStack PMC and she has accepted.
>
> Please join me in congratulating Ivet!
>
> -Simon (on behalf of the CloudStack PMC)
>
>
>
>







 

Re: [DISCUSS] Github Discussions for CloudStack?

[David Jumani]

Sounds like a good idea
+1 for giving it a try!

From: Rohit Yadav 
Sent: Wednesday, December 14, 2022 2:37 PM
To: d...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Subject: [DISCUSS] Github Discussions for CloudStack?

All,

In the past, we had moved away from JIRA and ReviewBoard to Github as it 
provided a single platform for both the user and the dev community to 
collaborate on issues/requests and code changes (pull requests). We later 
organically started using Github for release milestones/triaging, recently 
projects. For sub-projects such as cloudstack-cloudmonkey, 
cloudstack-terraform-provider etc we also use the wiki features. More recently 
we're not advised to move to Github actions from Travis CI by ASF infra.

Off lately, several user-related discussions and questions that we would have 
expected on the users ML are finding ways in Github issues, which aren't issues 
per se but questions, and discussions. Should we explore, enable and try Github 
Discussions [1] for CloudStack repos?

Several Apache projects have enabled Github Discussions [1], for example:
https://github.com/apache/couchdb/discussions
https://github.com/apache/apisix/discussions
https://github.com/apache/shardingsphere/discussions
https://github.com/apache/streampipes/discussions
https://github.com/apache/pulsar/discussions
https://github.com/apache/airflow/discussions
https://github.com/apache/dolphinscheduler/discussions
https://github.com/apache/inlong/discussions
https://github.com/apache/doris/discussions
https://github.com/apache/arrow-datafusion/discussions
https://github.com/apache/superset/discussions

[1] https://github.com/features/discussions


Regards.




 

Re: Setting UI timeout

[David Jumani]

Hi Joshua,

You can modify the "session.timeout" value in the 
"/etc/cloudstack/management/server.properties" file with the timeout value 
you'd like

From: Joshua Schaeffer 
Sent: Tuesday, August 30, 2022 9:32 PM
To: users@cloudstack.apache.org 
Subject: Setting UI timeout

Running ACS 4.15.1.0

Are these instructions still valid for setting the UI timeout: 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Increase+the+Timeout+of+the+CloudStack+Management+GUI

I edited my web.xml file on both management servers, set the  
value to 60 minutes, and restarted the services but the UI is still timing out 
after 30 minutes (the default I assume). What is the correct way to edit the 
UI's timeout?

--
Thanks,
Joshua Schaeffer


 

Re: Issues with cloudstack-kubernetes-provider load balancer

[David Jumani]

Hi Kiran

I've discussed this issue with Pierre offline.
This happens when the names of the VMs in CloudStack do not match the node 
names in Kubernetes, likely an upper-lower case issue
A PR to fix it has been raised : 
https://github.com/apache/cloudstack-kubernetes-provider/pull/41
As a workaround, you can rename the VMs in CloudStack to exactly match the 
output of `kubectl get nodes`

From: Kiran manohar Chavala 
Sent: Sunday, July 31, 2022 11:21 AM
To: users@cloudstack.apache.org 
Subject: Re: Issues with cloudstack-kubernetes-provider load balancer

Hi Pierre Le Fevre

Facing a similar kind of  issue when trying to acquire Loadbalncer Ip

Any workaround for the issue

❯ k describe svc kiran
Name: kiran
Namespace:default
Labels:   run=nginx
Annotations:  
Selector: run=nginx
Type: LoadBalancer
IP Family Policy: SingleStack
IP Families:  IPv4
IP:   10.99.211.32
IPs:  10.99.211.32
Port:   80/TCP
TargetPort:   8000/TCP
NodePort:   31588/TCP
Endpoints:10.44.0.4:8000,10.44.0.5:8000
Session Affinity: None
External Traffic Policy:  Cluster
Events:
  Type Reason  Age  From
 Message
   --   
 ---
  Normal   EnsuringLoadBalancer61s (x2 over 2m31s)  service-controller
 Ensuring load balancer
  Warning  SyncLoadBalancerFailed  31s (x2 over 2m1s)   service-controller
 Error syncing load balancer: failed to ensure load balancer: error
retrieving load balancer rules: Get
http://10.102.192.220:8080/client/api?apiKey=ih7O6aKn0-LD7FL2Y6H3wfXv0B1iRXQOG7rZc5iip__eNmiRpKx_27dF5sy_6kJ-7OZt7mx7w9wZHu9Pq9bRfA=listLoadBalancerRules=a94511f7024b24efdaae576625a6fe68=true=json=bpLHBJTA1LgLGV9DCevvKshu2Zg%3D:
dial tcp 10.102.192.220:8080: i/o timeout

Regards
Kiran






 

On Thu, Jun 16, 2022 at 8:33 PM Pierre Le Fevre  wrote:

> Hi all,
>
> I have recently been experimenting with Kubernetes in CloudStack and came
> across a quite odd problem with the communication
> between cloudstack-kubernetes-provider and the CloudStack API.
>
> After some experimentation with the cloud-config api-url variable, it seems
> that connection should be happening. I tried using wget from within
> the pods with success.
> However, whenever services try to sync the load balancer to CloudStack, the
> error* Error syncing load balancer: failed to ensure load balancer: could
> not find network *shows up.
>
> Taking a look at the logs of *cloud-controller-manager*, the same three
> rows come up repeatedly:
>
> I0616 14:02:26.189085   1 event.go:278]
> Event(v1.ObjectReference{Kind:"Service", Namespace:"default", Name:"balls",
> UID:"f75f1f54-2c97-4417-946d-90a536087ad8", APIVersion:"v1",
> ResourceVersion:"1776", FieldPath:""}): type: 'Normal' reason:
> 'EnsuringLoadBalancer' Ensuring load balancer
>
> E0616 14:02:26.273801   1 controller.go:244] error processing service
> default/balls (will retry): failed to ensure load balancer: could not find
> network
>
> I0616 14:02:26.274430   1 event.go:278]
> Event(v1.ObjectReference{Kind:"Service", Namespace:"default", Name:"balls",
> UID:"f75f1f54-2c97-4417-946d-90a536087ad8", APIVersion:"v1",
> ResourceVersion:"1776", FieldPath:""}): type: 'Warning' reason:
> 'SyncLoadBalancerFailed' Error syncing load balancer: failed to ensure load
> balancer: could not find network
>
>
> When watching the logs of our management server, the request
> *listNetworks *appears,
> coming from the kubernetes IP. It does, however, include an empty *id
> *parameter ,
> which in turn returns the error:
>
> {
> "listnetworksresponse": {
> "uuidList": [],
> "errorcode": 431,
> "cserrorcode": ,
> "errortext": "Unable to execute API command listnetworks due to
> invalid value. Invalid parameter id value= due to incorrect long value
> format, or entity does not exist or due to incorrect parameter annotation
> for the field in api cmd class."
> }
> }
>
> The request: http://*domain*/client/api?apiKey=*key*=listNetworks;
> *id=*=json=*signature*
>
> Looking at the code of cloudstack-kubernetes-provider
> (cloudstack_loadbalancer.go:417), it seems like the error should return
> *... **could not find network [network ID]*, but in our case, no ID shows
> up (it could be nil?).
> It appears that cs.verifyHosts (cloudstack_loadbalancer.go:100) is failing
> to update lb.networkID, which cascades into this error.
>
> Seeing as it shows up even after creating different clusters, could this
> still be a configuration issue, or is it a known bug in CKS?
>
> Thanks in advance,
> Pierre Le Fevre
>

Re: [VOTE] Apache Cloudstack 4.17.0.0 RC3

[David Jumani]

-1

I've noticed a few issues wrt CKS :

  *   When creating a CKS cluster with multiple control plane nodes via the UI 
- the value of the control plane nodes is not passed - Fixed in 
https://github.com/apache/cloudstack/pull/6416
  *   When creating a CKS cluster in a network without internet access, it 
fails to come up as it tries to download the container images despite them 
already being there in the Kubernetes ISO - WIP fix in 
https://github.com/apache/cloudstack/pull/6418
  *   When upgrading a CKS cluster via the UI, it throws an error and the 
Kubernetes version can not be selected - Fixed in 
https://github.com/apache/cloudstack/pull/6417 [Thanks Pearl]


From: Nicolas Vazquez 
Sent: Tuesday, May 24, 2022 8:29 PM
To: users ; d...@cloudstack.apache.org 

Subject: [VOTE] Apache Cloudstack 4.17.0.0 RC3

Hi all,
I have created a 4.17.0.0 release (RC3) with the following artefacts up for 
testing and a vote:

Git Branch and Commit SH:
https://github.com/apache/cloudstack/tree/4.17.0.0-RC20220524T1031
Commit: 8b9150cf3cb0bf469272ef1662993e092a36f747

Source release (checksums and signatures are available at the same location):
https://dist.apache.org/repos/dist/dev/cloudstack/4.17.0.0/

PGP release keys (signed using 239A653975E13A0EEF5122A1656E1BCC8CB54F84):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

The vote will be open until 29th May 2022.

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Regards,
Nicolas Vazquez




 

Re: Cloudstack Kubernetes Issue

[David Jumani]

Hi Seth,

The endpointe.url is only required by the cluster autoscaler and CloudStack 
Kubernetes provider.
The cluster should still come up successfully even if the value is incorrect. 
It just means that those two features will not work

From: Rohit Yadav 
Sent: Tuesday, November 23, 2021 4:28 PM
To: users@cloudstack.apache.org 
Subject: Re: Cloudstack Kubernetes Issue

Hi Seth,

It depends what failures you're getting, if it's related to endpointe pl fix 
the global setting with your API URL (for ex. I'm using 
http://192.168.1.10:8080/client/api). If you're using a domain name, ensure 
that's globally resolvable or at least by the DNS server configured for your 
zone/network. After you fix and try again, it may help if share your errors and 
logs.

If the URL is https enabled, avoid letsencrypt whose root authority X3 has 
expired few months and may give security errors.


Regards.


From: Seth Lyons 
Sent: Tuesday, November 23, 2021 01:40
To: users@cloudstack.apache.org 
Subject: RE: Cloudstack Kubernetes Issue

Hello, I am deploying 1.22.2 using link 
http://download.cloudstack.org/cks/setup-1.22.2.iso to create the template.

Sorry for the late response I had reinstalled everything and still the same 
issue.

Maybe it is the endpointe.url ? Does this need to be configured for my SSL 
encryption in the global settings? I have it set to my management dns name 
which resolves correctly.

Right now it looks like http://cloudstack.website.com:8080/client/api





Seth





 


-Original Message-
From: Pearl d'Silva 
Sent: Wednesday, November 17, 2021 3:12 AM
To: users@cloudstack.apache.org
Subject: Re: Cloudstack Kubernetes Issue

Hi,

Could you please share which version of Kubernetes you are trying to deploy. 
From ACS 4.16 onward, k8s versions > 1.20 are only supported.


Thanks,
Pearl


From: Seth Lyons 
Sent: Wednesday, November 17, 2021 2:51 AM
To: users@cloudstack.apache.org 
Subject: Cloudstack Kubernetes Issue

Hello,
I am running Cloudstacks 4.16 and trying to deploy the Kubernetes add on. When 
I add the service it is stuck in the Starting state, but I see that two 
instances are created and seem to be running when viewed through the console 
proxy.
I see this error in the logs which seems related:

2021-11-16 15:29:24,718 WARN  [c.c.k.c.a.KubernetesClusterActionWorker] 
(API-Job-Executor-12:ctx-aeed885c job-550 ctx-9066b68b) (logid:ac518757) Unable 
to retrieve VMs for Kubernetes cluster : Seth
2021-11-16 15:29:24,718 WARN  [c.c.k.c.a.KubernetesClusterActionWorker] 
(API-Job-Executor-12:ctx-aeed885c job-550 ctx-9066b68b) (logid:ac518757) Unable 
to retrieve control VM for Kubernetes cluster : Seth
2021-11-16 15:29:26,912 DEBUG [c.c.c.CapacityManagerImpl] 
(Work-Job-Executor-23:ctx-1628641a job-550/job-551 ctx-defc38ee) 
(logid:ac518757) STATS: Failed to alloc resource from host: 11 reservedCpu: 0, 
requested cpu: 4000, reservedMem: (0 bytes) 0, requested mem: (2.00 GB) 
2147483648
2021-11-16 15:29:34,893 DEBUG [c.c.c.CapacityManagerImpl] 
(Work-Job-Executor-24:ctx-efb62ae9 job-550/job-552 ctx-b435021d) 
(logid:ac518757) STATS: Failed to alloc resource from host: 11 reservedCpu: 0, 
requested cpu: 4000, reservedMem: (0 bytes) 0, requested mem: (2.00 GB) 
2147483648



[Photo]
[Logo]
Seth Lyons
DevOps Engineer | Automate io

[phone-icon]  (415) 757-4696
[phone-icon]  sly...@automateio.com
[phone-icon]  www.automateio.com
[Banner]

Re: Apache Cloudstack Instance Console Question

[David Jumani]

Hi William,

You'll need to add a firewall rule to allow traffic from the public IP of the 
console proxy running on port 80. You can find the IP of the proxy over at 
Infrastructure > SystemVMs. (Or inspect the VM console page and have a look at 
the URL in the iframe)
The console proxy also uses WebSockets, so I'm not sure if simple port 
forwarding will work but give it a shot!

From: William Hankard 
Sent: Saturday, October 23, 2021 4:09 AM
To: users@cloudstack.apache.org 
Subject: Apache Cloudstack Instance Console Question

Hello,

I am having an issue with accessing an instance console on my Cloudstack
environment.
My setup is as follows:

1) Opnsense Firewall with 1 wan port and 1 lan port
2) Red Hat Management server on lan subnet
3) Red Hat KVM Hypervisor on lan subnet

I have setup a port forward rule from my WAN network to the internal LAN
network to my management server.   I can access the management server fine
through
the firewall with my browser.  The issue I am having is when I create an
instance and try to access the console I get a timeout.  I am thinking
maybe I don't have some
port open or there is some console / novnc configuration that needs to be
done.   Any pointers would be appreciated.

Bill
William D. Hankard
Senior Enterprise Virtualization Architect / Backend Developer
IBM Security
X-Force Threat Intelligence and Integration Lab
william_hank...@us.ibm.com
Phone: 617-910-8562


 

Re: problem with project

[David Jumani]

Hi Piotr,

I'm able to reproduce it but on editing the settings such as the VM name it 
does get saved. It looks like the issue is in fetching the instance groups to 
which the user can add the VM.
Can you please raise an issue and we can look into creating a fix for it

From: Piotr Pisz 
Sent: Tuesday, September 21, 2021 2:13 PM
To: users@cloudstack.apache.org 
Subject: problem with project

Hello!

I have a question:

I have a project, a user in a project, VM. When the VM is turned off and I try 
to rename the VM, I get this message:

Request Failed (431)
Account and projectId can't be specified together

The changes to the settings are not saved, I did some experiments but I am not 
able to relate it to anything.
There is no error message in the CS log.

In the old client, this message does not appear, but the changes are also not 
saved.

Could someone please explain to me what is going on?

Regards,
Piotr



 

Re: Console proxy creation failure

[David Jumani]

If that's the case, you can remove the host, reset the IP table rules, 
reinstall the cloudstack agent and add the required IP tables rules as 
mentioned here (as some iptable rules are added to allow the console proxy 
communicate with the vnc port on the host)
https://docs.cloudstack.apache.org/en/latest/installguide/hypervisor/kvm.html
https://docs.cloudstack.apache.org/en/latest/installguide/hypervisor/kvm.html#open-ports-in-rhel-centos

From: technologyrss.mail 
Sent: Thursday, September 2, 2021 11:13 AM
To: David Jumani ; users@cloudstack.apache.org 
; d...@cloudstack.apache.org 

Subject: Re: Console proxy creation failure


I see iptables issue from my kvm host. after some time iptables service stop 
then I can't access any vm.


---

Alamin



On 9/2/2021 10:12 AM, David Jumani wrote:
Could you send the /var/log/cloud.log in the console proxy VM ? Also try 
destroying and recreating the proxy VM






From: technologyrss.mail 
<mailto:technologyrss.m...@gmail.com>
Sent: Wednesday, September 1, 2021 6:58 AM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org> 
<mailto:users@cloudstack.apache.org>; David Jumani 
<mailto:david.jum...@shapeblue.com>; 
d...@cloudstack.apache.org<mailto:d...@cloudstack.apache.org> 
<mailto:d...@cloudstack.apache.org>
Subject: Fwd: Console proxy creation failure



Thank you so much ! Yes, RAM issue. I increase RAM then fix but I see different 
error like I can't access vm console from browser. Please see below image.


ACS log file from below link.

https://drive.google.com/file/d/15C20k1wYlDFNReyY1iYoyfRdJodwdxiU/view?usp=sharing


[cid:part2.2E081B89.7FF30886@gmail.com]


---
Alamin.


On 8/31/2021 2:38 PM, David Jumani wrote:
Hi

At just a glance, It looks like there isn't sufficient memory for the Console 
proxy to come up (by default it needs 1024 MB)
Try adding more memory or increasing the memory overprovisioning factor in the 
configuration / global settings tab






From: technologyrss.mail 
<mailto:technologyrss.m...@gmail.com>
Sent: Tuesday, August 31, 2021 12:31 PM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org> 
<mailto:users@cloudstack.apache.org>; 
d...@cloudstack.apache.org<mailto:d...@cloudstack.apache.org> 
<mailto:d...@cloudstack.apache.org>
Subject: Console proxy creation failure


Hi,

I am able to setup ACS using centos 7.9. all service are properly working fine. 
But when I create basic zone then I see error like below .

ACS server : Centos 0s 7.9
NFS server : Centos 0s 7.8
KVM server : Centos 0s 7.8

[cid:part1.B6819867.0C83CE47@gmail.com]

Secondary Storage VM working fine but can't start proxy vm. what is issue?

[cid:part2.99CE7C85.B5717BC5@gmail.com]

This is system capacity like as below.


[cid:part3.389FB6FD.77D44A7C@gmail.com]


Please give me any idea..


Thanks, Alamin

 

Re: Plugin not working after upgrade to 4.15

[David Jumani]

With the introduction of the new UI, the method to add plugins has changed a 
bit, you can find more information here
https://docs.cloudstack.apache.org/en/latest/adminguide/ui.html#basic-ui-customization



 

From: Gross, Christian
Sent: Thursday, September 2, 2021 7:54 PM
To: users@cloudstack.apache.org
Subject: Plugin not working after upgrade to 4.15

Hello Community

Just updated ACS to 4.15 from 4.14. Now, our plugin is not working anymore. I 
tried it with restarting the management-server, but still no success.

According the following guide, this should still work:
https://docs.cloudstack.apache.org/en/latest/developersguide/plugins.html#third-party-ui-plugins

Our folder structure is as follows:

# pwd
/usr/share/cloudstack-management/webapp

# tree -L 1
.
|-- WEB-INF
|-- assets
|-- cloud.ico
|-- color.less
|-- config.json -> /etc/cloudstack/management/config.json
|-- config.json_bak
|-- css
|-- error.html
|-- example.html
|-- index.html
|-- js
|-- legacy
|-- locales
|-- plugins
`-- primate

# tree -L 1 plugins/
plugins/
|-- myplugin
`-- plugins.js

# tree -L 1 plugins/ncReports/
plugins/myplugin/
|-- config.js
|-- icon.png
|-- myplugin.css
|-- myplugin.js
|-- myplugin.png
`-- webfonts

Maybe someone of you has an idea, why this is not working anymore..

Best Regards
Chris

Re: Console proxy creation failure

[David Jumani]

Could you send the /var/log/cloud.log in the console proxy VM ? Also try 
destroying and recreating the proxy VM

From: technologyrss.mail 
Sent: Wednesday, September 1, 2021 6:58 AM
To: users@cloudstack.apache.org ; David Jumani 
; d...@cloudstack.apache.org 

Subject: Fwd: Console proxy creation failure



Thank you so much ! Yes, RAM issue. I increase RAM then fix but I see different 
error like I can't access vm console from browser. Please see below image.


ACS log file from below link.

https://drive.google.com/file/d/15C20k1wYlDFNReyY1iYoyfRdJodwdxiU/view?usp=sharing


[cid:part2.B70A23A0.CADBC208@gmail.com]


---
Alamin.


On 8/31/2021 2:38 PM, David Jumani wrote:
Hi

At just a glance, It looks like there isn't sufficient memory for the Console 
proxy to come up (by default it needs 1024 MB)
Try adding more memory or increasing the memory overprovisioning factor in the 
configuration / global settings tab






From: technologyrss.mail 
<mailto:technologyrss.m...@gmail.com>
Sent: Tuesday, August 31, 2021 12:31 PM
To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org> 
<mailto:users@cloudstack.apache.org>; 
d...@cloudstack.apache.org<mailto:d...@cloudstack.apache.org> 
<mailto:d...@cloudstack.apache.org>
Subject: Console proxy creation failure


Hi,

I am able to setup ACS using centos 7.9. all service are properly working fine. 
But when I create basic zone then I see error like below .

ACS server : Centos 0s 7.9
NFS server : Centos 0s 7.8
KVM server : Centos 0s 7.8

[cid:part1.B6819867.0C83CE47@gmail.com]

Secondary Storage VM working fine but can't start proxy vm. what is issue?

[cid:part2.99CE7C85.B5717BC5@gmail.com]

This is system capacity like as below.


[cid:part3.389FB6FD.77D44A7C@gmail.com]


Please give me any idea..


Thanks, Alamin

 

Re: Console proxy creation failure

[David Jumani]

Hi

At just a glance, It looks like there isn't sufficient memory for the Console 
proxy to come up (by default it needs 1024 MB)
Try adding more memory or increasing the memory overprovisioning factor in the 
configuration / global settings tab

From: technologyrss.mail 
Sent: Tuesday, August 31, 2021 12:31 PM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Console proxy creation failure


Hi,

I am able to setup ACS using centos 7.9. all service are properly working fine. 
But when I create basic zone then I see error like below .

ACS server : Centos 0s 7.9
NFS server : Centos 0s 7.8
KVM server : Centos 0s 7.8

[cid:part1.B6819867.0C83CE47@gmail.com]

Secondary Storage VM working fine but can't start proxy vm. what is issue?

[cid:part2.99CE7C85.B5717BC5@gmail.com]

This is system capacity like as below.


[cid:part3.389FB6FD.77D44A7C@gmail.com]


Please give me any idea..


Thanks, Alamin

 

Re: Unable to start agent: Failed to get private nic name

[David Jumani]

Hi,

You can have a look at the Trillian GitHub project, it is used to automate 
CloudStack deployments.

For Centos8, the Network Manager is used to create bridges and you can take 
reference from it to create the bridges in your setup
https://github.com/shapeblue/Trillian/blob/master/Ansible/roles/kvm/tasks/kvm_networking_bridge8.yml

From: technologyrss.mail 
Sent: Sunday, August 29, 2021 4:57 PM
To: users-h...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Subject: Unable to start agent: Failed to get private nic name



Hi,

I am setup CentOS Linux release 8.0.1905 (Core) server for kvm. libvirtd 
service properly running but ACS agent not working.

I think my bridge networking not setup properly. My physical kvm server have 
two interface but only allow one interface for internet traffic as LAN network 
(enp2s0).

[cid:part1.98D5BD99.C474ECEF@gmail.com]

Error as like below, also I send my agent.log file from attachment.

[cid:part2.1BA65833.1039978E@gmail.com]

How to setup bridge networking for centos 8 on my kvm server. ? I am already 
success using centos 7.9 kvm server bridge networking.

And I am using as same for centos 8 but not working.

--
Thanks & Regards.
Support Admin



Facebook | 
Twitter | 
YouTube | 
LinkedIn
Address : 116/1 West Malibagh, D. I. T Road
Dhaka-1217, Bangladesh
Mob : +88 01716915504
Email : support.ad...@technologyrss.com
Web : www.technologyrss.com



 

[ANNOUNCE] CloudStack Kubernetes Provider v1.0.0 Release

[David Jumani]

# CloudStack Kubernetes Provider v1.0.0 Release

The Apache CloudStack project is pleased to announce the first release of 
CloudStack Kubernetes Provider v1.0.0 that facilitates Kubernetes deployments 
on Cloudstack.

It allows Kubernetes to dynamically allocate IP addresses and the respective 
networking rules on CloudStack to ensure seamless TCP, UDP and TCP-Proxy 
LoadBalancer deployments on Kubernetes. This was historically part of the 
Kubernetes codebase which was later removed and donated to the project to allow 
for further maintenance of the provider plugin.

# Documentation

https://docs.cloudstack.apache.org/en/latest/plugins/cloudstack-kubernetes-provider.html

# Downloads

The official source code for the v1.0.0 release can be downloaded from the 
archive page:
https://archive.apache.org/dist/cloudstack/releases/kubernetes-provider-v1.0.0/

In addition to the official source code release, individual contributors have 
also made convenient images which can be found on DockerHub:
https://hub.docker.com/layers/apache/cloudstack-kubernetes-provider/v1.0.0/images/sha256-8c2408eccd30eef24cfa72cfbdd912aa4261bc032406d2d078a85dd7246b368d?context=explore


 

Re: How to add additional local storage pools on KVM

[David Jumani]

A brief description can be found in the agent.properties file

# local storage path, by default, it's /var/lib/libvirt/images/
#local.storage.path=/var/lib/libvirt/images/

>From my experience this needs to be set before adding the host to cloudstack 
>(if not, remove it, change the setting and re-add it)
This won't be overwritten, however cloudstack will use a shared pool if the 
zone is not set to use local storage

Use of local storage in cloudstack can be controlled by the use.local.storage 
setting
http://docs.cloudstack.apache.org/en/latest/installguide/configuration.html#configuration-parameters

About the ssd and hdd scenario, If that's the case, the local.storage.path can 
point to either the ssd or hdd partition and tag the host and offerings 
accordingly



From: Michael Brußk 
Sent: Wednesday, August 25, 2021 2:12 PM
To: users@cloudstack.apache.org 
Subject: Re: How to add additional local storage pools on KVM

Hi Davide,

thanks for replay.
Is there some documentation available about this setting?
When should this be set - before or after the host has been added to CS?
If before, how to make sure this will not be overwritten by the agent setup 
process?

> some of the hosts could mount the ssd and the rest the hdd and assign tags to 
> the host and the service offerings.
This is not possible, since each host has one local SSD- and one HDD-raid, 
those it can't be mounted from/to other hosts (maybe via NFS, but this would 
result in a weird design)
Regards,
Michael
-Ursprüngliche Nachricht-
Von: David Jumani 
Gesendet: Mittwoch, 25. August 2021 09:01
An: users@cloudstack.apache.org
Betreff: Re: How to add additional local storage pools on KVM

Hi,

You can specify the path to a local directory on the host (which can be 
mounted) in the agent.properties file

local.storage.path=/mnt/path

As for multiple storage locations on a single host, I'm not sure 
whether it is supported As a workaround, some of the hosts could mount the ssd 
and the rest the hdd and assign tags to the host and the service offerings.

CloudStack will match those tags and bring up the VM on the appropriate 
host 

From: Michael Bru?k mailto:m...@mib85.de)>

Sent: Tuesday, August 24, 2021 7:55 PM

To: users@cloudstack.apache.org (mailto:users@cloudstack.apache.org) 
mailto:users@cloudstack.apache.org)>

Subject: How to add additional local storage pools on KVM

Hi,

how is it possible to add additional local storage pools to KVM hosts?

As per documentation (and observations) when adding a new KVM host to a 
zone, where "use local storage for client vms" is enabled, CS automatically 
creates a new filesystem based local storage pool under /var/lib/libvirt/images.

We would like to use two additional local storages for different 
purposes (ssd-raid for realtime/hot data and hdd-raid for archive data) on each 
host (cluster with upto 8 hosts).

We are aware of that live migrations are not functional when using 
local storage, but we want to use already existing CloudStack installation (and 
all our processes around) for this special project.

Regards,

Michael

 

Re: How to add additional local storage pools on KVM

[David Jumani]

Hi,

You can specify the path to a local directory on the host (which can be 
mounted) in the agent.properties file

local.storage.path=/mnt/path

As for multiple storage locations on a single host, I'm not sure whether it is 
supported
As a workaround, some of the hosts could mount the ssd and the rest the hdd and 
assign tags to the host and the service offerings.
CloudStack will match those tags and bring up the VM on the appropriate host

From: Michael Bru?k 
Sent: Tuesday, August 24, 2021 7:55 PM
To: users@cloudstack.apache.org 
Subject: How to add additional local storage pools on KVM

Hi,

how is it possible to add additional local storage pools to KVM hosts?
As per documentation (and observations) when adding a new KVM host to a zone, 
where "use local storage for client vms" is enabled, CS automatically creates a 
new filesystem based local storage pool under /var/lib/libvirt/images.
We would like to use two additional local storages for different purposes 
(ssd-raid for realtime/hot data and hdd-raid for archive data) on each host 
(cluster with upto 8 hosts).
We are aware of that live migrations are not functional when using local 
storage, but we want to use already existing CloudStack installation (and all 
our processes around) for this special project.

Regards,
Michael

 

[RESULT] [VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)

[David Jumani]

Hi All,

The vote for CloudStack Kubernetes Provider v1.0.0 *passes* with
5 PMC + 2 non-PMC votes.

+1 (PMC / binding)
5 people (Rohit, Daan, Gabriel, Nicolas, Boris)

+1 (non-binding)
2 people (Abhishek, Suresh)

0
none

-1
none

Thanks to everyone participating. I will now prepare the release announcement 
to go out next week and publish the images to Dockerhub.


On 12/08/21, 1:52 PM, "Boris Stoyanov"  wrote:

+1 (binding), have not tested it personally but basing my +1 on testing 
done by Abhishek

From: David Jumani 
Date: Wednesday, 4 August 2021, 14:42
To: d...@cloudstack.apache.org , users 

Subject: [VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)
Hi All,

I've created the initial CloudStack Kubernetes Provider release v1.0.0, 
with the following artifacts up for a vote:

Git Branch and Commit SH:
https://github.com/apache/cloudstack-kubernetes-provider/tree/1.0
Commit: a8fccd9fe5c145bc3a12e3681bdf33e9f6ed382c

Source release (checksums and signatures are available at the same
location):

https://dist.apache.org/repos/dist/dev/cloudstack/kubernetes-provider-v1.0.0/

PGP release keys (signed using 92D88ECF4D63C923):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

The docker image can be found at 
https://hub.docker.com/r/apache/cloudstack-kubernetes-provider

The documentation for the same can be found at

https://github.com/apache/cloudstack-documentation/blob/main/source/plugins/cloudstack-kubernetes-provider.rst

https://github.com/apache/cloudstack-kubernetes-provider/blob/main/README.md#deployment
(be sure to replace the image version 
`apache/cloudstack-kubernetes-provider:v1.0.0` with 
`apache/cloudstack-kubernetes-provider:v1.0.0-RC20210804T0500`)

The vote will be open until 08 August 2021.

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Thanks,
David







 

Re: 2FA

[David Jumani]

Hi Rakesh,

MFA is generally done via an IAM rather than on a per-application basis. As 
Simon had mentioned, CloudStack does support SAML / LDAP so, in a general / 
corporate use case, the MFA would go there. So I do not think adding support 
for 2FA will add any significant benefit
That being said, I'll be happy to review any PR that's raised

From: Simon Weller 
Sent: Wednesday, August 11, 2021 12:31 AM
To: users ; dev 
Subject: Re: 2FA

Rakesh,

ACS does support SAML2 and in order to deploy 2FA/MFA, you could integrate it 
with an Identity and Access Management System such as Keycloak 
(https://www.keycloak.org/).

-Si


From: Rakesh Venkatesh 
http://www.rakeshv@gmail.com>>
Sent: Tuesday, August 10, 2021 4:34 AM
To: users ; dev 
Subject: 2FA

Hello

Has anyone thought about 2FA or about how to implement it in cloudstack?
Looks like this will be good addition to enhance the security. I have some
idea about implementing in the backend but dont have much idea on how to
display the QR code in ui or other functionalities which is needed for
frontend part.

--
Thanks and regards
Rakesh

 

Re: [VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)

[David Jumani]

Hi All,

The vote is still open as we need 3 binding +1s
Requesting PMCs to please cast their vote

From: David Jumani 
Sent: Tuesday, August 10, 2021 1:55 PM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Re: [VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)

Hi All,

The vote for CloudStack Kubernetes Provider v1.0.0 *passes* with
1 PMC + 2 non-PMC votes.

+1 (PMC / binding)
1 person (Rohit)

+1 (non-binding)
2 people (Abhishek, Suresh)

0
none

-1
none

Thanks to everyone participating. I will now prepare the release announcement 
to go out later this week and publish the images to Dockerhub.


From: Suresh Anaparti 
Sent: Tuesday, August 10, 2021 11:40 AM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Re: [VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)

+1

Tested basic deployment for the Traefik ingress controller, using the 
Kubernetes Provider with the below RC build (Env: ACS main + KVM + K8s Cluster 
v1.16.3).

Regards,
Suresh

On 04/08/21, 5:12 PM, "David Jumani"  wrote:

Hi All,

I've created the initial CloudStack Kubernetes Provider release v1.0.0, 
with the following artifacts up for a vote:

Git Branch and Commit SH:
https://github.com/apache/cloudstack-kubernetes-provider/tree/1.0
Commit: a8fccd9fe5c145bc3a12e3681bdf33e9f6ed382c

Source release (checksums and signatures are available at the same
location):

https://dist.apache.org/repos/dist/dev/cloudstack/kubernetes-provider-v1.0.0/

PGP release keys (signed using 92D88ECF4D63C923):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

The docker image can be found at 
https://hub.docker.com/r/apache/cloudstack-kubernetes-provider

The documentation for the same can be found at

https://github.com/apache/cloudstack-documentation/blob/main/source/plugins/cloudstack-kubernetes-provider.rst

https://github.com/apache/cloudstack-kubernetes-provider/blob/main/README.md#deployment
(be sure to replace the image version 
`apache/cloudstack-kubernetes-provider:v1.0.0` with 
`apache/cloudstack-kubernetes-provider:v1.0.0-RC20210804T0500`)

The vote will be open until 08 August 2021.

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Thanks,
David











 

Re: [VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)

[David Jumani]

Hi All,

Please ignore the previous mail, the voting thread is still open

From: David Jumani 
Sent: Tuesday, August 10, 2021 1:55 PM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Re: [VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)

Hi All,

The vote for CloudStack Kubernetes Provider v1.0.0 *passes* with
1 PMC + 2 non-PMC votes.

+1 (PMC / binding)
1 person (Rohit)

+1 (non-binding)
2 people (Abhishek, Suresh)

0
none

-1
none

Thanks to everyone participating. I will now prepare the release announcement 
to go out later this week and publish the images to Dockerhub.


From: Suresh Anaparti 
Sent: Tuesday, August 10, 2021 11:40 AM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Re: [VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)

+1

Tested basic deployment for the Traefik ingress controller, using the 
Kubernetes Provider with the below RC build (Env: ACS main + KVM + K8s Cluster 
v1.16.3).

Regards,
Suresh

On 04/08/21, 5:12 PM, "David Jumani"  wrote:

Hi All,

I've created the initial CloudStack Kubernetes Provider release v1.0.0, 
with the following artifacts up for a vote:

Git Branch and Commit SH:
https://github.com/apache/cloudstack-kubernetes-provider/tree/1.0
Commit: a8fccd9fe5c145bc3a12e3681bdf33e9f6ed382c

Source release (checksums and signatures are available at the same
location):

https://dist.apache.org/repos/dist/dev/cloudstack/kubernetes-provider-v1.0.0/

PGP release keys (signed using 92D88ECF4D63C923):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

The docker image can be found at 
https://hub.docker.com/r/apache/cloudstack-kubernetes-provider

The documentation for the same can be found at

https://github.com/apache/cloudstack-documentation/blob/main/source/plugins/cloudstack-kubernetes-provider.rst

https://github.com/apache/cloudstack-kubernetes-provider/blob/main/README.md#deployment
(be sure to replace the image version 
`apache/cloudstack-kubernetes-provider:v1.0.0` with 
`apache/cloudstack-kubernetes-provider:v1.0.0-RC20210804T0500`)

The vote will be open until 08 August 2021.

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Thanks,
David











 

Re: [VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)

[David Jumani]

Hi All,

The vote for CloudStack Kubernetes Provider v1.0.0 *passes* with
1 PMC + 2 non-PMC votes.

+1 (PMC / binding)
1 person (Rohit)

+1 (non-binding)
2 people (Abhishek, Suresh)

0
none

-1
none

Thanks to everyone participating. I will now prepare the release announcement 
to go out later this week and publish the images to Dockerhub.


From: Suresh Anaparti 
Sent: Tuesday, August 10, 2021 11:40 AM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Re: [VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)

+1

Tested basic deployment for the Traefik ingress controller, using the 
Kubernetes Provider with the below RC build (Env: ACS main + KVM + K8s Cluster 
v1.16.3).

Regards,
Suresh

On 04/08/21, 5:12 PM, "David Jumani"  wrote:

Hi All,

I've created the initial CloudStack Kubernetes Provider release v1.0.0, 
with the following artifacts up for a vote:

Git Branch and Commit SH:
https://github.com/apache/cloudstack-kubernetes-provider/tree/1.0
Commit: a8fccd9fe5c145bc3a12e3681bdf33e9f6ed382c

Source release (checksums and signatures are available at the same
location):

https://dist.apache.org/repos/dist/dev/cloudstack/kubernetes-provider-v1.0.0/

PGP release keys (signed using 92D88ECF4D63C923):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

The docker image can be found at 
https://hub.docker.com/r/apache/cloudstack-kubernetes-provider

The documentation for the same can be found at

https://github.com/apache/cloudstack-documentation/blob/main/source/plugins/cloudstack-kubernetes-provider.rst

https://github.com/apache/cloudstack-kubernetes-provider/blob/main/README.md#deployment
(be sure to replace the image version 
`apache/cloudstack-kubernetes-provider:v1.0.0` with 
`apache/cloudstack-kubernetes-provider:v1.0.0-RC20210804T0500`)

The vote will be open until 08 August 2021.

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Thanks,
David








 

Re: 'Infrastructure' then 'Hosts' in the webui not working

[David Jumani]

Adding to what Andria, could you also add the browser console logs

From: Andrija Panic 
Sent: Monday, August 9, 2021 1:01 PM
To: users 
Subject: Re: 'Infrastructure' then 'Hosts' in the webui not working

Hi James,

this might sound like a bug (unless someone advices otherwise) - so I would
advise that you open a GitHub issue, it would be good if you have saved
some screenshots - take time to properly report the problem, so that people
can look into it.

Thanks,
Andrija





 

On Sat, 7 Aug 2021 at 11:12, James Steele  wrote:

> My setup: Ubuntu Server 20.04.2, MySQL Ver 8.0.26-0ubuntu0.20.04.2
>
> I have been getting an error that when I click 'Infrastructure' then
> 'Hosts' in the webui (http://ipaddress:8080/client/) the error message:
> '(X) For input string: " "' is shown briefly, but the hosts are NOT listed.
> However the old web client works fine (
> http://ipaddress:8080/client/legacy/).
>
> The boxes that have the error were upgraded from 4.15 to 4.15.1
>
> I have just done a clean install on identical hardware straight to 4.15.1
> and there are no longer any errors.
>
> People have suggested that system Locale may be a problem. However using
> the default locale on the new install works fine (en_GB.UTF-8) and doesn’t
> need changing.
>
> I don’t think locale is the issue now (for me anyway). I think the mysql
> database has either been changed somehow during the original systems
> upgrade procedure. Or the 4.15 created database is being accessed
> differently from the system that has been through the upgrade procedure to
> 4.15.1
>
> Summary:
>
> Hardware, setup with 4.15, then upgraded to 4.15.1
> http://ipaddress:8080/client/#/host= 'Hosts' tab in the webui
> BROKEN with error
> http://ipaddress:8080/client/legacy/ = 'Hosts' tab in the webui is
> OK, lists all hosts correctly
>
> Hardware, setup clean with 4.15.1
> http://ipaddress:8080/client/#/host= 'Hosts' tab in the webui is
> OK, lists all hosts correctly
> http://ipaddress:8080/client/legacy/ = 'Hosts' tab in the webui is
> OK, lists all hosts correctly
>
> Any ideas?
>


--

Andrija Panić

[VOTE] Apache CloudStack Kubernetes Provider v1.0.0 (RC1)

[David Jumani]

Hi All,

I've created the initial CloudStack Kubernetes Provider release v1.0.0, with 
the following artifacts up for a vote:

Git Branch and Commit SH:
https://github.com/apache/cloudstack-kubernetes-provider/tree/1.0
Commit: a8fccd9fe5c145bc3a12e3681bdf33e9f6ed382c

Source release (checksums and signatures are available at the same
location):
https://dist.apache.org/repos/dist/dev/cloudstack/kubernetes-provider-v1.0.0/

PGP release keys (signed using 92D88ECF4D63C923):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

The docker image can be found at 
https://hub.docker.com/r/apache/cloudstack-kubernetes-provider

The documentation for the same can be found at
https://github.com/apache/cloudstack-documentation/blob/main/source/plugins/cloudstack-kubernetes-provider.rst
https://github.com/apache/cloudstack-kubernetes-provider/blob/main/README.md#deployment
(be sure to replace the image version 
`apache/cloudstack-kubernetes-provider:v1.0.0` with 
`apache/cloudstack-kubernetes-provider:v1.0.0-RC20210804T0500`)

The vote will be open until 08 August 2021.

For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Thanks,
David

 

Re: [PROPOSE] RM for CloudStack Kubernetes Provider v1.0

[David Jumani]

Thanks for your support.
As an RM, I'll need access to the cloudstack / cloudstack-kubernetes-provider 
dockerhub repo.
I'll also need my GPG key added to the KEYS file in the apache repo. Could a 
PMC help me out with that ?



pub   rsa4096 2021-07-29 [SC] [expires: 2023-07-29]
  C7E3B47728631AA39FB026FC92D88ECF4D63C923
uid   [ultimate] David Jumani 
sig 392D88ECF4D63C923 2021-07-29  David Jumani 


-BEGIN PGP PUBLIC KEY BLOCK-

mQINBGECVCwBEADN8ATXJEXavjqATmi3pC8T58Lyoq6oamIzR7qL/qfxha+eHM5M
zxR1plKqabcgC2I5R0wBbElVpO5Df27IJYOeH9COX/c8MxF8Urrk+Pj+esd8MncX
pIBIUifmBgTsglMOT3ohuP7igSpqFyVhs+WM0iLIlqq5YRTQ24VJRLfX29SUswVx
G6b//Ey+5lqecHjkAufw/9sSgzRJChnwIYkJno/v+4asR5RqzFIfZaGY8o3updff
Q7iPD6SZM3Dthjfw3xE2Snt+FZ+TX5nSgdDrND/kjMDtYxg6hM6CZLY48dBNmyUK
mZWQ+q+nZfJt/cgiRgcNySjKMK8yjtxw+wsKGWFJpzMasHASKSZVgIDPLWIVrk7G
xOisNF2FHyqZSFL3UanCrP4Tc8BOhN9iPQmk/LHEqYEBsSk6hHsDBXLJAd1RLvfV
+ehYWZwAXvLx76GX1ws3hLzzCCpq7g8RbJ4JZREWDUvgGl7k0r7BCeCreVIf1xdR
fcInDgCZeVfBq94y4U3hw/8juciCEbKOAbibVR1oWIBcwHqdifzPo7OsFci8Fmz9
UpQjRcvMm4INEtfyjZY9aXWrGCWXAC77QeCGln2TIqGycHiAdOliccrc6jv2MpJr
rBBK5MVgQmTMN563w2EwLwZPwKUqCLrK4lurkZlL+A9YPOOhN5OU06yl+wARAQAB
tCVEYXZpZCBKdW1hbmkgPGRhdmlkanVtYW5pQGFwYWNoZS5vcmc+iQJUBBMBCgA+
FiEEx+O0dyhjGqOfsCb8ktiOz01jySMFAmECVCwCGwMFCQPCZwAFCwkIBwIGFQoJ
CAsCBBYCAwECHgECF4AACgkQktiOz01jySMcMg/+LXbD1k0g+wyil+/CUzpeS4MB
pP0bRtRolY6T30AiN01NvMS3TPTOJmFdC0JOAkluWFL/SfHTvgVetVdE81GRYTyv
yzcDokSmQas1S5ldPw2p9Cmgp5MzgqZarxPXCkD26SSetsQmTVpa/jyjoKgw/Pha
Sb1pC8ZQogeH83koXJbiA5wY4lym30o6aMeZMDcRevUdOwwne5In9Ac1c5tnZ0cT
aZ8ou9Kb7X5/Wjm2eIbKuRxAy4yu31uKxbXtclyFdjA7K+vrUXFHtE1zQ8opd/DH
07Fqd9xSMwNcAlO4jlKZpFAtmHtLyr6aUjk0YyM4HNmV5y5jsmuUqHN5X3IhhoYr
aoj4JUXuDQTMJ4mksU2xIGIZm/kijZlMtcRWp/bqOwz9CeqrUGvgIrjMqG3puZYS
thUMiCu71/Iv0TrxpZPPLiRSkchkBbvif9HB/0Qh6x+Hg2knZz7YHEWcUa+CKV50
XpQjQh64WXjc6Hy4/NR2DOP6FXFnq5kqpOxL+uYeA4gPmf1cFtSEPjhkbJl1nS6K
/tJc0xqob5VIIKiVHAJreAMrvjk+XZPx5Rr7sB7YUyowO8cKKdoKrZ1IYgZh4ula
0CJp/FLuc5UnGYAUAAL8Z+0vIWJz7JIji+HBE1V0ipXvMBp5Cnw9TEyn06Sd7Y09
ogzHcVmW4B8oVEGSMH4=
=CBlM
-END PGP PUBLIC KEY BLOCK-


Thanks

From: Suresh Anaparti 
Sent: Thursday, July 15, 2021 8:45 PM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Re: [PROPOSE] RM for CloudStack Kubernetes Provider v1.0

+1

Good luck David!

Regards,
Suresh

On 15/07/21, 12:02 PM, "David Jumani"  wrote:

Hi,

I'd like to put myself forward as the release manager for CloudStack 
Kubernetes Provider<https://github.com/apache/cloudstack-kubernetes-provider> 
v1.0.

This will be the first release of CloudStack Kubernetes Provider which 
facilitates Kubernetes deployments on Cloudstack.
It allows Kubernetes to dynamically allocate IP addresses and the 
respective networking rules on CloudStack to ensure seamless TCP, UDP and 
TCP-Proxy LoadBalancer deployments on Kubernetes.

It was initially the Cloudstack provider in Kubernetes which was later 
extracted to allow for pluggable providers.
A lot of work and effort has gone into developing it, and we are looking 
forward to its grand debut.

The list of open issues triaged for the v1.0 milestone can be found at 
https://github.com/apache/cloudstack-kubernetes-provider/milestone/1
If you encounter any issues, please do report them at 
https://github.com/apache/cloudstack-kubernetes-provider/issues

Looking forward to your support

Thanks,
David








 

[PROPOSE] RM for CloudStack Kubernetes Provider v1.0

[David Jumani]

Hi,

I'd like to put myself forward as the release manager for CloudStack Kubernetes 
Provider v1.0.

This will be the first release of CloudStack Kubernetes Provider which 
facilitates Kubernetes deployments on Cloudstack.
It allows Kubernetes to dynamically allocate IP addresses and the respective 
networking rules on CloudStack to ensure seamless TCP, UDP and TCP-Proxy 
LoadBalancer deployments on Kubernetes.

It was initially the Cloudstack provider in Kubernetes which was later 
extracted to allow for pluggable providers.
A lot of work and effort has gone into developing it, and we are looking 
forward to its grand debut.

The list of open issues triaged for the v1.0 milestone can be found at 
https://github.com/apache/cloudstack-kubernetes-provider/milestone/1
If you encounter any issues, please do report them at 
https://github.com/apache/cloudstack-kubernetes-provider/issues

Looking forward to your support

Thanks,
David

 

Re: Reg : Novnc + KVM [Cent OS 8]

[David Jumani]

No additional settings are needed as noVNC is the default console in CloudStack 
4.15, just set up Centos8 as mentioned here 
http://docs.cloudstack.apache.org/en/latest/installguide/hypervisor/kvm.html 
and ensure that the firewall allows access to the VNC ports on the host.

From: pavan aravapalli 
Sent: Friday, July 9, 2021 11:41 AM
To: users@cloudstack.apache.org 
Subject: Re: Reg : Novnc + KVM [Cent OS 8]

Hi David,

Thanks for the quick response, Do we need additional settings on the kvm
host [Centos 8] to support novnc for guest VM running on KVM.

Regards,
Pavan.

On Fri, 9 Jul 2021 at 10:51, David Jumani 
wrote:

> Hi Pavan,
>
> It does work with Centos8 as a KVM host
> 
> From: pavan aravapalli 
> Sent: Friday, July 9, 2021 10:35 AM
> To: users@cloudstack.apache.org ; dev <
> d...@cloudstack.apache.org>
> Subject: Reg : Novnc + KVM [Cent OS 8]
>
> Hi,
>
>
> I saw below that PR is tested with kvm, but no specific version of KVM is
> mentioned. Does NoVnc Supported in CentOS 8.
> https://github.com/apache/cloudstack/pull/3967
>
>
> Regards,
> Pavan.
>
>
>
>

 

Re: Reg : Novnc + KVM [Cent OS 8]

[David Jumani]

Hi Pavan,

It does work with Centos8 as a KVM host

From: pavan aravapalli 
Sent: Friday, July 9, 2021 10:35 AM
To: users@cloudstack.apache.org ; dev 

Subject: Reg : Novnc + KVM [Cent OS 8]

Hi,


I saw below that PR is tested with kvm, but no specific version of KVM is
mentioned. Does NoVnc Supported in CentOS 8.
https://github.com/apache/cloudstack/pull/3967


Regards,
Pavan.

 

Re: [DISCUSS] Rocky 8.4 and CloudStack

[David Jumani]

Good idea Rohit, +1 on creating symlinks for el7, el8
I've also created a PR to support binary compatible variants of RHEL8. I'd 
appreciate feedback / testing from the community
I've tested it agianst Rocky & Alma and it seems to work just like C8 does

https://github.com/apache/cloudstack/pull/5158

From: Rohit Yadav 
Sent: Monday, June 28, 2021 4:32 PM
To: d...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Subject: Re: [DISCUSS] Rocky 8.4 and CloudStack

Great thanks all for the discussion, so what we mostly agree on are:

  *   CentOS8, Rocky Linux 8 and other initiatives may all be binary compatible
  *   We can host all el8 repos which these distros may use
  *   The community may help validate the CloudStack el8 pkgs among one or more 
clear winner with time

As an immediate action, let's us publish all "centos8" or "rocky8" package 
repos under generic "el8" repos? For example, 
http://download.cloudstack.org/testing/nightly/latest/ we can add symlink or 
rename dirs as "el8", "el7".


Regards.


From: n...@li.nux.ro 
Sent: Thursday, June 24, 2021 21:12
To: d...@cloudstack.apache.org 
Cc: Nathan McGarvey 
Subject: Re: [DISCUSS] Rocky 8.4 and CloudStack

That's a very good suggestion, I'm sure we can sort out something.

Regards,
Lucian





 

On 2021-06-24 14:40, Nathan McGarvey wrote:
> Nux,
> Also agree regarding EL8.
>
> I wonder if it is possible to build on a RHEL "development" license
> where builds and smoke tests and such can be done without licensing
> cost.
> (https://developers.redhat.com/articles/faqs-no-cost-red-hat-enterprise-linux,
> https://developers.redhat.com/terms-and-conditions)
>
> I'm not a lawyer and the terms seem murky as to how an Open-Source
> project like CloudStack would interact with those terms, even in a
> non-production sense. Do any other ASF projects use RHEL for build/test
> servers or anything like that?
>
>
> Thanks,
> -Nathan McGarvey
>
>
>
> On 6/24/21 8:17 AM, Sven Vogel wrote:
>> @nux
>>
>> „Might be then worth going for supporting "EL8" and by that include
>> any
>> of Rocky, Alma, OtherClone etc.“
>>
>> Agree
>>
>> __
>>
>> Sven Vogel
>> Senior Manager Research and Development - Cloud and Infrastructure
>>
>> EWERK DIGITAL GmbH
>> Brühl 24, D-04109 Leipzig
>> P +49 341 42649 - 99
>> F +49 341 42649 - 98
>> s.vo...@ewerk.com
>> www.ewerk.com
>>
>> Geschäftsführer:
>> Dr. Erik Wende, Hendrik Schubert, Tassilo Möschke
>> Registergericht: Leipzig HRB 9065
>>
>> Support:
>> +49 341 42649 555
>>
>> Zertifiziert nach:
>> ISO/IEC 27001:2013
>> DIN EN ISO 9001:2015
>> DIN ISO/IEC 2-1:2018
>>
>> ISAE 3402 Typ II Assessed
>>
>> EWERK-Blog |
>> LinkedIn |
>> Xing |
>> Twitter |
>> Facebook
>>
>>
>> Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.
>>
>> Disclaimer Privacy:
>> Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien)
>> ist vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht
>> der bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung,
>> Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte
>> informieren Sie in diesem Fall unverzüglich den Absender und löschen
>> Sie die E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem
>> System. Vielen Dank.
>>
>> The contents of this e-mail (including any attachments) are
>> confidential and may be legally privileged. If you are not the
>> intended recipient of this e-mail, any disclosure, copying,
>> distribution or use of its contents is strictly prohibited, and you
>> should please notify the sender immediately and then delete it
>> (including any attachments) from your system. Thank you.
>>
>> 
>> Von: n...@li.nux.ro 
>> Gesendet: Thursday, June 24, 2021 2:57:24 PM
>> An: d...@cloudstack.apache.org 
>> Betreff: Re: [DISCUSS] Rocky 8.4 and CloudStack
>>
>> Point taken. Good find with gdm, wonder if there are others.
>> I'm hoping this kind of problems disappear in time as the machine gets
>> "oiled" better.
>>
>> What I wanted to underline is that the situation is sort of like this:
>> Updates -> QA -> Stream -> RHEL
>>
>> Might be then worth going for supporting "EL8" and by that include any
>> of Rocky, Alma, OtherClone etc.
>>
>>
>>
>> On 2021-06-23 19:03, Nathan McGarvey wrote:
>>> Nux,
>>> Overall, I agree that it should be possible to use any other
>>> clone
>>> as they should be binary compatible.
>>>
>>> I don't quite understand your "pass through QA" and "basically
>>> RHEL
>>> packages" comment. There are already instances of breaking changes in
>>> CentOS 8 Stream that didn't make it into RHEL or CentOS non-stream.
>>> CentOS Stream is the only one where you *don't* know exactly what 

Option to stay on page after deploying a VM

[David Jumani]

Hi,

While creating multiple VMs, I've faced the issue of having to go back to the 
deploy VM form after each deployment
Although a mild inconvenience, it does get tiring to refill the form, so I've 
added the option to stay on the deploy VM form after creating a VM
This way all the form data remains intact and can be changed as per the VM 
requirements
Please have a look and let me know your feedback
https://github.com/apache/cloudstack/pull/4843

Thanks,
David


 

Re: [DISCUSS] Rocky 8.4 and CloudStack

[David Jumani]

+1
I think that since Cenots8 / Rocky / Alma are binary compatible it would be 
sufficient to support Rocky since it is looking like the go to alternative, and 
supporting any one would pretty much be supporting the other
About dropping support, I'm for supporting it until EOL this year

From: Rohit Yadav 
Sent: Tuesday, June 22, 2021 1:11 PM
To: d...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Subject: [DISCUSS] Rocky 8.4 and CloudStack

All,

With GA release of Rocky Linux 8.4 
(https://docs.rockylinux.org/release_notes/8.4) does it make sense now to 
completely drop support for CentOS8 in the next major release? I did a quick 
test and it seems rpms built on centos8 container continue to work on Rocky 
release. Thoughts?

Regards,
Rohit Yadav




 

OpenSUSE Support

[David Jumani]

Hi,

Hope you are all doing well.

I'm currently working on adding support for openSUSE Leap 15.2+ as a KVM 
hypervisor and Management / Usage server for Cloudstack,
I've raised a draft PR (still a WIP) and would like to get feedback and your 
thoughts on the idea as well as the code
https://github.com/apache/cloudstack/pull/5110
TIA

 

Re: Cloudstack source code compilation - RPMs build failed - LDAP

[David Jumani]

Hi Hema,

If it helps you can try and build it from source skipping the tests.
You can modify the cloud.spec to add the skip tests flag

From: Hema 
Sent: Saturday, June 5, 2021 4:42 PM
To: users@cloudstack.apache.org 
Subject: Re: Cloudstack source code compilation - RPMs build failed - LDAP

Hi,

I installed and configured LDAP as per the steps provided in the below link.
https://computingforgeeks.com/install-configure-openldap-server-centos/

[root@centos8 openldap]# netstat -ltnp | grep slapd
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address   Foreign Address State   
PID/Program name
tcp0  0 0.0.0.0:636 0.0.0.0:*   LISTEN  
516121/slapd
tcp0  0 0.0.0.0:389 0.0.0.0:*   LISTEN  
516121/slapd
tcp6   0  0 :::389  :::*LISTEN  
516121/slapd
tcp6   0  0 :::3306 :::*LISTEN  
1869/mysqld

The slapd service seem to be running on 389 port whereas the code was referring 
to 11389 port. So I tried modifying the hard coded value from 11389 to 389 in 
the below file,

$HOME/apache-cloudstack-4.15.0.0-src/plugins/user-authenticators/ldap/src/test/java/org/apache/cloudstack/ldap/LdapUnitConnectionTest.java
static final int PORT =11389
to
static final int PORT = 389

Now I am getting the error as,
<<< ERROR!
com.unboundid.ldap.sdk.LDAPException: An error occurred while attempting to 
start listener 'default':  BindException(Address already in use (Bind failed)),

What is expected to be done then to resolve the error initially posted ?

Is LDAP connection a pre-requisite for the source to be built ?

Thanks,
Hema







 

Re: Primate gui on other server

[David Jumani]

Hi Alessandro,

The new UI has been integrated into the cloudstack repo available at 
https://github.com/apache/cloudstack/tree/master/ui
It can still be built and installed on another server and point to your 
management server, however, it won't be compatible with 4.13.
You can upgrade your cloudstack version to 4.15 to enjoy all the features of 
the new UI

From: Alessandro Caviglione 
Sent: Thursday, May 20, 2021 10:17 PM
To: users@cloudstack.apache.org 
Subject: Primate gui on other server

Hi guys,
I tried Primate GUI since one of the firsts release and I remember that
I've installed it on another server made it point to my management server
by changing a config file.
Now I see that old github repo is bo more available and the new UI has been
integrated in new ACS release.
But my question is this: can I still install it separately and connect to
my ACS 4.13?
Where I can find the new repo?

Thank you

 

Re: Console connection is timing out

[David Jumani]

Hi Thomas,

Could you provide the logs of the console proxy ?
Can you check if the console proxy can reach the host on which the VMs are 
running ?
Also please sync the times on the Management server and hosts, destroy the 
console proxy and try again


From: thomas.laton 
Sent: Wednesday, May 19, 2021 7:03 PM
To: users@cloudstack.apache.org 
Subject: Console connection is timing out

Hello,

to see if I can use CloudStack 4.15.1 for my purposes, I set up a simple single 
server in Debian 10, running management and KVM host on the same machine using 
this manual https://rohityadav.cloud/blog/cloudstack-kvm/ as guidance. All 
seems to be working as it should. No errors or red flags.

However, I cannot connect to any VM using the console, be it system-vm or a 
newly created instance. The "consoleproxy" is shown as running, as are the 
instances I create but the console connections time out. The 
"management-server.log" shows no errors and I can connect to the "consoleproxy" 
using ssh.

>From inside the proxy, I cannot ping the gateway IP but the management server 
>is reachable and the secondary storage VM shows the same behavior but seems to 
>be working (e.g.: I could upload and use an iso). Other than that I can find 
>no obvious problems.

"consoleproxy.sslEnabled" is set to false.

Maybe, I should mention that I am not connected to the internet. Is this a 
problem? My final deployment can and must not be connected to the outside 
during setup or production.

And finally, is there a way to directly connect to the VMs without using the 
management UI?

Thanks,
Thomas

 

Re: alternative Active directory config?

[David Jumani]

Hi Yordan,

LDAP is enabled in the UI, it'll show up after you add an LDAP server under 
Configurations -> LDAP Configurations. Once you've added it log out and log 
back in again. You'll then be able to add LDAP users in the accounts section

From: Yordan Kostov 
Sent: Thursday, May 13, 2021 6:28 PM
To: users@cloudstack.apache.org 
Subject: alternative Active directory config?

Hey everyone,

In 4.15 it seems there is no LDAP config button in the new GUI 
or the old GUI, so after LDAP sources are pointed and global config is set 
there is no way to actually pin groups to accounts.

  *   New https://imgur.com/K4fN2Ax
  *   Old https://imgur.com/WuAvq4N

I was wondering if there is an alternative way to configure LDAP accounts?

Best regards,
Jordan

 

Re: noVNC not worked.

[David Jumani]

Hi carlcho,

Are you trying to enter fullscreen before the console has loaded ?

From: 조대형 
Sent: Friday, May 7, 2021 7:58 AM
To: users@cloudstack.apache.org 
Subject: noVNC not worked.

Hi, All.

Cloudstack 4.15



I have noVNC error. I can use console on Cloudstack.

Destroyed and restarted not worked.

System VMs are up and running.




  v-241-VM

Running

Up

consoleproxy





https://drive.google.com/file/d/1AR8ijZ9K3ZCseIM7069-
d589o8AM76gT/view?usp=sharing



Does anyone know how to fix it?


 

Re: VM console keeps pausing to the point of being unusable

[David Jumani]

I agree, try checking the number of concurrent connections as well as 
increasing the CPVM capacity.
Also check the network for any glitches / lag between the CPVM and the KVM hosts

From: Hean Seng 
Sent: Tuesday, May 4, 2021 4:03 PM
To: users@cloudstack.apache.org 
Subject: Re: VM console keeps pausing to the point of being unusable

Do you know how many concurrent access to VNC  from your user ?

Or you want to increase the Console Proxy Capacity?

Also, please make sure the console proxy Ip/Network is up when you having
issue on it.




On Tue, May 4, 2021 at 5:43 PM Adam Witwicki 
wrote:

> This bug is making cloudstack  completely unusable
>
> Is there a way to test VNC directly on KVM?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki
> Sent: 29 April 2021 14:04
> To: 'users@cloudstack.apache.org' 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> It didn’t go away forever, and now the same issue is back Same logs as
> before https://pastebin.com/YS6XCy6y
>
> Adam
> -Original Message-
> From: Adam Witwicki
> Sent: 27 April 2021 07:30
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Hi Nicolas,
>
> It was persisting over console systemVM destroy and creation, and any
> instance over 3 KVM hosts.
> Annoying we did not see the error in the console VM logs yesterday and
> users are reporting the console is currently working ok.
>
> Kind Regards
>
> Adam
>
> -Original Message-
> From: Nicolas Vazquez 
> Sent: 26 April 2021 21:26
> To: users@cloudstack.apache.org
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network. Treat
> hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> That's an error I've never hit before, does the issue persist after
> destroying and recreating the console proxy VM?
>
> Regards,
> Nicolas Vazquez
> 
> From: Adam Witwicki 
> Sent: Thursday, April 22, 2021 7:17 AM
> To: users@cloudstack.apache.org 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Paste is now working!
>
> Thanks
>
> Adam
>
> nicolas.vazq...@shapeblue.com
> www.shapeblue.com
> 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 22 April 2021 09:18
> To: users@cloudstack.apache.org
> Subject: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network. Treat
> hyperlinks and attachments in this email with caution. **
>
> Hello,
>
> We have an annoying issue, when using the cloudstack console to access a
> running instance the viewer will keep pausing every 10 to 15 mins, then its
> fine for a bit.
> I have found the cloud.log from the console proxy which is showing java
> exceptions queue full, could this be related?
>
> https://pastebin.com/YS6XCy6y
>
> CS version 4.13.1.0
>
> Any help appreciated
>
> Thanks
>
> Adam
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not guarantee
> that they are virus-free. You must therefore take full responsibility for
> virus checking.
> This message and any attachments are confidential and should only be read
> by those to whom they are addressed. If you are not the intended recipient,
> please contact us, delete the message from your computer and destroy any
> copies. Any distribution or copying without our prior permission is
> prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> The recipient is responsible for verifying its authenticity before acting
> on the contents. Any views or opinions presented are solely those of the
> author and do not necessarily represent those of Oakford Technology Limited.
> Registered address: Oakford Technology Limited, The Manor House, Potterne,
> Wiltshire. SN10 5PN.
> Registered in England and Wales No. 5971519
>
> Disclaimer Notice:
> This email has been sent by Oakford Technology Limited, while we have
> checked this e-mail and any attachments for viruses, we can not guarantee
> that they are virus-free. You must therefore take full responsibility for
> virus checking.
> This message and any attachments are confidential and should only be read
> by those to whom they are addressed. If you are not the intended recipient,
> please contact us, delete the message from your computer and destroy any
> copies. Any distribution or copying without our prior permission is
> prohibited.
> Internet communications are not always secure and therefore Oakford
> Technology Limited does not accept legal responsibility for this message.
> 

Re: VM console keeps pausing to the point of being unusable

[David Jumani]

You can follow the guide at https://github.com/novnc/noVNC

From: Adam Witwicki 
Sent: Tuesday, May 4, 2021 3:13 PM
To: users@cloudstack.apache.org 
Subject: RE: VM console keeps pausing to the point of being unusable

This bug is making cloudstack  completely unusable

Is there a way to test VNC directly on KVM?

Thanks

Adam


 


-Original Message-
From: Adam Witwicki
Sent: 29 April 2021 14:04
To: 'users@cloudstack.apache.org' 
Subject: RE: VM console keeps pausing to the point of being unusable

It didn’t go away forever, and now the same issue is back Same logs as before 
https://pastebin.com/YS6XCy6y

Adam
-Original Message-
From: Adam Witwicki
Sent: 27 April 2021 07:30
To: users@cloudstack.apache.org
Subject: RE: VM console keeps pausing to the point of being unusable

Hi Nicolas,

It was persisting over console systemVM destroy and creation, and any instance 
over 3 KVM hosts.
Annoying we did not see the error in the console VM logs yesterday and users 
are reporting the console is currently working ok.

Kind Regards

Adam

-Original Message-
From: Nicolas Vazquez 
Sent: 26 April 2021 21:26
To: users@cloudstack.apache.org
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam,

That's an error I've never hit before, does the issue persist after destroying 
and recreating the console proxy VM?

Regards,
Nicolas Vazquez

From: Adam Witwicki 
Sent: Thursday, April 22, 2021 7:17 AM
To: users@cloudstack.apache.org 
Subject: RE: VM console keeps pausing to the point of being unusable

Paste is now working!

Thanks

Adam

nicolas.vazq...@shapeblue.com
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK @shapeblue




-Original Message-
From: Adam Witwicki 
Sent: 22 April 2021 09:18
To: users@cloudstack.apache.org
Subject: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

We have an annoying issue, when using the cloudstack console to access a 
running instance the viewer will keep pausing every 10 to 15 mins, then its 
fine for a bit.
I have found the cloud.log from the console proxy which is showing java 
exceptions queue full, could this be related?

https://pastebin.com/YS6XCy6y

CS version 4.13.1.0

Any help appreciated

Thanks

Adam

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore 

Re: [VOTE] Renaming default git branch name from 'master' to 'main' and replace offensive words as appropriate for inclusiveness

[David Jumani]

+1
However I think it's better to rename it to leader / worker rather than primary 
/ secondary in the case of resources that follow such a paradigm like 
kubernetes, etc

From: Suresh Anaparti 
Sent: Friday, April 30, 2021 5:13 PM
To: d...@cloudstack.apache.org ; 
priv...@cloudstack.apache.org 
Cc: users@cloudstack.apache.org 
Subject: [VOTE] Renaming default git branch name from 'master' to 'main' and 
replace offensive words as appropriate for inclusiveness

Hi All,

Following the discussion thread on renaming default git branch name and 
inclusiveness [1], I would like to start a vote to gather consensus on the 
following plan:

1. Accept the following rename PRs (raised against 'master' branch) which 
renames git default branch to 'main' and replaces some offensive words, and 
Merge them post acceptance.
- cloudstack => PR: https://github.com/apache/cloudstack/pull/4922
- cloudstack-documentation => PR: 
https://github.com/apache/cloudstack-documentation/pull/155
- cloudstack-www => PR: https://github.com/apache/cloudstack-www/pull/83
- cloudstack-cloudmonkey => PR: 
https://github.com/apache/cloudstack-cloudmonkey/pull/76
- cloudstack-kubernetes-provider => PR: 
https://github.com/apache/cloudstack-kubernetes-provider/pull/29
- cloudstack-ec2stack => PR: 
https://github.com/apache/cloudstack-ec2stack/pull/2
- cloudstack-gcestack => PR: 
https://github.com/apache/cloudstack-gcestack/pull/3

2. Request ASF infra to disable pushes to 'master' branch.

3. Rename 'master' branch to 'main' [2][3], and Request ASF infra (open INFRA 
ticket) to make 'main' as the default branch [4], in GitHub repo settings for 
all the CloudStack repos. This will also re-target the current PRs against 
'master' branch to 'main'.

3a. The update on the central repo will be done as follows (only by a PMC or 
Infra member with access)
- Clone the repo (git clone https://github.com/apache/cloudstack.git)
- Sync local 'master' with the cloudstack repo (cd cloudstack && git 
checkout master && git fetch --all -p && git pull)
- Rename local 'master' branch to 'main' (git branch -m master main)
- Push renamed 'main' branch (git push -u origin main)
- Update Default Branch on GitHub [4]
- Delete 'master' branch (git push origin --delete master)
3b. After the central renaming has been done. New users can clone and directly 
checkout 'main' branch. Existing users can start using 'main' locally, using 
the below steps.
- Switch to master branch (git checkout master)
- Rename local 'master' branch to 'main' (git branch -m master main)
- Sync local 'main' with repo (git fetch)
- Remove the existing tracking connection with “origin/master” (git 
branch --unset-upstream)
- Create a new tracking connection with the new “origin/main” branch 
(git branch -u origin/main)
- All local branches should still point to the same commit as base 
revision. If there is a problem (git checkout  && git 
rebase main)

4. Update the integrated systems with CloudStack repos, mainly Travis CI and 
Jenkins configuration with 'main' branch. Check and update UI building, 
apidocs, systemvmtemplate builds; project website and docs (cwiki); and any 
other build/release jobs. Track them through the issue: 
https://github.com/apache/cloudstack/issues/4887.

5. Perform Health Checks (using a dummy PR), and ensure there are no issues 
with the build/release configuration. This PR needs to run full matrix of 
tests. Fix the issues noticed during the health checks.

6. Announce the default branch change to 'main' (and 'master' deprecation) on 
the mailing list.

The vote will be open until Fri 7th May 2021.

For sanity in tallying the vote, Can PMC members please be sure to indicate 
“(binding)” with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

[1] https://markmail.org/message/k767evgjnmzogyhf
[2] https://github.com/github/renaming
[3] 
https://docs.github.com/en/github/administering-a-repository/renaming-a-branch
[4] 
https://docs.github.com/en/github/administering-a-repository/changing-the-default-branch

Regards,
Suresh





 

Re: Missing Features in the new UI

[David Jumani]

Thanks for adding them to the issue Nicolas.
Inviting others to pitch in with the features they use which are missing in the 
new UI so we can take a call on whether to implement them.

From: Nicolas Vazquez 
Sent: Thursday, April 29, 2021 10:29 AM
To: users 
Subject: Re: Missing Features in the new UI

Thanks David.

I would like to include a few items in the list, the last one was not avaiable 
in the legacy UI but would be nice to have it:

  *   Add LDAP account button
  *   Link account to LDAP
  *   Import VMs (Vmware)

Regards,

Nicolas Vazquez


From: David Jumani 
Sent: Tuesday, April 27, 2021 7:36 AM
To: users 
Subject: Missing Features in the new UI

Hi,

I was going through the new UI and noticed that a few features are not yet 
implemented in the new UI which exist in the legacy UI and APIs exist in the 
backend (not sure whether they're still functional). I've made a list of them 
over at https://github.com/apache/cloudstack/issues/4937 and wanted to get 
feedback on whether there's a need or sufficient users who still use them to 
implement them in the new UI. The primary ones are :
  *

  *   Global Server Load Balancing Support 
http://docs.cloudstack.apache.org/en/latest/adminguide/networking/global_server_load_balancing.html
  *   AutoScale without Netscaler 
http://docs.cloudstack.apache.org/en/latest/adminguide/autoscale_without_netscaler.html
  *   Override default traffic label for VMware with nexus / dvswitch when 
adding a cluster

If anyone is still using them, please shoutout so a call can be taken whether 
to implement them in the new UI or not









 

Missing Features in the new UI

[David Jumani]

Hi,

I was going through the new UI and noticed that a few features are not yet 
implemented in the new UI which exist in the legacy UI and APIs exist in the 
backend (not sure whether they're still functional). I've made a list of them 
over at https://github.com/apache/cloudstack/issues/4937 and wanted to get 
feedback on whether there's a need or sufficient users who still use them to 
implement them in the new UI. The primary ones are :
  *

  *   Global Server Load Balancing Support 
http://docs.cloudstack.apache.org/en/latest/adminguide/networking/global_server_load_balancing.html
  *   AutoScale without Netscaler 
http://docs.cloudstack.apache.org/en/latest/adminguide/autoscale_without_netscaler.html
  *   Override default traffic label for VMware with nexus / dvswitch when 
adding a cluster

If anyone is still using them, please shoutout so a call can be taken whether 
to implement them in the new UI or not



 

Re: VM console keeps pausing to the point of being unusable

[David Jumani]

Hi Adam,

Looking at the logs it appears that there could be a lag in the network which 
can lead to the queue filling up because it is unable to send all the events in 
time, or that there are too many events to process so maybe don't be too 
aggressive with the mouse.
It also looks like the socket gets closed which could again point to a network 
issue.
It also appears that you switched from the old console to the newer novnc 
console (since you mentioned paste), so are you facing the same issues with the 
novnc console as well ?

From: Adam Witwicki 
Sent: Thursday, April 22, 2021 3:47 PM
To: users@cloudstack.apache.org 
Subject: RE: VM console keeps pausing to the point of being unusable

Paste is now working!

Thanks

Adam

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 


-Original Message-
From: Adam Witwicki 
Sent: 22 April 2021 09:18
To: users@cloudstack.apache.org
Subject: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hello,

We have an annoying issue, when using the cloudstack console to access a 
running instance the viewer will keep pausing every 10 to 15 mins, then its 
fine for a bit.
I have found the cloud.log from the console proxy which is showing java 
exceptions queue full, could this be related?

https://pastebin.com/YS6XCy6y

CS version 4.13.1.0

Any help appreciated

Thanks

Adam

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Disclaimer Notice:
This email has been sent by Oakford Technology Limited, while we have checked 
this e-mail and any attachments for viruses, we can not guarantee that they are 
virus-free. You must therefore take full responsibility for virus checking.
This message and any attachments are confidential and should only be read by 
those to whom they are addressed. If you are not the intended recipient, please 
contact us, delete the message from your computer and destroy any copies. Any 
distribution or copying without our prior permission is prohibited.
Internet communications are not always secure and therefore Oakford Technology 
Limited does not accept legal responsibility for this message. The recipient is 
responsible for verifying its authenticity before acting on the contents. Any 
views or opinions presented are solely those of the author and do not 
necessarily represent those of Oakford Technology Limited.
Registered address: Oakford Technology Limited, The Manor House, Potterne, 
Wiltshire. SN10 5PN.
Registered in England and Wales No. 5971519

Re: noVNC console reuqest using curl

[David Jumani]

Hi,

Looks like the signature generation was an issue
This should work and generate the right signature

http://csurl:8080/client/console';
$apiKey = 
'SH3j2o3CLpKKAUHc1ubTsiHEdchITQRhzgv7Fjt4-0I4bcKmTn6E9Y6GNCrke_hpYgFlGyIA';

function getSignature($queryString) {
$secretKey = 
'5nyeq6svs47WjTTAsXHmFmV2ZOT7fJakuDL9raSjmeQXaP_irOH-n6DW2zAl9Q';
$hash = hash_hmac("sha1", $queryString, $secretKey, true);
$base64encoded = base64_encode($hash);
return urlencode($base64encoded);
}

$arg['apikey'] = $apiKey;
$arg['cmd'] = 'access';
$arg['vm'] = 'd692f12c-80d7-33b4-a880-224d3239a527';

//ksort($arg);
$query2 = http_build_query($arg);
$query2 = str_replace("+", "%20", $query2);
$query2 .= "=" . getSignature(strtolower($query2));

echo $query2

?>

You can check the signature with the management server logs

2021-03-31 04:03:58,279 DEBUG [c.c.s.ConsoleProxyServlet] 
(qtp1233705144-520:null) (logid:) User signature: OwUEVSBqVPv9lv4ZIR6yfhg CFo= 
is not equaled to computed signature: OwUEVSBqVPv9lv4ZIR6yfhg+CFo=

>From the response, you can get the URL of the console session from an iframe 
>in the response

my-vmhttp://10.0.0.0/resource/noVNC/vnc.html?port=8080=cgSFHGdXY502cfW-rkXhbPpE436L8ndmF4Dd2R2xb1SlVHGIoCmCMFvnZXCPTSm8X7KQ6BFtyswc_Ias5NndQk6BIEPGXBSlQ6kZuL6GnrqIiRl70tb3Yq_2jKQRJMR7ix4ghVEoSK-5w6PhmLzCeNZC4NcX3ir4h0SY_Y9jfxqBT5fIOiLnM3F8uQWYjof6FcdwjPb0vhqDKMWlwhQNxRKBOGqKlkv0J3XVl_y86jTDaK8PL6d2BOD5kqS7NS_HFcKhFwLldiZONRZCxjOtECS7tsCyCqXLJFFSdeiaJuYhttp://94.156.173.24/resource/noVNC/vnc.html?port=8080=cgSFHGdXY502cfW-rkXhbPpE436L8ndmF4Dd2R2xb1SlVHGIoCmCMFvnZXCPTSm8X7KQ6BFtyswc_Ias5NndQk6BIEPGXBSlQ6kZuL6GnrqIiRl70tb3Yq_2jKQRJMR7ix4ghVEoSK-5w6PhmLzCeNZC4NcX3ir4h0SY_Y9jfxqBT5fIOiLnM3F8uQWYjof6FcdwjPb0vhqDKMWlwhQNxRKBOGqKlkv0J3XVl_y86jTDaK8PL6d2BOD5kqS7NS_HFcKhFwLldiZONRZCxjOtECS7tsCyCqXLJFFSdeiaJuY>">




From: Dinesh Mohanty 
Sent: Wednesday, March 31, 2021 4:15 PM
To: users@cloudstack.apache.org 
Subject: Re: noVNC console reuqest using curl

Hi,

I tried this and have same issue with CS 4.15:

http://csurl:8080/client/console'; 
[http://csurl:8080/client/console';]
$apiKey = 
'SH3j2o3CLpKKAUHc1ubTsiHEdchITQRhzgv7Fjt4-0I4bcKmTn6E9Y6GNCrke_hpYgFlGyIA';
$secretKey = '5nyeq6svs47WjTTAsXHmFmV2ZOT7fJakuDL9raSjmeQXaP_irOH-n6DW2zAl9Q';

function getSignature($queryString) {
$hash = @hash_hmac("SHA1", $queryString, $secretKey, true);
$base64encoded = base64_encode($hash);
return urlencode($base64encoded);
}

$arg['cmd'] = 'access';
$arg['vm'] = 'd692f12c-80d7-33b4-a880-224d3239a527';
$arg['apikey'] = $apiKey;

//ksort($arg);
$query2 = http_build_query($arg);
$query2 = str_replace("+", "%20", $query2);
$query2 .= "=" . getSignature(strtolower($query2));

$ch2 = curl_init();
curl_setopt($ch2, CURLOPT_URL, $endpoint); //$url
curl_setopt($ch2, CURLOPT_RETURNTRANSFER, 1);
curl_setopt($ch2, CURLOPT_TIMEOUT, '3');

curl_setopt($ch2, CURLOPT_CUSTOMREQUEST, "POST");
curl_setopt($ch2, CURLOPT_SSL_VERIFYPEER, false);
curl_setopt ($ch2, CURLOPT_POSTFIELDS, $query2);
curl_setopt ($ch2, CURLOPT_POST, 1);

$headers = array();
$headers[] = 'Content-Type: application/x-www-form-urlencoded';
curl_setopt($ch2, CURLOPT_HTTPHEADER, $headers);

curl_setopt($ch2, CURLOPT_VERBOSE, true);
curl_setopt($ch2, CURLOPT_STDERR, fopen(dirname(__FILE__).'/errorlog.txt', 
'w'));

$json2 = curl_exec($ch2);
if (curl_errno($ch2)) {
$json2 = json_encode(array('createdomainresponse' => array('errortext' => 
curl_error($ch2;
}
curl_close($ch2);
$response2 = json_decode($json2, true);


echo '';
print_r($json2);
echo '';

Access denied. Invalid web session or API key in request

On 2021/03/31 06:31:13, Alireza Eskandari wrote:
> There is no official document about getting console of VM so you can use>
> this workflow (notice that this works for old console):>
> You don't need to call login API method. Just POST a request with these>
> parameters:>
> cmd=access===>
> to this endpoint:>
> http:///client/console>
> (Note that API endpoint of CloudStack is: http://>
> /client/api)>
> You will get a response like this:>
> vm-name>
>
> From the above response we should provide a pop up or new tab for “src”>
> attribute of “frame” tag>
> which is:>
> http://xxx.xxx.xxx.xxx/ajax?token=hL2gz4eojpms9DpGyj0YmeCREvL_I8_AigH1CfWiwXKbiPK55507CZsjj1LT4cK1y8XQ_YeLS0gx3M2WC7Kch0JoTIjGEl0yOB6LOyOwDhVQ6WgYzRAglDeTtIYCvgU8glQLpWYl7FLhqhtB0MhwwGeAI6qokK1YWqznplNhBgz5L3I0vMFuNAuaKsmKn3JepAuc1OKnizO4t9tmp9WgZYGhXiq13W3ZBAYUs1bgxPKKoPTC24_W2bMCVZA8YcePamU1ww5atI5hhXjaywRw>
>
> On Tue, Mar 30, 2021 at 11:34 PM WHMCSModule Networks Support <>
> supp...@whmcsmodule.net> wrote:>
>
> > Hi Team,>
> >>
> >>
> > As title said how to achive this part i.e using curl request get the novnc>
> > access.>
> >>
> > Till now:>
> > I got user session key from user login>
> >>
> > say:>
> > Array ( [loginresponse] => Array ( [username] => admin [userid] =>>
> > f8fc2819-863a-11eb-8ae3-005056bd05cc [domainid] =>>
> > 

Re: Overprovisioning consideration in metrics API response

[David Jumani]

+1 on this. Allocated should consider overprovisioning!

From: Rohit Yadav 
Sent: Wednesday, March 31, 2021 3:30 PM
To: d...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Subject: Re: Overprovisioning consideration in metrics API response

Thanks for starting this thread Abhishek. I think all 'allocated' API response 
keys (irrespective of type such as CPU, RAM, storage/disk etc) across all 
list/metrics APIs should consider overprovisioning factor.

For example, if the total resource value/limit is 100 and overprovisioning 
factor is 1.5 that means CloudStack can effectively allocate 1.5*100=150 of 
that resource, which in actual or physical value is (allocated value / 
over-provisioning factor). Let me add user@ ML to hear if users agree with my 
interpretation of allocated values/metrics.


Regards.


From: Abhishek Kumar 
Sent: Wednesday, March 31, 2021 13:31
To: d...@cloudstack.apache.org 
Subject: Overprovisioning consideration in metrics API response

Hi devs,

There have been recurring issues and changes for API responses not considering 
the over-provisioning factor while reporting metrics for hosts, clusters, etc.
https://github.com/apache/cloudstack/issues/4778
https://github.com/apache/cloudstack/pull/4850
https://github.com/apache/cloudstack/pull/4499

While some of the metric parameters doesn't consider overprovisioning at all, 
some give value in the format- "memorytotalgb": "6.78 GB (x 1.0)".​
So, to address this should we consider a code/API-wide change?
And while fixing it should we introduce new parameters such as - 
cputotalwithoverprovisioning, memorytotalwithoverprovisioning, etc or should we 
apply the overprovisioning factors to the existing response parameters?
Please share your thoughts.

Regards,
Abhishek

abhishek.ku...@shapeblue.com
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue




rohit.ya...@shapeblue.com
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue




david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Congratulations to Sven - Apache Software Foundation Member

[David Jumani]

Congratulations Sven!

From: Paul Angus 
Sent: Thursday, March 18, 2021 2:43 AM
To: d...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Subject: Congratulations to Sven - Apache Software Foundation Member

Hi All,



More great news.



Please join me in congratulating Sven,  for being made a Member of the
Apache Software Foundation.



Congratulations Sven, keep up the good work!



Kind regards



Paul Angus




david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Congratulations to Gabriel - CloudStack PMC Chair

[David Jumani]

Congratulations Gabriel !

From: Paul Angus 
Sent: Thursday, March 18, 2021 2:40 AM
To: d...@cloudstack.apache.org ; 
users@cloudstack.apache.org 
Cc: priv...@cloudstack.apache.org 
Subject: Congratulations to Gabriel - CloudStack PMC Chair

Hi All CloudStack enthusiasts!



Please join me in congratulating Gabriel for becoming the next CloudStack
PMC Chair.

Congratulations Gabriel, very well deserved!



I would also like to thank Sven for his great work of the past year!







Kind regards



Paul Angus




david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Goggle Summer of Code 2021

[David Jumani]

Hi Boris,

+1 on the idea and I'm happy to co-mentor wrt the coding part

From: Boris Stoyanov 
Sent: Monday, March 15, 2021 1:07 PM
To: d...@cloudstack.apache.org 
Cc: users@cloudstack.apache.org ; 
priv...@cloudstack.apache.org 
Subject: Re: Goggle Summer of Code 2021

Hi Giles and all,

I’d like to propose some improvements in the UI around user experience. I think 
it’ll be great if users can navigate around just using keyboards, meaning go to 
different pages, confirm dialogues and submit forms without the use of mouse.

Here’s a detailed description of the feature: 
https://github.com/apache/cloudstack/issues/4798

As far as mentorship, I’m happy to take part on the ideas/requirements side of 
the feature, but we’ll need a volunteer for the coding part.

Thanks,
Bobby.

From: Giles Sirett 
Date: Tuesday, 16 February 2021, 11:30
To: d...@cloudstack.apache.org 
Cc: users@cloudstack.apache.org , 
priv...@cloudstack.apache.org 
Subject: Goggle Summer of Code 2021
Hi all

It would be great if the CloudStack project were able to get a few Google 
Summer of Code  [1] students this year to work on projects within our 
community. We've had a number of previous GSoC students (examples at [2] ), who 
have worked on innovative features/ projects within cloudstack and have then 
gone on to become significant contributors to Cloudstack .


In order to be able to attract students to work on Cloudstack, we need 2 things:

  1.  A number of candidate projects for students to work on. Students browse 
all GSoC the candidate projects and choose one that interests them- effectively 
every organisation is competing for the students interest.  These projects 
therefore need to be reasonably interesting looking projects to attract 
potential students. The students spend approximately 9 weeks coding, so the 
projects need to be appropriately scaled
  2.  Somebody prepared to mentor the student throughout the duration of the 
project (usually the person who suggests the project)

The student application period starts 29 March [3]
The ASF  has registered itself as a mentor  organisation with Google , allowing 
individual Apache projects to list candidate projects  for students to work on. 
A wiki page [4]  has been created at the ASF level to allow ASF projects to  
list their ideas for students


I'm happy to coordinate this from a Cloudstack perspective.
If others are happy with this approach, then I ask for two things at this stage:


  1.  Could people suggest appropriate projects. This could be a piece of 
integration that you've always considered and not got around to or could be an 
improvement that you've always wanted to do. If people can reply to this thread 
with ANY ideas, it would be a good start (irrespective of whether you wish to 
be a mentor or not)
  2.  At the same time, could people say whether they'd be prepared to be a 
student mentor or not




[1] https://summerofcode.withgoogle.com/


[2]
https://blog.netapp.com/blogs/mentoring-with-google-summer-of-code-and-lessons-in-cloudstack/
https://dzone.com/articles/cloudstack-google-summer-code
https://opensource.googleblog.com/2014/07/gsoc-students-create-google-compute.html


[3]https://summerofcode.withgoogle.com/how-it-works/#timeline

[4] https://cwiki.apache.org/confluence/display/COMDEV/GSoC+2021+Ideas+list



Kind regards
Giles


giles.sir...@shapeblue.com
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue



boris.stoya...@shapeblue.com
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue




david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Goggle Summer of Code 2021

[David Jumani]

Hi,

I'd like to propose the idea of allowing the user to set multiple SSH keys for 
a VM rather than just a single one via the API.
It would be simple enough to complete within the timeframe for someone new to 
the project as well as be a great addition to ACS

Thanks,
David

From: Giles Sirett 
Sent: Tuesday, February 16, 2021 2:59 PM
To: d...@cloudstack.apache.org 
Cc: users@cloudstack.apache.org ; 
priv...@cloudstack.apache.org 
Subject: Goggle Summer of Code 2021

Hi all

It would be great if the CloudStack project were able to get a few Google 
Summer of Code  [1] students this year to work on projects within our 
community. We've had a number of previous GSoC students (examples at [2] ), who 
have worked on innovative features/ projects within cloudstack and have then 
gone on to become significant contributors to Cloudstack .


In order to be able to attract students to work on Cloudstack, we need 2 things:

  1.  A number of candidate projects for students to work on. Students browse 
all GSoC the candidate projects and choose one that interests them- effectively 
every organisation is competing for the students interest.  These projects 
therefore need to be reasonably interesting looking projects to attract 
potential students. The students spend approximately 9 weeks coding, so the 
projects need to be appropriately scaled
  2.  Somebody prepared to mentor the student throughout the duration of the 
project (usually the person who suggests the project)

The student application period starts 29 March [3]
The ASF  has registered itself as a mentor  organisation with Google , allowing 
individual Apache projects to list candidate projects  for students to work on. 
A wiki page [4]  has been created at the ASF level to allow ASF projects to  
list their ideas for students


I'm happy to coordinate this from a Cloudstack perspective.
If others are happy with this approach, then I ask for two things at this stage:


  1.  Could people suggest appropriate projects. This could be a piece of 
integration that you've always considered and not got around to or could be an 
improvement that you've always wanted to do. If people can reply to this thread 
with ANY ideas, it would be a good start (irrespective of whether you wish to 
be a mentor or not)
  2.  At the same time, could people say whether they'd be prepared to be a 
student mentor or not




[1] https://summerofcode.withgoogle.com/


[2]
https://blog.netapp.com/blogs/mentoring-with-google-summer-of-code-and-lessons-in-cloudstack/
https://dzone.com/articles/cloudstack-google-summer-code
https://opensource.googleblog.com/2014/07/gsoc-students-create-google-compute.html


[3]https://summerofcode.withgoogle.com/how-it-works/#timeline

[4] https://cwiki.apache.org/confluence/display/COMDEV/GSoC+2021+Ideas+list



Kind regards
Giles


giles.sir...@shapeblue.com
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue




david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: primate ui logo

[David Jumani]

Hi Pitor,

You can change the values of 'banner' and 'logo' to point to the new images in 
the UI config file over at `/usr/share/cloudstack-management/webapp/config.json`
The docs to customize the new UI can be found here
http://docs.cloudstack.apache.org/en/latest/adminguide/ui.html#basic-ui-customization

Thanks,
David

From: Piotr Pisz 
Sent: Thursday, February 4, 2021 2:01 AM
To: users@cloudstack.apache.org 
Subject: primate ui logo

Hello!



Is it possible to replace the logo in the new UI (primate)?

On login screen and in the upper left corner.



Best regards,

Piotr




david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Ubuntu 20.04 - Management Server

[David Jumani]

Hi Roy,

Support was added a few months ago via 
https://github.com/apache/cloudstack/pull/4068

It will be supported in the next release of CloudStack

Thanks,
David

From: Roy Ward 
Sent: Wednesday, December 9, 2020 2:35 PM
To: users@cloudstack.apache.org 
Subject: Ubuntu 20.04 - Management Server

Good morning,

Could anyone tell me whether Ubuntu 20.04 is supported for the Cloudstack
management server.

This link suggests that anything above Ubuntu 16.04:
http://docs.cloudstack.apache.org/en/latest/installguide/overview/index.html#minimum-system-requirements

However, this Github post suggests that it is a work in progress:
https://github.com/apache/cloudstack/issues/4081

Any information will be gratefully received.

Thanks.

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: New Joiner

[David Jumani]

Welcome Hoang!

Thanks,
David

From: Unitech Mai Nguyen 
Sent: Wednesday, November 4, 2020 8:01 AM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Cc: sven.vo...@qform.de 
Subject: New Joiner

Hello Everyone,

My name is Hoang and I'm currently working for Ewerk.
It is my great pleasure to have a chance to join the Cloudstack Primate project.
It has been a wonderful time for me since last December when I started my first 
task.

I would look forward to being a part of this team for a long time to go. And I 
hope to have your kind help.
Thank you so much.
__
Hoang Nguyen
Frontend Developer

EWERK DIGITAL GmbH
Brühl 24, D-04109 Leipzig
P +49 341 42649 - 99
F +49 341 42649 - 98
www.ewerk.xn--com-zq0a

Geschäftsführer:
Dr. Erik Wende, Hendrik Schubert, Frank Richter
Registergericht: Leipzig HRB 9065

Zertifiziert nach:
ISO/IEC 27001:2013
DIN EN ISO 9001:2015
DIN ISO/IEC 2-1:2011

__

Unitech Mai Nguyen
Frontend Developer

EWERK DIGITAL GmbH
Brühl 24, D-04109 Leipzig
P
F +49 341 42649 - 98
hoang.ngu...@ewerk.com
www.ewerk.com

Geschäftsführer:
Dr. Erik Wende, Hendrik Schubert, Tassilo Möschke
Registergericht: Leipzig HRB 9065

Support:
+49 341 42649 555

Zertifiziert nach:
ISO/IEC 27001:2013
DIN EN ISO 9001:2015
DIN ISO/IEC 2-1:2011

ISAE 3402 Typ II Assessed

EWERK-Blog | 
LinkedIn | 
Xing | 
Twitter | 
Facebook


Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.

Disclaimer Privacy:
Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist 
vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der 
bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, 
Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte 
informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die 
E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen 
Dank.

The contents of this e-mail (including any attachments) are confidential and 
may be legally privileged. If you are not the intended recipient of this 
e-mail, any disclosure, copying, distribution or use of its contents is 
strictly prohibited, and you should please notify the sender immediately and 
then delete it (including any attachments) from your system. Thank you.

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Triage Permission on GitHub

[David Jumani]

Hi,

I'd like to let everyone know about the Triage permission on GitHub, which 
allows non-commiters to manage issues and PRs on the CloudStack repository.
Right now, there are community members who have been granted this permission, 
and I'd like to suggest that others who would like the triage permission to 
boldly request it. It requires community / PMC approval followed by an infra 
ticket raised on the apache Jira, similar to this 
https://issues.apache.org/jira/browse/INFRA-20855
Request and approval can be gotten by shooting out a mail mentioning your 
GitHub handle in the mailing list, preferably as part of this mail chain to 
make it easier to pass on a consolidated to the infrastructure team to reduce 
complications and to speed up the process.

Thanks and happy Triaging!
David

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Hypervisor Capabilities - KVM 50

[David Jumani]

I'm not too sure about it but you can find the documentation here
https://cloudstack.apache.org/api/apidocs-4.14/apis/listHypervisorCapabilities.html

From: Hean Seng 
Sent: Tuesday, October 20, 2020 12:36 PM
To: users@cloudstack.apache.org 
Subject: Re: Hypervisor Capabilities - KVM 50

Hi

Thanks for reply.

How abount  the maxdatavolumeslimit ,  is that means the max data storage
PerVM  ? or in KVM cluster

On Tue, Oct 20, 2020 at 2:06 PM David Jumani 
wrote:

> Hi Hean,
>
> It means the max number of Guest VMs per host for this hypervisor
>
> It can be updated via the updateHypervisorCapabilities API
>
> update hypervisorcapabilities id=13 maxguestslimit=51
> {
>   "null": {
> "hypervisor": "KVM",
> "hypervisorversion": "default",
> "id": "13",
> "maxdatavolumeslimit": 32,
> "maxguestslimit": 51,
> "securitygroupenabled": true,
> "storagemotionenabled": true
>   }
> }
>
> Thanks,
> David
> 
> From: Hean Seng 
> Sent: Tuesday, October 20, 2020 11:30 AM
> To: users@cloudstack.apache.org 
> Subject: Hypervisor Capabilities - KVM 50
>
> HI
>
> I saw Hypervisor Capabilities of KVM set to 50 .
>
> Is that means 50VM in one Host only ?  Or one Cluster of KVM can configure
> 50 Hypervisor Host.
>
> How possible to edit this value ?
>
>
> --
> Regards,
> Hean Seng
>
> david.jum...@shapeblue.com
> www.shapeblue.com<http://www.shapeblue.com>
> 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> @shapeblue
>
>
>
>

--
Regards,
Hean Seng

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Hypervisor Capabilities - KVM 50

[David Jumani]

Hi Hean,

It means the max number of Guest VMs per host for this hypervisor

It can be updated via the updateHypervisorCapabilities API

update hypervisorcapabilities id=13 maxguestslimit=51
{
  "null": {
"hypervisor": "KVM",
"hypervisorversion": "default",
"id": "13",
"maxdatavolumeslimit": 32,
"maxguestslimit": 51,
"securitygroupenabled": true,
"storagemotionenabled": true
  }
}

Thanks,
David

From: Hean Seng 
Sent: Tuesday, October 20, 2020 11:30 AM
To: users@cloudstack.apache.org 
Subject: Hypervisor Capabilities - KVM 50

HI

I saw Hypervisor Capabilities of KVM set to 50 .

Is that means 50VM in one Host only ?  Or one Cluster of KVM can configure
50 Hypervisor Host.

How possible to edit this value ?


--
Regards,
Hean Seng

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: metadata on VR

[David Jumani]

It could be because the key has been deleted on Cloudstack. Checking the logs 
could verify that

From: m...@swen.io 
Sent: Thursday, October 15, 2020 2:07 PM
To: users@cloudstack.apache.org 
Subject: AW: metadata on VR

Hi,

any idea why a public key which is not in the db is put into the public-keys
file on the VR?

Swen

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 


-Ursprüngliche Nachricht-
Von: David Jumani 
Gesendet: Mittwoch, 14. Oktober 2020 14:30
An: users@cloudstack.apache.org
Betreff: Re: metadata on VR

Hi Cu,

The database stores the MD5 fingerprint of the key. Could you check the
fingerprint on the VR via

ssh-keygen -E md5 -lf publick-keys

Thanks,
David

From: m...@swen.io 
Sent: Wednesday, October 14, 2020 5:26 PM
To: users@cloudstack.apache.org 
Subject: AW: metadata on VR

Hi David,

thx for getting back so fast. That is what I thought too.
Now the problem is that in the file public-keys is a key that is not in the
database. It should be in the table ssh_keypairs, correct?
When I do a ssh-keygen -lf public-keys on the file in the VR the fingerprint
did not match any fingerprint in the ssh_keypairs table.

I am wondering where the key in the public-keys file comes from.

Cu Swen



david.jum...@shapeblue.com
www.shapeblue.com<http://www.shapeblue.com>
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue




-Ursprüngliche Nachricht-
Von: David Jumani 
Gesendet: Mittwoch, 14. Oktober 2020 12:19
An: users@cloudstack.apache.org
Betreff: Re: metadata on VR

Hi,

The file contents are written by vmdata.py itself. The public keys are sent
to the router by the management server when the ssh key is reset.
The vmdata.py file receives this and a method 'createFile' is internally
called which writes the relevant data in the respective file in the folder.

Thanks,
David

From: m...@swen.io 
Sent: Wednesday, October 14, 2020 3:34 PM
To: users@cloudstack.apache.org 
Subject: metadata on VR

Hi all,



I have a question regarding the metadata on virtual routers. We are running
an older version, so I am not sure if path or script are being renamed or
changed.

I see that CS is creating /var/www/html/metadata// on the VR for all VMs
in the network.

As far as I understand this script is creating the folders:
/opt/cloud/bin/vmdata.py



But I am unable to find which script is creating the files with content
inside this folder.

In particular I need to know what is creating the file public-keys where the
content of this file is from.



Thank you for any help!



Cu Swen




david.jum...@shapeblue.com
www.shapeblue.com<http://www.shapeblue.com>
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue

Re: metadata on VR

[David Jumani]

Hi Cu,

The database stores the MD5 fingerprint of the key. Could you check the 
fingerprint on the VR via

ssh-keygen -E md5 -lf publick-keys

Thanks,
David

From: m...@swen.io 
Sent: Wednesday, October 14, 2020 5:26 PM
To: users@cloudstack.apache.org 
Subject: AW: metadata on VR

Hi David,

thx for getting back so fast. That is what I thought too.
Now the problem is that in the file public-keys is a key that is not in the 
database. It should be in the table ssh_keypairs, correct?
When I do a ssh-keygen -lf public-keys on the file in the VR the fingerprint 
did not match any fingerprint in the ssh_keypairs table.

I am wondering where the key in the public-keys file comes from.

Cu Swen



david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 


-Ursprüngliche Nachricht-
Von: David Jumani 
Gesendet: Mittwoch, 14. Oktober 2020 12:19
An: users@cloudstack.apache.org
Betreff: Re: metadata on VR

Hi,

The file contents are written by vmdata.py itself. The public keys are sent to 
the router by the management server when the ssh key is reset.
The vmdata.py file receives this and a method 'createFile' is internally called 
which writes the relevant data in the respective file in the folder.

Thanks,
David

From: m...@swen.io 
Sent: Wednesday, October 14, 2020 3:34 PM
To: users@cloudstack.apache.org 
Subject: metadata on VR

Hi all,



I have a question regarding the metadata on virtual routers. We are running an 
older version, so I am not sure if path or script are being renamed or changed.

I see that CS is creating /var/www/html/metadata// on the VR for all VMs in 
the network.

As far as I understand this script is creating the folders:
/opt/cloud/bin/vmdata.py



But I am unable to find which script is creating the files with content inside 
this folder.

In particular I need to know what is creating the file public-keys where the 
content of this file is from.



Thank you for any help!



Cu Swen




david.jum...@shapeblue.com
www.shapeblue.com<http://www.shapeblue.com>
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK @shapeblue

Re: metadata on VR

[David Jumani]

Hi,

The file contents are written by vmdata.py itself. The public keys are sent to 
the router by the management server when the ssh key is reset.
The vmdata.py file receives this and a method 'createFile' is internally called 
which writes the relevant data in the respective file in the folder.

Thanks,
David

From: m...@swen.io 
Sent: Wednesday, October 14, 2020 3:34 PM
To: users@cloudstack.apache.org 
Subject: metadata on VR

Hi all,



I have a question regarding the metadata on virtual routers. We are running
an older version, so I am not sure if path or script are being renamed or
changed.

I see that CS is creating /var/www/html/metadata// on the VR for all VMs
in the network.

As far as I understand this script is creating the folders:
/opt/cloud/bin/vmdata.py



But I am unable to find which script is creating the files with content
inside this folder.

In particular I need to know what is creating the file public-keys where the
content of this file is from.



Thank you for any help!



Cu Swen




david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

[DISCUSS] CloudStack Kubernetes Cluster Auto-Scaler support

[David Jumani]

Hi,

I'm currently working on adding support for CloudStack as a cloud provider for 
Kubernetes to allow it to dynamically scale the cluster size based on capacity 
requirements.
It runs as a separate pod in its own deployment and requires an API and Secret 
key to communicate with CloudStack.

While that's going on, I'd like some feedback on how it can be integrated and 
even deployed from the CloudStack side. I have three proposals and would like 
your input :

  1.  Provide the deployment yaml file to the user, have them change the min 
and max cluster size to suit their requirement, provide the API keys as 
Kubernetes secrets and deploy it themselves. (Most flexible as the user can 
change several autoscaling parameters as well)
  2.  Deploy it via the scaleKubernetesCluster API. This will require adding 
additional parameters to the API such as minsize, maxsize, apikey and secretkey 
for the service to communicate with CloudStack. (Uses default autoscaling 
parameters, api keys provided by the user)
  3.  Deploy it via the scaleKubernetesCluster API, but also create a service 
account and use its API keys to communicate with CloudStack. The user will 
still need to provide the minsize and maxsize to the API. (Uses default 
autoscaling parameters, api keys generated and used by a service account, which 
if deleted could cause issues)

The design document can be found here :
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Cluster+Autoscaler+for+CloudStack+Kubernetes+Service

Additional info can be found here :
https://github.com/kubernetes/autoscaler/blob/master/cluster-autoscaler/FAQ.md

Look forward to hearing from you!

Thanks,
David


david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: VM not created in LocalStorage

[David Jumani]

Thanks for reporting the issue Hean. A PR to fix it has been created
https://github.com/apache/cloudstack-primate/pull/739

From: Hean Seng 
Sent: Wednesday, September 23, 2020 1:12 PM
To: users@cloudstack.apache.org ; Rafael del Valle 

Subject: Re: VM not created in LocalStorage

Really the bug of Primate (  i updated yesterday )

I found that 2 value not updated even key in in Service offering

One of that is Network Rate = nw_rate

another one is. localdisk

update disk_offering set use_local_storage=1 where id=53




I manual update it to 1 and create VM, it seems ok



On Wed, Sep 23, 2020 at 3:39 PM Rafael del Valle 
wrote:

> Hi Hean,
>
> Yes, I check the UI and when I display the offering it reads:
>
> Storage Typelocal
>
>
> Rafael
>
>
>
> On Wed, 2020-09-23 09:20 AM, Hean Seng  wrote:
> > I created compute offering , select Local, but after created the
> offering,
> > i click back and see the detail
> >
> > Storage Type
> > shared
> >
> > It still show Storage Type Share, may be update to db wrong ?
> >
> >
> >
> > On Wed, Sep 23, 2020 at 3:13 PM Rafael del Valle "
> target="_blank">
> > wrote:
> >
> > > Hi Hean,
> > >
> > > Did you create a Compute offering with local storage?
> > >
> > > I found that I had to create both compute and storage offerings with
> local
> > > storage enabled, and this was not obvious in documentation. At least in
> > > 4.14. This was before managed through configuration, i think.
> > >
> > > Rafael
> > >
> > > On Wed, 2020-09-23 09:09 AM, Hean Seng " target="_blank"><
> heans...@gmail.com> wrote:
> > > > Hi
> > > >
> > > > I creating another cluster with 1 hpervisor host and local storage.
> > > >
> > > > After successfully added hypervisor, the localstorage is
> automatically
> > > > recognized at Primary Storage , it show up .
> > > >
> > > > I proceed to create a VM, and choose to the this new cluster that
> just
> > > > create, and seems VM is not successfully create. Following is log ,
> seems
> > > > unable to find storage.
> > > >
> > > > Any one know what is the issue of ?
> > > >
> > > > 2020-09-23 03:03:13,205 DEBUG [c.c.n.NetworkModelImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > > Service SecurityGroup is not supported in the network id=229
> > > >
> > > > 2020-09-23 03:03:13,212 DEBUG [c.c.n.NetworkModelImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > > Service SecurityGroup is not supported in the network id=229
> > > >
> > > > 2020-09-23 03:03:13,216 DEBUG [c.c.v.UserVmManagerImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > > Destination Host to deploy the VM is specified, specifying a
> deployment
> > > > plan to deploy the VM
> > > >
> > > > 2020-09-23 03:03:13,239 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > > DeploymentPlanner allocation algorithm: null
> > > >
> > > > 2020-09-23 03:03:13,239 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > > Trying to allocate a host and storage pools from dc:4,
> pod:4,cluster:10,
> > > > requested cpu: 500, requested ram: 524288000
> > > >
> > > > 2020-09-23 03:03:13,239 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > Is
> > > > ROOT volume READY (pool already allocated)?: No
> > > >
> > > > 2020-09-23 03:03:13,239 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > > DeploymentPlan has host_id specified, choosing this host and making
> no
> > > > checks on this host: 9
> > > >
> > > > 2020-09-23 03:03:13,240 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > > Looking for suitable pools for this host under zone: 4, pod: 4,
> cluster:
> > > 10
> > > >
> > > > 2020-09-23 03:03:13,244 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > > Checking suitable pools for volume (Id, Type): (65,ROOT)
> > > >
> > > > 2020-09-23 03:03:13,244 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > We
> > > > need to allocate new storagepool for this volume
> > > >
> > > > 2020-09-23 03:03:13,246 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > > Calling StoragePoolAllocators to find suitable pools
> > > >
> > > > 2020-09-23 03:03:13,248 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> > > > (API-Job-Executor-6:ctx-8a914274 job-740 ctx-b8369f5d)
> (logid:cce85213)
> > > > LocalStoragePoolAllocator trying to find 

Re: Primate Advance Network -> Security Group , no VLAN selection

[David Jumani]

Hi Hean,

It was an issue that was fixed in 
https://github.com/apache/cloudstack-primate/pull/567/files
Please try it with the latest master

Thanks,
David

From: Hean Seng 
Sent: Tuesday, September 22, 2020 3:32 PM
To: users@cloudstack.apache.org 
Subject: Primate Advance Network -> Security Group , no VLAN selection

Hi

I am now using Primate and  testing Create Advance zone with Security Group
Isolation.

During the creation process , it does not have selection for me to define
VLAN, however during the creation process , it seems to pop out error for
no VLAN.

At the Old Interface , there is VLAN selection field, but the old interface
has too many bugs, so far , never successfully creating any zone in the Old
Interface .

I am using Cloustack 4.14 on CentOS 7

Anybody have this experience on this and work around suggestions ?



--
Regards,
Hean Seng

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Cloudstack instances - Reset VM password

[David Jumani]

Hi Hean,

Cloudstack uses cloud-set-guest-password to reset the password
http://docs.cloudstack.apache.org/en/4.11.1.0/adminguide/templates/_password.html#adding-password-management-to-templates

Configuring cloud-init for Cloudstack can be found over here
http://docs.cloudstack.apache.org/en/latest/adminguide/virtual_machines/user-data.html#using-cloud-init
https://cloudinit.readthedocs.io/en/latest/topics/datasources/cloudstack.html

Thanks,
David


From: Hean Seng 
Sent: Friday, September 18, 2020 10:39 AM
To: users@cloudstack.apache.org 
Subject: Cloudstack instances - Reset VM password

Is anybody know  Reset password for Cloudstack VM instance ,  it still
based on the script or CloudInit ?

Anybody know how to make this work  ?

And any best practice to make a template that can configure CloudInit ?



--
Regards,
Hean Seng

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: BUILD FAILURE

[David Jumani]

Hi Ala,

You can also skip the tests using the skipTests flag

mvn   -DskipTests

Thanks,
David


From: Pearl d'Silva 
Sent: Tuesday, September 15, 2020 8:54 AM
To: users@cloudstack.apache.org 
Subject: Re: BUILD FAILURE

Hi Ala,

Please ensure you are using the latest 4.14 branch of CloudStack which includes 
a fix for the 2 tests that seem to be failing
https://github.com/apache/cloudstack/pull/4226/commits/2454b3ae971c418e54f738659c89312f143ac378


Thanks,
Pearl

From: Ala de Dragón 
Sent: Tuesday, September 15, 2020 1:59 AM
To: users@cloudstack.apache.org 
Subject: Re: BUILD FAILURE

Hello I was following your link but stuck at the same place:

[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time:  07:28 min (Wall Clock)
[INFO] Finished at: 2020-09-14T22:21:59+02:00
[INFO] 
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
(default-test) on project cloud-plugin-ca-rootca: There are test
failures.
[ERROR]
[ERROR] Please refer to
/root/cloudstack/plugins/ca/root-ca/target/surefire-reports for the
individual test results.
[ERROR] Please refer to dump files (if any exist) [date].dump,
[date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with
the -e switch.
un Maven using the -X switch to enable full debug logging.
Downloaded from central:
https://repo.maven.apache.org/maven2/com/sun/istack/istack-commons-runtime/3.0.5/istack-commons-runtime-3.0.5.pom
(3.4 kB at 8.9 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/sun/istack/istack-commons/3.0.5/istack-commons-3.0.5.pom
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :cloud-plugin-ca-rootca
Destroying 8 processes


org.apache.cloudstack.ca.provider.RootCACustomTrustManagerTest.txt

Test set: org.apache.cloudstack.ca.provider.RootCACustomTrustManagerTest
---
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.863
s - in org.apache.cloudstack.ca.provider.RootCACustomTrustManagerTest





org.apache.cloudstack.ca.provider.RootCAProviderTest.txt

---
Test set: org.apache.cloudstack.ca.provider.RootCAProviderTest
---
Tests run: 8, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 6.724
s <<< FAILURE! - in
org.apache.cloudstack.ca.provider.RootCAProviderTest
testCreateSSLEngineWithAuthStrictness(org.apache.cloudstack.ca.provider.RootCAProviderTest)
 Time elapsed: 1.242 s  <<< FAILURE!
java.lang.AssertionError
at 
org.apache.cloudstack.ca.provider.RootCAProviderTest.testCreateSSLEngineWithAuthStrictness(RootCAProviderTest.java:146)

testCreateSSLEngineWithoutAuthStrictness(org.apache.cloudstack.ca.provider.RootCAProviderTest)
 Time elapsed: 0.795 s  <<< FAILURE!
java.lang.AssertionError
at 
org.apache.cloudstack.ca.provider.RootCAProviderTest.testCreateSSLEngineWithoutAuthStrictness(RootCAProviderTest.java:138)




I'm not planing to deploy Certs with this system. I use let's encrypt
and certboot. Do I really need to compile this pluging witch is not
working for me?
I'm not able to understantd why it fails to compile. I don't
understand this logs.
As always any hint is wellcome.
:D

2020-09-14 14:16 GMT+02:00, Ala de Dragón :
> Hi Rohit, thank yo for your response. I was reding this manual you
> told me, I was following the one in
> https://buildmedia.readthedocs.org/media/pdf/cloudstack-installation/latest/cloudstack-installation.pdf
>
> but the one you told seems better in my case.
> I have a few questions, regarding to the flags, I saw in that commad:
> mvn -Pdeveloper,systemvm clean install
>
> So I suposse there are 2 flags, Developers and SystemVM. Where can I
> learn about those flags and others? I want to test in a local server a
> "all in one Baremetal server" with the management, Database and node
> in the same server.
> Regards
>
> 2020-09-14 13:34 GMT+02:00, Rohit Yadav :
>> Hi Ala - as the error says you are using a maven profile that doesn't
>> exist.
>>
>> Depending on whether you want to do a oss build or a non-oss build you
>> may
>> need to pass some flags. For example, refer:
>> http://docs.cloudstack.apache.org/en/4.14.0.0/developersguide/developer_guide.html#installing-cloudstack-from-source
>>
>> Note: For 4.14.0.0 - just ensure to install openjdk11-jdk for building.
>>
>>
>> Regards.
>>

Re: Building Cloudstack from source for production purpose and then packaging, which mvn profile to use ?

[David Jumani]

Thanks Jean!
Primate is the UI while CloudMonkey is a cli tool. They both end up making API 
calls to the management server, although cloudmonkey exposes the entire list of 
APIs.

Thanks,
David

From: jean-michel 
Sent: Saturday, September 12, 2020 8:31 PM
To: users@cloudstack.apache.org 
Subject: Re: Building Cloudstack from source for production purpose and then 
packaging, which mvn profile to use ?

Thank you David for all of these useful information.


Building packages for Debian 10 has succeeded however with some
adjustments to be made.


So, my little contribution:

1) At least two patches are required for cloudstack 4.14.0.0

https://github.com/apache/cloudstack/pull/4226/commits/2454b3ae971c418e54f738659c89312f143ac378

https://github.com/apache/cloudstack/pull/4306/commits/4081a5c2dcc6d6e387fd65df35b238cb551bd7fe


2) The build of the package python3-mysql.connector for Debian 10

https://salsa.debian.org/python-team/modules/mysql-connector-python/


Now comes the time to test the packages and next the build of
cloudstack-primate, which look very nice.


One last question. Do I really need Cloudmonkey if I use
cloudstack-primate?


Thx

On 2020-09-12 14:43, David Jumani wrote:
> If you're building an os package and planning on installing it on a vm, 
> there's no need to build it with mvn manually. The build process :
> # To install dependencies, can skip if already done
> git clone https://github.com/rhtyd/cloudstack-nonoss.git
> cd cloudstack-nonoss
> ./install-non-oss.sh
>
> 
>
> Assuing you're using Ubuntu / debian then
> dpkg-buildpackage -uc -us -b
>
> For centos :
> package.sh --distribution centos7
>
> The profiles passed are to ensure the various modules are built so that 
> Cloudstack functions properly
> The systemvm.iso contains all the necessary jars for the systemvms to work
>
> After this, you should have the cloudstack-*.deb/rpm packages ready to install
> The logging level, etc is configurable once you install CloudStack.
> 
> From: jean-michel 
> Sent: Saturday, September 12, 2020 6:07 PM
> To: users@cloudstack.apache.org 
> Subject: Re: Building Cloudstack from source for production purpose and then 
> packaging, which mvn profile to use ?
>
> Hi David
>
>
> Thx for this quick reply.
>
>
> So, if I'm not mistaken there are two steps:
>
> 1) Cloudstack build with mvn
>
> and then
>
> 2) Os packaging with one of the script depending on the OS target.
>
>
> Now let's take the first step with mvn.
>
> 1) What bothers me, but maybe wrongly, it's the 'developer' option
> passed to mvn.
>
> First of all I don't plan to develop on my workstation, but secondly I
> want to be sure that the result of the build will not contain some debug
> flags or others things for development.
>
> 2) Do I really need, for production purpose the 'systemvm' option ? What
> is 'systemvm' and should I build 'systemvm.iso' for production purpose ?
>
> I found this documentation
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack
> but it's not clear for me.
>
> I also tried the 'deps' option like in this documentation
> http://docs.cloudstack.apache.org/en/4.14.0.0/installguide/building_from_source.html#building-deb-packages
>
> but during the build I get a 'deps' profile doesn't exist, something
> like that.
>
>
> Thx
>
> On 2020-09-12 14:03, David Jumani wrote:
>> Hi Jean,
>>
>> When building from source, you can follow the guide here
>> http://docs.cloudstack.apache.org/en/latest/developersguide/developer_guide.html?highlight=nonoss#building-non-free-packages
>> It includes a step that installs dependencies.
>>
>> When building os packages, you can use the packaging/package.sh script for 
>> centos or dpkg-buildpackage for debian systems.
>> package.sh --distribution centos7
>>
>> It internally uses the developer and systemvm profile :
>> mvn -Psystemvm,developer -Dnoredist clean package
>>
>>
>> Hope this helps!
>>
>> Thanks,
>> David
>>
>> 
>> From: jean-michel 
>> Sent: Saturday, September 12, 2020 5:20 PM
>> To: users@cloudstack.apache.org 
>> Subject: Building Cloudstack from source for production purpose and then 
>> packaging, which mvn profile to use ?
>>
>> Hi
>>
>> It's a first time with Cloudstack and Java for me. Despite of the
>> various documentation I found about building Cloudstack from sources and
>> then packaging, I still don't know which profile I should use with mvn
>> for production purpose and if in this case a profile is necessary.
>>
>> Thx for your

Re: Building Cloudstack from source for production purpose and then packaging, which mvn profile to use ?

[David Jumani]

If you're building an os package and planning on installing it on a vm, there's 
no need to build it with mvn manually. The build process :
# To install dependencies, can skip if already done
git clone https://github.com/rhtyd/cloudstack-nonoss.git
cd cloudstack-nonoss
./install-non-oss.sh



Assuing you're using Ubuntu / debian then
dpkg-buildpackage -uc -us -b

For centos :
package.sh --distribution centos7

The profiles passed are to ensure the various modules are built so that 
Cloudstack functions properly
The systemvm.iso contains all the necessary jars for the systemvms to work

After this, you should have the cloudstack-*.deb/rpm packages ready to install
The logging level, etc is configurable once you install CloudStack.

From: jean-michel 
Sent: Saturday, September 12, 2020 6:07 PM
To: users@cloudstack.apache.org 
Subject: Re: Building Cloudstack from source for production purpose and then 
packaging, which mvn profile to use ?

Hi David


Thx for this quick reply.


So, if I'm not mistaken there are two steps:

1) Cloudstack build with mvn

and then

2) Os packaging with one of the script depending on the OS target.


Now let's take the first step with mvn.

1) What bothers me, but maybe wrongly, it's the 'developer' option
passed to mvn.

First of all I don't plan to develop on my workstation, but secondly I
want to be sure that the result of the build will not contain some debug
flags or others things for development.

2) Do I really need, for production purpose the 'systemvm' option ? What
is 'systemvm' and should I build 'systemvm.iso' for production purpose ?

I found this documentation
https://cwiki.apache.org/confluence/display/CLOUDSTACK/How+to+build+CloudStack
but it's not clear for me.

I also tried the 'deps' option like in this documentation
http://docs.cloudstack.apache.org/en/4.14.0.0/installguide/building_from_source.html#building-deb-packages

but during the build I get a 'deps' profile doesn't exist, something
like that.


Thx

On 2020-09-12 14:03, David Jumani wrote:
> Hi Jean,
>
> When building from source, you can follow the guide here
> http://docs.cloudstack.apache.org/en/latest/developersguide/developer_guide.html?highlight=nonoss#building-non-free-packages
> It includes a step that installs dependencies.
>
> When building os packages, you can use the packaging/package.sh script for 
> centos or dpkg-buildpackage for debian systems.
> package.sh --distribution centos7
>
> It internally uses the developer and systemvm profile :
> mvn -Psystemvm,developer -Dnoredist clean package
>
>
> Hope this helps!
>
> Thanks,
> David
>
> 
> From: jean-michel 
> Sent: Saturday, September 12, 2020 5:20 PM
> To: users@cloudstack.apache.org 
> Subject: Building Cloudstack from source for production purpose and then 
> packaging, which mvn profile to use ?
>
> Hi
>
> It's a first time with Cloudstack and Java for me. Despite of the
> various documentation I found about building Cloudstack from sources and
> then packaging, I still don't know which profile I should use with mvn
> for production purpose and if in this case a profile is necessary.
>
> Thx for your help
>
>
> david.jum...@shapeblue.com
> www.shapeblue.com<http://www.shapeblue.com>
> 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> @shapeblue
>
>
>

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Building Cloudstack from source for production purpose and then packaging, which mvn profile to use ?

[David Jumani]

Hi Jean,

When building from source, you can follow the guide here
http://docs.cloudstack.apache.org/en/latest/developersguide/developer_guide.html?highlight=nonoss#building-non-free-packages
It includes a step that installs dependencies.

When building os packages, you can use the packaging/package.sh script for 
centos or dpkg-buildpackage for debian systems.
package.sh --distribution centos7

It internally uses the developer and systemvm profile :
mvn -Psystemvm,developer -Dnoredist clean package


Hope this helps!

Thanks,
David


From: jean-michel 
Sent: Saturday, September 12, 2020 5:20 PM
To: users@cloudstack.apache.org 
Subject: Building Cloudstack from source for production purpose and then 
packaging, which mvn profile to use ?

Hi

It's a first time with Cloudstack and Java for me. Despite of the
various documentation I found about building Cloudstack from sources and
then packaging, I still don't know which profile I should use with mvn
for production purpose and if in this case a profile is necessary.

Thx for your help


david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Unable to build first zone

[David Jumani]

Glad to hear it!

The reason for the next error could be when bridges are not configured on the 
host. Could you check the bridge config as mentioned here :
http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.11/hypervisor/kvm.html


Thanks,
David

From: Joshua Schaeffer 
Sent: Thursday, September 10, 2020 8:50 PM
To: users@cloudstack.apache.org 
Subject: Re: Unable to build first zone

Hi Joshua,
> I don't think it's an issue trying to reach the gateway provided in the API
>
> Could you try and run the command via cloudmonkey ?
>
> cmk create pod zoneid=9d7004b7-c129-412c-8d8f-7f6f65319604 name=POD1 
> gateway=10.2.20.1 netmask=255.255.252.0 startip=10.2.21.65 endip=10.2.21.80
>
>
Okay, I figured out the first issue. The 504 error was because my load balancer 
was timing out before the pod creation finished. If I run the wizard directly 
on one of the controller nodes it gets past that step. I'll adjust the timeout 
settings in HAProxy. However, I'm getting a different error when it gets to the 
step to add the host. It is throwing an HTTP 530 now. I'm pretty sure it is 
because the agent is not running properly on the host. When I try to start the 
agent I get this:

2020-09-10 15:02:54,724 INFO  [cloud.agent.AgentShell] (main:null) (logid:) 
Agent started
2020-09-10 15:02:54,748 INFO  [cloud.agent.AgentShell] (main:null) (logid:) 
Implementation Version is 4.14.0.0
2020-09-10 15:02:54,757 INFO  [cloud.agent.AgentShell] (main:null) (logid:) 
agent.properties found at /etc/cloudstack/agent/agent.properties
2020-09-10 15:02:54,824 INFO  [cloud.agent.AgentShell] (main:null) (logid:) 
Defaulting to using properties file for storage
2020-09-10 15:02:54,828 INFO  [cloud.agent.AgentShell] (main:null) (logid:) 
Defaulting to the constant time backoff algorithm
2020-09-10 15:02:54,901 INFO  [cloud.utils.LogUtils] (main:null) (logid:) log4j 
configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2020-09-10 15:02:54,919 INFO  [cloud.agent.AgentShell] (main:null) (logid:) 
Using default Java settings for IPv6 preference for agent connection
2020-09-10 15:02:55,061 INFO  [cloud.agent.Agent] (main:null) (logid:) id is
2020-09-10 15:02:55,066 WARN  [cloud.resource.ServerResourceBase] (main:null) 
(logid:) Nics are not specified in properties file/db, will try to autodiscover
2020-09-10 15:02:55,073 INFO  [cloud.resource.ServerResourceBase] (main:null) 
(logid:) Designating private to be nic bond-storage
2020-09-10 15:02:55,081 ERROR [kvm.resource.LibvirtComputingResource] 
(main:null) (logid:) uefi properties file not found due to: Unable to find file 
uefi.properties.
2020-09-10 15:02:55,155 INFO  [kvm.resource.LibvirtConnection] (main:null) 
(logid:) No existing libvirtd connection found. Opening a new one
2020-09-10 15:02:55,659 INFO  [org.reflections.Reflections] (main:null) 
(logid:) Reflections took 234 ms to scan 1 urls, producing 9 keys and 11 values
2020-09-10 15:02:55,701 INFO  [kvm.resource.LibvirtComputingResource] 
(main:null) (logid:) No libvirt.vif.driver specified. Defaults to 
BridgeVifDriver.
2020-09-10 15:02:55,718 ERROR [kvm.resource.LibvirtComputingResource] 
(main:null) (logid:) Failed to get private nic name
2020-09-10 15:02:55,719 ERROR [cloud.agent.AgentShell] (main:null) (logid:) 
Unable to start agent: Failed to get private nic name

I just turned on DEBUG and am going through those logs now. Should I manually 
be setting the public.network.device and private.network.device? If so, what 
should these be set to? I'm not seeing a lot of references to these settings in 
the documentation.

--
Thanks,
Joshua Schaeffer


david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Unable to build first zone

[David Jumani]

Hi Joshua,

I don't think it's an issue trying to reach the gateway provided in the API

Could you try and run the command via cloudmonkey ?

cmk create pod zoneid=9d7004b7-c129-412c-8d8f-7f6f65319604 name=POD1 
gateway=10.2.20.1 netmask=255.255.252.0 startip=10.2.21.65 endip=10.2.21.80

Thanks,
David

From: Joshua Schaeffer 
Sent: Thursday, September 10, 2020 12:11 AM
To: users@cloudstack.apache.org 
Subject: Re: Unable to build first zone



On 9/9/20 12:17 PM, Joshua Schaeffer wrote:
 Perhaps you could check the API being called, via the networks tab in the
 browser developer tools. The failed request generally responds with whats
 wrong.
 Another reason it could fail is a missing or invalid parameter. It doesn't
 throw an exception in the logs but is more of a one-liner like this :

 2020-09-09 01:53:00,858 INFO  [c.c.a.ApiServer]
 (qtp1136419747-3235:ctx-be37c54f ctx-5a9ade88) (logid:ec603079) Unable to
 execute API command createpod due to missing parameter name

 The logs would be helpful.

 Thanks,
 David
 


David, sorry I didn't realize you meant to get the API request from the 
browser. Yes this gives me more information. When it is trying to create the 
pod it returns a 504 gateway timeout response to this API call:

http://bllcloudlb01.harmonywave.cloud/client/api/?zoneId=9d7004b7-c129-412c-8d8f-7f6f65319604=POD1=10.2.20.1=255.255.252.0=10.2.21.65=10.2.21.80=createPod=json

That network is reachable from the controller node:

jschaeffer@bllcloudctl01:~$ ping -c 4 10.2.20.1
PING 10.2.20.1 (10.2.20.1) 56(84) bytes of data.
64 bytes from 10.2.20.1: icmp_seq=1 ttl=255 time=14.4 ms
64 bytes from 10.2.20.1: icmp_seq=2 ttl=255 time=22.2 ms
64 bytes from 10.2.20.1: icmp_seq=3 ttl=255 time=63.2 ms
64 bytes from 10.2.20.1: icmp_seq=4 ttl=255 time=49.6 ms

--- 10.2.20.1 ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3005ms
rtt min/avg/max/mdev = 14.367/37.332/63.156/19.841 ms

--
Thanks,
Joshua Schaeffer


david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Unable to build first zone

[David Jumani]

Hi Joshua,

Perhaps you could check the API being called, via the networks tab in the 
browser developer tools. The failed request generally responds with whats wrong.
Another reason it could fail is a missing or invalid parameter. It doesn't 
throw an exception in the logs but is more of a one-liner like this :

2020-09-09 01:53:00,858 INFO  [c.c.a.ApiServer] 
(qtp1136419747-3235:ctx-be37c54f ctx-5a9ade88) (logid:ec603079) Unable to 
execute API command createpod due to missing parameter name

The logs would be helpful.

Thanks,
David

From: Joshua Schaeffer 
Sent: Wednesday, September 9, 2020 3:22 AM
To: users@cloudstack.apache.org 
Subject: Unable to build first zone

I'm having trouble getting my first zone to build. I'm going through "Add Zone" 
wizard and choosing "Advanced". After providing all the data I try to build the 
zone and wizard errors out on "Creating pod". It also says something went 
wrong, but gives no additional information:



If I click on "Fix errors" it takes me to the pod setup page, but i'm not sure 
if anything is actually wrong. If I click on "Save changes" it just does the 
same thing.



I'm not really seeing anything obvious in the logs either, but would be happy 
to provide them.

Thanks,
Joshua Schaeffer


david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: API LIstUsageRecord

[David Jumani]

Hi,

It's all traffic from all the VMs as mentioned in the docs

NETWORK_BYTES_SENT : Tracks the total number of bytes sent by all the VMs for 
an account. Cloud.com does not currently track network traffic per VM.
NETWORK_BYTES_RECEIVED : Tracks the total number of bytes received by all the 
VMs for an account. Cloud.com does not currently track network traffic per VM.

Thanks,
David

From: Hean Seng 
Sent: Monday, September 7, 2020 11:30 PM
To: users@cloudstack.apache.org 
Subject: API LIstUsageRecord

HI

Anybody know the API
https://cloudstack.apache.org/api/apidocs-4.14/apis/listUsageRecords.html
http://docs.cloudstack.apache.org/projects/cloudstack-administration/en/4.8/usage.html#network-usage-record-format

The network traffic is Public IP traffic, or Incluide Guest Traffic.



Thank you

--
Regards,
Hean Seng

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Cloudstack Isolated Network - VLAN

[David Jumani]

Hi,

You can also try to use PVLANs

Thanks,
David

From: Hean Seng 
Sent: Friday, September 4, 2020 10:55 AM
To: users@cloudstack.apache.org 
Subject: Cloudstack Isolated Network - VLAN

Hi

Cloudstack Reserve VLAN for isolated network,  However VLAN in network have
limitation of 4096 vlan,

If one user one isolated network, it means we can only create 4096 users .


Anybody have any suggestion for work around ?


--
Regards,
Hean Seng

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Pass userdata with CMK

[David Jumani]

Hi,

You need to pass the userdata (not user-data) as a base64 encoded string (try 
https://www.base64encode.org/ or the base64 command on Linux).

template=7bf01470-e3a5-4f37-b035-023c663c1b48
service=80b47022-a341-446f-a14a-128b85a099d0
zone=530cb1c3-1c90-4055-816e-3b58fbf9de91
keypair=mykey
userdata="$(base64 ./user-data)"

cmk deploy virtualmachine templateid="$template"
serviceofferingid="$service" zoneid="$zone" keypair="$keypair"
userdata="$userdata"

Thanks,
David

From: Poulpatine 
Sent: Wednesday, September 2, 2020 3:21 PM
To: users@cloudstack.apache.org 
Subject: Pass userdata with CMK

Hi,

I'm trying to pass userdata in cmk command line during virtual machine
deployment but I can't figure how to do that.

Among other tests, I've tried something like that in a very basic shell
script:

#!/bin/bash

cli=cmk
template=7bf01470-e3a5-4f37-b035-023c663c1b48
service=80b47022-a341-446f-a14a-128b85a099d0
zone=530cb1c3-1c90-4055-816e-3b58fbf9de91
keypair=mykey
userdata="$(sed -E ':a;N;$!ba;s/\r{0,1}\n/\\n/g' user-data)"

$ cli deploy virtualmachine templateid="$template"
serviceofferingid="$service" zoneid="$zone" keypair="$keypair"
user-data="$userdata"

But I still can't figure how to make it.

Do you have any suggestions?

Many thanks.

--
\o/ Poulpatine \o/

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: How to reset password using cloud-init in cloudstack

[David Jumani]

Hi Jerry,

Could you check the file `/etc/cloudstack/vmpassword.json` in the VR whether 
the password has been updated? It shows as { "IP": "password" }
Also could you provide the logs ?

Thanks,
David

From: li jerry 
Sent: Sunday, August 30, 2020 1:12 PM
To: users@cloudstack.apache.org 
Subject: How to reset password using cloud-init in cloudstack

Hi All
We tried to replace the cloud-set-guest-password script with cloud-init in 
CentOS.

l  The VM is deployed through the template, and the password takes effect

l  Reset VM password via CloudStack, failed (cannot log in with new password)

Does anyone know how to solve it?

Here is the operation procedure:


l  Cloud-init is installed in guest VM and cloudstack data source is configured;

l  Convert VM to template (enable password)

l  Deploy VM for new template;

l  Use the password ssh returned by cloudstack to log in to the VM, and it is 
successful

The above test proves that cloud-init works well

Next, I test the vm  resetpassword:

l  Shut down VM

l  reset password

l  Start VM

Failed to login VM with new password
Login VM successfully with old password

Description password reset function failed

VM cloud-init log output:
helpers.py [DEBUG]: config-set-passwords already ran (freq=once-per-instance)


Can the set passwords module be executed every time it is restarted?
(I have implemented the reset password function using cloudbase-init in Windows)

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Fresh 4.14 install - UI won't start after reboot

[David Jumani]

Hi,

I've created a PR with a message for the same

https://github.com/apache/cloudstack/pull/4239
[https://avatars3.githubusercontent.com/u/47359?s=400=4]
Adding message to ensure ports are open by davidjumani · Pull Request #4239 · 
apache/cloudstack
Description Displays a message so that the user knows to open up the following 
ports on the management server since the host might be using unsupported 
firewall management tools Types of changes ...
github.com


Haven't removed the part that adds the rules so existing functionality remains 
the same but lets the user know that the ports need to be opened. Let me know 
what you all think!

Thanks,
David

From: Andrija Panic 
Sent: Friday, July 31, 2020 4:34 PM
To: users 
Subject: Re: Fresh 4.14 install - UI won't start after reboot

Fully agree anyone up for a PR that would edit the script to avoid
firewall rules setup but instead print a descriptive message advising ports
8080, 8443, 8250 and possibly 8096 should be open?

cheers,

On Fri, 31 Jul 2020 at 10:26, Riepl, Gregor (SWISS TXT) <
gregor.ri...@swisstxt.ch> wrote:

> Hi Andrija,
>
> My idea would be to either ensure (in the cloudstack-setup-management) that
> both firewalld/ufw are disabled and continue operating with pure iptables
>  OR  to not add rules at all, but instead print a message on the
> requirements to open access to ports 8080/8250/9090 with whatever firewall
> management tool the user uses
>
> ​Supporting many different firewall management tools will be a Herculean
> effort and may still fail when new tools emerge.
> I think it would be ok to drop automatic firewall rule creation and let
> the user manage their own rules instead.
>
> It's always been this way on Debian (and derivates), and I don't see why
> other distributions should be different.
> Perhaps RHEL/CentOS has handled this differently in the past, and
> firewalld is supposed to solve the distribution fragmentation problem, just
> like systemd did. But there's far less adoption of firewalld than systemd,
> so I don't think it makes sense to try to solve this in CloudStack.
>
> (just my 2¢)
>
> Regards,
> Gregor
>


--

Andrija Panić

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: Downloading template

[David Jumani]

Hi Fariborz,

You can find the download button under the details tab

Thanks,
David

From: Fariborz Navidan 
Sent: Sunday, June 7, 2020 4:57 PM
To: users@cloudstack.apache.org 
Subject: Downloading template

Hello,

Where download template button in 4.14? It was previously possible to get
download link under "zones" tab of a template in 4.13

david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

Re: OVS Plugin does not appear on the Network Service Providers screen

[David Jumani]

Hi,

CloudStack automatically uses OVS if it is configured the way Jerry mentioned. 
I have created a PR for editing the docs
https://github.com/apache/cloudstack-documentation/pull/133
[https://avatars3.githubusercontent.com/u/47359?s=400=4]
Edit OVS Plugin by davidjumani · Pull Request #133 · 
apache/cloudstack-documentation
Adding a note to inform users how to use OVS despite it not showing up as a 
network service provider
github.com


Thanks,
David

From: Andrija Panic 
Sent: Thursday, June 4, 2020 9:41 PM
To: users 
Subject: Re: OVS Plugin does not appear on the Network Service Providers screen

If there is more to the OVS than what's in the official docs, please
consider sending a PR against the docs (4.13 branch would be OK and we'll
forward merge to 4.14/master):
https://github.com/apache/cloudstack-documentation/tree/4.13


david.jum...@shapeblue.com 
www.shapeblue.com
3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
@shapeblue
  
 

On Thu, 4 Jun 2020 at 13:58, li jerry  wrote:

> Official documents are relatively backward, no updates
>
> 4.13.1 Please follow the steps below
>
> 1: Install openvswitch(build or yum)
> 2, change /etc/cloudstack/agent/agent.properties, add
> libvirt.vif.driver=com.cloud.hypervisor.kvm.resource.OvsVifDriver
> network.bridge.type=openvswitch
>
>
> When creating ZONE on the UI, please select VLAN isolation. Others are no
> different from normal BRIDGE
>
> (Enable vendor ovs in the network as prompted in the documentation, please
> ignore)
> -邮件原件-
> 发件人: Po Dragonwarrior 
> 发送时间: 2020年6月4日 19:42
> 收件人: users@cloudstack.apache.org
> 主题: OVS Plugin does not appear on the Network Service Providers screen
>
> Hello,
>
> I am trying ACS 4.13.1 and I installed Openvswitch too. Installation went
> smooth and system VMs are up…  but OVS does not appear on the “Network
> Service Providers” screen at the UI on the GRE physical network.
>
> Is there another way e.g. from the command line to check/enable it?… where
> should I look for possible problems?
>
> If I try to create a network offering with OVS as the “Virtual Networking”
> option then the creation of instance fails
>
> I would appreciate any help.
>
> best,
> Po
>


--

Andrija Panić

Re: ACS 4.13.1 failed to create PVLAN network

[David Jumani]

Hi Jerry, could you trace the DHCP packet coming out of the vm and the router ?


ovs-appctl ofproto/trace vlan_tci=0x,dl_src=
ovs-appctl ofproto/trace 
vlan_tci=0x,dl_src=,dl_dst=ff:ff:ff:ff:ff:ff
ovs-appctl ofproto/trace 
dl_vlan=,dl_src=,dl_dst=ff:ff:ff:ff:ff:ff


From: li jerry 
Sent: Saturday, May 30, 2020 1:13 PM
To: users@cloudstack.apache.org 
Subject: Re: ACS 4.13.1 failed to create PVLAN network

hi David, I cleared all the experimental environment and redeployed the test.
pvlan can work normally, and a VM with a PVLAN network + an isolated network 
can also work normally.

However, I found that when the VR where the PVLAN is located and the VM are not 
in the same HOST, the VM cannot obtain the IP of the PVLAN.

I checked ovs flows and the flow table was issued.

(VM has Pvlan Network and Isolated Network, Isolated Network can DHCP to IP, 
Pvlan Network can not get.

(Migrate VM to HOST where PVLAN VR is located, then VM can get all IPs)


Does PVLAN need other switch support?

My switch all port trunk all

-邮件原件-
发件人: David Jumani 
发送时间: 2020年5月29日 12:36
收件人: users@cloudstack.apache.org
主题: Re: ACS 4.13.1 failed to create PVLAN network

That's great!
There will be no communication between the devices on a PVLAN if they're 
isolated except DHCP (since isolated should not be able to communicate with 
each other).
About multiple NICs, in my setup, I've had a VM attached to a PVLAN as well as 
an Isolated and it worked. Haven't tried multiple PVLANs though 

From: li jerry 
Sent: Thursday, May 28, 2020 2:05 PM
To: users@cloudstack.apache.org 
Subject: Re: ACS 4.13.1 failed to create PVLAN network

Thanks to David, Boris and all friends.

I am on the master branch of clone github.com, and then merge PR 
[https://github.com/apache/cloudstack/pull/4040].

I have successfully implemented a PVLAN network in my test environment.
Realize no communication between VM and VM; Communication between VM and DHCP 
(dhcp request)

However, during the test, the following two problems were encountered.

1. VM does not support multiple NICs
  When creating vm> 1 NIC, the cloudstack-agent not create ovs flows.


2. L3 PVLAN, Secondary Isolated VLAN Type = Isolated. VM cannot get userdata 
information
  I tested in the VM and found that only DHCP requests can be sent to the VR, 
and other requests HTTP 80 AND 8080 can not communicate.


Is this a bug? Or am I doing something wrong?

-邮件原件-
发件人: David Jumani 
发送时间: 2020年5月27日 19:38
收件人: users@cloudstack.apache.org
主题: Re: ACS 4.13.1 failed to create PVLAN network

It's off master, I've built it using the PR that I shared, and yes, two bridges 
via ovs in my setup too!

From: li jerry 
Sent: Wednesday, May 27, 2020 3:34 PM
To: users@cloudstack.apache.org 
Subject: 回复: ACS 4.13.1 failed to create PVLAN network

Thanks David, is your environment 4.13.1 or 4.15?

I can test it according to your version.

In 4.13.1 I used openvswitch and created two bridges through ovs-vsctl

-Jerry

发件人: David Jumani<mailto:david.jum...@shapeblue.com>
发送时间: 2020年5月27日 16:28
收件人: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
主题: Re: ACS 4.13.1 failed to create PVLAN network

Hi Jerry,

The way PVLAN works on KVM is that it uses OpenFlow rules to emulate PVLAN, so 
OVS must be used for Linux networking, not the default Linux bridge. Apart from 
that, there were certain issues with it which have been addressed in the PR 
provided by Boris. It's been tested and working on OVS 2.9.2 When creating an 
L3 PVLAN, the VR is automatically created only when an instance is brought up 
on that network.
The steps I followed are :

  1.  Create the PVLAN network
  2.  Create an instance and attach it to the network
  3.  Wait until the router comes up

The OpenFlow scripts run in the background on the agent Once the instance is 
up, it should work as expected

I haven't tried adding a live host to a PVLAN network, but it worked when I 
tried it following the above steps.
You can test the PVLAN connectivity by pinging another host using the interface 
attached to the PVLAN network 
From: Boris Stoyanov 
Sent: Wednesday, May 27, 2020 1:45 PM
To: users@cloudstack.apache.org 
Subject: Re: ACS 4.13.1 failed to create PVLAN network

I can't advise if simply merging this code in 4.13 will work fine, it may cause 
some side issues since it's a big gap in code bases, therefore I'll advise you 
to install/upgrade you test env to this PR ( 4.15 )

Bobby.

On 27.05.20, 11:07, "li jerry"  wrote:

Thank you Boris for the information.

I now go to merge this PR into 4.13.1 for testing. Provide test results 
later.

-Jerry

发件人: Boris Stoyanov<mailto:boris.stoya...@shapeblue.com>
发送时间: 2020年5月27日 16:01
收件人: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
主题: Re: ACS 

Re: ACS 4.13.1 failed to create PVLAN network

[David Jumani]

That's great!
There will be no communication between the devices on a PVLAN if they're 
isolated except DHCP (since isolated should not be able to communicate with 
each other).
About multiple NICs, in my setup, I've had a VM attached to a PVLAN as well as 
an Isolated and it worked. Haven't tried multiple PVLANs though

From: li jerry 
Sent: Thursday, May 28, 2020 2:05 PM
To: users@cloudstack.apache.org 
Subject: Re: ACS 4.13.1 failed to create PVLAN network

Thanks to David, Boris and all friends.

I am on the master branch of clone github.com, and then merge PR 
[https://github.com/apache/cloudstack/pull/4040].

I have successfully implemented a PVLAN network in my test environment.
Realize no communication between VM and VM;
Communication between VM and DHCP (dhcp request)

However, during the test, the following two problems were encountered.

1. VM does not support multiple NICs
  When creating vm> 1 NIC, the cloudstack-agent not create ovs flows.


2. L3 PVLAN, Secondary Isolated VLAN Type = Isolated. VM cannot get userdata 
information
  I tested in the VM and found that only DHCP requests can be sent to the VR, 
and other requests HTTP 80 AND 8080 can not communicate.


Is this a bug? Or am I doing something wrong?

-邮件原件-
发件人: David Jumani 
发送时间: 2020年5月27日 19:38
收件人: users@cloudstack.apache.org
主题: Re: ACS 4.13.1 failed to create PVLAN network

It's off master, I've built it using the PR that I shared, and yes, two bridges 
via ovs in my setup too!

From: li jerry 
Sent: Wednesday, May 27, 2020 3:34 PM
To: users@cloudstack.apache.org 
Subject: 回复: ACS 4.13.1 failed to create PVLAN network

Thanks David, is your environment 4.13.1 or 4.15?

I can test it according to your version.

In 4.13.1 I used openvswitch and created two bridges through ovs-vsctl

-Jerry

发件人: David Jumani<mailto:david.jum...@shapeblue.com>
发送时间: 2020年5月27日 16:28
收件人: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
主题: Re: ACS 4.13.1 failed to create PVLAN network

Hi Jerry,

The way PVLAN works on KVM is that it uses OpenFlow rules to emulate PVLAN, so 
OVS must be used for Linux networking, not the default Linux bridge. Apart from 
that, there were certain issues with it which have been addressed in the PR 
provided by Boris. It's been tested and working on OVS 2.9.2 When creating an 
L3 PVLAN, the VR is automatically created only when an instance is brought up 
on that network.
The steps I followed are :

  1.  Create the PVLAN network
  2.  Create an instance and attach it to the network
  3.  Wait until the router comes up

The OpenFlow scripts run in the background on the agent Once the instance is 
up, it should work as expected

I haven't tried adding a live host to a PVLAN network, but it worked when I 
tried it following the above steps.
You can test the PVLAN connectivity by pinging another host using the interface 
attached to the PVLAN network 
From: Boris Stoyanov 
Sent: Wednesday, May 27, 2020 1:45 PM
To: users@cloudstack.apache.org 
Subject: Re: ACS 4.13.1 failed to create PVLAN network

I can't advise if simply merging this code in 4.13 will work fine, it may cause 
some side issues since it's a big gap in code bases, therefore I'll advise you 
to install/upgrade you test env to this PR ( 4.15 )

Bobby.

On 27.05.20, 11:07, "li jerry"  wrote:

Thank you Boris for the information.

I now go to merge this PR into 4.13.1 for testing. Provide test results 
later.

-Jerry

发件人: Boris Stoyanov<mailto:boris.stoya...@shapeblue.com>
发送时间: 2020年5月27日 16:01
收件人: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
主题: Re: ACS 4.13.1 failed to create PVLAN network

Hi Li,

Can you try your tests with this PR: 
https://github.com/apache/cloudstack/pull/4040
This one ^^ is enabling it on L2 networks, to be honest I'm not sure about 
L3 as I'm currently testing it.

But to be able to test I'll need to facilitate an L3 network (arping 
requires IP), and then specify the interface to the other L2 network attached 
to the same VM.
Please note that this is 4.15+ and it's currently under testing, so do it 
in a testing lab.

Thanks,

On 26.05.20, 18:14, "li jerry"  wrote:

Dear All

Who has successfully deployed a PVLAN network on ACS 4.13.1?
I created the PVLAN network through the following process, but it failed

Server:
CentOS7
CloudStack 4.13.1

Zone 1：

l  Physical Network1 ：Public and Guest , Isolation method=VLAN, KVM 
traffic label=br1

l  Physical Network2 :  Management , Isolation method=VLAN, KVM traffic 
label=br2

SystemVM Template (KVM): Version 4.11.3

Hypervisor:
CentOS7.7 3.10.0-1062
Openvswitch-2.12.0
libvirt 4.5.0
QEMU 1.5.3



1. Create

Re: ACS 4.13.1 failed to create PVLAN network

[David Jumani]

It's off master, I've built it using the PR that I shared, and yes, two bridges 
via ovs in my setup too!

From: li jerry 
Sent: Wednesday, May 27, 2020 3:34 PM
To: users@cloudstack.apache.org 
Subject: 回复: ACS 4.13.1 failed to create PVLAN network

Thanks David, is your environment 4.13.1 or 4.15?

I can test it according to your version.

In 4.13.1 I used openvswitch and created two bridges through ovs-vsctl

-Jerry

发件人: David Jumani<mailto:david.jum...@shapeblue.com>
发送时间: 2020年5月27日 16:28
收件人: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
主题: Re: ACS 4.13.1 failed to create PVLAN network

Hi Jerry,

The way PVLAN works on KVM is that it uses OpenFlow rules to emulate PVLAN, so 
OVS must be used for Linux networking, not the default Linux bridge. Apart from 
that, there were certain issues with it which have been addressed in the PR 
provided by Boris. It's been tested and working on OVS 2.9.2
When creating an L3 PVLAN, the VR is automatically created only when an 
instance is brought up on that network.
The steps I followed are :

  1.  Create the PVLAN network
  2.  Create an instance and attach it to the network
  3.  Wait until the router comes up

The OpenFlow scripts run in the background on the agent
Once the instance is up, it should work as expected

I haven't tried adding a live host to a PVLAN network, but it worked when I 
tried it following the above steps.
You can test the PVLAN connectivity by pinging another host using the interface 
attached to the PVLAN network

From: Boris Stoyanov 
Sent: Wednesday, May 27, 2020 1:45 PM
To: users@cloudstack.apache.org 
Subject: Re: ACS 4.13.1 failed to create PVLAN network

I can't advise if simply merging this code in 4.13 will work fine, it may cause 
some side issues since it's a big gap in code bases, therefore I'll advise you 
to install/upgrade you test env to this PR ( 4.15 )

Bobby.

On 27.05.20, 11:07, "li jerry"  wrote:

Thank you Boris for the information.

I now go to merge this PR into 4.13.1 for testing. Provide test results 
later.

-Jerry

发件人: Boris Stoyanov<mailto:boris.stoya...@shapeblue.com>
发送时间: 2020年5月27日 16:01
收件人: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>
主题: Re: ACS 4.13.1 failed to create PVLAN network

Hi Li,

Can you try your tests with this PR: 
https://github.com/apache/cloudstack/pull/4040
This one ^^ is enabling it on L2 networks, to be honest I'm not sure about 
L3 as I'm currently testing it.

But to be able to test I'll need to facilitate an L3 network (arping 
requires IP), and then specify the interface to the other L2 network attached 
to the same VM.
Please note that this is 4.15+ and it's currently under testing, so do it 
in a testing lab.

Thanks,

On 26.05.20, 18:14, "li jerry"  wrote:

Dear All

Who has successfully deployed a PVLAN network on ACS 4.13.1?
I created the PVLAN network through the following process, but it failed

Server:
CentOS7
CloudStack 4.13.1

Zone 1：

l  Physical Network1 ：Public and Guest , Isolation method=VLAN, KVM 
traffic label=br1

l  Physical Network2 :  Management , Isolation method=VLAN, KVM traffic 
label=br2

SystemVM Template (KVM): Version 4.11.3

Hypervisor:
CentOS7.7 3.10.0-1062
Openvswitch-2.12.0
libvirt 4.5.0
QEMU 1.5.3



1. Create L3 Guest Network, name= Pvlan-Net-01, vlan=700, 
isolatedpvlan=1700

( this is api command)


command=createNetwork=409b04ea-d128-48ac-8e33-4df700da89cc=9778a4ab-0de8-4440-9879-a488416e0572=ca0768c8-f068-4d88-b7bd-2766414a6415=Pvlan-Net-01=Pvlan-Net-01=700=false=1700=domain=172.17.0.1=255.255.0.0=172.17.1.1=172.17.1.254=hyperx.com=json&_=1590497900407


2. attache network to VM vm1 (this VM is running and has an 
isolated network 10.0.0.x / 24)

3. attache failed, management throws the following error:



this is management log

2020-05-26 21:59:40,268 DEBUG [c.c.a.t.Request] 
(Work-Job-Executor-1:ctx-905dd7d7 job-44/job-45 ctx-4c296832) (logid:2009fc05) 
Seq 4-6374282322589515787: Received:  { Ans: , MgmtId: 113349236140, via: 
4(), Ver: v1, Flags: 10, { StartAnswer, CheckSshAnswer, 
GetDomRVersionAnswer, NetworkUsageAnswer, Answer, Answer, Answer, Answer, 
Answer } }

2020-05-26 21:59:40,280 DEBUG [o.a.c.n.t.AdvancedNetworkTopology] 
(Work-Job-Executor-1:ctx-905dd7d7 job-44/job-45 ctx-4c296832) (logid:2009fc05) 
SETUP DHCP PVLAN RULES

2020-05-26 21:59:40,292 DEBUG [c.c.n.r.NetworkHelperImpl] 
(Work-Job-Executor-1:ctx-905dd7d7 job-44/job-45 ctx-4c296832) (logid:2009fc05) 
Router requires upgrade. Unable to send command to router:5, router template 
version : null, minimal required version : 4.10.0

2020-05-26 21:59:40,294

Re: ACS 4.13.1 failed to create PVLAN network

[David Jumani]

Hi Jerry,

The way PVLAN works on KVM is that it uses OpenFlow rules to emulate PVLAN, so 
OVS must be used for Linux networking, not the default Linux bridge. Apart from 
that, there were certain issues with it which have been addressed in the PR 
provided by Boris. It's been tested and working on OVS 2.9.2
When creating an L3 PVLAN, the VR is automatically created only when an 
instance is brought up on that network.
The steps I followed are :

  1.  Create the PVLAN network
  2.  Create an instance and attach it to the network
  3.  Wait until the router comes up

The OpenFlow scripts run in the background on the agent
Once the instance is up, it should work as expected

I haven't tried adding a live host to a PVLAN network, but it worked when I 
tried it following the above steps.
You can test the PVLAN connectivity by pinging another host using the interface 
attached to the PVLAN network

From: Boris Stoyanov 
Sent: Wednesday, May 27, 2020 1:45 PM
To: users@cloudstack.apache.org 
Subject: Re: ACS 4.13.1 failed to create PVLAN network

I can't advise if simply merging this code in 4.13 will work fine, it may cause 
some side issues since it's a big gap in code bases, therefore I'll advise you 
to install/upgrade you test env to this PR ( 4.15 )

Bobby.

On 27.05.20, 11:07, "li jerry"  wrote:

Thank you Boris for the information.

I now go to merge this PR into 4.13.1 for testing. Provide test results 
later.

-Jerry

发件人: Boris Stoyanov
发送时间: 2020年5月27日 16:01
收件人: users@cloudstack.apache.org
主题: Re: ACS 4.13.1 failed to create PVLAN network

Hi Li,

Can you try your tests with this PR: 
https://github.com/apache/cloudstack/pull/4040
This one ^^ is enabling it on L2 networks, to be honest I'm not sure about 
L3 as I'm currently testing it.

But to be able to test I'll need to facilitate an L3 network (arping 
requires IP), and then specify the interface to the other L2 network attached 
to the same VM.
Please note that this is 4.15+ and it's currently under testing, so do it 
in a testing lab.

Thanks,

On 26.05.20, 18:14, "li jerry"  wrote:

Dear All

Who has successfully deployed a PVLAN network on ACS 4.13.1?
I created the PVLAN network through the following process, but it failed

Server:
CentOS7
CloudStack 4.13.1

Zone 1：

l  Physical Network1 ：Public and Guest , Isolation method=VLAN, KVM 
traffic label=br1

l  Physical Network2 :  Management , Isolation method=VLAN, KVM traffic 
label=br2

SystemVM Template (KVM): Version 4.11.3

Hypervisor:
CentOS7.7 3.10.0-1062
Openvswitch-2.12.0
libvirt 4.5.0
QEMU 1.5.3



1. Create L3 Guest Network, name= Pvlan-Net-01, vlan=700, 
isolatedpvlan=1700

( this is api command)


command=createNetwork=409b04ea-d128-48ac-8e33-4df700da89cc=9778a4ab-0de8-4440-9879-a488416e0572=ca0768c8-f068-4d88-b7bd-2766414a6415=Pvlan-Net-01=Pvlan-Net-01=700=false=1700=domain=172.17.0.1=255.255.0.0=172.17.1.1=172.17.1.254=hyperx.com=json&_=1590497900407


2. attache network to VM vm1 (this VM is running and has an 
isolated network 10.0.0.x / 24)

3. attache failed, management throws the following error:



this is management log

2020-05-26 21:59:40,268 DEBUG [c.c.a.t.Request] 
(Work-Job-Executor-1:ctx-905dd7d7 job-44/job-45 ctx-4c296832) (logid:2009fc05) 
Seq 4-6374282322589515787: Received:  { Ans: , MgmtId: 113349236140, via: 
4(), Ver: v1, Flags: 10, { StartAnswer, CheckSshAnswer, 
GetDomRVersionAnswer, NetworkUsageAnswer, Answer, Answer, Answer, Answer, 
Answer } }

2020-05-26 21:59:40,280 DEBUG [o.a.c.n.t.AdvancedNetworkTopology] 
(Work-Job-Executor-1:ctx-905dd7d7 job-44/job-45 ctx-4c296832) (logid:2009fc05) 
SETUP DHCP PVLAN RULES

2020-05-26 21:59:40,292 DEBUG [c.c.n.r.NetworkHelperImpl] 
(Work-Job-Executor-1:ctx-905dd7d7 job-44/job-45 ctx-4c296832) (logid:2009fc05) 
Router requires upgrade. Unable to send command to router:5, router template 
version : null, minimal required version : 4.10.0

2020-05-26 21:59:40,294 WARN  [o.a.c.n.t.AdvancedNetworkVisitor] 
(Work-Job-Executor-1:ctx-905dd7d7 job-44/job-45 ctx-4c296832) (logid:2009fc05) 
Timed Out

com.cloud.exception.ResourceUnavailableException: Resource 
[VirtualRouter:5] is unreachable: Unable to send command. Router requires 
upgrade

at 
com.cloud.network.router.NetworkHelperImpl.sendCommandsToRouter(NetworkHelperImpl.java:175)

at 
org.apache.cloudstack.network.topology.AdvancedNetworkVisitor.visit(AdvancedNetworkVisitor.java:185)

at com.cloud.network.rules.DhcpPvlanRules.accept(DhcpPvlanRules.java:61)

at