Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Ivan Serdyuk]

I wonder if that would assume some choice for a desired compiler? Perhaps
https://github.com/golang/gofrontend, https://go.googlesource.com/gollvm/ and
https://github.com/tinygo-org/tinygo?

I also wonder if ARM platform might be supported, since Java-on-ARM and
Kubernetes/Docker-on-ARM are pretty typical, in a modern production
environment.

Ivan

On Tue, Sep 24, 2019 at 9:42 AM Abhishek Kumar 
wrote:

> Hi all,
>
> I would like to propose developing a plugin for Kubernetes integration in
> CloudStack, can be named CloudStack Kubernetes Service plugin.
> I've written down an initial design document for it here,
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service
> Please review and provide your thoughts and suggestions.
>
> Regards,
>
>
> Abhishek Kumar
>
> Software Engineer
>
> ShapeBlue
>
> abhishek.ku...@shapeblue.com
>
> www.shapeblue.com
>
> abhishek.ku...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Riepl, Gregor (SWISS TXT)]

Isn't multi-master kind of a baseline requirement?
etcd should be operated on at least three nodes to have a quorum, so a there 
should be at least three masters...

From: Abhishek Kumar 
Sent: 26 September 2019 08:11
To: dev@cloudstack.apache.org 
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

I would be really interested in exploring multi-master k8s cluster but it is 
not in proposal at the moment. We can surely look into this.
FS mentions, for deployment, plugin will use kubeadm and kubectl tools.


From: Pierre-Luc Dion 
Sent: 25 September 2019 22:41
To: dev@cloudstack.apache.org 
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Make sense for the proposed implementation, would it handle redundant
master?
How would the k8s cluster would be created, using Rancher tools, kubectl or
other?

so far, the small part I understand from MaaS, it could be very interesting
to integrate it to cloudstack in a way where it could be use to  scale
Hypervisor host, specially KVM nodes.


On Wed, Sep 25, 2019 at 10:47 AM Paul Angus 
wrote:

> The proposed implementation will create a master and n worker nodes.
> It will also support (graceful) cluster resizing, the next step would be
> to enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive
> that scaling, so that you can scale with demand rather than needing to
> oversize you environment to begin with.
>
> I've been keeping MaaS in mind as way of doing baremetal Kubernetes along
> side VM based Kubernetes clusters.  Interestingly a few people that I have
> spoken to have said that they prefer the use of VMs, because whole servers
> as the unit of scale is often very wasteful, unless you 'share' them which
> has all sorts of security implications...
>
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Pierre-Luc Dion 
> Sent: 25 September 2019 15:31
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
>
> Hi Paul,
>
> Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not
> sure I'm curious to see how cloudstack could become more "other Apache
> products friendly" but I don't have particular use case compared to k8s
> integration. Has you are suggesting, would probably make sense to use Helm
> to deploy any other application stack.
>
> btw, we are still working on the Canonical MaaS integration, a bit more
> challenging than anticipated...
>
>
> To get back to a *Kubernetes Service plugin*:
> To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I
> need to deploy monstrous instances for worker nodes.
> which doesn't make sense if I'm a cloud consumer. So I think we need to
> solve something challenging: a k8s service that would scale has needed
> while keeping in mind redundancy of worker nodes without sacrifice on
> security. Is the worker node is part of the ongoing work or it's more about
> offering a k8s master and api infrastructure to a user ?
>
> An easy path would be some kind of shared worker nodes pool but that
> involve possible security risk unless you would trust users that consume
> those workers.
>
>
> On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
> wrote:
>
> > Hi Pierre-Luc,
> >
> > (we missed you at CCCNA!) How are you seeing CloudStack being more
> > deployment friendly?  What you do think that we could do on top of
> > creating the Kubenetes Cluster to begin with?
> > [thinking out loud - we could pre-package Tiller to make it easier to
> > deploy openWhisk via Helm charts ? ]
> >
> > Kind regards
> >
> >
> > Paul.
> >
> >
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Pierre-Luc Dion 
> > Sent: 25 September 2019 13:37
> > To: dev@cloudstack.apache.org
> > Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
> >
> > Hi Rohit, Nux,
> >
> > Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I
> agree
> > with your opinion, but there is a lot of interest for k8s and seams like
> a
> > lot of organisations are moving to container based infrastructures to
> > standardized their deployment.
> >
> > if we want to extent the discussion to function as a service, would you
> > guys see a possibility for us to be more aligned or more deployment
> > friendly for Openwhisk ?
> >
> > Cheers,
> >
> >
> > On Wed, Sep 25, 2019 at 6:54 AM Will Stevens 
> > wrote:
> >
> > > We see huge demand for K8s in our customer base. Just a note...
> > >
> > > On Wed, Sep 25, 2019, 4:03 AM Nux!  wrote:
> > >
> > > > Do you guys see high demand for K8s?
> > > >  From where I'm looking it seems to be going the way of Openstack,
> > > > loads of hype, overcomplicated, near-impossible to 

Re: 4.13 repo

[Gabriel Beims Bräscher]

Hi Rohit,

I will re-build 4.13.0.0 packages as noredist and re-sync the mirrors.

Regards,
Gabriel.



Em qui, 26 de set de 2019 às 08:00, Rohit Yadav 
escreveu:

> Hi Gabriel/Wido,
>
> I've built and copied the ACS 4.13.0.0 packages using the 4.13.0.0 git tag
> (7c7efe7) to:
> http://download.cloudstack.org/centos/7/4.13/
> http://download.cloudstack.org/centos/6/4.13/
> 
>
>
> Kindly check, I've signed them using my key
> . If you'd prefer, kindly
> rebuild the packages with noredist and sign them suitably. Thanks.
>
> Can you comment if you had overridden them, if so can you fix your build
> jobs to generate noredist packages?
>
>
> Thanks.
>
> Regards,
>
> Rohit Yadav
>
> Software Architect, ShapeBlue
> https://www.shapeblue.com
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> @shapeblue
>
>
>
> --
> *From:* Rohit Yadav 
> *Sent:* Thursday, September 26, 2019 15:36
> *To:* Paul Angus ; dev@cloudstack.apache.org <
> dev@cloudstack.apache.org>
> *Cc:* Wido den Hollander 
> *Subject:* Re: 4.13 repo
>
> Hi Gabriel/Wido,
>
> I noticed that CentOS7 4.13 packages are not noredist (i.e. don't have
> support for VMware). Is that preferred because I think in the past for some
> releases at least for CentOS6/7, the packages had support for VMware
> (noredist).
>
> Can you check your debian/ubuntu packages as well? If you don't mind can
> you re-build the Ubuntu ones and I can help update the CentOS6/7 packages.
>
>
> Regards,
>
> Rohit Yadav
>
> Software Architect, ShapeBlue
>
> https://www.shapeblue.com
>
> 
> From: Gabriel Beims Bräscher 
> Sent: Thursday, September 26, 2019 02:07
> To: Paul Angus 
> Cc: dev@cloudstack.apache.org ; Wido den
> Hollander 
> Subject: Re: 4.13 repo
>
> Hello @dev / Paul,
>
> Packages are now available for CentOS6, CentOS7, Ubuntu 18.04 and Ubuntu
> 16.04 at http://download.cloudstack.org/.
> Please, let me know in case anyone has issues installing CloudStack
> 4.13.0.0 via the cloudstack.org mirrors.
>
> Regards,
> Gabriel.
>
> Em ter, 24 de set de 2019 às 09:10, Gabriel Beims Bräscher <
> gabrasc...@gmail.com> escreveu:
>
> > Hi Paul,
> >
> > No problem, we will take a look at this; will update here when finished
> > building and making them available.
> >
> > Cheers,
> > Gabriel.
> >
> > Em ter, 24 de set de 2019 às 06:19, Paul Angus  >
> > escreveu:
> >
> >> Hi Gabriel/Wido,
> >>
> >>
> >>
> >> I’m about to press send on the 4.13 release announcement. Could you guys
> >> build the Debian packages for download.cloudstack.org please (as you
> >> create them in a fancy way  ), I’ve pushed up the CentOS packages.
> >>
> >> We should probably look into a centralised Jenkins job or something to
> do
> >> this for us each time!
> >>
> >>
> >>
> >> Many thanks
> >>
> >>
> >>
> >>
> >>
> >> Paul Angus
> >>
> >>
> >>
> >> paul.an...@shapeblue.com
> >> www.shapeblue.com
> >> @shapeblue
> >>
> >>
> >>
> >>
> >
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>

Re: 4.13 repo

[Rohit Yadav]

Hi Gabriel/Wido,

I've built and copied the ACS 4.13.0.0 packages using the 4.13.0.0 git tag 
(7c7efe7) to:
http://download.cloudstack.org/centos/7/4.13/
http://download.cloudstack.org/centos/6/4.13/


Kindly check, I've signed them using my 
key. If you'd prefer, kindly rebuild 
the packages with noredist and sign them suitably. Thanks.

Can you comment if you had overridden them, if so can you fix your build jobs 
to generate noredist packages?


Thanks.


Regards,

Rohit Yadav

Software Architect, ShapeBlue

https://www.shapeblue.com


From: Rohit Yadav 
Sent: Thursday, September 26, 2019 15:36
To: Paul Angus ; dev@cloudstack.apache.org 

Cc: Wido den Hollander 
Subject: Re: 4.13 repo

Hi Gabriel/Wido,

I noticed that CentOS7 4.13 packages are not noredist (i.e. don't have support 
for VMware). Is that preferred because I think in the past for some releases at 
least for CentOS6/7, the packages had support for VMware (noredist).

Can you check your debian/ubuntu packages as well? If you don't mind can you 
re-build the Ubuntu ones and I can help update the CentOS6/7 packages.


Regards,

Rohit Yadav

Software Architect, ShapeBlue

https://www.shapeblue.com


From: Gabriel Beims Bräscher 
Sent: Thursday, September 26, 2019 02:07
To: Paul Angus 
Cc: dev@cloudstack.apache.org ; Wido den Hollander 

Subject: Re: 4.13 repo

Hello @dev / Paul,

Packages are now available for CentOS6, CentOS7, Ubuntu 18.04 and Ubuntu
16.04 at http://download.cloudstack.org/.
Please, let me know in case anyone has issues installing CloudStack
4.13.0.0 via the cloudstack.org mirrors.

Regards,
Gabriel.

Em ter, 24 de set de 2019 às 09:10, Gabriel Beims Bräscher <
gabrasc...@gmail.com> escreveu:

> Hi Paul,
>
> No problem, we will take a look at this; will update here when finished
> building and making them available.
>
> Cheers,
> Gabriel.
>
> Em ter, 24 de set de 2019 às 06:19, Paul Angus 
> escreveu:
>
>> Hi Gabriel/Wido,
>>
>>
>>
>> I’m about to press send on the 4.13 release announcement. Could you guys
>> build the Debian packages for download.cloudstack.org please (as you
>> create them in a fancy way  ), I’ve pushed up the CentOS packages.
>>
>> We should probably look into a centralised Jenkins job or something to do
>> this for us each time!
>>
>>
>>
>> Many thanks
>>
>>
>>
>>
>>
>> Paul Angus
>>
>>
>>
>> paul.an...@shapeblue.com
>> www.shapeblue.com
>> @shapeblue
>>
>>
>>
>>
>

rohit.ya...@shapeblue.com
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue




rohit.ya...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 

Re: 4.13 repo

[Rohit Yadav]

Hi Gabriel/Wido,

I noticed that CentOS7 4.13 packages are not noredist (i.e. don't have support 
for VMware). Is that preferred because I think in the past for some releases at 
least for CentOS6/7, the packages had support for VMware (noredist).

Can you check your debian/ubuntu packages as well? If you don't mind can you 
re-build the Ubuntu ones and I can help update the CentOS6/7 packages.


Regards,

Rohit Yadav

Software Architect, ShapeBlue

https://www.shapeblue.com


From: Gabriel Beims Bräscher 
Sent: Thursday, September 26, 2019 02:07
To: Paul Angus 
Cc: dev@cloudstack.apache.org ; Wido den Hollander 

Subject: Re: 4.13 repo

Hello @dev / Paul,

Packages are now available for CentOS6, CentOS7, Ubuntu 18.04 and Ubuntu
16.04 at http://download.cloudstack.org/.
Please, let me know in case anyone has issues installing CloudStack
4.13.0.0 via the cloudstack.org mirrors.

Regards,
Gabriel.

Em ter, 24 de set de 2019 às 09:10, Gabriel Beims Bräscher <
gabrasc...@gmail.com> escreveu:

> Hi Paul,
>
> No problem, we will take a look at this; will update here when finished
> building and making them available.
>
> Cheers,
> Gabriel.
>
> Em ter, 24 de set de 2019 às 06:19, Paul Angus 
> escreveu:
>
>> Hi Gabriel/Wido,
>>
>>
>>
>> I’m about to press send on the 4.13 release announcement. Could you guys
>> build the Debian packages for download.cloudstack.org please (as you
>> create them in a fancy way  ), I’ve pushed up the CentOS packages.
>>
>> We should probably look into a centralised Jenkins job or something to do
>> this for us each time!
>>
>>
>>
>> Many thanks
>>
>>
>>
>>
>>
>> Paul Angus
>>
>>
>>
>> paul.an...@shapeblue.com
>> www.shapeblue.com
>> @shapeblue
>>
>>
>>
>>
>

rohit.ya...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Abhishek Kumar]

Hi Gregor,

For cluster node templates, FS mentions service will use CoreOS template (from 
here, http://dl.openvm.eu/cloudstack/coreos/x86_64/). User can also build their 
templates. Initial though is to use a global setting(for registering template) 
or an API parameter during cluster creation.
We can also explore the possibility of a new, common, maybe debian-based, 
systemvm template which can be used by the service.
There are no additional security changes for nodes. Security will be same what 
we have for normal instances in CloudStack.

Regards,
Index of /cloudstack/coreos/x86_64 - 
openvm.eu
Name Last modified Size; Parent Directory - alpha/ 14-Sep-2019 02:54 - beta/ 
14-Sep-2019 01:42 - buildtime.txt: 13-Sep-2019 17:53 : 13 : 
coreos_production_cloudstack_image-hyperv.vhd.zip
dl.openvm.eu


From: Riepl, Gregor (SWISS TXT) 
Sent: 25 September 2019 22:11
To: dev@cloudstack.apache.org 
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi all,

kubernetes-cloudstack-provider provides the missing link between Kubernetes and 
CloudStack resources (firewall, loadbalancer, node information, ...).

There is one other component that you still need, though: Suitable images.
I'm not sure if this is something that CloudStack should provide, but without 
them, automated resizing will be difficult.

Paul, do you already have an idea on how to do handle this?
Require users to build their own images?
Create a ready-to-use template like it's done for the system VMs?
How could PaaS deployments (for example, OpenShift) be handled?
What about node security?

We've been deploying Kubernetes very successfully via custom Ansible scripts so 
far. But having CloudStack do much of the heavy lifting might allow for some 
very interesting use cases.
If cluster scaling can be abstracted at the API level, it could also be added 
to the cloud provider - allowing infrastructure scaling from within k8s itself, 
or even based on load!
In such a case, initial setup should focus first and foremost on the control 
plane (i.e. bootstrapping master nodes), then allowing worker scaling via k8s 
resources.

Regards,
Gregor

From: Paul Angus 
Sent: 25 September 2019 16:47
To: dev@cloudstack.apache.org 
Subject: RE: [DISCUSS] CloudStack Kubernetes Service plugin

The proposed implementation will create a master and n worker nodes.
It will also support (graceful) cluster resizing, the next step would be to 
enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive that 
scaling, so that you can scale with demand rather than needing to oversize you 
environment to begin with.

I've been keeping MaaS in mind as way of doing baremetal Kubernetes along side 
VM based Kubernetes clusters.  Interestingly a few people that I have spoken to 
have said that they prefer the use of VMs, because whole servers as the unit of 
scale is often very wasteful, unless you 'share' them which has all sorts of 
security implications...




paul.an...@shapeblue.com
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue




abhishek.ku...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 


-Original Message-
From: Pierre-Luc Dion 
Sent: 25 September 2019 15:31
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi Paul,

Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not sure 
I'm curious to see how cloudstack could become more "other Apache products 
friendly" but I don't have particular use case compared to k8s integration. Has 
you are suggesting, would probably make sense to use Helm to deploy any other 
application stack.

btw, we are still working on the Canonical MaaS integration, a bit more 
challenging than anticipated...


To get back to a *Kubernetes Service plugin*:
To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I need 
to deploy monstrous instances for worker nodes.
which doesn't make sense if I'm a cloud consumer. So I think we need to solve 
something challenging: a k8s service that would scale has needed while keeping 
in mind redundancy of worker nodes without sacrifice on security. Is the worker 
node is part of the ongoing work or it's more about offering a k8s master and 
api infrastructure to a user ?

An easy path would be some kind of shared worker nodes pool but that involve 
possible security risk unless you would trust users that consume those workers.


On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
wrote:

> Hi Pierre-Luc,
>
> (we missed you at CCCNA!) How are you seeing CloudStack being more
> deployment friendly?  What you do think that we could do on top of
> creating the Kubenetes Cluster to begin with?
> [thinking out loud - we could pre-package Tiller to make it easier to
> deploy openWhisk via Helm charts ? ]

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Abhishek Kumar]

I would be really interested in exploring multi-master k8s cluster but it is 
not in proposal at the moment. We can surely look into this.
FS mentions, for deployment, plugin will use kubeadm and kubectl tools.


From: Pierre-Luc Dion 
Sent: 25 September 2019 22:41
To: dev@cloudstack.apache.org 
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Make sense for the proposed implementation, would it handle redundant
master?
How would the k8s cluster would be created, using Rancher tools, kubectl or
other?

so far, the small part I understand from MaaS, it could be very interesting
to integrate it to cloudstack in a way where it could be use to  scale
Hypervisor host, specially KVM nodes.


On Wed, Sep 25, 2019 at 10:47 AM Paul Angus 
wrote:

> The proposed implementation will create a master and n worker nodes.
> It will also support (graceful) cluster resizing, the next step would be
> to enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive
> that scaling, so that you can scale with demand rather than needing to
> oversize you environment to begin with.
>
> I've been keeping MaaS in mind as way of doing baremetal Kubernetes along
> side VM based Kubernetes clusters.  Interestingly a few people that I have
> spoken to have said that they prefer the use of VMs, because whole servers
> as the unit of scale is often very wasteful, unless you 'share' them which
> has all sorts of security implications...
>
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Pierre-Luc Dion 
> Sent: 25 September 2019 15:31
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
>
> Hi Paul,
>
> Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not
> sure I'm curious to see how cloudstack could become more "other Apache
> products friendly" but I don't have particular use case compared to k8s
> integration. Has you are suggesting, would probably make sense to use Helm
> to deploy any other application stack.
>
> btw, we are still working on the Canonical MaaS integration, a bit more
> challenging than anticipated...
>
>
> To get back to a *Kubernetes Service plugin*:
> To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I
> need to deploy monstrous instances for worker nodes.
> which doesn't make sense if I'm a cloud consumer. So I think we need to
> solve something challenging: a k8s service that would scale has needed
> while keeping in mind redundancy of worker nodes without sacrifice on
> security. Is the worker node is part of the ongoing work or it's more about
> offering a k8s master and api infrastructure to a user ?
>
> An easy path would be some kind of shared worker nodes pool but that
> involve possible security risk unless you would trust users that consume
> those workers.
>
>
> On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
> wrote:
>
> > Hi Pierre-Luc,
> >
> > (we missed you at CCCNA!) How are you seeing CloudStack being more
> > deployment friendly?  What you do think that we could do on top of
> > creating the Kubenetes Cluster to begin with?
> > [thinking out loud - we could pre-package Tiller to make it easier to
> > deploy openWhisk via Helm charts ? ]
> >
> > Kind regards
> >
> >
> > Paul.
> >
> >
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Pierre-Luc Dion 
> > Sent: 25 September 2019 13:37
> > To: dev@cloudstack.apache.org
> > Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
> >
> > Hi Rohit, Nux,
> >
> > Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I
> agree
> > with your opinion, but there is a lot of interest for k8s and seams like
> a
> > lot of organisations are moving to container based infrastructures to
> > standardized their deployment.
> >
> > if we want to extent the discussion to function as a service, would you
> > guys see a possibility for us to be more aligned or more deployment
> > friendly for Openwhisk ?
> >
> > Cheers,
> >
> >
> > On Wed, Sep 25, 2019 at 6:54 AM Will Stevens 
> > wrote:
> >
> > > We see huge demand for K8s in our customer base. Just a note...
> > >
> > > On Wed, Sep 25, 2019, 4:03 AM Nux!  wrote:
> > >
> > > > Do you guys see high demand for K8s?
> > > >  From where I'm looking it seems to be going the way of Openstack,
> > > > loads of hype, overcomplicated, near-impossible to upgrade.
> > > > Not sure if it's worth investing resources for this.
> > > >
> > > > Lucian
> > > >
> > > > ---
> > > > Sent from the Delta quadrant using Borg technology!
> > > >
> > > > On 2019-09-24 07:41, Abhishek Kumar wrote:
> > > > > Hi all,
> > > > >
> > > > > I would like to propose developing a plugin for Kubernetes
> > > > >